-- Logs begin at Thu 2022-08-04 03:14:35 UTC, end at Thu 2022-08-04 06:08:22 UTC. -- Aug 04 04:12:42.715468 n-d-851337-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 04:12:42.724699 n-d-851337-5 devstack@n-api.service[104028]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 04:12:42 2022] *** Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: nodename: n-d-851337-5 Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: machine: x86_64 Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: clock source: unix Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: pcre jit disabled Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: detected number of CPU cores: 4 Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: current working directory: / Aug 04 04:12:42.726674 n-d-851337-5 devstack@n-api.service[104028]: detected binary path: /usr/bin/uwsgi-core Aug 04 04:12:42.727408 n-d-851337-5 devstack@n-api.service[104028]: your processes number limit is 47680 Aug 04 04:12:42.727408 n-d-851337-5 devstack@n-api.service[104028]: your memory page size is 4096 bytes Aug 04 04:12:42.727408 n-d-851337-5 devstack@n-api.service[104028]: detected max file descriptor number: 2048 Aug 04 04:12:42.727408 n-d-851337-5 devstack@n-api.service[104028]: lock engine: pthread robust mutexes Aug 04 04:12:42.727408 n-d-851337-5 devstack@n-api.service[104028]: thunder lock: enabled Aug 04 04:12:42.727408 n-d-851337-5 devstack@n-api.service[104028]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 04:12:42.727408 n-d-851337-5 devstack@n-api.service[104028]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 04:12:42.766071 n-d-851337-5 devstack@n-api.service[104028]: Python main interpreter initialized at 0x55e04e6609c0 Aug 04 04:12:42.766071 n-d-851337-5 devstack@n-api.service[104028]: python threads support enabled Aug 04 04:12:42.766071 n-d-851337-5 devstack@n-api.service[104028]: your server socket listen backlog is limited to 100 connections Aug 04 04:12:42.766071 n-d-851337-5 devstack@n-api.service[104028]: your mercy for graceful operations on workers is 90 seconds Aug 04 04:12:42.766436 n-d-851337-5 devstack@n-api.service[104028]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 04:12:42.766522 n-d-851337-5 devstack@n-api.service[104028]: *** Operational MODE: preforking *** Aug 04 04:12:42.766745 n-d-851337-5 devstack@n-api.service[104028]: *** uWSGI is running in multiple interpreter mode *** Aug 04 04:12:42.766745 n-d-851337-5 devstack@n-api.service[104028]: spawned uWSGI master process (pid: 104028) Aug 04 04:12:42.767011 n-d-851337-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 04:12:42.767632 n-d-851337-5 devstack@n-api.service[104028]: spawned uWSGI worker 1 (pid: 104029, cores: 1) Aug 04 04:12:42.767973 n-d-851337-5 devstack@n-api.service[104028]: spawned uWSGI worker 2 (pid: 104030, cores: 1) Aug 04 04:12:42.768187 n-d-851337-5 devstack@n-api.service[104028]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 04:12:43.431406 n-d-851337-5 devstack@n-api.service[104030]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:12:43.433583 n-d-851337-5 devstack@n-api.service[104029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:12:44.531689 n-d-851337-5 devstack@n-api.service[104030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:12:44.531689 n-d-851337-5 devstack@n-api.service[104030]: from cryptography.utils import int_from_bytes Aug 04 04:12:44.532299 n-d-851337-5 devstack@n-api.service[104030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:12:44.532299 n-d-851337-5 devstack@n-api.service[104030]: from cryptography.utils import int_from_bytes Aug 04 04:12:44.547489 n-d-851337-5 devstack@n-api.service[104029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:12:44.547489 n-d-851337-5 devstack@n-api.service[104029]: from cryptography.utils import int_from_bytes Aug 04 04:12:44.548029 n-d-851337-5 devstack@n-api.service[104029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:12:44.548029 n-d-851337-5 devstack@n-api.service[104029]: from cryptography.utils import int_from_bytes Aug 04 04:12:47.037965 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:12:47.038504 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:12:47.038504 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:12:47.038928 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:12:47.039054 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:12:47.039138 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:12:47.039216 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:12:47.039294 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:12:47.039379 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:12:47.039471 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:12:47.039644 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.039744 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.039970 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.040066 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.040290 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.040379 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.040607 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.040700 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.040938 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.041038 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.041251 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.041351 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.041570 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.041670 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.041887 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.041982 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.042213 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.042305 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.042469 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.042553 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.042784 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.042870 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.043131 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.043221 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.043455 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.043552 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.043762 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.043864 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.044074 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.044179 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.044384 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.044468 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.044688 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.044775 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.045009 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.045093 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.045830 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.045935 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.046321 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.046431 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.046798 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.046935 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.046935 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.047922 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048014 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048141 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048141 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048358 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048455 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048534 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048610 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048745 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048827 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.048910 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.049043 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.049165 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.049253 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.049331 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.049596 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.049724 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.049906 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.050004 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.050222 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.050310 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.050537 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.050621 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.050847 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.050939 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.051288 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.051393 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.051599 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.051687 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.051908 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.052009 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.052226 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.052310 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.052560 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.052653 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.052866 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.052958 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.053190 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.053275 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.053510 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.053608 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.053826 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.053912 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.054146 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.054243 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.054445 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.054550 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.054752 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.054839 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.055084 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.055183 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.055402 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.055489 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.055708 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.055817 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.056008 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.056111 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.056258 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.056350 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.056561 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.056645 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.056941 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.057042 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.057200 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.057286 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.057520 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.057608 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.057770 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.057878 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.058016 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.058111 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.058336 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.058475 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.058648 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.058738 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.058969 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.059057 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.059285 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.059381 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.059588 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.059684 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.059894 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.060046 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.060197 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.060284 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.060503 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.060589 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.060806 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.060929 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.061667 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.061764 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.061985 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.062071 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.062303 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.062395 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.062623 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.062717 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.062933 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.063051 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.063276 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.063363 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.063676 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.063769 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.063929 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.064019 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.064244 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.064369 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.064586 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.064700 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.064900 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.064991 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.065206 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.065295 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.065522 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.065622 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.065842 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.065955 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.066148 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.066237 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.066453 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.066549 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.066759 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.066846 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.067103 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.067194 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.067437 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.067527 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.067742 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.067834 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.067992 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.068081 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.068298 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.068389 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.068604 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.068693 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.068924 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.069015 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.069232 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.069323 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.069542 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.069631 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.069850 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.069940 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.070153 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.070250 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.070460 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.070549 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.070766 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.070862 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.071094 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.071194 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.071403 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.071492 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.071711 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.071828 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.072011 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.072097 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.072317 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.072410 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.072620 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.072717 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.072924 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.073011 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.073236 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.073321 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.073555 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.073650 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.073861 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.073953 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.074163 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.074256 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.074468 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.074559 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.074772 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.074866 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.075119 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.075218 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.075427 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.075527 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.075734 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.075824 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.076054 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.076143 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.076358 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.076527 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.076699 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.076789 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.077017 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.077107 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.077324 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.077428 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.077629 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.077719 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.077946 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.078035 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.078246 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.078336 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.078552 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.078649 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.078868 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.078988 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.079199 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.079287 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.079503 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.079590 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.079806 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.079893 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.080107 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.080194 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.080410 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.080497 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.080709 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.080797 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.081010 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.081109 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.081312 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.081400 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.081613 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.081712 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.081927 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.082015 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.082245 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.082333 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.082552 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.082648 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.082858 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.082948 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.083186 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.083286 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.083505 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.083603 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:12:47.083840 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.083941 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.084168 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.084256 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.084530 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.084630 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.084824 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.084912 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.085156 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.085246 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.085487 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.085575 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.085807 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.085895 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.086117 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.086216 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.086433 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.086521 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.086759 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.086847 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.087096 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.087186 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.087407 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.087496 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.087720 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.087816 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.088039 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.088135 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.088355 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.088463 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.088682 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.088771 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.088997 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.089085 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.089311 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.089401 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.089628 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.089716 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.089937 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.090026 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.090253 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.090341 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.090577 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.090673 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.090897 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.091033 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.091235 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.091324 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.091577 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.091666 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.091917 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.092015 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.092257 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.092345 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.092581 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.092669 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.092902 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.093004 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.093211 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.093300 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.093522 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.093617 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.093829 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.093925 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.094149 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.094244 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.094480 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.094569 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.094790 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.094886 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.095131 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.095218 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.095444 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.095536 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.095756 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.095847 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.096065 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.096153 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.096378 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.096525 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.096669 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.096805 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.097008 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.097152 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.097324 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.097465 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.097638 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.097787 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.097949 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.098098 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.098246 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.098389 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.098563 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.098713 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.098857 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.099050 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.099192 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.099407 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.099546 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.099686 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.099835 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.099978 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.100119 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.100274 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.100417 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.100557 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.100705 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.100845 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.101004 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.101155 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.101297 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.101446 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.101587 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.101727 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.101892 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.102051 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.102194 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.102334 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.102499 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.102648 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.102807 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.102947 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.103141 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.103287 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.103440 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.103590 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.103749 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.103890 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.104031 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.104174 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.104322 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.104471 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.104627 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.104780 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.104929 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.105077 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.105220 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.105360 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.105512 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.105655 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.105798 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.105938 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.106079 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.106233 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.106375 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.106516 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.106690 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.106841 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.107025 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.107189 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.107333 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.107481 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.107624 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.108250 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.108439 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.108592 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.108754 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.108906 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.109053 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.109187 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.109385 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.109529 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.109719 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.109859 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.110023 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.110170 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.110347 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.110501 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.110676 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.110826 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.111000 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.111153 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.111301 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.111444 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.111616 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.111760 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.111927 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.112071 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.112224 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.112360 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.112529 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.112674 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.112843 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.112994 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.113144 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.113288 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.113434 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.113579 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.113716 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.113859 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.114019 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.114162 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.114323 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.114465 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.114902 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.115112 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.115257 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.115408 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.115549 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.115689 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.115831 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.115986 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.116136 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.116278 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.116441 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.116592 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.116743 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.116884 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.117078 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.117234 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.117412 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.117568 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.117726 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.117868 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.118041 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.118194 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.118358 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.118506 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.118660 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.118802 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.118994 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.119110 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.119310 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.119402 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.119619 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.119707 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.119931 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.120018 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.120248 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.120343 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.120561 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.120709 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.120879 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.120965 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.121191 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.121286 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.121512 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.121597 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.121826 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.121912 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.122194 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.122346 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.122430 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.122507 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.122748 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.122843 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.123112 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.123216 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.123991 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.124094 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.124315 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.124411 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.124646 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.124741 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.124962 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.125048 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.125278 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.125363 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.125588 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.125674 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.125901 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.125985 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.126211 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.126297 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.126523 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.126672 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.126840 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.126926 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.127176 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.127262 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.127494 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.127587 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.127805 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.127890 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.128125 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.128212 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.128439 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.128531 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.128754 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.128838 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.129059 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.129155 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.129371 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.129459 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.129699 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.129784 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.130030 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.130123 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.130341 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.130426 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.130650 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.130735 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.130989 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.131091 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.131306 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.131392 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.131619 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.131703 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.131929 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.132029 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.132233 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.132324 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.132537 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.132624 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.132849 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.132943 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.133161 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.133253 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.133472 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.133557 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.133778 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.133878 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.134082 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.134168 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.134395 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.134480 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.134703 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.134790 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.135030 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.135118 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.135335 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.135419 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.135645 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.135751 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.135966 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.136052 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.136277 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.136373 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.136598 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.136685 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.136918 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.137011 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.137223 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.137318 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.137525 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.137610 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.137848 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.137940 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.138154 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.138248 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.138458 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.138550 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.138758 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.138843 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.139112 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.139239 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.139458 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.139553 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.139769 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.139867 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.140076 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.140187 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.140389 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.140482 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.140708 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.140793 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.141017 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.141106 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.141330 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.141415 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.141640 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.141733 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.141947 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.142042 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.142268 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.142429 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.142575 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.142747 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.142881 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.143085 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.143218 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.143399 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.143530 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.143710 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.143844 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.144019 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.144157 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.144330 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.144481 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.144651 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.144793 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.144962 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.145105 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.145272 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.145416 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.145582 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.145721 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.145885 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.146034 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.146195 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.146354 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.146511 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.146931 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.147103 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.147285 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.147441 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.147603 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.147759 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.147924 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.148192 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.148303 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.148391 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.148557 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.148707 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.148887 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.149038 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.149221 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.149375 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.149565 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.149718 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.149873 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.150027 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.150185 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.150338 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.150495 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.150644 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.150803 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.150967 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.151142 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.151291 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.151452 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.151599 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.151762 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.151907 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.152068 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.152221 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.152381 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.152532 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.152677 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.152836 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.152986 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.153143 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.153295 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.153447 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.153612 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.153754 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.153910 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.154071 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.154218 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.154377 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.154531 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.154713 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.154866 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.155041 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.155216 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.155402 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.155570 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.155714 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.155881 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.156021 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.156193 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.156326 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.156503 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.156631 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.156851 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.157000 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.157163 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.157270 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.157507 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.157596 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.157838 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.157925 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.158190 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.158286 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.158501 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.158634 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.158811 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.158898 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.159161 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.159267 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.159470 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.159559 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.159776 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.159863 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.160081 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.160169 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.160392 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.160479 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.160700 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.160786 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.161005 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.161135 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.161317 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.161403 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.161626 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.161719 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.161935 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.162024 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.162244 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.162336 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.162545 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.162643 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.162854 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.162941 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.163181 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.163283 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.163500 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.163594 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.163811 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.163899 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.164117 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.164202 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.164421 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.164521 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.164733 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.164818 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.165039 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.165124 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.165342 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.165436 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.165651 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.165735 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.165955 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.166041 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.166269 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.166355 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.166574 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.166661 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.166878 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.166982 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.167209 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.167304 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.167520 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.167614 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.167831 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.167923 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.168133 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.168219 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.168457 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.168542 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.168769 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.168861 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.169073 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.169160 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.169377 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.169509 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.169686 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.169780 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.169985 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.170079 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.170810 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.170906 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.171144 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.171246 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.171466 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.171560 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.171783 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.171870 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.172090 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.172184 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.172397 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.172482 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.172701 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.172787 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.173003 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.173098 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.173305 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.173391 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.173611 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.173697 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.173914 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.174006 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.174212 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.174298 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.174511 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.174597 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.174812 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.174899 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.175138 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.175227 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.175459 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.175557 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.175767 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.175862 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.176071 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.176157 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.176375 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.176460 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.176678 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.176766 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.177023 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.177108 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.177326 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.177420 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.177681 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.177782 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.177985 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.178074 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.178301 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.178400 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.178618 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.178703 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.178929 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.179034 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.179263 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.179371 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.179577 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.179663 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.179881 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.179966 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.180193 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.180286 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.180502 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.180590 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.180814 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.180905 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.181114 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.181207 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.181417 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.181506 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.181736 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.181831 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.182047 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.182134 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.182354 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.182451 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.182675 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.182762 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.183047 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.183151 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.183337 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.183423 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.183641 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.183734 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.183950 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.184036 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.184256 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.184341 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.184563 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.184694 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.184872 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.184971 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.185177 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.185262 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.185485 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.185584 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.185795 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.185914 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.186648 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.186735 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.186974 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.187075 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.187296 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.187382 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.187605 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.187692 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.187916 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.188011 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.188228 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.188314 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.188540 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.188627 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.188865 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.188966 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.189176 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.189262 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.189479 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.189563 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.189786 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.189873 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.190087 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.190172 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.190396 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.190481 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.190698 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.190785 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.191159 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.191250 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.191472 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.191568 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.191782 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.191870 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.192085 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.192177 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.192392 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.192478 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.192704 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.192790 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.193018 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.193105 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.193331 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.193426 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.193635 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.193720 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.194050 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.194135 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.194360 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.194455 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.194667 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.194752 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.194993 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.195094 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.195303 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.195403 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.195609 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.195710 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.195915 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.196008 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.196236 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.196336 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.196541 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.196626 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.196848 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.196933 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.197150 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.197236 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.197470 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.197557 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.197774 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.197860 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.198094 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.198193 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.198509 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.198596 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.198822 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.198967 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.199153 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.199241 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.199569 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.199656 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.199878 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.199976 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.200189 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.200283 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.200509 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.200595 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.200829 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.200922 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.201148 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.201235 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.201472 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.201652 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.201789 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.201877 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.202081 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.202181 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.202403 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.202490 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.202729 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.202816 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.203060 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.203205 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.203377 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.203465 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.203678 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.203765 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.204000 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.204098 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.204319 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.204404 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.204633 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.204726 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.204951 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.205049 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.205363 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.205450 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.205683 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.205776 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.205994 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.206081 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.206312 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.206397 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.206636 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.206728 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.206939 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.207053 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.207265 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.207363 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.207573 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.207661 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.207875 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.207969 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.208180 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.208266 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.208497 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.208582 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.208800 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.208886 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.209109 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.209198 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.209418 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.209517 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.209726 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.209811 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.210029 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.210115 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.210330 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.210424 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.210651 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.210737 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.210970 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.211070 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.211300 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.211396 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.211617 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.211704 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.211939 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.212033 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.212261 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.212357 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.212568 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.212661 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.212890 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.212985 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.213202 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.213289 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.213506 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.213594 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.213807 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.213892 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.214110 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.214198 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.214450 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.214536 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.214755 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.214842 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.215100 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.215193 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.215431 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.215519 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.215760 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.215847 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.216071 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.216168 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.216402 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.216500 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.216730 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.216830 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.217045 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.217151 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.217384 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.217472 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.217709 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.217803 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.218012 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.218105 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.218319 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.218406 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.218627 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.218728 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.218932 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.219115 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.219261 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.219347 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.219564 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.219668 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.219875 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.220007 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.220178 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.220272 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.220482 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.220571 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.220786 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.220871 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.221107 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.221193 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.221413 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.221500 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.221732 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.221818 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.222043 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.222142 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.222343 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.222451 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.222651 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.222743 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.222966 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.223055 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.223316 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.223405 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.223621 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.223708 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.223951 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.224046 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.224260 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.224355 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.224582 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.224669 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.224900 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.224996 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.225215 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.225302 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.225531 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.225617 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.225845 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.225939 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.226160 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.226254 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.226473 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.226560 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.226794 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.226911 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.227122 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.227343 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.227431 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.227738 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.227884 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.228054 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.228471 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.228609 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.228941 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.229072 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.229257 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.229573 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.229887 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.230055 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.230201 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.230515 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.230646 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.230826 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.231162 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.231293 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.231474 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.231784 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.231880 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.232113 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.232428 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.232520 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.233278 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.233507 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.233604 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.233913 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.234030 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.234229 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.234544 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.234648 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.234861 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.235192 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.235283 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.235543 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.235749 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.235838 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.236152 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.236283 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.236467 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.236783 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.236882 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.237094 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.237372 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.237461 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.237705 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.237954 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.238049 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.238316 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.238592 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.238679 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.238925 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.239210 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.239303 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.239834 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.240002 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.240170 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.240352 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.240491 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.240695 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.240805 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.241072 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.241167 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.241406 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.241495 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.241730 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.241928 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.242062 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.242245 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.242391 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.242583 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.242719 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.242909 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.243079 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.243258 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.243404 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.243573 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.243729 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.243890 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.244055 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.244216 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.244376 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.244524 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.244693 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.244830 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.245018 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.245141 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.245342 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.245450 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.245676 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.245763 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.246018 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.246122 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.246348 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.246443 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.246650 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.246736 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.247006 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.247119 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.247302 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.247390 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.247832 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.247920 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.248155 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.248249 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.249006 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.249104 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.249358 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.249446 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.249687 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.249784 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.250007 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.250102 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.250314 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.250402 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.250637 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.250725 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.250943 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.251047 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.251274 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.251374 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.251588 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.251676 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.251899 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.251985 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.252206 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.252349 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.252513 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.252600 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.252830 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.252917 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.253136 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.253233 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.253439 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.253526 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.253748 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.253849 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.254053 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.254288 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.254376 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.254645 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.254732 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.254982 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.255084 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.255290 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.255378 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.255603 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.255689 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.255908 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.256004 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.256214 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.256706 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.256706 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.256866 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.256944 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.257156 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.257247 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.257469 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.257556 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.257775 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.257861 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.258086 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.258173 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.258391 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.258476 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.258702 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.258797 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.259031 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.259133 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.259344 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.259480 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.259651 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.259748 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.259959 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.260045 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.260266 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.260353 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.260585 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.260679 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.260894 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.260982 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.261204 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.261303 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.261520 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.261615 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.261829 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.261919 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.262138 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.262232 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.262445 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.262533 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.262752 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.262839 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.263095 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.263340 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.263439 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.263677 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.263802 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.264032 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.264133 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.264342 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.264438 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.264648 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.264735 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.264962 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.265057 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.265266 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.265361 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.265575 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.265663 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.265883 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.265976 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.266198 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.266287 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.266509 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.266597 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.266820 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.266907 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.267166 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.267257 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.267478 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.267566 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.267789 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.267877 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.268101 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.268189 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.268410 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.268497 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.268719 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.268969 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.269069 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.269313 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.269409 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.269621 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.269707 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.269930 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.270018 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.270238 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.270326 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.270552 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.270639 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.270873 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.271001 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.271209 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.271298 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.271530 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.271616 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.271845 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.271942 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.272159 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.272291 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.272469 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.272564 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.272782 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.272870 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.273091 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.273189 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.273402 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.273497 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.273716 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.273804 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.274028 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.274115 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.274340 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.274435 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.274645 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.274731 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.274972 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.275093 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.275283 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.275406 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.275594 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.275725 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.275905 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.276047 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.276222 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.276357 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.276565 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.276679 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.276885 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.277001 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.277206 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.277294 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.277524 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.277612 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.277840 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.277936 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.278155 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.278245 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.278471 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.278558 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.278786 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.278881 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.279139 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.279229 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.279461 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.279548 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.279816 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.279919 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.280124 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.280213 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.280430 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.280517 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.280747 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.280849 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.281058 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.281146 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.281362 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.281451 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.281666 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.281779 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.281976 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.282093 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.282280 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.282418 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.282590 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.282745 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.282893 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.283083 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.283224 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.283409 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.283535 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.283723 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.283837 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.284056 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.284143 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.284398 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.284487 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.284721 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.284806 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.285025 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.285112 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.285330 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.285418 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.285637 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.285724 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.285940 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.286028 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.286244 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.286340 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.286546 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.286634 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.286851 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.286938 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.287178 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.287267 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.287486 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.287581 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.287799 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.287895 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.288152 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.288246 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.288414 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.288501 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.288721 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.288817 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.289031 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.289118 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.289337 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.289432 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.289643 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.289738 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.289951 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.290038 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.290258 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.290402 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.290565 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.290659 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.290869 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.290973 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.291211 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.291298 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.291521 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.291608 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.291825 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.291911 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.292130 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.292216 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.292434 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.292521 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.292741 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.292828 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.293047 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.293135 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.293376 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.293462 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.293682 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.293770 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.294008 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.294157 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.294332 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.294457 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.294646 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.294790 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.294994 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.295136 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.295841 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.295972 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.296241 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.296329 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.296599 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.296702 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.296910 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.296998 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.297218 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.297305 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.297528 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.297634 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.297837 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.297925 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.298151 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.298237 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.298460 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.298549 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.298768 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.298855 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.299107 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.299197 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.299423 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.299512 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.299750 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.299837 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.300076 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.300164 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.300385 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.300472 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.300712 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.300843 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.301035 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.301131 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.301359 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.301454 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.301677 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.301763 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.302007 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.302102 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.302320 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.302407 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.302635 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.302722 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.302947 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.303084 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.303282 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.303376 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.303523 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:12:47.303610 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.303897 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.304216 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.304528 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.304841 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.305161 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.305482 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.305813 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.306144 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.306459 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.306788 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.307156 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.307511 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.307828 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.308178 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.308510 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.308828 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.309142 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.309451 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:12:47.309702 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:12:47.461242 n-d-851337-5 devstack@n-api.service[104029]: INFO dbcounter [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Registered counter for database nova_api Aug 04 04:12:47.465685 n-d-851337-5 devstack@n-api.service[104030]: INFO dbcounter [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Registered counter for database nova_api Aug 04 04:12:47.482542 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.486278 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_db.sqlalchemy.engines [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.490167 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writer thread running {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:47.493053 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writer thread running {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:47.545973 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.context [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=104029) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:12:47.548374 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.context [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=104030) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:12:47.549837 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_concurrency.lockutils [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:12:47.551439 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_concurrency.lockutils [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:12:47.552229 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_concurrency.lockutils [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:12:47.552323 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:12:47.553873 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:12:47.554220 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_concurrency.lockutils [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:12:47.554670 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:12:47.556225 n-d-851337-5 devstack@n-api.service[104029]: INFO dbcounter [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Registered counter for database nova_cell0 Aug 04 04:12:47.556709 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:12:47.558699 n-d-851337-5 devstack@n-api.service[104030]: INFO dbcounter [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Registered counter for database nova_cell0 Aug 04 04:12:47.562267 n-d-851337-5 devstack@n-api.service[104029]: INFO dbcounter [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Registered counter for database nova_cell1 Aug 04 04:12:47.564693 n-d-851337-5 devstack@n-api.service[104030]: INFO dbcounter [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Registered counter for database nova_cell1 Aug 04 04:12:47.569927 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.571112 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.572922 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_db.sqlalchemy.engines [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.576044 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_db.sqlalchemy.engines [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.578120 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writer thread running {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:47.580812 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writer thread running {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:47.581297 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writer thread running {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:47.586449 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writer thread running {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:47.724400 n-d-851337-5 devstack@n-api.service[104030]: INFO dbcounter [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Registered counter for database nova_cell0 Aug 04 04:12:47.724918 n-d-851337-5 devstack@n-api.service[104029]: INFO dbcounter [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Registered counter for database nova_cell0 Aug 04 04:12:47.734116 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_db.sqlalchemy.engines [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.735844 n-d-851337-5 devstack@n-api.service[104029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:12:47.738648 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writer thread running {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:47.740440 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writer thread running {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:12:48.074427 n-d-851337-5 devstack@n-api.service[104030]: WARNING keystonemiddleware.auth_token [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:12:48.075401 n-d-851337-5 devstack@n-api.service[104029]: WARNING keystonemiddleware.auth_token [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:12:48.081751 n-d-851337-5 devstack@n-api.service[104030]: WARNING keystonemiddleware.auth_token [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:12:48.082646 n-d-851337-5 devstack@n-api.service[104029]: WARNING keystonemiddleware.auth_token [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:12:48.421381 n-d-851337-5 devstack@n-api.service[104030]: WARNING keystonemiddleware.auth_token [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:12:48.427059 n-d-851337-5 devstack@n-api.service[104029]: WARNING keystonemiddleware.auth_token [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:12:48.427357 n-d-851337-5 devstack@n-api.service[104030]: WARNING keystonemiddleware.auth_token [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:12:48.432639 n-d-851337-5 devstack@n-api.service[104030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e04e6609c0 pid: 104030 (default app) Aug 04 04:12:48.432997 n-d-851337-5 devstack@n-api.service[104029]: WARNING keystonemiddleware.auth_token [None req-5df27948-c005-441c-91e9-d01839ccdbb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:12:48.434680 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:12:48.436411 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Aug 04 04:12:48.436814 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Thu Aug 4 04:12:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:12:48.438836 n-d-851337-5 devstack@n-api.service[104029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e04e6609c0 pid: 104029 (default app) Aug 04 04:14:05.243450 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:05.244430 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 04 04:14:05.244817 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:05.259736 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writing DB stats nova_api:SELECT=3 {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:05.260850 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writing DB stats nova_cell1:SELECT=3 {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:05.261556 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writing DB stats nova_cell0:SELECT=3 {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:05.263125 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:06.136848 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-44eebf82-7f1a-41e7-bee1-75836e91fd15 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:06.169922 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-44eebf82-7f1a-41e7-bee1-75836e91fd15 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915423 Aug 04 04:14:06.174450 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:14:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:08.387163 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:08.388214 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-0fcd6bbf-1056-4aa8-b2f4-9c9777b71059 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 04 04:14:08.388606 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:08.894527 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-52ebd47a-b157-4004-8ca3-6afc3e7a2b7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "ram": 256, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:08.915983 n-d-851337-5 devstack@n-api.service[104029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:14:08.915983 n-d-851337-5 devstack@n-api.service[104029]: warnings.warn(msg) Aug 04 04:14:08.945623 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-52ebd47a-b157-4004-8ca3-6afc3e7a2b7a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.549974 Aug 04 04:14:08.946501 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:09.169823 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-adae5049-47a9-4c23-b0d6-007eccf2ef7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:09.174223 n-d-851337-5 devstack@n-api.service[104030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:14:09.174223 n-d-851337-5 devstack@n-api.service[104030]: warnings.warn(msg) Aug 04 04:14:09.176864 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writing DB stats nova_api:SELECT=3 {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:09.177670 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writing DB stats nova_cell0:SELECT=3 {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:09.178588 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writing DB stats nova_cell1:SELECT=3 {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:09.179340 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:09.243871 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-adae5049-47a9-4c23-b0d6-007eccf2ef7d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288825 Aug 04 04:14:09.244541 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1336 bytes} [Thu Aug 4 04:14:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:14:11.531346 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-52ebd47a-b157-4004-8ca3-6afc3e7a2b7a admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:11.532575 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-52ebd47a-b157-4004-8ca3-6afc3e7a2b7a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Aug 04 04:14:11.533365 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:12.308321 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-42874e70-9e8a-41ca-8d4a-dc3befd97761 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "vcpus": 1}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:12.329429 n-d-851337-5 devstack@n-api.service[104030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:14:12.329429 n-d-851337-5 devstack@n-api.service[104030]: warnings.warn(msg) Aug 04 04:14:12.350625 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-42874e70-9e8a-41ca-8d4a-dc3befd97761 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.810464 Aug 04 04:14:12.351728 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:12.364887 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-28b6fa53-c4d2-4fbc-8f11-cbed5fa0ebfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:12.368359 n-d-851337-5 devstack@n-api.service[104029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:14:12.368359 n-d-851337-5 devstack@n-api.service[104029]: warnings.warn(msg) Aug 04 04:14:12.404428 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-28b6fa53-c4d2-4fbc-8f11-cbed5fa0ebfa admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044578 Aug 04 04:14:12.405908 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1336 bytes} [Thu Aug 4 04:14:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:14.901308 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-42874e70-9e8a-41ca-8d4a-dc3befd97761 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:14.902310 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-42874e70-9e8a-41ca-8d4a-dc3befd97761 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 04 04:14:14.902706 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:15.607881 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-08f08161-6cab-4dda-b5a4-821cafe37087 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:15.631058 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-08f08161-6cab-4dda-b5a4-821cafe37087 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715168 Aug 04 04:14:15.632371 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:15.652024 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-f673f481-c165-4770-aa4a-c68e9d93c2e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:15.690619 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-f673f481-c165-4770-aa4a-c68e9d93c2e9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042349 Aug 04 04:14:15.692039 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1336 bytes} [Thu Aug 4 04:14:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:14:18.200510 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-08f08161-6cab-4dda-b5a4-821cafe37087 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:18.201438 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-08f08161-6cab-4dda-b5a4-821cafe37087 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Aug 04 04:14:18.201864 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:18.657580 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-485f9878-cc12-4f86-a6c8-e3e68cddb62a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "swap": 0, "vcpus": 2, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:18.680741 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-485f9878-cc12-4f86-a6c8-e3e68cddb62a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472710 Aug 04 04:14:18.687097 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:18.694832 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-67eb7969-dc09-4ed1-b65a-2c2b528db975 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:18.722628 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-67eb7969-dc09-4ed1-b65a-2c2b528db975 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031320 Aug 04 04:14:18.723354 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1336 bytes} [Thu Aug 4 04:14:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:20.992049 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-485f9878-cc12-4f86-a6c8-e3e68cddb62a admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:20.993069 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-485f9878-cc12-4f86-a6c8-e3e68cddb62a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 04 04:14:20.993644 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:21.469393 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-47aeb375-d867-4e54-b045-8c6ead82ae9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:21.488002 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-47aeb375-d867-4e54-b045-8c6ead82ae9d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487596 Aug 04 04:14:21.488868 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:21.506005 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-6b88a394-d12a-4a52-826d-e22af5c0ec59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:21.532245 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-6b88a394-d12a-4a52-826d-e22af5c0ec59 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029847 Aug 04 04:14:21.532998 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1336 bytes} [Thu Aug 4 04:14:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:23.923838 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-47aeb375-d867-4e54-b045-8c6ead82ae9d admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:23.926918 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-47aeb375-d867-4e54-b045-8c6ead82ae9d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003756 Aug 04 04:14:23.937833 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:23 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:24.474322 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-29b64159-b734-4af9-a89c-a43de45f0676 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:24.504168 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-29b64159-b734-4af9-a89c-a43de45f0676 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.565771 Aug 04 04:14:24.505338 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:14:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:14:26.852696 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-47aeb375-d867-4e54-b045-8c6ead82ae9d admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:26.854044 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-47aeb375-d867-4e54-b045-8c6ead82ae9d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001918 Aug 04 04:14:26.854594 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:27.281182 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-873d7b5f-64ce-418d-ba20-4fa35ff827bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "name": "m1.tiny", "swap": 0, "disk": 1, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:27.301867 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-873d7b5f-64ce-418d-ba20-4fa35ff827bb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.440651 Aug 04 04:14:27.302570 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:27.316754 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d9288e5-0c7f-4fc4-8364-606b624cbc87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:27.346663 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d9288e5-0c7f-4fc4-8364-606b624cbc87 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034594 Aug 04 04:14:27.347593 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1333 bytes} [Thu Aug 4 04:14:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:29.533908 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-873d7b5f-64ce-418d-ba20-4fa35ff827bb admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:29.534906 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-873d7b5f-64ce-418d-ba20-4fa35ff827bb admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 04 04:14:29.535331 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:14:29.978003 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-b4dec06a-3352-4cb4-b2d0-93aaecd5501a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:29.999135 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-b4dec06a-3352-4cb4-b2d0-93aaecd5501a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456884 Aug 04 04:14:29.999718 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:30.011835 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-7b440466-c6a7-4f60-973d-0c78714d7292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:30.036958 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-7b440466-c6a7-4f60-973d-0c78714d7292 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028808 Aug 04 04:14:30.037530 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1333 bytes} [Thu Aug 4 04:14:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:32.385862 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-b4dec06a-3352-4cb4-b2d0-93aaecd5501a admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:32.387618 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-b4dec06a-3352-4cb4-b2d0-93aaecd5501a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Aug 04 04:14:32.388155 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:32.807767 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-0e87bae4-8499-41f2-bad4-a9c7319cf457 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:32.829877 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-0e87bae4-8499-41f2-bad4-a9c7319cf457 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435724 Aug 04 04:14:32.830688 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:32.842288 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-fb035e30-3bf8-41f5-9ca7-264f962066b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:32.867036 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-fb035e30-3bf8-41f5-9ca7-264f962066b2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028342 Aug 04 04:14:32.867755 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1333 bytes} [Thu Aug 4 04:14:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:35.099675 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-0e87bae4-8499-41f2-bad4-a9c7319cf457 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:35.100684 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-0e87bae4-8499-41f2-bad4-a9c7319cf457 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 04 04:14:35.101090 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:35.525939 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-4ec2d22b-508c-4cf1-9e94-045464f6d924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:35.532203 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:14:35.548344 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-4ec2d22b-508c-4cf1-9e94-045464f6d924 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.440603 Aug 04 04:14:35.555302 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:35.562483 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-b67b1f07-ba71-402e-9d72-109d1cfcfefa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:35.588534 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-b67b1f07-ba71-402e-9d72-109d1cfcfefa admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031016 Aug 04 04:14:35.589292 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1333 bytes} [Thu Aug 4 04:14:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:14:37.888767 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-4ec2d22b-508c-4cf1-9e94-045464f6d924 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:14:37.889767 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-4ec2d22b-508c-4cf1-9e94-045464f6d924 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 04 04:14:37.891098 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:14:38.340724 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-2bbfdbba-1b0a-49a9-ad85-6b71efb1359d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:38.362460 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-2bbfdbba-1b0a-49a9-ad85-6b71efb1359d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465676 Aug 04 04:14:38.363199 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1283 bytes} [Thu Aug 4 04:14:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:14:38.376953 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-5eb27548-c84e-4881-a00d-ec0cda64a9f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:14:38.402470 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-5eb27548-c84e-4881-a00d-ec0cda64a9f9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030053 Aug 04 04:14:38.403087 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1333 bytes} [Thu Aug 4 04:14:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:15:02.345470 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-2bbfdbba-1b0a-49a9-ad85-6b71efb1359d admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:02.346562 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-2bbfdbba-1b0a-49a9-ad85-6b71efb1359d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 04 04:15:02.346988 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:02.358029 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:15:02.755157 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-b49920c7-7a4d-46aa-aee8-7a89c3da8f7b admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:02.772898 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-b49920c7-7a4d-46aa-aee8-7a89c3da8f7b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.419793 Aug 04 04:15:02.773361 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:15:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:15:03.858022 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-2bbfdbba-1b0a-49a9-ad85-6b71efb1359d admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:03.859094 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-2bbfdbba-1b0a-49a9-ad85-6b71efb1359d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 04 04:15:03.859492 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:04.395678 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-caf5e42b-3a65-42ca-865c-cae74882d3da admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:04.401242 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.wsgi [None req-caf5e42b-3a65-42ca-865c-cae74882d3da admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-caf5e42b-3a65-42ca-865c-cae74882d3da admin admin] Request method failure captured: Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: Accept: application/json Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: Accept-Encoding: gzip, deflate Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: Connection: keep-alive Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: Content-Length: 0 Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: Host: 10.222.0.69 Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: Openstack-Api-Version: compute 2.90 Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: Openstack-System-Scope: None Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: User-Agent: python-novaclient Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Auth-Token: gAAAAABi60fHLjDHT6JBBQs1qHQGy_iwhnRtQa5ZXO2nHNLcUyx_hFio_pS6fNrLvSV_Ujcoq1N65cpMpJHodmkfOBs6XSp2kh_w5QZANhlkbC_K2QoDIo-FXYRhlE95sYuI0kAfwf2EnEmipkGt2BeMzmSMOYg85CH8bMu-eCbVunHdYTXX5x0 Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Domain-Id: None Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Domain-Name: None Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Identity-Status: Confirmed Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Is-Admin-Project: True Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Domain-Id: default Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Domain-Name: Default Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Name: admin Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Role: member,reader,admin Aug 04 04:15:04.404476 n-d-851337-5 devstack@n-api.service[104029]: X-Roles: member,reader,admin Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecdd99555e0e4a55b64e911246147660", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant: admin Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant-Name: admin Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-User: admin Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-User-Domain-Id: default Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-User-Domain-Name: Default Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-User-Id: a46afccba4254a128bee5c33b35bac6a Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: X-User-Name: admin Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: method: > Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: exception: Flavor 42 could not be found. Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: action_args: {'id': '42'} Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:15:04.406046 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:04.407779 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.409092 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-caf5e42b-3a65-42ca-865c-cae74882d3da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:15:04.410353 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-caf5e42b-3a65-42ca-865c-cae74882d3da admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395921 Aug 04 04:15:04.410353 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Aug 4 04:15:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:15:04.415504 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-0f8893f3-0a0c-4d92-b54e-1e7b9a1a4023 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:04.420071 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:15:04.440070 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-0f8893f3-0a0c-4d92-b54e-1e7b9a1a4023 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028035 Aug 04 04:15:04.440627 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Aug 4 04:15:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:15:04.455430 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6b1e414b-4d23-4bc4-858c-7e22dcba1791 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:04.479263 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6b1e414b-4d23-4bc4-858c-7e22dcba1791 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026851 Aug 04 04:15:04.479794 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Aug 4 04:15:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:15:04.489464 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-59dc9473-d42f-4d71-ab47-e7c4c662acb0 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:04.496334 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.wsgi [None req-59dc9473-d42f-4d71-ab47-e7c4c662acb0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-59dc9473-d42f-4d71-ab47-e7c4c662acb0 admin admin] Request method failure captured: Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: Accept: application/json Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: Accept-Encoding: gzip, deflate Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: Connection: keep-alive Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: Content-Length: 0 Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: Host: 10.222.0.69 Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: Openstack-Api-Version: compute 2.90 Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: Openstack-System-Scope: None Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: User-Agent: python-novaclient Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Auth-Token: gAAAAABi60fHLjDHT6JBBQs1qHQGy_iwhnRtQa5ZXO2nHNLcUyx_hFio_pS6fNrLvSV_Ujcoq1N65cpMpJHodmkfOBs6XSp2kh_w5QZANhlkbC_K2QoDIo-FXYRhlE95sYuI0kAfwf2EnEmipkGt2BeMzmSMOYg85CH8bMu-eCbVunHdYTXX5x0 Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Domain-Id: None Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Domain-Name: None Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Identity-Status: Confirmed Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Is-Admin-Project: True Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Domain-Id: default Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Domain-Name: Default Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Name: admin Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Role: member,reader,admin Aug 04 04:15:04.499624 n-d-851337-5 devstack@n-api.service[104030]: X-Roles: member,reader,admin Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecdd99555e0e4a55b64e911246147660", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant: admin Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant-Name: admin Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-User: admin Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-User-Domain-Id: default Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-User-Domain-Name: Default Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-User-Id: a46afccba4254a128bee5c33b35bac6a Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: X-User-Name: admin Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: method: > Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: exception: Flavor 42 could not be found. Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: action_args: {'id': '42'} Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:15:04.501161 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:04.502103 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:04.503229 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-59dc9473-d42f-4d71-ab47-e7c4c662acb0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:15:04.504239 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-59dc9473-d42f-4d71-ab47-e7c4c662acb0 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015428 Aug 04 04:15:04.504239 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Aug 4 04:15:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:15:05.489219 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6b1e414b-4d23-4bc4-858c-7e22dcba1791 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:05.490222 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6b1e414b-4d23-4bc4-858c-7e22dcba1791 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Aug 04 04:15:05.490634 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:06.024884 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-9f65ceeb-38ff-4c7c-8403-48aa67742af4 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:06.030574 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.wsgi [None req-9f65ceeb-38ff-4c7c-8403-48aa67742af4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-9f65ceeb-38ff-4c7c-8403-48aa67742af4 admin admin] Request method failure captured: Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: Accept: application/json Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: Accept-Encoding: gzip, deflate Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: Connection: keep-alive Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: Content-Length: 0 Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: Host: 10.222.0.69 Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: Openstack-Api-Version: compute 2.90 Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: Openstack-System-Scope: None Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: User-Agent: python-novaclient Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Auth-Token: gAAAAABi60fJ5b3V7fkqTLRnqH0_kajOf2_cKFa8LnS4-tm1783vJh8DXsC0Jg6dnxI03PmZK6YaeNX7ZxiyJe0YHsMXkaZCFTAAw2J9qTexXg-xvNX9Ozzr95vU5urz3LvQ0FGHSSmXu1nyBdFzR53xRLLuRhRLv4H4Qn15Gl2nD6_rvm_k14Y Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Domain-Id: None Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Domain-Name: None Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Identity-Status: Confirmed Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Is-Admin-Project: True Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Domain-Id: default Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Domain-Name: Default Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Name: admin Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Role: member,reader,admin Aug 04 04:15:06.032101 n-d-851337-5 devstack@n-api.service[104030]: X-Roles: member,reader,admin Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecdd99555e0e4a55b64e911246147660", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant: admin Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant-Name: admin Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-User: admin Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-User-Domain-Id: default Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-User-Domain-Name: Default Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-User-Id: a46afccba4254a128bee5c33b35bac6a Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: X-User-Name: admin Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: method: > Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: exception: Flavor 84 could not be found. Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: action_args: {'id': '84'} Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:15:06.033444 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:06.034260 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.035616 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-9f65ceeb-38ff-4c7c-8403-48aa67742af4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:15:06.036842 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-9f65ceeb-38ff-4c7c-8403-48aa67742af4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396454 Aug 04 04:15:06.036842 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Aug 4 04:15:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:15:06.043781 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-9f76fb04-4c08-4784-9538-1e8f3dc2ee5e admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:06.058457 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-9f76fb04-4c08-4784-9538-1e8f3dc2ee5e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018900 Aug 04 04:15:06.059013 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Aug 4 04:15:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:15:06.068402 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-d17bc216-64d3-483f-bace-ccd5831b0ee0 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:06.085098 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-d17bc216-64d3-483f-bace-ccd5831b0ee0 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020206 Aug 04 04:15:06.085643 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Aug 4 04:15:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:15:06.095743 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-bfd4c264-1e9e-4f7e-b222-5dd1ba6ffe48 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:06.101191 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.wsgi [None req-bfd4c264-1e9e-4f7e-b222-5dd1ba6ffe48 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-bfd4c264-1e9e-4f7e-b222-5dd1ba6ffe48 admin admin] Request method failure captured: Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: Accept: application/json Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: Accept-Encoding: gzip, deflate Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: Connection: keep-alive Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: Content-Length: 0 Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: Host: 10.222.0.69 Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: Openstack-Api-Version: compute 2.90 Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: Openstack-System-Scope: None Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: User-Agent: python-novaclient Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Auth-Token: gAAAAABi60fJ5b3V7fkqTLRnqH0_kajOf2_cKFa8LnS4-tm1783vJh8DXsC0Jg6dnxI03PmZK6YaeNX7ZxiyJe0YHsMXkaZCFTAAw2J9qTexXg-xvNX9Ozzr95vU5urz3LvQ0FGHSSmXu1nyBdFzR53xRLLuRhRLv4H4Qn15Gl2nD6_rvm_k14Y Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Domain-Id: None Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Domain-Name: None Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Identity-Status: Confirmed Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Is-Admin-Project: True Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Domain-Id: default Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Domain-Name: Default Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Name: admin Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Role: member,reader,admin Aug 04 04:15:06.102677 n-d-851337-5 devstack@n-api.service[104029]: X-Roles: member,reader,admin Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecdd99555e0e4a55b64e911246147660", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant: admin Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant-Name: admin Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-User: admin Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-User-Domain-Id: default Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-User-Domain-Name: Default Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-User-Id: a46afccba4254a128bee5c33b35bac6a Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: X-User-Name: admin Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: method: > Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: exception: Flavor 84 could not be found. Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: action_args: {'id': '84'} Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:15:06.104740 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:06.105682 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:06.106970 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-bfd4c264-1e9e-4f7e-b222-5dd1ba6ffe48 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:15:06.108272 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-bfd4c264-1e9e-4f7e-b222-5dd1ba6ffe48 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012541 Aug 04 04:15:06.108272 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Aug 4 04:15:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:15:07.074764 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-d17bc216-64d3-483f-bace-ccd5831b0ee0 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:07.075807 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-d17bc216-64d3-483f-bace-ccd5831b0ee0 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 04 04:15:07.076236 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:07.600006 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-ca2b9448-3b20-43e0-b778-fba93f71e0d6 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:07.605734 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.wsgi [None req-ca2b9448-3b20-43e0-b778-fba93f71e0d6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-ca2b9448-3b20-43e0-b778-fba93f71e0d6 admin admin] Request method failure captured: Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: Accept: application/json Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: Accept-Encoding: gzip, deflate Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: Connection: keep-alive Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: Content-Length: 0 Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: Host: 10.222.0.69 Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: Openstack-Api-Version: compute 2.90 Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: Openstack-System-Scope: None Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: User-Agent: python-novaclient Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Auth-Token: gAAAAABi60fKRFW7FHtQWpMcXTxjv0PMkocERA8Tk3UJz5RqCBFQ5HOL2wY9IVOSsteFThXTW8Gf72w3aBBu0jU3tjyZN6oUyc_2c44L82UCxa3hlbrPa5l9ZB5x6RE8ZvQViLBER8Jev_tM9f22SsUO_TXD-GKF6bmFPEppASHgQilKq2q00QQ Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Domain-Id: None Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Domain-Name: None Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Identity-Status: Confirmed Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Is-Admin-Project: True Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Domain-Id: default Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Domain-Name: Default Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Project-Name: admin Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Role: member,reader,admin Aug 04 04:15:07.607268 n-d-851337-5 devstack@n-api.service[104029]: X-Roles: member,reader,admin Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecdd99555e0e4a55b64e911246147660", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant: admin Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-Tenant-Name: admin Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-User: admin Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-User-Domain-Id: default Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-User-Domain-Name: Default Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-User-Id: a46afccba4254a128bee5c33b35bac6a Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: X-User-Name: admin Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: method: > Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: exception: Flavor 451 could not be found. Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: action_args: {'id': '451'} Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:15:07.608619 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:07.609824 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.611120 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-ca2b9448-3b20-43e0-b778-fba93f71e0d6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:15:07.612432 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-ca2b9448-3b20-43e0-b778-fba93f71e0d6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394501 Aug 04 04:15:07.612432 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Aug 4 04:15:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:15:07.618531 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-c4767661-25e0-4499-892a-d4a8d6ac73c8 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:07.633815 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-c4767661-25e0-4499-892a-d4a8d6ac73c8 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018852 Aug 04 04:15:07.634352 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Aug 4 04:15:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:15:07.644568 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:07.659406 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018351 Aug 04 04:15:07.659945 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Aug 4 04:15:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:15:07.669515 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-2d1cff41-946c-48d4-9e04-787b60d45bf2 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:07.674838 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.wsgi [None req-2d1cff41-946c-48d4-9e04-787b60d45bf2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-2d1cff41-946c-48d4-9e04-787b60d45bf2 admin admin] Request method failure captured: Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: Accept: application/json Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: Accept-Encoding: gzip, deflate Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: Connection: keep-alive Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: Content-Length: 0 Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: Host: 10.222.0.69 Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: Openstack-Api-Version: compute 2.90 Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: Openstack-System-Scope: None Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: User-Agent: python-novaclient Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Auth-Token: gAAAAABi60fKRFW7FHtQWpMcXTxjv0PMkocERA8Tk3UJz5RqCBFQ5HOL2wY9IVOSsteFThXTW8Gf72w3aBBu0jU3tjyZN6oUyc_2c44L82UCxa3hlbrPa5l9ZB5x6RE8ZvQViLBER8Jev_tM9f22SsUO_TXD-GKF6bmFPEppASHgQilKq2q00QQ Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Domain-Id: None Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Domain-Name: None Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Identity-Status: Confirmed Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Is-Admin-Project: True Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Domain-Id: default Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Domain-Name: Default Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Project-Name: admin Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Role: member,reader,admin Aug 04 04:15:07.676356 n-d-851337-5 devstack@n-api.service[104030]: X-Roles: member,reader,admin Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecdd99555e0e4a55b64e911246147660"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecdd99555e0e4a55b64e911246147660", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant: admin Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant-Id: ecdd99555e0e4a55b64e911246147660 Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-Tenant-Name: admin Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-User: admin Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-User-Domain-Id: default Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-User-Domain-Name: Default Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-User-Id: a46afccba4254a128bee5c33b35bac6a Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: X-User-Name: admin Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: method: > Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: exception: Flavor 451 could not be found. Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: action_args: {'id': '451'} Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:15:07.677685 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:07.678473 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: ERROR nova.api.openstack.wsgi Aug 04 04:15:07.679577 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-2d1cff41-946c-48d4-9e04-787b60d45bf2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:15:07.680604 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-2d1cff41-946c-48d4-9e04-787b60d45bf2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011882 Aug 04 04:15:07.680604 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Aug 4 04:15:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 04:15:08.652222 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:08.653219 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 04 04:15:08.653605 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:09.177721 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-bd5eaa83-31d2-4b33-8ce3-7e8b1930d7d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:15:09.196856 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-bd5eaa83-31d2-4b33-8ce3-7e8b1930d7d9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406600 Aug 04 04:15:09.198041 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Aug 4 04:15:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:15:10.301282 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:10.302313 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 04 04:15:10.302710 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:10.839623 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-08cb3f25-95cd-4bed-ba63-5df72bd135df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:15:10.860659 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-08cb3f25-95cd-4bed-ba63-5df72bd135df admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.417488 Aug 04 04:15:10.861139 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Aug 4 04:15:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:15:11.844213 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:11.845218 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 04 04:15:11.845644 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:12.382306 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-c81af314-9c90-45b5-a884-3ee9b96f970a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:15:12.401583 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-c81af314-9c90-45b5-a884-3ee9b96f970a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.417039 Aug 04 04:15:12.402124 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Aug 4 04:15:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:15:13.384327 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:13.385367 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 04 04:15:13.385763 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:13.908779 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-4a3e45c1-ef0e-4257-aeaf-d21a1ae32900 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:15:13.927783 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-4a3e45c1-ef0e-4257-aeaf-d21a1ae32900 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.405020 Aug 04 04:15:13.928453 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Aug 4 04:15:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:15:14.902727 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:14.903762 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 04 04:15:14.904164 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:15:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:15:15.435540 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-5559d583-fe92-48c8-b408-d4757efb58d6 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:15:15.455823 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-5559d583-fe92-48c8-b408-d4757efb58d6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409599 Aug 04 04:15:15.456357 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Thu Aug 4 04:15:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:16:07.499931 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:16:07.500978 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-6d209453-3191-4009-8bd2-fe60f70ddaa9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 04 04:16:07.501387 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 931 bytes} [Thu Aug 4 04:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:16:07.512594 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:16:07.896939 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-19947ab0-0aab-440e-adff-069b83dd779f admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:16:07.917391 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-19947ab0-0aab-440e-adff-069b83dd779f admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409962 Aug 04 04:16:07.917858 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:16:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:16:07.938832 n-d-851337-5 devstack@n-api.service[104029]: DEBUG dbcounter [-] [104029] Writing DB stats nova_api:SELECT=14 {{(pid=104029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:16:07.942860 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-3019153b-7afe-43c5-ae4d-b89441f52e0b admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:16:07.950592 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-3019153b-7afe-43c5-ae4d-b89441f52e0b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013172 Aug 04 04:16:07.951175 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1283 bytes} [Thu Aug 4 04:16:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:16:07.962860 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-20dba6e7-d483-48f2-a259-fe3b0b36683e admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:16:07.970385 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-20dba6e7-d483-48f2-a259-fe3b0b36683e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011174 Aug 04 04:16:07.970905 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1286 bytes} [Thu Aug 4 04:16:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:16:07.982887 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-493bcc2c-4413-48b4-90cc-97016d717094 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:16:07.990672 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-493bcc2c-4413-48b4-90cc-97016d717094 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011349 Aug 04 04:16:07.991228 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1286 bytes} [Thu Aug 4 04:16:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:16:08.003106 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-833e3402-698f-4d38-951b-ffde452803a2 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:16:08.010571 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-833e3402-698f-4d38-951b-ffde452803a2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011001 Aug 04 04:16:08.011119 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1283 bytes} [Thu Aug 4 04:16:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:21:20.580716 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-493bcc2c-4413-48b4-90cc-97016d717094 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:21:20.581725 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-493bcc2c-4413-48b4-90cc-97016d717094 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 04 04:21:20.582120 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:21:20.720716 n-d-851337-5 devstack@n-api.service[104030]: DEBUG dbcounter [-] [104030] Writing DB stats nova_api:SELECT=6 {{(pid=104030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:21:20.865136 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-59b25df7-8827-4fd0-8120-0ba2f7763a05 admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:21:20.867513 n-d-851337-5 devstack@n-api.service[104030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:21:20.867513 n-d-851337-5 devstack@n-api.service[104030]: warnings.warn(msg) Aug 04 04:21:20.869218 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-59b25df7-8827-4fd0-8120-0ba2f7763a05 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:21:20.869218 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-59b25df7-8827-4fd0-8120-0ba2f7763a05 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:21:20.869930 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-59b25df7-8827-4fd0-8120-0ba2f7763a05 admin admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:21:20.870356 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-59b25df7-8827-4fd0-8120-0ba2f7763a05 admin admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:21:20.911911 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-59b25df7-8827-4fd0-8120-0ba2f7763a05 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.192563 Aug 04 04:21:20.912482 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Aug 4 04:21:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:21:21.745110 n-d-851337-5 devstack@n-api.service[104029]: DEBUG nova.api.openstack.wsgi [None req-493bcc2c-4413-48b4-90cc-97016d717094 admin admin] Calling method '>' {{(pid=104029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:21:21.746161 n-d-851337-5 devstack@n-api.service[104029]: INFO nova.api.openstack.requestlog [None req-493bcc2c-4413-48b4-90cc-97016d717094 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 04 04:21:21.746567 n-d-851337-5 devstack@n-api.service[104029]: [pid: 104029|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Aug 4 04:21:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:21:21.937781 n-d-851337-5 devstack@n-api.service[104030]: DEBUG nova.api.openstack.wsgi [None req-790aa5d9-6e38-4476-bd04-5efcf65ba1cc admin admin] Calling method '>' {{(pid=104030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:21:21.940194 n-d-851337-5 devstack@n-api.service[104030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:21:21.940194 n-d-851337-5 devstack@n-api.service[104030]: warnings.warn(msg) Aug 04 04:21:21.941381 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-790aa5d9-6e38-4476-bd04-5efcf65ba1cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:21:21.942667 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-790aa5d9-6e38-4476-bd04-5efcf65ba1cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:21:21.943199 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-790aa5d9-6e38-4476-bd04-5efcf65ba1cc admin admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:21:21.943636 n-d-851337-5 devstack@n-api.service[104030]: DEBUG oslo_concurrency.lockutils [None req-790aa5d9-6e38-4476-bd04-5efcf65ba1cc admin admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:21:21.965676 n-d-851337-5 devstack@n-api.service[104030]: INFO nova.api.openstack.requestlog [None req-790aa5d9-6e38-4476-bd04-5efcf65ba1cc admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.080502 Aug 04 04:21:21.966246 n-d-851337-5 devstack@n-api.service[104030]: [pid: 104030|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Aug 4 04:21:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:22:05.373733 n-d-851337-5 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 04:22:05.374365 n-d-851337-5 devstack@n-api.service[104028]: Thu Aug 4 04:22:05 2022 - graceful shutdown triggered... Aug 04 04:22:05.374808 n-d-851337-5 devstack@n-api.service[104029]: Gracefully killing worker 1 (pid: 104029)... Aug 04 04:22:05.375232 n-d-851337-5 devstack@n-api.service[104030]: Gracefully killing worker 2 (pid: 104030)... Aug 04 04:22:06.375073 n-d-851337-5 devstack@n-api.service[104028]: worker 1 buried after 1 seconds Aug 04 04:22:06.375073 n-d-851337-5 devstack@n-api.service[104028]: worker 2 buried after 1 seconds Aug 04 04:22:06.375073 n-d-851337-5 devstack@n-api.service[104028]: goodbye to uWSGI. Aug 04 04:22:06.376613 n-d-851337-5 systemd[1]: devstack@n-api.service: Succeeded. Aug 04 04:22:06.377224 n-d-851337-5 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 04:22:06.380025 n-d-851337-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 04:22:06.397663 n-d-851337-5 devstack@n-api.service[119335]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 04:22:06 2022] *** Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: nodename: n-d-851337-5 Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: machine: x86_64 Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: clock source: unix Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: pcre jit disabled Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: detected number of CPU cores: 4 Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: current working directory: / Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: detected binary path: /usr/bin/uwsgi-core Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: your processes number limit is 47680 Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: your memory page size is 4096 bytes Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: detected max file descriptor number: 2048 Aug 04 04:22:06.421495 n-d-851337-5 devstack@n-api.service[119335]: lock engine: pthread robust mutexes Aug 04 04:22:06.422466 n-d-851337-5 devstack@n-api.service[119335]: thunder lock: enabled Aug 04 04:22:06.422466 n-d-851337-5 devstack@n-api.service[119335]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 04:22:06.422466 n-d-851337-5 devstack@n-api.service[119335]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 04:22:06.461270 n-d-851337-5 devstack@n-api.service[119335]: Python main interpreter initialized at 0x55f64ef2f9c0 Aug 04 04:22:06.461270 n-d-851337-5 devstack@n-api.service[119335]: python threads support enabled Aug 04 04:22:06.461270 n-d-851337-5 devstack@n-api.service[119335]: your server socket listen backlog is limited to 100 connections Aug 04 04:22:06.461270 n-d-851337-5 devstack@n-api.service[119335]: your mercy for graceful operations on workers is 90 seconds Aug 04 04:22:06.461702 n-d-851337-5 devstack@n-api.service[119335]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 04:22:06.461702 n-d-851337-5 devstack@n-api.service[119335]: *** Operational MODE: preforking *** Aug 04 04:22:06.461961 n-d-851337-5 devstack@n-api.service[119335]: *** uWSGI is running in multiple interpreter mode *** Aug 04 04:22:06.461961 n-d-851337-5 devstack@n-api.service[119335]: spawned uWSGI master process (pid: 119335) Aug 04 04:22:06.462164 n-d-851337-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 04:22:06.462789 n-d-851337-5 devstack@n-api.service[119335]: spawned uWSGI worker 1 (pid: 119342, cores: 1) Aug 04 04:22:06.463338 n-d-851337-5 devstack@n-api.service[119335]: spawned uWSGI worker 2 (pid: 119343, cores: 1) Aug 04 04:22:06.463629 n-d-851337-5 devstack@n-api.service[119335]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 04:22:07.129782 n-d-851337-5 devstack@n-api.service[119342]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:22:07.141140 n-d-851337-5 devstack@n-api.service[119343]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:22:08.298259 n-d-851337-5 devstack@n-api.service[119343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:22:08.298259 n-d-851337-5 devstack@n-api.service[119343]: from cryptography.utils import int_from_bytes Aug 04 04:22:08.299593 n-d-851337-5 devstack@n-api.service[119343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:22:08.299593 n-d-851337-5 devstack@n-api.service[119343]: from cryptography.utils import int_from_bytes Aug 04 04:22:08.299764 n-d-851337-5 devstack@n-api.service[119342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:22:08.299764 n-d-851337-5 devstack@n-api.service[119342]: from cryptography.utils import int_from_bytes Aug 04 04:22:08.300156 n-d-851337-5 devstack@n-api.service[119342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:22:08.300156 n-d-851337-5 devstack@n-api.service[119342]: from cryptography.utils import int_from_bytes Aug 04 04:22:10.648835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:22:10.649448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:22:10.649624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:22:10.649993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:22:10.650253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:22:10.650664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.651005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.651336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.651661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.651996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.652317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.652641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.652965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.653296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.653561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.653882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.654210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.654538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.654850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.655192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.655516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.655827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.656161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.656473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.656973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.657438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.657758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.658100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.658943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.659291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.659409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:22:10.659781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:22:10.659855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.659933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.660129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:22:10.660240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.660447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:22:10.660539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.660713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:22:10.660871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.661087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.661259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.661422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.661592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.661747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.661899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.662077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.662242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.662399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.662629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.662746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.662974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.663091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.663281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.663433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.663611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.663770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.663943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.664055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.664246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.664352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.664597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.664703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.664925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.665043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.665259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.665473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.665714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.665933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.665933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.666645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.666760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.666845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.667955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.668045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.668230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.668333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.668553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.668647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.668874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.668975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.669129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.669232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.669384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.669504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.669710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.669822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.670035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.670147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.670351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.670471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.670668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.670849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.670996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.671195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.671315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.671514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.671618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.671835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.671933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.672224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.672325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.672534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.672632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.672861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.672953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.673183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.673285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.673509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.673652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.673872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.674508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.674690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.674834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.675094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.675219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.675358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.675448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.675672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.675771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.676017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.676122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.676334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.676430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.676652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.676743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.676977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.677126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.677286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.677377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.677596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.677701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.677850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.677953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.678162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.678265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.678488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.678586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.678813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.678904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.679164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.679256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.679419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.679553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.679674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.679774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.679998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.680096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.680324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.680431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.680633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.680733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.680944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.681040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.681253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.681355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.681562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.681652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.681886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.681976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.682181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.682285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.682491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.682582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.682799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.682896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.683132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.683285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.683444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.683534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.683755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.683844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.684065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.684163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.684376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.684476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.684718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.684852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.685023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.685129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.685338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.685440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.685646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.685749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.685958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.686050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.686268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.686372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.686601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.686703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.686914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.687049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.687251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.687362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.687563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.687660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.687878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.687968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.688187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.688409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.688549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.688703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.689816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.690042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.690139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.690355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.690443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.690667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.690756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.691003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.691122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.691316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.691418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.691629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.691729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.691940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.692039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.692251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.692357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.692559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.692668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.692868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.692965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.693174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.693295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.693485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.693600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.693796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.693888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.694106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.694196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.694414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.694516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.694724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.694815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.695071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.695214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.695388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.695505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.695701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.695799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.696012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.696109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.696338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.696443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.696650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.696747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.696964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.697061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.697292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.697402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.697605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.697723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.697917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.698034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.698243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.698340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.698554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.698660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.698866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.699012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.699210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.699306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.699515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.699643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.699830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.699936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.700154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.700261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.700466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.700571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.700776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.700881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.701086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.701183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.701398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.701503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.701706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.701810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.702015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.702114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.702323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.702433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.702637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.702741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.702943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.703071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.703289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.703394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.703617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.703775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.703935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.704035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.704247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.704383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.704557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.704649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.704880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:22:10.704986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.705256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.705367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.705592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.705715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.705930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.706033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.706250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.706353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.706579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.706686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.706897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.707019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.707239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.707360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.707559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.707671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.707872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.707964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.708187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.708288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.708506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.708597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.708823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.708914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.709141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.709234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.709459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.709595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.709780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.709871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.710100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.710233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.710417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.710560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.710734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.710882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.711069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.711205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.711383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.711524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.711693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.711840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.712009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.712143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.712320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.712445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.712645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.712792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.712982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.713110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.713296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.713436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.713636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.713851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.714016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.714146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.714291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.714489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.714699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.714846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.715114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.715387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.715514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.715754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.715899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.716980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.717108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.717236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.717378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.717508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.717710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.717842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.717979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.718109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.718246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.718384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.718514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.718651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.718788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.718928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.719114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.719246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.719386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.719515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.719670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.719801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.719945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.720076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.720212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.720379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.720521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.721233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.721377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.721572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.721713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.721883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.722015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.722202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.722336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.722514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.722647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.722839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.723007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.723158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.723299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.723477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.723614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.723786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.724013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.724162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.724293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.724432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.724644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.724776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.724920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.725065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.725263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.725486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.725620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.725764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.725979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.726113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.726237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.726375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.726504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.726668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.726909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.727221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.727357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.727495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.727638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.727849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.727997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.728128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.728265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.728408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.728550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.728754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.728967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.729195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.729430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.729649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.729853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.729853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.730284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.730496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.730709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.730918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.731155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.731399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.731632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.731861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.732082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.732310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.732522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.732522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.732950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.733164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.733382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.733624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.733860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.734186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.734566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.734794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.734937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.735108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.735273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.735616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.735784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.735915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.736146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.736146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.736993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.737800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.738128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.738325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.738325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.738780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.739036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.739274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.739503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.739726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.739958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.740169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.740369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.740551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.740664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.740782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.740909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.741947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.742084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.742226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.742363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.742502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.742638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.742768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.742896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.743879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.744955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.745089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.745089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.745312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.745440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.745440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.745886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.746026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.746163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.746380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.746519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.746660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.746790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.746910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.747048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.747219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.747431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.747554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.747694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.747833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.747964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.748194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.748385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.748611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.748858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.749068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.749278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.749491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.749852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.750085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.750320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.750537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.750756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.751040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.751282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.751505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.751655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.751768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.751903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.752514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.752636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.752763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.752882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.753939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.754059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.754189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.754415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.754550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.754670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.754808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.754966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.755170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.755316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.755458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.755596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.755825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.756149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.756279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.756409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.756642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.756792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.756924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.757062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.757192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.757320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.757460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.757608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.757739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.757877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.758006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.758143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.758355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.758501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.758631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.758776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.758914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.759178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.759310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.759449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.759579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.759714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.759845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.759973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.760111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.760231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.760359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.760476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.760610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.760747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.760886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.761965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.762227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.762364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.762507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.762507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.762766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.762982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.763116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.763116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.763380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.763516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.763516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.763781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.763911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.764049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.764178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.764307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.764448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.764659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.764793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.764916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.765029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.765155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.765341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.765470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.765610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.765749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.765968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.766125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.766332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.766465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.766577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.766798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.766917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.767088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.767230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.767369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.767534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.768269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.768474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.768615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.768764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.768895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.769977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.770104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.770247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.770379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.770515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.770652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.770789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.770926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.771145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.771287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.771419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.771549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.771677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.771815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.771946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.772879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.773133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.773271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.773410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.773540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.773677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.773817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.773958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.774088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.774217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.774355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.774497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.774657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.774861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.775015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.775160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.775345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.775505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.775764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.775892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.776074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.776183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.776391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.776506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.776733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.777036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.777167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.777295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.777535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.777685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.777816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.777946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.778075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.778205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.778343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.778564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.778681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.778880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.779040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.779252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.779361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.779592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.779685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.779934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.780030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.780247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.780352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.780557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.780664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.780887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.780996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.781199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.781381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.781509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.781817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.781909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.782136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.782241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.782445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.782544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.782752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.782857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.783128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.783227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.783458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.783550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.783777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.783890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.784085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.784185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.784395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.784489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.784707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.784808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.785015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.785128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.785323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.785414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.785634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.785727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.785944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.786052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.786250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.786349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.786564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.786653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.786877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.787090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.787245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.787399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.787553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.787706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.787859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.788014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.788159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.788388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.788545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.788780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.788946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.789103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.789248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.789399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.789550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.789693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.789850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.790010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.790159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.790303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.790445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.790588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.790764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.790920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.791165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.791322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.791477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.791621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.791774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.791926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.792078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.792229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.792381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.792541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.792692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.792836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.792986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.793147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.793303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.793462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.793607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.793758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.793903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.794053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.794198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.794351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.794496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.794645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.794788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.794946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.795121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.795281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.795426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.795597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.795851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.796001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.796309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.796466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.796636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.796793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.796946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.797098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.797268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.797414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.797567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.797719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.797863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.798007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.798159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.798304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.798454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.798599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.798778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.799015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.799180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.799335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.799485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.799630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.799780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.799924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.800087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.800242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.800387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.800530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.800681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.800835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.800979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.801121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.801281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.801426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.801570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.801721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.801866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.802009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.802160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.802303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.802454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.802613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.802758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.802902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.803094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.803259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.803411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.803564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.803710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.803855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.803998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.804276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.804441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.804595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.804739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.804883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.805034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.805190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.805342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.805493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.805649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.805817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.805977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.806121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.806341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.806568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.806724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.806868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.807045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.807203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.807368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.807528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.807679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.807832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.807977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.808138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.808282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.808432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.808576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.808727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.808871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.809041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.809253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.809413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.809565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.809710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.809862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.810027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.810181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.810326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.810470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.810619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.810764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.810916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.811097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.811256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.811419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.811571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.811728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.811880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.812025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.812167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.812311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.812461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.812614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.812766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.812911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.813061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.813215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.813359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.813580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.813725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.813868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.814018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.814162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.814888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.815092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.815240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.815385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.815569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.815716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.815887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.816034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.816177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.816330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.816484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.816726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.816887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.817032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.817175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.817326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.817478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.817631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.817783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.817938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.818089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.818233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.818384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.818529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.818529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.818810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.818810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.819168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.819168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.819553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.819700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.819852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.819852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.820135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.820285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.820450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.820599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.820753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.820907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.821071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.821216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.821366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.821517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.821661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.821815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.821971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.822116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.822267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.822410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.822560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.822704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.822856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.823019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.823170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.823325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.823469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.823611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.823784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.823937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.824081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.824233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.824394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.824629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.824778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.824931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.825082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.825233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.825384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.825537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.825681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.825835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.825979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.826123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.826266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.826418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.826418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.826714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.826942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.827160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.827313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.827479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.827624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.827785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.827937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.828083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.828234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.828388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.828538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.828697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.828697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.828985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.829138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.829282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.829515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.829673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.829836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.830021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.830773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.830920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.830920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.831231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.831377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.831528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.831528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.831822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.831973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.832124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.832276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.832439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.832591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.832744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.832887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.833038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.833183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.833339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.833492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.833645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.833790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.833942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.834087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.834240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.834395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.834547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.834784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.834940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.835139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.835298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.835443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.835595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.835739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.835881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.836109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.836263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.836428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.836583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.836727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.836877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.837125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.837274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.837419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.837570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.837570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.837867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.838022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.838175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.838318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.838485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.838639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.838791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.838982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.839135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.839278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.839431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.839667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.839826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.839972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.840128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.840272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.840424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.840588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.840761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.840907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.841050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.841206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.841362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.841362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.841648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.841800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.841943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.842102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.842246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.842401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.842558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.842704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.842847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.843054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.843205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.843363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.843508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.843658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.843804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.843947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.844101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.844255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.844409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.844560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.844713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.844948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.845099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.845257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.845403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.845546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.845546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.845856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.846000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.846152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.846297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.846458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.846603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.846746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.846903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.847092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.847311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.847459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.847602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.847745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.847902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.848056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.848206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.848358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.848518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.848670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.848825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.848970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.849113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.849270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.849430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.849580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.849825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.850006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.850006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.850310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.850478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.850659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.850824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.851030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.851190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.851341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.851502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.851667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.851825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.851988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.852147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.852306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.852475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.852633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.852785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.852934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.853084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.853242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.853402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.853553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.853704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.853862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.854020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.854172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.854346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.854498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.854662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.854814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.855007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.855174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.855328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.855487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.855646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.855977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.856147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.856311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.856472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.856631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.856785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.856944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.857104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.857255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.857511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.857677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.857829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.857979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.858142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.858303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.858303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.858611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.858770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.858929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.859137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.859549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.859712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.859958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.860116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.860268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.860427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.860589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.860753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.860915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.861103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.861294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.861459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.861613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.861769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.861929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.862087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.862256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.862408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.862559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.862709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.862869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.863059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.863229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.863229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.863552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.863709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.863859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.864035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.864195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.864346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.864495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.864495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.864788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.864963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.865114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.865264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.865414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.865570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.865722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.865959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.866119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.866270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.866419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.866570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.866719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.866883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.867094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.867246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.867396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.867650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.867819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.867980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.868131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.868282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.868446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.868598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.868763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.868914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.869082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.869082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.869377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.869528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.869691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.869851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.870086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.870251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.870404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.870562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.870738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.870892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.871070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.871235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.871387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.871549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.871708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.871868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.872021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.872179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.872338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.872498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.872656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.872807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.872957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.873108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.873277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.873442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.873594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.873751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.873909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.874068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.874220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.874385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.874544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.874703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.874862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.875080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.875254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.875424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.875424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.875734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.875893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.876050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.876217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.876369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.876520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.876678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.876678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.877474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.877654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.877828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.877980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.878137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.878289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.878439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.878598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.878758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.878909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.879082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.879245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.879406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.879557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.879715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.879884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.879884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.880263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.880432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.880593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.880751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.880911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.881070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.881233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.881393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.881553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.881705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.881864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.882034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.882185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.882345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.882497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.882647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.882797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.882990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.883167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.883326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.883478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.883636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.883788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.883939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.884107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.884258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.884409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.884409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.884703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.884854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.885973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.886902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.887921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.888997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.889164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.889325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.889477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.889634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.889803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.889956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.890121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.890297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.890454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.890606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.890764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.890924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.891140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.891295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.891452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.891603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.891761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.891930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.892091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.892242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.892393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.892649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.893302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.893463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.893614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.893764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.893913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.894064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.894216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.894457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.894610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.894761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.894913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.895099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.895260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.895421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.895574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.895732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.895884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.896042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.896203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.896362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.896536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.896687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.896838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.896988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.897147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.897299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.897449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.897607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.897796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.897980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.898147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.898322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.898490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.898640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.898790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.898940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.899167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.899328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.899481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.899640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.899797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.899957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.900155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.900308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.900468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.900468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.900775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.900935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.901086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.901236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.901386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.901542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.901693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.901857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.902031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.902191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.902388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.902544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.902718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.902870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.903042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.903042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.903384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.903583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.903748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.903908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.904058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.904216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.904368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.904519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.904694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.904845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.904996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.905146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.925571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.926188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.926372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.926543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.926700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.926873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.927036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.927177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.927327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.927494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.927662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.927822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.927967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.928139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.928283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.928605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.928930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.929101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.929240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.929527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.929793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.929955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.930102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.930234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.930365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.930497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.930726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.930877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.931046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.931197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.931351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.931517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.931663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.931813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.931978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.932142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.932315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.932471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.932605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.932759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.932913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.933075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.933246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.933407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.933578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.933727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.933883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.934040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.934182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.934331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.934483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.934632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.934779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.934934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.935124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.935274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.935437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.935591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.935754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.936051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.936485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.936643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.936813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.936976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.937147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.937322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.937485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.937646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.937817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.937969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.938121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.938298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.938449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.938751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.938925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.939269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.940205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.940384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.940544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.940690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.940832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.940967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.941833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.943034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.943034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.943034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.943034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.943034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.943034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:22:10.943034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:22:11.080419 n-d-851337-5 devstack@n-api.service[119343]: INFO dbcounter [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Registered counter for database nova_api Aug 04 04:22:11.080565 n-d-851337-5 devstack@n-api.service[119342]: INFO dbcounter [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Registered counter for database nova_api Aug 04 04:22:11.101466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_db.sqlalchemy.engines [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.102816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_db.sqlalchemy.engines [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.108549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writer thread running {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.109878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writer thread running {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.166947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.context [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=119343) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:22:11.169017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.context [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=119342) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:22:11.171159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:11.172773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:11.173190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:11.173592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:11.175387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:11.176146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:11.176242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:11.178182 n-d-851337-5 devstack@n-api.service[119343]: INFO dbcounter [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Registered counter for database nova_cell0 Aug 04 04:22:11.178450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:11.180565 n-d-851337-5 devstack@n-api.service[119342]: INFO dbcounter [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Registered counter for database nova_cell0 Aug 04 04:22:11.182381 n-d-851337-5 devstack@n-api.service[119343]: INFO dbcounter [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Registered counter for database nova_cell1 Aug 04 04:22:11.185207 n-d-851337-5 devstack@n-api.service[119342]: INFO dbcounter [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Registered counter for database nova_cell1 Aug 04 04:22:11.189383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_db.sqlalchemy.engines [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.195497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_db.sqlalchemy.engines [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.195675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writer thread running {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.197420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_db.sqlalchemy.engines [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.201235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writer thread running {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.202820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_db.sqlalchemy.engines [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.341596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writer thread running {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.346515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writer thread running {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.350596 n-d-851337-5 devstack@n-api.service[119343]: INFO dbcounter [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Registered counter for database nova_cell0 Aug 04 04:22:11.355866 n-d-851337-5 devstack@n-api.service[119342]: INFO dbcounter [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Registered counter for database nova_cell0 Aug 04 04:22:11.357926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_db.sqlalchemy.engines [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.363669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writer thread running {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.363946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_db.sqlalchemy.engines [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:22:11.368410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writer thread running {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:22:11.683000 n-d-851337-5 devstack@n-api.service[119343]: WARNING keystonemiddleware.auth_token [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:22:11.689882 n-d-851337-5 devstack@n-api.service[119342]: WARNING keystonemiddleware.auth_token [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:22:11.690339 n-d-851337-5 devstack@n-api.service[119343]: WARNING keystonemiddleware.auth_token [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:22:11.697296 n-d-851337-5 devstack@n-api.service[119342]: WARNING keystonemiddleware.auth_token [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:22:12.031161 n-d-851337-5 devstack@n-api.service[119343]: WARNING keystonemiddleware.auth_token [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:22:12.037281 n-d-851337-5 devstack@n-api.service[119343]: WARNING keystonemiddleware.auth_token [None req-faba2f56-3a95-4029-b091-4563009d9915 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:22:12.041324 n-d-851337-5 devstack@n-api.service[119342]: WARNING keystonemiddleware.auth_token [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:22:12.043542 n-d-851337-5 devstack@n-api.service[119343]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f64ef2f9c0 pid: 119343 (default app) Aug 04 04:22:12.047350 n-d-851337-5 devstack@n-api.service[119342]: WARNING keystonemiddleware.auth_token [None req-3dfe2df9-674e-40e5-96e6-900509179d84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:22:12.054130 n-d-851337-5 devstack@n-api.service[119342]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f64ef2f9c0 pid: 119342 (default app) Aug 04 04:22:51.585500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:51.586415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:51.587274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:51.588013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:52.370242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:52.371457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:52.372309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:52.373126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:52.977318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9be81e6-497b-49f9-82fc-4547f40bf4c3 tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:52.980269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9be81e6-497b-49f9-82fc-4547f40bf4c3 tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:52.980873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9be81e6-497b-49f9-82fc-4547f40bf4c3 tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:52.982107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9be81e6-497b-49f9-82fc-4547f40bf4c3 tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:52.982828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9be81e6-497b-49f9-82fc-4547f40bf4c3 tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.032887 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9be81e6-497b-49f9-82fc-4547f40bf4c3 tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] 10.222.0.69 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.453161 Aug 04 04:22:53.033463 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1/1] 10.222.0.69 () {58 vars in 1164 bytes} [Thu Aug 4 04:22:51 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:22:53.467142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '.version_select at 0x7f1921127670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:53.468797 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:53.468797 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:53.476452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=119343) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 04:22:53.477550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.478524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.508494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.509170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.522009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.522680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.529219 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5efc263-afc7-4bd2-8b52-32201b1335d0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.494564 Aug 04 04:22:53.529965 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2/2] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Aug 4 04:22:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:53.535244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:53.536313 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:53.536313 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:53.537638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.538226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.539261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.539853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.564860 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] 10.222.0.69 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.033127 Aug 04 04:22:53.565854 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3/3] 10.222.0.69 () {58 vars in 1185 bytes} [Thu Aug 4 04:22:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:53.567706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:53.568852 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7113105-96f7-4aa2-a0a1-4f000ca7d70c tempest-AZAdminV2TestJSON-913340419 tempest-AZAdminV2TestJSON-913340419-project-admin] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001307 Aug 04 04:22:53.569315 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 4/4] 10.222.0.69 () {56 vars in 886 bytes} [Thu Aug 4 04:22:53 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 04:22:53.662452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Calling method '.version_select at 0x7f192128dd30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:53.666985 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:53.666985 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:53.672809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=119342) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 04:22:53.673650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.674085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.700481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.700926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.712672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24c56148-167c-4e68-9746-2925a927699c tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1981235867", "id": 1403236609, "os-flavor-access:is_public": "True"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:53.714838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:53.715315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:53.721896 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5ef447a-efce-493b-b084-977c4127bbe3 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.362969 Aug 04 04:22:53.722761 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1/5] 10.222.0.69 () {60 vars in 1208 bytes} [Thu Aug 4 04:22:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:22:53.727859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ef349a18-2344-4757-ae6a-dfecc69c4851 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-826353648", "name": "tempest-test_aggregate-412153155"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:53.748935 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:53.748935 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:53.762756 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:53.762756 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:53.764210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-ef349a18-2344-4757-ae6a-dfecc69c4851 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid 1af32a5f-ca4f-47c8-95b8-06fe724a71f3 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:22:53.784025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24c56148-167c-4e68-9746-2925a927699c tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.213450 Aug 04 04:22:53.787141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 5/6] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:53 2022] POST /compute/v2.1/flavors => generated 430 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:53.851979 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ef349a18-2344-4757-ae6a-dfecc69c4851 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.127897 Aug 04 04:22:53.852656 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2/7] 10.222.0.69 () {60 vars in 1165 bytes} [Thu Aug 4 04:22:53 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:54.054907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b5e914f6-c9fc-4832-97ab-1bd112b1c852 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:54.055408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-995861807", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:54.057445 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:54.057445 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:54.058656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5e914f6-c9fc-4832-97ab-1bd112b1c852 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:54.059575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5e914f6-c9fc-4832-97ab-1bd112b1c852 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:54.061457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5e914f6-c9fc-4832-97ab-1bd112b1c852 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:54.061889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5e914f6-c9fc-4832-97ab-1bd112b1c852 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:54.089025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b5e914f6-c9fc-4832-97ab-1bd112b1c852 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.302916 Aug 04 04:22:54.098594 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 6/8] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:22:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:54.114264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62744902-e45a-4b9e-a021-76d3fbad8a02 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:54.115217 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:54.115217 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:54.144620 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62744902-e45a-4b9e-a021-76d3fbad8a02 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1403236609" status: 202 len: 0 microversion: 2.1 time: 0.044046 Aug 04 04:22:54.145541 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 7/9] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:22:54 2022] DELETE /compute/v2.1/flavors/1403236609 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:54.152070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-824c7594-632e-437b-af14-b95993be0b0c tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:54.152931 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:54.152931 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:54.165330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-824c7594-632e-437b-af14-b95993be0b0c tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.017254 Aug 04 04:22:54.166084 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 8/10] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:22:54 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:54.176809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba94b82c-0af6-43f1-b7d5-61a904cb3b38 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:54.207876 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba94b82c-0af6-43f1-b7d5-61a904cb3b38 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034278 Aug 04 04:22:54.208559 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 9/11] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:54.227253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9e4cbd5-6b5d-475f-ba24-78af27ecfb4a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:54.230027 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:54.230027 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:54.284243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e4cbd5-6b5d-475f-ba24-78af27ecfb4a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:54.285501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e4cbd5-6b5d-475f-ba24-78af27ecfb4a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:54.639923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:22:54.836133 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9e4cbd5-6b5d-475f-ba24-78af27ecfb4a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.624541 Aug 04 04:22:54.836932 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 10/12] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:22:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:54.856584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f043d211-c0da-4b84-8aaf-d23926c8ae66 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1257777397", "id": 667488824, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:54.868464 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:54.868464 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:54.902543 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f043d211-c0da-4b84-8aaf-d23926c8ae66 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.064121 Aug 04 04:22:54.903168 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 11/13] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:54 2022] POST /compute/v2.1/flavors => generated 414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:54.917238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7edac4f-9834-4653-bdab-2ff7792fbf85 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:54.942634 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b7edac4f-9834-4653-bdab-2ff7792fbf85 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.031228 Aug 04 04:22:54.943617 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 12/14] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:54 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:54.961518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-012e3860-76b1-4938-b666-fc50da19cede tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:54.962786 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:54.962786 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:54.982856 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-012e3860-76b1-4938-b666-fc50da19cede tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/667488824" status: 202 len: 0 microversion: 2.1 time: 0.024250 Aug 04 04:22:54.984153 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 13/15] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:22:54 2022] DELETE /compute/v2.1/flavors/667488824 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:22:54.993916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-302bcbd5-f29f-49ca-87ad-34b1dd7188ad tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.023832 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-302bcbd5-f29f-49ca-87ad-34b1dd7188ad tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032860 Aug 04 04:22:55.025016 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 14/16] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:22:55.113310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:22:55.114416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:22:55.114893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:22:55.115931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:22:55.116498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:22:55.136077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:55.136549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:55.137384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:55.138025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:55.168939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:22:55.175737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for user 80bef27d84824d25b096a8507009d824 and project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:22:55.187136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:22:55.190580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:22:55.245548 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-522f6ab7-fb13-4e4d-9887-f4cee1413fb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391875 Aug 04 04:22:55.246352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3/17] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:22:55.258976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4480efc8-15de-454f-8d35-d5deb5d1a429 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-879588296", "id": 1411545945, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:55.262714 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:55.262714 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:55.298625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4480efc8-15de-454f-8d35-d5deb5d1a429 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.043224 Aug 04 04:22:55.307082 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 4/18] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:55 2022] POST /compute/v2.1/flavors => generated 428 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:55.312925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96581b5b-85cd-4a5e-8714-bcbe00b2c113 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.313698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96581b5b-85cd-4a5e-8714-bcbe00b2c113 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:22:55.444139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-96581b5b-85cd-4a5e-8714-bcbe00b2c113 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:22:55.461744 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96581b5b-85cd-4a5e-8714-bcbe00b2c113 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1212 microversion: 2.1 time: 0.153179 Aug 04 04:22:55.462568 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 5/19] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:22:55 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1212 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:55.468096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0ec1a09d-963a-477f-9e1f-69cac5ee38bd tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.469099 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:55.469099 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:55.494027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-19656221", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "availability_zone": "tempest-test_az-826353648"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:55.508766 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0ec1a09d-963a-477f-9e1f-69cac5ee38bd tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1411545945" status: 202 len: 0 microversion: 2.1 time: 0.043446 Aug 04 04:22:55.510443 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 6/20] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:22:55 2022] DELETE /compute/v2.1/flavors/1411545945 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:55.521386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:55.522092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:55.523372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:55.523983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:55.531736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ddf1c6c-9fba-4925-8223-e8255bcc5719 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.595611 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ddf1c6c-9fba-4925-8223-e8255bcc5719 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075685 Aug 04 04:22:55.596206 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 7/21] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:55.615174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53d19e8a-d5c4-488c-a8c6-058ede6d59bc tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-268186812", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:55.618590 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:55.618590 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:55.681716 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53d19e8a-d5c4-488c-a8c6-058ede6d59bc tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.070607 Aug 04 04:22:55.682494 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 8/22] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:55 2022] POST /compute/v2.1/flavors => generated 506 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:55.695020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57b9cf98-3463-4a86-8399-d8ffd508a30e tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.715960 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57b9cf98-3463-4a86-8399-d8ffd508a30e tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/5fea8528-a71d-4cda-b7b8-dc6b248eaca1" status: 202 len: 0 microversion: 2.1 time: 0.025211 Aug 04 04:22:55.719780 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 9/23] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:22:55 2022] DELETE /compute/v2.1/flavors/5fea8528-a71d-4cda-b7b8-dc6b248eaca1 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:55.730984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f00d8db5-8fed-43ce-9e34-47871817e06f tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.760949 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f00d8db5-8fed-43ce-9e34-47871817e06f tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037155 Aug 04 04:22:55.761563 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 10/24] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:55.786942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b30bfe8d-716b-4f18-a240-4d080f649976 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-150157132", "id": "cc14510e-c501-4f6c-93c9-86d9d849ec80", "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:55.809919 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b30bfe8d-716b-4f18-a240-4d080f649976 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029289 Aug 04 04:22:55.811244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 11/25] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:55 2022] POST /compute/v2.1/flavors => generated 506 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:55.825276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6e71fbd-3dfd-46ef-b13c-345b2c1ddc90 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.856157 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6e71fbd-3dfd-46ef-b13c-345b2c1ddc90 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/cc14510e-c501-4f6c-93c9-86d9d849ec80" status: 202 len: 0 microversion: 2.1 time: 0.036849 Aug 04 04:22:55.857668 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 12/26] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:22:55 2022] DELETE /compute/v2.1/flavors/cc14510e-c501-4f6c-93c9-86d9d849ec80 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:22:55.869453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20c4d4d0-beac-451b-ad97-a6184540129f tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.915222 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20c4d4d0-beac-451b-ad97-a6184540129f tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053199 Aug 04 04:22:55.915829 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 13/27] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:55.935117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04e9dcc8-c24b-4099-8248-e94061bc3ce1 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1022288740", "id": 1034960393, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:55.965556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04e9dcc8-c24b-4099-8248-e94061bc3ce1 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034129 Aug 04 04:22:55.966551 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 14/28] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:55.978878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9559cf0c-2809-430b-a4a6-7a2d27c70f01 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:55.995858 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9559cf0c-2809-430b-a4a6-7a2d27c70f01 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1034960393" status: 200 len: 414 microversion: 2.1 time: 0.021388 Aug 04 04:22:55.997012 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 15/29] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:22:55 2022] GET /compute/v2.1/flavors/1034960393 => generated 414 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:56.394683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:22:56.452366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b9311ba-b7f2-43e5-bb7e-7eb8cbb46150 tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:56.487069 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b9311ba-b7f2-43e5-bb7e-7eb8cbb46150 tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.481883 Aug 04 04:22:56.488228 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 16/30] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:56 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:22:56.506819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2488a05-c954-4a63-b023-39fb6814e7db tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:56.509552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2488a05-c954-4a63-b023-39fb6814e7db tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:22:56.720721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2488a05-c954-4a63-b023-39fb6814e7db tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:22:56.730341 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2488a05-c954-4a63-b023-39fb6814e7db tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1212 microversion: 2.1 time: 0.240476 Aug 04 04:22:56.731155 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 17/31] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:22:56 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1212 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:56.736815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cb52dbb4-de92-47f2-a0fc-d83f122640fd tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:56.739176 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:56.739176 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:56.774265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cb52dbb4-de92-47f2-a0fc-d83f122640fd tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1034960393" status: 202 len: 0 microversion: 2.1 time: 0.040997 Aug 04 04:22:56.776374 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 18/32] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:22:56 2022] DELETE /compute/v2.1/flavors/1034960393 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:56.785826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1aa3aa51-463f-468c-9af0-0df1d6934682 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:56.814259 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1aa3aa51-463f-468c-9af0-0df1d6934682 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033680 Aug 04 04:22:56.815634 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 19/33] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:56.857454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:22:56.857925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:22:56.858495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:22:56.859365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:22:56.860068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:22:56.878722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:56.879893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:56.881345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:56.882378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:56.917695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Getting quotas for project b046531f3dc8443bad8b040202d8b432. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:22:56.924956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Getting quotas for user 31bbfbe3ada6470997b454753788b86e and project b046531f3dc8443bad8b040202d8b432. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:22:56.939167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:22:56.942566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:22:57.005894 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a37e4b7-fce5-4762-98b9-1928ab8e5aed tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979212 Aug 04 04:22:57.013046 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 15/34] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:22:57.019940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ed433d33-aba4-4a66-b4c5-8fbd4ee8f095 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1745065522", "id": 125163791, "os-flavor-access:is_public": "False"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:57.023834 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:57.023834 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:57.040541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1fcd532d-8eec-4d72-a254-bafff370b1df tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-285630443", "id": 1439828405, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:57.048123 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:57.048123 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:57.073066 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ed433d33-aba4-4a66-b4c5-8fbd4ee8f095 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.058276 Aug 04 04:22:57.075327 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 16/35] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:57.089552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b1d85fb-fa26-4b96-a1a6-2e5fd1fca825 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.090079 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1fcd532d-8eec-4d72-a254-bafff370b1df tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.271840 Aug 04 04:22:57.092390 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 20/36] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:22:56 2022] POST /compute/v2.1/flavors => generated 448 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:22:57.105573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3568003d-e97f-4562-9f11-30f53c1a2f4e tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "125163791"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:57.107354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b1d85fb-fa26-4b96-a1a6-2e5fd1fca825 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:22:57.131811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=10,nova_api:DELETE=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:57.134248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3568003d-e97f-4562-9f11-30f53c1a2f4e tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] HTTP exception thrown: Flavor 125163791 could not be found. Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3568003d-e97f-4562-9f11-30f53c1a2f4e tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] Request method failure captured: Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 106 Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60maTkXK4blw4xHsn15G_LkW_jwpvvTHphvnWgtHLdTLqoLtTOnecCN1caQnUkPmlCETQBWY0f09xAJS101erCo4b97U1gxnlq5RKJRVTc4NqMCgZc0XQweXb-dUd-selshODyc22AXxxvvgBdFu4QFCJQaTC3YKSAzT5tUyPqOj0PY Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f931f3c8815440ae95ea94b76f586260 Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsAdminTestJSON-1287901255 Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:22:57.140318 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f931f3c8815440ae95ea94b76f586260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f931f3c8815440ae95ea94b76f586260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f931f3c8815440ae95ea94b76f586260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f931f3c8815440ae95ea94b76f586260", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsAdminTestJSON-1287901255 Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f931f3c8815440ae95ea94b76f586260 Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1287901255 Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsAdminTestJSON-1287901255-project Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0a2863f5da34393a36abc94a25d77c7 Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsAdminTestJSON-1287901255-project Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "test", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "125163791"}} Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:22:57.141771 n-d-851337-5 devstack@n-api.service[119342]: exception: Flavor 125163791 could not be found. Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '125163791'}}} Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 125163791 could not be found. Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:22:57.143131 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 125163791 could not be found. Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:22:57.144799 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:22:57.146276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:22:57.146276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:22:57.146276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:22:57.146276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 125163791 could not be found. Aug 04 04:22:57.146276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:22:57.148361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3568003d-e97f-4562-9f11-30f53c1a2f4e tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] Returning 400 to user: Flavor 125163791 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:22:57.149388 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3568003d-e97f-4562-9f11-30f53c1a2f4e tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.055925 Aug 04 04:22:57.150613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 21/37] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:57 2022] POST /compute/v2.1/servers => generated 80 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:22:57.273419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b1d85fb-fa26-4b96-a1a6-2e5fd1fca825 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:22:57.318341 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b1d85fb-fa26-4b96-a1a6-2e5fd1fca825 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1240 microversion: 2.1 time: 0.240312 Aug 04 04:22:57.320128 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 17/38] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1240 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:57.327169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c85e7afa-eea2-44f7-953f-ce532b3063a1 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.329849 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:57.329849 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:57.370710 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c85e7afa-eea2-44f7-953f-ce532b3063a1 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/125163791" status: 202 len: 0 microversion: 2.1 time: 0.049021 Aug 04 04:22:57.376600 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 18/39] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:22:57 2022] DELETE /compute/v2.1/flavors/125163791 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:57.386148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a0709c9d-0156-46ec-aa5d-5db00619ad61 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.438318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a0709c9d-0156-46ec-aa5d-5db00619ad61 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.060018 Aug 04 04:22:57.452076 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 19/40] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:57.463443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc724565-cf73-4149-a926-810da15e7046 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1578910063", "id": 1377659824, "os-flavor-access:is_public": "False"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:57.466642 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:57.466642 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:57.495349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:22:57.504175 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc724565-cf73-4149-a926-810da15e7046 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.044070 Aug 04 04:22:57.523359 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:57 2022] POST /compute/v2.1/flavors => generated 415 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:57.528764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70f2c75c-c1e2-47b9-be83-56a006858634 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1753509113", "id": 432809491, "os-flavor-access:is_public": "True"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:57.560378 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70f2c75c-c1e2-47b9-be83-56a006858634 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035877 Aug 04 04:22:57.567684 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 21/42] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:57 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:57.573791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b7c14a6-dba0-495e-a087-0cbf4859f5db tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.598421 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b7c14a6-dba0-495e-a087-0cbf4859f5db tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.028272 Aug 04 04:22:57.598981 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 22/43] 10.222.0.69 () {58 vars in 1169 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:57.612355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc932e5e-9b52-49a4-891d-ee2cd37573d6 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.622680 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc932e5e-9b52-49a4-891d-ee2cd37573d6 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.014312 Aug 04 04:22:57.625027 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 23/44] 10.222.0.69 () {58 vars in 1177 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:57.631199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35402d53-885f-4c50-b49f-38a46a2a2dcb tempest-FlavorsV255TestJSON-824855891 tempest-FlavorsV255TestJSON-824855891-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.636547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d1cb0a79-7ab2-4d59-8ec7-60fd3c41837d tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.653011 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d1cb0a79-7ab2-4d59-8ec7-60fd3c41837d tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.020360 Aug 04 04:22:57.653661 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 24/45] 10.222.0.69 () {58 vars in 1171 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:57.660851 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35402d53-885f-4c50-b49f-38a46a2a2dcb tempest-FlavorsV255TestJSON-824855891 tempest-FlavorsV255TestJSON-824855891-project] 10.222.0.69 "GET /compute/v2.1/flavors/1439828405" status: 200 len: 448 microversion: 2.55 time: 0.508896 Aug 04 04:22:57.668303 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 22/46] 10.222.0.69 () {60 vars in 1199 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/1439828405 => generated 448 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:22:57.670225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da6e7237-b5d8-4138-8bc1-8a0b22e16cff tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.681880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0beaf362-a800-48e2-bc8c-84aecd2543df tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] Action: 'update', calling method: .version_select at 0x7f1921652af0>, body: {"flavor": {"description": "new"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:57.682239 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da6e7237-b5d8-4138-8bc1-8a0b22e16cff tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.018728 Aug 04 04:22:57.690771 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 25/47] 10.222.0.69 () {58 vars in 1169 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:57.696316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76ef273b-53dd-4227-959c-5f3fd94ee453 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.722004 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:57.722004 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:57.722877 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76ef273b-53dd-4227-959c-5f3fd94ee453 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5809 microversion: 2.1 time: 0.030294 Aug 04 04:22:57.724013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 26/48] 10.222.0.69 () {58 vars in 1169 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5809 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:57.750862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9b46514-801c-42e4-9ea6-1925905bd569 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.787634 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0beaf362-a800-48e2-bc8c-84aecd2543df tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/1439828405" status: 200 len: 449 microversion: 2.55 time: 0.109302 Aug 04 04:22:57.790653 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 23/49] 10.222.0.69 () {62 vars in 1219 bytes} [Thu Aug 4 04:22:57 2022] PUT /compute/v2.1/flavors/1439828405 => generated 449 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:22:57.795423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.801578 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9b46514-801c-42e4-9ea6-1925905bd569 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5809 microversion: 2.1 time: 0.060410 Aug 04 04:22:57.802682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:22:57.821268 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 27/50] 10.222.0.69 () {58 vars in 1175 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5809 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:57.839006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dbbb3cb3-6f1a-4bf5-96cb-4953c2406267 tempest-FlavorsV255TestJSON-824855891 tempest-FlavorsV255TestJSON-824855891-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.841248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:57.842372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:57.844624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:57.846731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:57.910157 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dbbb3cb3-6f1a-4bf5-96cb-4953c2406267 tempest-FlavorsV255TestJSON-824855891 tempest-FlavorsV255TestJSON-824855891-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6146 microversion: 2.55 time: 0.086730 Aug 04 04:22:57.919888 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 28/51] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail => generated 6146 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:22:57.929593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9f497271-6f89-4b26-aece-abb7e7d45212 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.953544 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9f497271-6f89-4b26-aece-abb7e7d45212 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5809 microversion: 2.1 time: 0.030403 Aug 04 04:22:57.955199 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 29/52] 10.222.0.69 () {58 vars in 1173 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5809 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:57.967349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5bb68b44-9a35-4e57-bd4c-75693cf7c894 tempest-FlavorsV255TestJSON-824855891 tempest-FlavorsV255TestJSON-824855891-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:57.995016 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5bb68b44-9a35-4e57-bd4c-75693cf7c894 tempest-FlavorsV255TestJSON-824855891 tempest-FlavorsV255TestJSON-824855891-project] 10.222.0.69 "GET /compute/v2.1/flavors" status: 200 len: 3407 microversion: 2.55 time: 0.038288 Aug 04 04:22:57.995868 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 30/53] 10.222.0.69 () {60 vars in 1166 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/flavors => generated 3407 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:22:58.010152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ac0db56e-0958-4da5-abb4-9a3bccaa1221 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.064703 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ac0db56e-0958-4da5-abb4-9a3bccaa1221 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5809 microversion: 2.1 time: 0.059880 Aug 04 04:22:58.066179 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 31/54] 10.222.0.69 () {58 vars in 1169 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5809 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:58.083637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-565b1bc4-e020-4971-922e-53c64166e1cd tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.086780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:22:58.100984 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42a7c841-91f9-47ee-858b-883c977fd4a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1285 microversion: 2.1 time: 0.309069 Aug 04 04:22:58.101889 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 24/55] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:22:57 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1285 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:58.119082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-efc8754e-8b7f-4791-8e41-df356336b856 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.120224 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:58.120224 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:58.129318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-565b1bc4-e020-4971-922e-53c64166e1cd tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1439828405" status: 202 len: 0 microversion: 2.55 time: 0.058778 Aug 04 04:22:58.133170 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 32/56] 10.222.0.69 () {60 vars in 1202 bytes} [Thu Aug 4 04:22:58 2022] DELETE /compute/v2.1/flavors/1439828405 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:22:58.138141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ac2d924-1320-40ec-8819-32296bc3bfa6 tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.155320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-efc8754e-8b7f-4791-8e41-df356336b856 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/432809491" status: 202 len: 0 microversion: 2.1 time: 0.052069 Aug 04 04:22:58.155985 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 25/57] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:22:58 2022] DELETE /compute/v2.1/flavors/432809491 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:58.168171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ade0b81c-141a-4d9f-87e1-7dadd301ff1f tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.172233 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ac2d924-1320-40ec-8819-32296bc3bfa6 tempest-FlavorsV255TestJSON-128392677 tempest-FlavorsV255TestJSON-128392677-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5707 microversion: 2.55 time: 0.037722 Aug 04 04:22:58.173663 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 33/58] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 5707 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:22:58.203131 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ade0b81c-141a-4d9f-87e1-7dadd301ff1f tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040789 Aug 04 04:22:58.204070 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 26/59] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:58.225166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8ce9f23-ed9e-4d1d-b781-cd13c0bc2450 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.259322 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8ce9f23-ed9e-4d1d-b781-cd13c0bc2450 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1377659824" status: 202 len: 0 microversion: 2.1 time: 0.037807 Aug 04 04:22:58.260381 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 34/60] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:22:58 2022] DELETE /compute/v2.1/flavors/1377659824 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:58.269957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36ba9106-33e5-41a8-9072-3b960a57c43a tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.294463 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-36ba9106-33e5-41a8-9072-3b960a57c43a tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029571 Aug 04 04:22:58.295760 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 27/61] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:58.321018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e43d224d-8d55-4214-8661-14647bc114c0 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-493139705", "id": 1148071874, "os-flavor-access:is_public": "False"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:58.340775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.341725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:22:58.350724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:58.353342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:58.355563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:58.358031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:58.379805 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e43d224d-8d55-4214-8661-14647bc114c0 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.062391 Aug 04 04:22:58.380423 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 35/62] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:22:58.392317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f0a7fb2-d4df-4ee4-9f55-4895b746905b tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.440225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f0a7fb2-d4df-4ee4-9f55-4895b746905b tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051638 Aug 04 04:22:58.440809 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 36/63] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:22:58.461719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6679a09-39b8-4219-a984-4f388b677476 tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.498798 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d6679a09-39b8-4219-a984-4f388b677476 tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043566 Aug 04 04:22:58.500280 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 37/64] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:22:58.519156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03976f3a-f7a4-4729-a71f-b59e1195b4e8 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.555365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:22:58.558285 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03976f3a-f7a4-4729-a71f-b59e1195b4e8 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1148071874" status: 202 len: 0 microversion: 2.1 time: 0.043874 Aug 04 04:22:58.562426 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 38/65] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:22:58 2022] DELETE /compute/v2.1/flavors/1148071874 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:58.567344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ea780b6e-dd9a-4741-a9b0-cc886be83b3a tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1240 microversion: 2.1 time: 0.229167 Aug 04 04:22:58.571577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b44f929-ca4a-4448-871b-69354b753382 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.580159 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 28/66] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1240 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:22:58.609821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b44f929-ca4a-4448-871b-69354b753382 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041493 Aug 04 04:22:58.612294 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 39/67] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:22:58.642725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eee4b8e7-a73a-4cc8-ae6f-7192fd13c020 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-626946945", "id": 2112454518, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:22:58.647977 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:58.647977 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:58.684323 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eee4b8e7-a73a-4cc8-ae6f-7192fd13c020 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.047955 Aug 04 04:22:58.690369 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 29/68] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:22:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:58.703797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44ce513f-4a9d-4bb3-b21b-554c39dde385 tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.748744 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44ce513f-4a9d-4bb3-b21b-554c39dde385 tempest-FlavorsAdminTestJSON-1287901255 tempest-FlavorsAdminTestJSON-1287901255-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.049630 Aug 04 04:22:58.762245 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 40/69] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:58.769016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a55c4da-48cd-4ac4-bb90-0cdb291c7434 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.770077 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:58.770077 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:22:58.803052 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a55c4da-48cd-4ac4-bb90-0cdb291c7434 tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/2112454518" status: 202 len: 0 microversion: 2.1 time: 0.039172 Aug 04 04:22:58.807160 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 30/70] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:22:58 2022] DELETE /compute/v2.1/flavors/2112454518 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:22:58.814288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6ec4c41-bbaa-432d-88bb-6cd027a284ae tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:58.842121 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d6ec4c41-bbaa-432d-88bb-6cd027a284ae tempest-FlavorsAdminTestJSON-45197364 tempest-FlavorsAdminTestJSON-45197364-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032382 Aug 04 04:22:58.851566 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 41/71] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:59.123394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:59.124015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:22:59.149639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.150083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.153277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.167798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.350996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:22:59.365512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb73bb83-231f-4898-a469-b03daebf9c8b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1291 microversion: 2.1 time: 0.241916 Aug 04 04:22:59.367078 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 31/72] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:22:59 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1291 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:59.592723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:59.593587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:22:59.609492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.610064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.611450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.612094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.772582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f19206adb80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:59.773638 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:59.773638 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:59.778381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.783574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.814388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.816265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.846011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.848210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.871392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cbaec0f8-97e2-4b7c-abd5-39aa633a32f4 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.607025 Aug 04 04:22:59.883298 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 42/73] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:22:59.893698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f19206addc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:22:59.895732 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:22:59.895732 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:22:59.900524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.901140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.930110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.933383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.963964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:22:59.964336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:22:59.980193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-530d1b14-fca4-4ec2-8b76-ce818baf1bca tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.093724 Aug 04 04:22:59.993931 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 43/74] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Aug 4 04:22:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:22:59.999714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f19206adf70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.000775 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:00.000775 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:00.002924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.003518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.020561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.021407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.034161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.034687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.043229 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9ac07b5-b76b-4bec-b1b3-ce1ff6687616 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047700 Aug 04 04:23:00.044177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 44/75] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:22:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:00.057710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a866f79f-2230-4864-a8b9-24860415e3df tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f19206ade50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.057964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:00.058679 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:00.058679 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:00.060034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a866f79f-2230-4864-a8b9-24860415e3df tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.060725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a866f79f-2230-4864-a8b9-24860415e3df tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.071178 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c454b149-9ef6-4e29-ac58-da14ed625e82 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1294 microversion: 2.1 time: 0.481436 Aug 04 04:23:00.075924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 32/76] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:22:59 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1294 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:00.086130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a866f79f-2230-4864-a8b9-24860415e3df tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.086910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a866f79f-2230-4864-a8b9-24860415e3df tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.117500 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a866f79f-2230-4864-a8b9-24860415e3df tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.063246 Aug 04 04:23:00.138683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27060e07-63b1-4152-9ef2-7fdc6d29230b tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f191b679700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.139865 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 45/77] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:00.140200 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:00.140200 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:00.142130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27060e07-63b1-4152-9ef2-7fdc6d29230b tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.142585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27060e07-63b1-4152-9ef2-7fdc6d29230b tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.198969 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27060e07-63b1-4152-9ef2-7fdc6d29230b tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.064509 Aug 04 04:23:00.220388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f19206ad040>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.221364 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:00.221364 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:00.223044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.223649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.227510 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 33/78] 10.222.0.69 () {58 vars in 1179 bytes} [Thu Aug 4 04:23:00 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:00.239844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.240447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.253380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.253988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.261612 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb481d6d-a5c6-4f5d-bd27-d91558d3296e tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045346 Aug 04 04:23:00.273411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27c7fa46-bd17-43f1-8bd3-0fd997a73aad tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f191b679ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.274897 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:00.274897 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:00.276948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c7fa46-bd17-43f1-8bd3-0fd997a73aad tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.277658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c7fa46-bd17-43f1-8bd3-0fd997a73aad tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.280269 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 46/79] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:00.300187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c7fa46-bd17-43f1-8bd3-0fd997a73aad tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.300942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c7fa46-bd17-43f1-8bd3-0fd997a73aad tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.308347 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27c7fa46-bd17-43f1-8bd3-0fd997a73aad tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.038707 Aug 04 04:23:00.326439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e643db93-6f2e-44e4-b771-d58980c302d9 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f19206ad670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.328626 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:00.328626 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:00.330777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e643db93-6f2e-44e4-b771-d58980c302d9 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.331486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e643db93-6f2e-44e4-b771-d58980c302d9 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.334385 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 34/80] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:00.347281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e643db93-6f2e-44e4-b771-d58980c302d9 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.348097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e643db93-6f2e-44e4-b771-d58980c302d9 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.355591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e643db93-6f2e-44e4-b771-d58980c302d9 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.035036 Aug 04 04:23:00.366694 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 47/81] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:00 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:00.372455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Calling method '.version_select at 0x7f191b679550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.373591 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:00.373591 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:00.375178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.375880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.389096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:00.390108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:00.408583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.409446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.411588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.412203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.412940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.415026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.442286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.443483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.459688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3e9d1ef-4b94-4db0-801c-9a672dfe9211 tempest-HypervisorAdminTestJSON-1566147991 tempest-HypervisorAdminTestJSON-1566147991-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:23:00.461341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685f4608-5f27-4c9a-9894-076eb2ba23cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.464694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685f4608-5f27-4c9a-9894-076eb2ba23cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.465937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685f4608-5f27-4c9a-9894-076eb2ba23cb None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:00.467848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685f4608-5f27-4c9a-9894-076eb2ba23cb None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:00.496903 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.compute.rpcapi [None req-685f4608-5f27-4c9a-9894-076eb2ba23cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 04:23:00.499156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685f4608-5f27-4c9a-9894-076eb2ba23cb None None] Releasing lock "compute-rpcapi-router" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:23:00.594582 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-685f4608-5f27-4c9a-9894-076eb2ba23cb None None] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.225653 Aug 04 04:23:00.595929 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 35/82] 10.222.0.69 () {58 vars in 1173 bytes} [Thu Aug 4 04:23:00 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:00.997453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:01.035083 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc2995c0-ce05-49d3-ba97-1910cf197ccf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1291 microversion: 2.1 time: 0.647481 Aug 04 04:23:01.040820 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 48/83] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:00 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1291 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:01.098780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:01.099573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:01.126643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:01.128632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:01.130865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:01.135743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:01.414754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:01.432929 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d2667e2-48c2-449b-a47f-d9c3a12b95e7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1294 microversion: 2.1 time: 0.338447 Aug 04 04:23:01.456321 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 36/84] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:01 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1294 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:02.056541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:02.058211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:02.079187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:02.079888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:02.081455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:02.085227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:02.465949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:02.468552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:02.506642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:02.507852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:02.509707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:02.510856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:03.479230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:03.492454 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-87c0f5d7-fe18-46dd-b367-41b8511f80a0 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1294 microversion: 2.1 time: 1.033760 Aug 04 04:23:03.495698 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 37/85] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:02 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1294 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:03.828372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:03.848101 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6e9771c-96f4-4aa9-9447-c20f9ef0cd0e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 1.795170 Aug 04 04:23:03.861980 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 49/86] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:02 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:04.519381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:04.520145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:04.553934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:04.554610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:04.555691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:04.556138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:04.875084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:04.875715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:04.889750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:04.890475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:04.899180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:04.900821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:05.737333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:05.751946 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4900eb6e-bfc0-4daa-bc04-4ea81f0137c4 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 1.237037 Aug 04 04:23:05.753182 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 38/87] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:04 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:05.991439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:06.007010 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-150401ab-5f47-48b4-9ab4-a4f2fadf1524 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 1.134057 Aug 04 04:23:06.009287 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 50/88] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:04 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:06.774119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:06.775682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:06.785523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:06.793245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:06.794111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:06.795358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:06.801171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:07.038246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:07.038246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:07.042620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:07.046864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:07.050323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:07.051868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:07.052309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:07.315289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:07.369658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:07.389789 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57f45402-c3e4-4fdc-9bb7-d13190dd2d8f tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.619555 Aug 04 04:23:07.395768 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 39/89] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:06 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:08.415771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:08.417316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:08.449223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:08.452155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:08.459910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:08.461585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:09.231717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:09.241276 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2e6c0b54-ae9a-4862-a481-411a791565c5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 2.212361 Aug 04 04:23:09.247594 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 51/90] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:07 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:09.540760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:09.558189 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6c7b90a-8c6c-4a04-8da9-ce39da681b06 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 1.145550 Aug 04 04:23:09.559935 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 40/91] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:08 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:10.001800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-aa027f61-8372-489b-be83-db571b5c4c73 req-cdc8d1de-265b-4326-8e0f-4b9eb7cf3981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97ea115-9836-44d8-b12e-674b6434a8b7", "tag": "0548d468-cd23-4c32-ac67-82a9fc6f4186"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:10.038150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-aa027f61-8372-489b-be83-db571b5c4c73 req-cdc8d1de-265b-4326-8e0f-4b9eb7cf3981 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:10.039863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-aa027f61-8372-489b-be83-db571b5c4c73 req-cdc8d1de-265b-4326-8e0f-4b9eb7cf3981 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:10.106421 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-aa027f61-8372-489b-be83-db571b5c4c73 req-cdc8d1de-265b-4326-8e0f-4b9eb7cf3981 service nova] Creating event network-changed:0548d468-cd23-4c32-ac67-82a9fc6f4186 for instance a97ea115-9836-44d8-b12e-674b6434a8b7 on n-h2-851337-5 Aug 04 04:23:10.111191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-aa027f61-8372-489b-be83-db571b5c4c73 req-cdc8d1de-265b-4326-8e0f-4b9eb7cf3981 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:23:10.115964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-391abda2-86c0-464a-8021-35502eaf7a91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:10.118055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-391abda2-86c0-464a-8021-35502eaf7a91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:10.119074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-391abda2-86c0-464a-8021-35502eaf7a91 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:10.124610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-391abda2-86c0-464a-8021-35502eaf7a91 None None] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:10.152041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.rpcapi [None req-391abda2-86c0-464a-8021-35502eaf7a91 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 04:23:10.152937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-391abda2-86c0-464a-8021-35502eaf7a91 None None] Releasing lock "compute-rpcapi-router" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:23:10.214166 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-391abda2-86c0-464a-8021-35502eaf7a91 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.965115 Aug 04 04:23:10.214776 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 52/92] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:10.264837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:10.265541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:10.284645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:10.287108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:10.292298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:10.295403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:10.392769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bdf5da1f-f2c3-4034-9d60-a27df9d89e6a tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-196555819", "id": 2047012734, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:10.398152 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:10.398152 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:10.497350 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bdf5da1f-f2c3-4034-9d60-a27df9d89e6a tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.934075 Aug 04 04:23:10.500306 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 41/93] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:23:09 2022] POST /compute/v2.1/flavors => generated 467 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:10.527143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:10.870360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:10.879383 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6ecee25b-91d0-4638-bf5d-bd58f6fb4983 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.618644 Aug 04 04:23:10.880531 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 53/94] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:10 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:10.904641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:10.905547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:10.913737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:10.914480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:10.915655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:10.917202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:11.021921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-de36381d-0e68-4ea3-852c-32bb46d12fbd tempest-FlavorsV261TestJSON-660579868 tempest-FlavorsV261TestJSON-660579868-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:11.049499 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-de36381d-0e68-4ea3-852c-32bb46d12fbd tempest-FlavorsV261TestJSON-660579868 tempest-FlavorsV261TestJSON-660579868-project] 10.222.0.69 "GET /compute/v2.1/flavors/2047012734" status: 200 len: 467 microversion: 2.61 time: 0.536132 Aug 04 04:23:11.069780 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 42/95] 10.222.0.69 () {60 vars in 1199 bytes} [Thu Aug 4 04:23:10 2022] GET /compute/v2.1/flavors/2047012734 => generated 467 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:11.075170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7b58f5da-effc-4d8b-bdcb-8243a6635fc8 tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:11.078696 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:11.078696 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:11.131251 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7b58f5da-effc-4d8b-bdcb-8243a6635fc8 tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/2047012734" status: 200 len: 468 microversion: 2.61 time: 0.059441 Aug 04 04:23:11.141073 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 43/96] 10.222.0.69 () {62 vars in 1219 bytes} [Thu Aug 4 04:23:11 2022] PUT /compute/v2.1/flavors/2047012734 => generated 468 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:11.147669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5f4c3d7-61a2-4972-a7a0-537829a85f1a tempest-FlavorsV261TestJSON-660579868 tempest-FlavorsV261TestJSON-660579868-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:11.195041 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5f4c3d7-61a2-4972-a7a0-537829a85f1a tempest-FlavorsV261TestJSON-660579868 tempest-FlavorsV261TestJSON-660579868-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.049143 Aug 04 04:23:11.196290 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 44/97] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:23:11 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:23:11.224520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-de77da66-a43e-4f36-b7ba-97566f792a93 tempest-FlavorsV261TestJSON-660579868 tempest-FlavorsV261TestJSON-660579868-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:11.269856 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-de77da66-a43e-4f36-b7ba-97566f792a93 tempest-FlavorsV261TestJSON-660579868 tempest-FlavorsV261TestJSON-660579868-project] 10.222.0.69 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.050344 Aug 04 04:23:11.271113 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 45/98] 10.222.0.69 () {60 vars in 1166 bytes} [Thu Aug 4 04:23:11 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:23:11.293324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39ccc4ac-4751-40e3-a123-e699967655f9 tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:11.304780 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:11.304780 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:11.312781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:11.326848 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c155d184-1563-4b03-bb76-8ea50390691c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.444754 Aug 04 04:23:11.327958 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 54/99] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:10 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:11.386048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39ccc4ac-4751-40e3-a123-e699967655f9 tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/2047012734" status: 202 len: 0 microversion: 2.61 time: 0.098258 Aug 04 04:23:11.390103 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 46/100] 10.222.0.69 () {60 vars in 1202 bytes} [Thu Aug 4 04:23:11 2022] DELETE /compute/v2.1/flavors/2047012734 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:23:11.401700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dc0ad89f-630f-4dae-acb1-ed4c00828c51 tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:11.451371 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dc0ad89f-630f-4dae-acb1-ed4c00828c51 tempest-FlavorsV261TestJSON-1968282823 tempest-FlavorsV261TestJSON-1968282823-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.050153 Aug 04 04:23:11.468637 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 55/101] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:23:11 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:23:11.902454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:11.903603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:11.913953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:11.915361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:11.917115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:11.917876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:12.160101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:12.170403 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc1be8be-8d45-41e0-a309-efb6a159b1e8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.272492 Aug 04 04:23:12.171512 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 47/102] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:11 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:12.357674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:12.358287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:12.370713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:12.371192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:12.371972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:12.372402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:12.495135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88fd9ae8-77a8-485a-b26e-dc280d26aebf tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Calling method '.version_select at 0x7f19205e6940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:12.496251 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:12.496251 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:12.503052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-88fd9ae8-77a8-485a-b26e-dc280d26aebf tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b1bce8b75db24a1d9aa96cc0f8144623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef06a469562645f68fb337e164e5584c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88fd9ae8-77a8-485a-b26e-dc280d26aebf tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Request method failure captured: Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ms-q2bv5FOrqDo6DC3bXYL4VFEwcDqHfXxRJK-iKFni1lBn1wrvvvTGVuXk8dHEGmxFQs1qP6nZDVZVU81XeP91YQkVMvT5lW8VfeeuoiyNC0QZZWWL1cjCqM3spOsgvYg48hQuWKAZuc9Vo7yfY2WfWVxaoNcj0JCqDvFQf83t4g Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:12.511843 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ef06a469562645f68fb337e164e5584c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ef06a469562645f68fb337e164e5584c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b1bce8b75db24a1d9aa96cc0f8144623 Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: action_args: {} Aug 04 04:23:12.513273 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:12.514128 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 04:23:12.515485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.518052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88fd9ae8-77a8-485a-b26e-dc280d26aebf tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:12.519036 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-88fd9ae8-77a8-485a-b26e-dc280d26aebf tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.413947 Aug 04 04:23:12.520922 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 56/103] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Aug 4 04:23:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 416 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:23:12.533048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a08a7cc2-0526-4af5-aa87-25230e7d2e24 tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Calling method '.version_select at 0x7f192064d8b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:12.534391 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:12.534391 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:12.537330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a08a7cc2-0526-4af5-aa87-25230e7d2e24 tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b1bce8b75db24a1d9aa96cc0f8144623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef06a469562645f68fb337e164e5584c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a08a7cc2-0526-4af5-aa87-25230e7d2e24 tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Request method failure captured: Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ms-q2bv5FOrqDo6DC3bXYL4VFEwcDqHfXxRJK-iKFni1lBn1wrvvvTGVuXk8dHEGmxFQs1qP6nZDVZVU81XeP91YQkVMvT5lW8VfeeuoiyNC0QZZWWL1cjCqM3spOsgvYg48hQuWKAZuc9Vo7yfY2WfWVxaoNcj0JCqDvFQf83t4g Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:12.540693 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ef06a469562645f68fb337e164e5584c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ef06a469562645f68fb337e164e5584c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b1bce8b75db24a1d9aa96cc0f8144623 Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: action_args: {} Aug 04 04:23:12.541960 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:12.542773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 04:23:12.543950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.546809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a08a7cc2-0526-4af5-aa87-25230e7d2e24 tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:12.549120 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a08a7cc2-0526-4af5-aa87-25230e7d2e24 tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.023382 Aug 04 04:23:12.551592 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 57/104] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:12 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:12.569966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7f5e9bcf-98c7-4903-98ef-f5a5a7fd2727 req-7266d03c-b001-470e-b125-6fca1f7a217c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f7b417-b7c3-4a6b-a229-ab7b635a84fc", "tag": "3179942a-f3a2-4e28-b99e-3553e28c7c62"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:12.600984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f5e9bcf-98c7-4903-98ef-f5a5a7fd2727 req-7266d03c-b001-470e-b125-6fca1f7a217c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:12.601585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f5e9bcf-98c7-4903-98ef-f5a5a7fd2727 req-7266d03c-b001-470e-b125-6fca1f7a217c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:12.615584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7f5e9bcf-98c7-4903-98ef-f5a5a7fd2727 req-7266d03c-b001-470e-b125-6fca1f7a217c service nova] Creating event network-changed:3179942a-f3a2-4e28-b99e-3553e28c7c62 for instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc on n-h2-851337-5 Aug 04 04:23:12.621972 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7f5e9bcf-98c7-4903-98ef-f5a5a7fd2727 req-7266d03c-b001-470e-b125-6fca1f7a217c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061462 Aug 04 04:23:12.623164 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 58/105] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:12.629621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d6decaf-9461-4c94-bddd-2ac4a5e0c1fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Calling method '.version_select at 0x7f192063c700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:12.630784 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:12.630784 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:12.632152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8d6decaf-9461-4c94-bddd-2ac4a5e0c1fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b1bce8b75db24a1d9aa96cc0f8144623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef06a469562645f68fb337e164e5584c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d6decaf-9461-4c94-bddd-2ac4a5e0c1fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Request method failure captured: Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ms-q2bv5FOrqDo6DC3bXYL4VFEwcDqHfXxRJK-iKFni1lBn1wrvvvTGVuXk8dHEGmxFQs1qP6nZDVZVU81XeP91YQkVMvT5lW8VfeeuoiyNC0QZZWWL1cjCqM3spOsgvYg48hQuWKAZuc9Vo7yfY2WfWVxaoNcj0JCqDvFQf83t4g Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:12.633958 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ef06a469562645f68fb337e164e5584c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ef06a469562645f68fb337e164e5584c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b1bce8b75db24a1d9aa96cc0f8144623 Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: action_args: {} Aug 04 04:23:12.635161 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:12.635802 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 04:23:12.636750 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:12.638866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d6decaf-9461-4c94-bddd-2ac4a5e0c1fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:12.640034 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8d6decaf-9461-4c94-bddd-2ac4a5e0c1fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015566 Aug 04 04:23:12.640740 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 59/106] 10.222.0.69 () {58 vars in 1179 bytes} [Thu Aug 4 04:23:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:12.725950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:12.735782 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffb1dbf3-6238-4fdb-9211-c551a256cdbb tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.381921 Aug 04 04:23:12.750174 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 48/107] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:12 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:12.994088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Calling method '.version_select at 0x7f192064dee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:12.994923 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:12.994923 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:12.996175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:12.996613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.021920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:DELETE=9 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:13.028853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.029544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.062126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.062817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.066824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:13.076529 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-370fd82e-8869-49ff-8945-179e08b3783a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.426831 Aug 04 04:23:13.079459 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 60/108] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:13.095771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27083985-7c95-4443-8fb7-2eca7636a8fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Calling method '.version_select at 0x7f192063c940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:13.097281 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:13.097281 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:13.098994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-27083985-7c95-4443-8fb7-2eca7636a8fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b1bce8b75db24a1d9aa96cc0f8144623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef06a469562645f68fb337e164e5584c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27083985-7c95-4443-8fb7-2eca7636a8fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Request method failure captured: Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ms-q2bv5FOrqDo6DC3bXYL4VFEwcDqHfXxRJK-iKFni1lBn1wrvvvTGVuXk8dHEGmxFQs1qP6nZDVZVU81XeP91YQkVMvT5lW8VfeeuoiyNC0QZZWWL1cjCqM3spOsgvYg48hQuWKAZuc9Vo7yfY2WfWVxaoNcj0JCqDvFQf83t4g Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:13.102133 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ef06a469562645f68fb337e164e5584c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ef06a469562645f68fb337e164e5584c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b1bce8b75db24a1d9aa96cc0f8144623 Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1'} Aug 04 04:23:13.103470 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:13.104359 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 04:23:13.105382 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.107423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27083985-7c95-4443-8fb7-2eca7636a8fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:13.109382 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27083985-7c95-4443-8fb7-2eca7636a8fe tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.022554 Aug 04 04:23:13.115354 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 61/109] 10.222.0.69 () {58 vars in 1173 bytes} [Thu Aug 4 04:23:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:13.122577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f9897f3-b6f1-43ae-8cc6-0f5b3464de8c tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Calling method '.version_select at 0x7f19205db670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:13.128208 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0f9897f3-b6f1-43ae-8cc6-0f5b3464de8c tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] HTTP exception thrown: Hypervisor with ID '30276af6-5749-4506-83ac-8e85cf0e121b' could not be found. Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f9897f3-b6f1-43ae-8cc6-0f5b3464de8c tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Request method failure captured: Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors/30276af6-5749-4506-83ac-8e85cf0e121b/uptime HTTP/1.1 Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mvrnruspnELgctC00YrFivWa6UU-p7ePd5Py89yd1HtXMIQQ9YOENXUmsMqLqxWDVG9MVcj8YmWAHUBWxckKfJC5UrgGfRpqOyebphXkO91rWOWuVKxXBSybhhpWQ7P9zwZP-JOMmMeojd0lqdCvTJ_z0t-O8vGJoZqtUnoQMywR4 Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 8b1adec205cd44569491dfb066b82e98 Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1826230421 Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:13.147688 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b1adec205cd44569491dfb066b82e98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b1adec205cd44569491dfb066b82e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b1adec205cd44569491dfb066b82e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b1adec205cd44569491dfb066b82e98", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1826230421 Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 8b1adec205cd44569491dfb066b82e98 Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1826230421 Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 909e8269e6194b8899cdd60462aa09c9 Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: exception: Hypervisor with ID '30276af6-5749-4506-83ac-8e85cf0e121b' could not be found. Aug 04 04:23:13.148899 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '30276af6-5749-4506-83ac-8e85cf0e121b'} Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '30276af6-5749-4506-83ac-8e85cf0e121b' Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 04:23:13.149577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '30276af6-5749-4506-83ac-8e85cf0e121b' could not be found. Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.150672 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '30276af6-5749-4506-83ac-8e85cf0e121b' could not be found. Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f9897f3-b6f1-43ae-8cc6-0f5b3464de8c tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Returning 404 to user: Hypervisor with ID '30276af6-5749-4506-83ac-8e85cf0e121b' could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0f9897f3-b6f1-43ae-8cc6-0f5b3464de8c tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/30276af6-5749-4506-83ac-8e85cf0e121b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.032398 Aug 04 04:23:13.151876 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 62/110] 10.222.0.69 () {58 vars in 1278 bytes} [Thu Aug 4 04:23:13 2022] GET /compute/v2.1/os-hypervisors/30276af6-5749-4506-83ac-8e85cf0e121b/uptime => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:13.162329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Calling method '.version_select at 0x7f192064d3a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:13.163208 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:13.163208 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:13.164417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.164868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.194885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.195282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.210818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e966de8-6907-4ea0-8453-8fbce4c8b0c5 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1050983546", "id": 1565893272, "os-flavor-access:is_public": "False"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:13.218619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.221330 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:13.221330 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:13.221938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.237475 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9da9ef9c-31bd-4369-b65f-70db4b23a4ce tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079188 Aug 04 04:23:13.241094 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 63/111] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:23:13.257467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:13.258532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:13.269309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.273175 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e966de8-6907-4ea0-8453-8fbce4c8b0c5 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.449969 Aug 04 04:23:13.274477 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 49/112] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:12 2022] POST /compute/v2.1/flavors => generated 439 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:13.281970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-221476c3-97f6-411c-8127-ed71b78ec16d tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Calling method '.version_select at 0x7f191b570ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:13.282256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.283191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.283494 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:13.283494 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:13.283714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.285128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-221476c3-97f6-411c-8127-ed71b78ec16d tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b1bce8b75db24a1d9aa96cc0f8144623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef06a469562645f68fb337e164e5584c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-221476c3-97f6-411c-8127-ed71b78ec16d tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Request method failure captured: Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60ms-q2bv5FOrqDo6DC3bXYL4VFEwcDqHfXxRJK-iKFni1lBn1wrvvvTGVuXk8dHEGmxFQs1qP6nZDVZVU81XeP91YQkVMvT5lW8VfeeuoiyNC0QZZWWL1cjCqM3spOsgvYg48hQuWKAZuc9Vo7yfY2WfWVxaoNcj0JCqDvFQf83t4g Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:13.290685 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ef06a469562645f68fb337e164e5584c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ef06a469562645f68fb337e164e5584c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ef06a469562645f68fb337e164e5584c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ef06a469562645f68fb337e164e5584c Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-868210750 Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b1bce8b75db24a1d9aa96cc0f8144623 Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-868210750-project Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '1'} Aug 04 04:23:13.291843 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:13.292556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 04:23:13.293471 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.299280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-221476c3-97f6-411c-8127-ed71b78ec16d tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:13.300749 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-221476c3-97f6-411c-8127-ed71b78ec16d tempest-HypervisorAdminNegativeTestJSON-868210750 tempest-HypervisorAdminNegativeTestJSON-868210750-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.024391 Aug 04 04:23:13.310722 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 50/113] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:13.316590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b83e713-3cc0-46f0-81e1-470e9075ba47 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:13.330593 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:13.330593 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:13.679574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:13.695012 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-079bbcd8-b89b-4d2e-a3b6-fa73508e73b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.452484 Aug 04 04:23:13.702992 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 64/114] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:13 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:13.702992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-feb3ace3-19c6-41a1-bd24-1267c7cab82a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Calling method '.version_select at 0x7f1920596700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:13.702992 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:13.702992 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:13.702992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-feb3ace3-19c6-41a1-bd24-1267c7cab82a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] HTTP exception thrown: Hypervisor with ID '6660e51c-528f-49be-8922-6c4767ccc8dc' could not be found. Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-feb3ace3-19c6-41a1-bd24-1267c7cab82a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Request method failure captured: Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors/6660e51c-528f-49be-8922-6c4767ccc8dc HTTP/1.1 Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mvrnruspnELgctC00YrFivWa6UU-p7ePd5Py89yd1HtXMIQQ9YOENXUmsMqLqxWDVG9MVcj8YmWAHUBWxckKfJC5UrgGfRpqOyebphXkO91rWOWuVKxXBSybhhpWQ7P9zwZP-JOMmMeojd0lqdCvTJ_z0t-O8vGJoZqtUnoQMywR4 Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 8b1adec205cd44569491dfb066b82e98 Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1826230421 Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:13.705005 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b1adec205cd44569491dfb066b82e98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b1adec205cd44569491dfb066b82e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b1adec205cd44569491dfb066b82e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b1adec205cd44569491dfb066b82e98", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1826230421 Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 8b1adec205cd44569491dfb066b82e98 Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1826230421 Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 909e8269e6194b8899cdd60462aa09c9 Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: exception: Hypervisor with ID '6660e51c-528f-49be-8922-6c4767ccc8dc' could not be found. Aug 04 04:23:13.706066 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6660e51c-528f-49be-8922-6c4767ccc8dc'} Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6660e51c-528f-49be-8922-6c4767ccc8dc' Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 04:23:13.706783 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:23:13.707845 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6660e51c-528f-49be-8922-6c4767ccc8dc' could not be found. Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6660e51c-528f-49be-8922-6c4767ccc8dc' could not be found. Aug 04 04:23:13.708819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:13.710542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-feb3ace3-19c6-41a1-bd24-1267c7cab82a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] Returning 404 to user: Hypervisor with ID '6660e51c-528f-49be-8922-6c4767ccc8dc' could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:13.711455 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-feb3ace3-19c6-41a1-bd24-1267c7cab82a tempest-HypervisorAdminNegativeTestJSON-1826230421 tempest-HypervisorAdminNegativeTestJSON-1826230421-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/6660e51c-528f-49be-8922-6c4767ccc8dc" status: 404 len: 123 microversion: 2.1 time: 0.014447 Aug 04 04:23:13.712264 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 65/115] 10.222.0.69 () {58 vars in 1257 bytes} [Thu Aug 4 04:23:13 2022] GET /compute/v2.1/os-hypervisors/6660e51c-528f-49be-8922-6c4767ccc8dc => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:13.758903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:13.759730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:13.771693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.774036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.775119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:13.778456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:13.889513 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b83e713-3cc0-46f0-81e1-470e9075ba47 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1565893272/action" status: 200 len: 97 microversion: 2.1 time: 0.577053 Aug 04 04:23:13.895997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 51/116] 10.222.0.69 () {60 vars in 1200 bytes} [Thu Aug 4 04:23:13 2022] POST /compute/v2.1/flavors/1565893272/action => generated 97 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:23:13.913127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-626f0bb5-1b6b-468b-96ce-b1d7e9d173c2 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:14.153345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:14.167315 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08ebdf89-768c-4635-9b2e-3d20954a7c5c tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.410333 Aug 04 04:23:14.168558 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 66/117] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:13 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:14.374875 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-626f0bb5-1b6b-468b-96ce-b1d7e9d173c2 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] HTTP exception thrown: Flavor access already exists for flavor 28 and project 9853f451247c44b98f4915e3026fdd2b combination. Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-626f0bb5-1b6b-468b-96ce-b1d7e9d173c2 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Request method failure captured: Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/flavors/1565893272/action HTTP/1.1 Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 67 Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mvYglV6eG6DYrQaRQbgjPOWza-r9G4BHVV8rEAoyRqNpnspMEuD5idHi84i-TP1i0LHac4PPiXrIZdpcesmEFhwNZndNserYn5bJXNwkIKDFf9npE-VJ0gbb_7wrsGEWNDy45iN4SljDu9uAnc0-SHrwLEjPaKlp45A1FubmbKd_8 Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 382016faa58045e4a433fc85898934a3 Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:14.400861 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/382016faa58045e4a433fc85898934a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/382016faa58045e4a433fc85898934a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/382016faa58045e4a433fc85898934a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_382016faa58045e4a433fc85898934a3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 382016faa58045e4a433fc85898934a3 Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f746ce1bb3aa4506a69812216c12b246 Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: {"addTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} Aug 04 04:23:14.402290 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: exception: Flavor access already exists for flavor 28 and project 9853f451247c44b98f4915e3026fdd2b combination. Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '1565893272', 'body': {'addTenantAccess': {'tenant': '9853f451247c44b98f4915e3026fdd2b'}}} Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result.read() Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:23:14.403410 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '28-9853f451247c44b98f4915e3026fdd2b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:23:14.404559 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:23:14.405836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:23:14.407345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result.read() Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '28-9853f451247c44b98f4915e3026fdd2b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 4, 23, 14, 358643), 'updated_at': None, 'flavor_id': 28, 'project_id': '9853f451247c44b98f4915e3026fdd2b'}] Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:14.408507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 28 and project 9853f451247c44b98f4915e3026fdd2b combination. Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:14.409480 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 28 and project 9853f451247c44b98f4915e3026fdd2b combination. Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:14.413276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:14.414682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 28 and project 9853f451247c44b98f4915e3026fdd2b combination. Aug 04 04:23:14.414682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:14.414682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-626f0bb5-1b6b-468b-96ce-b1d7e9d173c2 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Returning 409 to user: Flavor access already exists for flavor 28 and project 9853f451247c44b98f4915e3026fdd2b combination. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:14.415374 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-626f0bb5-1b6b-468b-96ce-b1d7e9d173c2 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1565893272/action" status: 409 len: 152 microversion: 2.1 time: 0.509695 Aug 04 04:23:14.416421 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 52/118] 10.222.0.69 () {60 vars in 1200 bytes} [Thu Aug 4 04:23:13 2022] POST /compute/v2.1/flavors/1565893272/action => generated 152 bytes in 515 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:14.424526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78451546-0818-4cea-806c-f44b7e4e2c37 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:14.427370 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:14.427370 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:14.717773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:14.718270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:14.746208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:14.746685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:14.748237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:14.748680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:15.052306 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78451546-0818-4cea-806c-f44b7e4e2c37 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1565893272/action" status: 200 len: 21 microversion: 2.1 time: 0.631593 Aug 04 04:23:15.058635 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 67/119] 10.222.0.69 () {60 vars in 1200 bytes} [Thu Aug 4 04:23:14 2022] POST /compute/v2.1/flavors/1565893272/action => generated 21 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:23:15.067744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb0a8bb6-a5c1-43f5-8667-772a5a4c52a3 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.068850 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:15.068850 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:15.107737 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb0a8bb6-a5c1-43f5-8667-772a5a4c52a3 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1565893272" status: 202 len: 0 microversion: 2.1 time: 0.047717 Aug 04 04:23:15.113023 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 68/120] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:23:15 2022] DELETE /compute/v2.1/flavors/1565893272 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:23:15.119457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b6e07606-297c-4b90-8cc7-6abd80a381c6 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.166160 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b6e07606-297c-4b90-8cc7-6abd80a381c6 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051534 Aug 04 04:23:15.167974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:15.177088 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fe2f3afe-85ec-4b94-93e8-602f6c2cb36b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.463197 Aug 04 04:23:15.182306 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 69/121] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:15.182935 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 53/122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:14 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:15.191983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b5bd434-0c66-4b3c-90fd-2f4ed5e6ac77 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2095967937", "id": 889242343, "os-flavor-access:is_public": "True"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:15.198275 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:15.198275 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:15.208074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.209150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:15.220929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:15.224027 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b5bd434-0c66-4b3c-90fd-2f4ed5e6ac77 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.040551 Aug 04 04:23:15.226358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:15.227009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:15.233222 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 70/123] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:15 2022] POST /compute/v2.1/flavors => generated 435 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:15.234085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:15.238092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:15.243900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5931cd1-2cdb-4037-8ae5-7ef57d70f4b0 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.244669 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:15.244669 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:15.262015 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e5931cd1-2cdb-4037-8ae5-7ef57d70f4b0 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5931cd1-2cdb-4037-8ae5-7ef57d70f4b0 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Request method failure captured: Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/flavors/889242343/os-flavor-access HTTP/1.1 Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mvYglV6eG6DYrQaRQbgjPOWza-r9G4BHVV8rEAoyRqNpnspMEuD5idHi84i-TP1i0LHac4PPiXrIZdpcesmEFhwNZndNserYn5bJXNwkIKDFf9npE-VJ0gbb_7wrsGEWNDy45iN4SljDu9uAnc0-SHrwLEjPaKlp45A1FubmbKd_8 Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 382016faa58045e4a433fc85898934a3 Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:15.264117 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/382016faa58045e4a433fc85898934a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/382016faa58045e4a433fc85898934a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/382016faa58045e4a433fc85898934a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_382016faa58045e4a433fc85898934a3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 382016faa58045e4a433fc85898934a3 Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f746ce1bb3aa4506a69812216c12b246 Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: exception: Access list not available for public flavors. Aug 04 04:23:15.265186 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'flavor_id': '889242343'} Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 04 04:23:15.265831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:15.266907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5931cd1-2cdb-4037-8ae5-7ef57d70f4b0 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:15.268906 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5931cd1-2cdb-4037-8ae5-7ef57d70f4b0 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/889242343/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033137 Aug 04 04:23:15.273416 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 71/124] 10.222.0.69 () {58 vars in 1206 bytes} [Thu Aug 4 04:23:15 2022] GET /compute/v2.1/flavors/889242343/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:15.286021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f294934d-c40e-4b09-a993-10b30d840992 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.335695 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f294934d-c40e-4b09-a993-10b30d840992 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/889242343" status: 202 len: 0 microversion: 2.1 time: 0.058304 Aug 04 04:23:15.337824 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 72/125] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:23:15 2022] DELETE /compute/v2.1/flavors/889242343 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:23:15.347664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b3794fd-e096-4775-a444-54724d78fc6a tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.392903 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b3794fd-e096-4775-a444-54724d78fc6a tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048697 Aug 04 04:23:15.396273 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 73/126] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:15.415963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab6ac100-8199-431a-b593-1739d6bc4eeb tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2029603239", "id": 648208127, "os-flavor-access:is_public": "False"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:15.457308 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab6ac100-8199-431a-b593-1739d6bc4eeb tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.044998 Aug 04 04:23:15.458493 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 74/127] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:15 2022] POST /compute/v2.1/flavors => generated 436 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:23:15.468575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:15.473153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:15.480485 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e7578908-ad23-4ee3-8330-f1b7d8c9c2a9 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.278163 Aug 04 04:23:15.481650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 54/128] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:15 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:15.770389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a151c1d4-9567-4959-ba42-3e036dc44a31 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:15.773112 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:15.773112 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:15.773987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a151c1d4-9567-4959-ba42-3e036dc44a31 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'db2a90cd85a040c0bf6656d1bdf11fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9853f451247c44b98f4915e3026fdd2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a151c1d4-9567-4959-ba42-3e036dc44a31 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Request method failure captured: Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/flavors/648208127/action HTTP/1.1 Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 67 Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mrDcI5BtyFO1OOp3w6Indpd5tJvhd6Fc64lBSKXGbCoLkiKt4gJTYtLeR8sgAeZjrTDFOEyb-Ixgz2U-_sXQFAL0VwcHpMey0OIM0Ey1uVLPybOvJEMrEbf0mu5I-vzl1tkGVnfLar1wcOft7qKizOI17XM-71DTcSjGXFrwlGo9Y Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 9853f451247c44b98f4915e3026fdd2b Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1081900027 Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:15.775871 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9853f451247c44b98f4915e3026fdd2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9853f451247c44b98f4915e3026fdd2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9853f451247c44b98f4915e3026fdd2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9853f451247c44b98f4915e3026fdd2b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1081900027 Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 9853f451247c44b98f4915e3026fdd2b Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1081900027 Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FlavorsAccessNegativeTestJSON-1081900027-project Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: db2a90cd85a040c0bf6656d1bdf11fcc Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1081900027-project Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: {"addTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} Aug 04 04:23:15.777088 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '648208127', 'body': {'addTenantAccess': {'tenant': '9853f451247c44b98f4915e3026fdd2b'}}} Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:15.777740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 04:23:15.778830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:15.781332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a151c1d4-9567-4959-ba42-3e036dc44a31 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:15.781332 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a151c1d4-9567-4959-ba42-3e036dc44a31 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] 10.222.0.69 "POST /compute/v2.1/flavors/648208127/action" status: 403 len: 130 microversion: 2.1 time: 0.311271 Aug 04 04:23:15.783697 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 75/129] 10.222.0.69 () {60 vars in 1197 bytes} [Thu Aug 4 04:23:15 2022] POST /compute/v2.1/flavors/648208127/action => generated 130 bytes in 318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:23:15.788740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6ac786c8-b99b-4ef9-aaf1-8fab3b5d0590 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.789517 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:15.789517 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:15.821901 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6ac786c8-b99b-4ef9-aaf1-8fab3b5d0590 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/648208127" status: 202 len: 0 microversion: 2.1 time: 0.036724 Aug 04 04:23:15.825700 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 55/130] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:23:15 2022] DELETE /compute/v2.1/flavors/648208127 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:23:15.832528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7c4d291-f511-4643-bd05-539abfc5cb5d tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:15.879796 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7c4d291-f511-4643-bd05-539abfc5cb5d tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049974 Aug 04 04:23:15.882369 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 76/131] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:15.905795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7f135dd-7574-4f3b-963f-6e453027bee3 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1613402553", "id": 1955739413, "os-flavor-access:is_public": "False"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:15.909560 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:15.909560 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:15.940739 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7f135dd-7574-4f3b-963f-6e453027bee3 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.042685 Aug 04 04:23:15.944835 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 56/132] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:15 2022] POST /compute/v2.1/flavors => generated 439 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:15.955310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2fc59c85-e969-448e-a8ee-8537046e76b9 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:16.212174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:16.213198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:16.232024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:16.240579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:16.241818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:16.243806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:16.541946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:16.556036 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff79c53c-19cf-4329-a9f4-a92fbcce9cd5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.350998 Aug 04 04:23:16.558031 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 57/133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:16 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:16.572533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:16.575158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:16.591771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:16.592612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:16.593616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:16.595760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:16.823235 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2fc59c85-e969-448e-a8ee-8537046e76b9 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1955739413/action" status: 200 len: 97 microversion: 2.1 time: 0.873273 Aug 04 04:23:16.824596 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 77/134] 10.222.0.69 () {60 vars in 1200 bytes} [Thu Aug 4 04:23:15 2022] POST /compute/v2.1/flavors/1955739413/action => generated 97 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:23:16.836930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc07e44c-c8ab-44ed-bb87-01a64b0a2df1 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:16.842558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc07e44c-c8ab-44ed-bb87-01a64b0a2df1 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'db2a90cd85a040c0bf6656d1bdf11fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9853f451247c44b98f4915e3026fdd2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc07e44c-c8ab-44ed-bb87-01a64b0a2df1 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Request method failure captured: Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/flavors/1955739413/action HTTP/1.1 Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 70 Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mrDcI5BtyFO1OOp3w6Indpd5tJvhd6Fc64lBSKXGbCoLkiKt4gJTYtLeR8sgAeZjrTDFOEyb-Ixgz2U-_sXQFAL0VwcHpMey0OIM0Ey1uVLPybOvJEMrEbf0mu5I-vzl1tkGVnfLar1wcOft7qKizOI17XM-71DTcSjGXFrwlGo9Y Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 9853f451247c44b98f4915e3026fdd2b Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1081900027 Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:16.847477 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9853f451247c44b98f4915e3026fdd2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9853f451247c44b98f4915e3026fdd2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9853f451247c44b98f4915e3026fdd2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9853f451247c44b98f4915e3026fdd2b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1081900027 Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 9853f451247c44b98f4915e3026fdd2b Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1081900027 Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FlavorsAccessNegativeTestJSON-1081900027-project Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: db2a90cd85a040c0bf6656d1bdf11fcc Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1081900027-project Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: {"removeTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} Aug 04 04:23:16.848811 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1955739413', 'body': {'removeTenantAccess': {'tenant': '9853f451247c44b98f4915e3026fdd2b'}}} Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can( Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:16.849556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 04:23:16.850527 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:16.854231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc07e44c-c8ab-44ed-bb87-01a64b0a2df1 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:16.855836 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc07e44c-c8ab-44ed-bb87-01a64b0a2df1 tempest-FlavorsAccessNegativeTestJSON-1081900027 tempest-FlavorsAccessNegativeTestJSON-1081900027-project] 10.222.0.69 "POST /compute/v2.1/flavors/1955739413/action" status: 403 len: 133 microversion: 2.1 time: 0.023697 Aug 04 04:23:16.857200 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 78/135] 10.222.0.69 () {60 vars in 1200 bytes} [Thu Aug 4 04:23:16 2022] POST /compute/v2.1/flavors/1955739413/action => generated 133 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:16.868709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9eb7be74-0b0c-48dd-ba5f-5450f7dcc15d tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9853f451247c44b98f4915e3026fdd2b"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:17.035116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:17.057615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-47ec652e-ba60-4268-b54f-8b5e200c8efa tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.493915 Aug 04 04:23:17.061424 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 58/136] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:16 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:17.410754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9eb7be74-0b0c-48dd-ba5f-5450f7dcc15d tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1955739413/action" status: 200 len: 21 microversion: 2.1 time: 0.547271 Aug 04 04:23:17.417953 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 79/137] 10.222.0.69 () {60 vars in 1200 bytes} [Thu Aug 4 04:23:16 2022] POST /compute/v2.1/flavors/1955739413/action => generated 21 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:23:17.425814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aeb1a494-263b-41c0-8112-aad794683556 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:17.426582 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:17.426582 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:17.449673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aeb1a494-263b-41c0-8112-aad794683556 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1955739413" status: 202 len: 0 microversion: 2.1 time: 0.027463 Aug 04 04:23:17.450272 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 59/138] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:23:17 2022] DELETE /compute/v2.1/flavors/1955739413 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:23:17.460719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-acc98a09-24a3-43ff-8103-103fe3d9c7ae tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:17.502102 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-acc98a09-24a3-43ff-8103-103fe3d9c7ae tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044060 Aug 04 04:23:17.503471 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 80/139] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:17.525850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b5389b66-7445-4393-beb9-455443e3bc49 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1943088660", "id": 1344278002, "os-flavor-access:is_public": "False"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:17.529309 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:17.529309 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:17.560827 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b5389b66-7445-4393-beb9-455443e3bc49 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.039853 Aug 04 04:23:17.567062 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 60/140] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:17 2022] POST /compute/v2.1/flavors => generated 439 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:17.574613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23a38700-4443-4e01-9128-e8524e360a7f tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "43973ee9220344ea9fcd42b3d7f76da9"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:17.580210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:17.580999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:17.604138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:17.605005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:17.607169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:17.608611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:18.120199 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-23a38700-4443-4e01-9128-e8524e360a7f tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] HTTP exception thrown: Flavor access not found for 32 / 43973ee9220344ea9fcd42b3d7f76da9 combination. Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23a38700-4443-4e01-9128-e8524e360a7f tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Request method failure captured: Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/flavors/1344278002/action HTTP/1.1 Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 70 Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mvYglV6eG6DYrQaRQbgjPOWza-r9G4BHVV8rEAoyRqNpnspMEuD5idHi84i-TP1i0LHac4PPiXrIZdpcesmEFhwNZndNserYn5bJXNwkIKDFf9npE-VJ0gbb_7wrsGEWNDy45iN4SljDu9uAnc0-SHrwLEjPaKlp45A1FubmbKd_8 Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 382016faa58045e4a433fc85898934a3 Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:18.128869 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/382016faa58045e4a433fc85898934a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/382016faa58045e4a433fc85898934a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/382016faa58045e4a433fc85898934a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_382016faa58045e4a433fc85898934a3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 382016faa58045e4a433fc85898934a3 Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843 Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f746ce1bb3aa4506a69812216c12b246 Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: {"removeTenantAccess": {"tenant": "43973ee9220344ea9fcd42b3d7f76da9"}} Aug 04 04:23:18.130156 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: exception: Flavor access not found for 32 / 43973ee9220344ea9fcd42b3d7f76da9 combination. Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1344278002', 'body': {'removeTenantAccess': {'tenant': '43973ee9220344ea9fcd42b3d7f76da9'}}} Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 04 04:23:18.130796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 32 / 43973ee9220344ea9fcd42b3d7f76da9 combination. Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 32 / 43973ee9220344ea9fcd42b3d7f76da9 combination. Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:18.131830 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:18.132821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:18.132821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:18.132821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:18.132821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:18.132821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 32 / 43973ee9220344ea9fcd42b3d7f76da9 combination. Aug 04 04:23:18.132821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:18.136091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23a38700-4443-4e01-9128-e8524e360a7f tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Returning 404 to user: Flavor access not found for 32 / 43973ee9220344ea9fcd42b3d7f76da9 combination. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:18.143981 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23a38700-4443-4e01-9128-e8524e360a7f tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1344278002/action" status: 404 len: 124 microversion: 2.1 time: 0.573452 Aug 04 04:23:18.148767 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 81/141] 10.222.0.69 () {60 vars in 1200 bytes} [Thu Aug 4 04:23:17 2022] POST /compute/v2.1/flavors/1344278002/action => generated 124 bytes in 579 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:18.183702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:18.196106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d0d3ed9-426c-4013-89f9-43fcbf8df1e0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.621626 Aug 04 04:23:18.198285 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 61/142] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:17 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:18.223034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:18.224002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:18.238384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:18.238842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:18.239657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:18.240095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:18.536667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:18.545677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-babdeca2-144a-4742-985c-08906a5618d8 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.345521 Aug 04 04:23:18.546263 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 62/143] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:18 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:18.566812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5b1115b0-a8e0-4a99-8a0f-4675bf6f3259 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:18.577935 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:18.577935 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:18.607702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-767cb8c0-b6d2-41f8-8163-5719223ec312 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Calling method '.version_select at 0x7f192064dee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:18.611970 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:18.611970 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:18.612795 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5b1115b0-a8e0-4a99-8a0f-4675bf6f3259 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1344278002" status: 202 len: 0 microversion: 2.1 time: 0.057949 Aug 04 04:23:18.617231 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 63/144] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:23:18 2022] DELETE /compute/v2.1/flavors/1344278002 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:23:18.617779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-767cb8c0-b6d2-41f8-8163-5719223ec312 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:18.618280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-767cb8c0-b6d2-41f8-8163-5719223ec312 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:18.619351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-767cb8c0-b6d2-41f8-8163-5719223ec312 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:18.622067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-767cb8c0-b6d2-41f8-8163-5719223ec312 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:18.644429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3fe1b11d-a86a-486b-b17b-bdca34b16b34 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:18.688483 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-767cb8c0-b6d2-41f8-8163-5719223ec312 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.536119 Aug 04 04:23:18.705079 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 82/145] 10.222.0.69 () {58 vars in 1128 bytes} [Thu Aug 4 04:23:18 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:18.712964 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3fe1b11d-a86a-486b-b17b-bdca34b16b34 tempest-FlavorsAccessNegativeTestJSON-1560397843 tempest-FlavorsAccessNegativeTestJSON-1560397843-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092295 Aug 04 04:23:18.715497 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 64/146] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:18.928957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-33ee5d08-08bf-4ff1-8ac7-b39f6362ff3c req-fdf37b29-bafd-4d21-926a-ad35b8f0e8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f7b417-b7c3-4a6b-a229-ab7b635a84fc", "name": "network-vif-plugged", "status": "completed", "tag": "3179942a-f3a2-4e28-b99e-3553e28c7c62"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:18.952451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-33ee5d08-08bf-4ff1-8ac7-b39f6362ff3c req-fdf37b29-bafd-4d21-926a-ad35b8f0e8cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:18.954415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-33ee5d08-08bf-4ff1-8ac7-b39f6362ff3c req-fdf37b29-bafd-4d21-926a-ad35b8f0e8cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:18.991343 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-33ee5d08-08bf-4ff1-8ac7-b39f6362ff3c req-fdf37b29-bafd-4d21-926a-ad35b8f0e8cb service nova] Creating event network-vif-plugged:3179942a-f3a2-4e28-b99e-3553e28c7c62 for instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc on n-h2-851337-5 Aug 04 04:23:19.008788 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-33ee5d08-08bf-4ff1-8ac7-b39f6362ff3c req-fdf37b29-bafd-4d21-926a-ad35b8f0e8cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302124 Aug 04 04:23:19.011276 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 83/147] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:19.183046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-066356e7-e25b-4c8a-a31f-81c6532e8041 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Calling method '.version_select at 0x7f191ab12790>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.185458 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:19.185458 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:19.186865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-066356e7-e25b-4c8a-a31f-81c6532e8041 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c136b87a864046a3b1a7eab7d6aec5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d151ae4a1a54396b4025dcabce71e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-066356e7-e25b-4c8a-a31f-81c6532e8041 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Request method failure captured: Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mzNzgmCkjjQkWlWBqJEOpdu9R3yOOYz8DGT6cZzuEDcC7RrgMdYSKSAudXL_ZeKhIs2cj3pLX9RFAiquQ1o-JJs65cA3dg657tvZk4HbPVFOTdlNeZHg9oQXz4tIf10Sn8GMq3tS1fMnrJG8sAhsYE2ACEBpAK2PQi38tBNqoWWTc Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:19.199016 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d151ae4a1a54396b4025dcabce71e35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c136b87a864046a3b1a7eab7d6aec5f4 Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: action_args: {} Aug 04 04:23:19.200363 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.201309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 04:23:19.202474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.206675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-066356e7-e25b-4c8a-a31f-81c6532e8041 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.210230 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-066356e7-e25b-4c8a-a31f-81c6532e8041 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.493578 Aug 04 04:23:19.211018 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 65/148] 10.222.0.69 () {58 vars in 1128 bytes} [Thu Aug 4 04:23:18 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 495 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:19.222777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.223325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca05a25c-e143-4be7-b5aa-95169fbf375f tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Calling method '.version_select at 0x7f191ab31040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.223713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:19.225639 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:19.225639 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:19.231110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca05a25c-e143-4be7-b5aa-95169fbf375f tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c136b87a864046a3b1a7eab7d6aec5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d151ae4a1a54396b4025dcabce71e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca05a25c-e143-4be7-b5aa-95169fbf375f tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Request method failure captured: Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/n-d-851337-5/reboot HTTP/1.1 Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mzNzgmCkjjQkWlWBqJEOpdu9R3yOOYz8DGT6cZzuEDcC7RrgMdYSKSAudXL_ZeKhIs2cj3pLX9RFAiquQ1o-JJs65cA3dg657tvZk4HbPVFOTdlNeZHg9oQXz4tIf10Sn8GMq3tS1fMnrJG8sAhsYE2ACEBpAK2PQi38tBNqoWWTc Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:19.232772 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d151ae4a1a54396b4025dcabce71e35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c136b87a864046a3b1a7eab7d6aec5f4 Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'n-d-851337-5'} Aug 04 04:23:19.235141 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.236012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 04:23:19.237160 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.238719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca05a25c-e143-4be7-b5aa-95169fbf375f tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.240465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:19.240915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:19.241701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:19.242304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:19.243383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca05a25c-e143-4be7-b5aa-95169fbf375f tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-851337-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.015554 Aug 04 04:23:19.244395 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 66/149] 10.222.0.69 () {58 vars in 1188 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/n-d-851337-5/reboot => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:19.255806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f32a54f-d787-4521-948f-19da68053af9 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Calling method '.version_select at 0x7f191ad11ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.292908 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1f32a54f-d787-4521-948f-19da68053af9 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f32a54f-d787-4521-948f-19da68053af9 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:19.298749 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'nonexistent_hostname'} Aug 04 04:23:19.300196 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:19.301066 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 04:23:19.303401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.305309 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.310755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f32a54f-d787-4521-948f-19da68053af9 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.317750 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f32a54f-d787-4521-948f-19da68053af9 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.065491 Aug 04 04:23:19.324566 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 67/150] 10.222.0.69 () {58 vars in 1212 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:19.347391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3abc8204-0c64-401c-9c3c-013e36af2318 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Calling method '.version_select at 0x7f191aa7d0d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.350679 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:19.350679 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:19.352299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3abc8204-0c64-401c-9c3c-013e36af2318 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c136b87a864046a3b1a7eab7d6aec5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d151ae4a1a54396b4025dcabce71e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3abc8204-0c64-401c-9c3c-013e36af2318 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Request method failure captured: Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/n-d-851337-5 HTTP/1.1 Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mzNzgmCkjjQkWlWBqJEOpdu9R3yOOYz8DGT6cZzuEDcC7RrgMdYSKSAudXL_ZeKhIs2cj3pLX9RFAiquQ1o-JJs65cA3dg657tvZk4HbPVFOTdlNeZHg9oQXz4tIf10Sn8GMq3tS1fMnrJG8sAhsYE2ACEBpAK2PQi38tBNqoWWTc Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:19.358910 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d151ae4a1a54396b4025dcabce71e35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c136b87a864046a3b1a7eab7d6aec5f4 Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'n-d-851337-5'} Aug 04 04:23:19.360663 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.361336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 04:23:19.362344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.366574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3abc8204-0c64-401c-9c3c-013e36af2318 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.367677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3abc8204-0c64-401c-9c3c-013e36af2318 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-851337-5" status: 403 len: 109 microversion: 2.1 time: 0.035728 Aug 04 04:23:19.371063 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 68/151] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/n-d-851337-5 => generated 109 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:19.389413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8330659c-2ba2-4316-bbbb-14cab38800f8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Calling method '.version_select at 0x7f191aa5baf0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.405745 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8330659c-2ba2-4316-bbbb-14cab38800f8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8330659c-2ba2-4316-bbbb-14cab38800f8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:19.409614 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'nonexistent_hostname'} Aug 04 04:23:19.410906 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.412193 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.413217 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.415583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8330659c-2ba2-4316-bbbb-14cab38800f8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.416444 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8330659c-2ba2-4316-bbbb-14cab38800f8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037877 Aug 04 04:23:19.418763 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 69/152] 10.222.0.69 () {58 vars in 1191 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:19.430980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47616580-7760-4884-9fd8-d41afdca58d7 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Calling method '.version_select at 0x7f191ab318b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.434379 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:19.434379 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:19.437100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-47616580-7760-4884-9fd8-d41afdca58d7 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c136b87a864046a3b1a7eab7d6aec5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d151ae4a1a54396b4025dcabce71e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47616580-7760-4884-9fd8-d41afdca58d7 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Request method failure captured: Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/n-d-851337-5/shutdown HTTP/1.1 Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mzNzgmCkjjQkWlWBqJEOpdu9R3yOOYz8DGT6cZzuEDcC7RrgMdYSKSAudXL_ZeKhIs2cj3pLX9RFAiquQ1o-JJs65cA3dg657tvZk4HbPVFOTdlNeZHg9oQXz4tIf10Sn8GMq3tS1fMnrJG8sAhsYE2ACEBpAK2PQi38tBNqoWWTc Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:19.440666 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d151ae4a1a54396b4025dcabce71e35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c136b87a864046a3b1a7eab7d6aec5f4 Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'n-d-851337-5'} Aug 04 04:23:19.441826 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.442578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 04:23:19.443551 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.448455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47616580-7760-4884-9fd8-d41afdca58d7 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.451559 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-47616580-7760-4884-9fd8-d41afdca58d7 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-851337-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.026417 Aug 04 04:23:19.454516 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 70/153] 10.222.0.69 () {58 vars in 1194 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/n-d-851337-5/shutdown => generated 113 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:19.463448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e547261-7148-4288-80e3-3161bca17806 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Calling method '.version_select at 0x7f191aa7d1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.474876 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-9e547261-7148-4288-80e3-3161bca17806 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e547261-7148-4288-80e3-3161bca17806 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:19.479164 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'nonexistent_hostname'} Aug 04 04:23:19.480785 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:19.481459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 04:23:19.482560 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.483616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.489007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e547261-7148-4288-80e3-3161bca17806 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.490209 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e547261-7148-4288-80e3-3161bca17806 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.031900 Aug 04 04:23:19.491370 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 71/154] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:19.502645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04cd93ac-8f5b-4770-a3a4-80c9b7465261 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Calling method '.version_select at 0x7f191aa5bdc0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.506233 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:19.506233 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:19.510546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04cd93ac-8f5b-4770-a3a4-80c9b7465261 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c136b87a864046a3b1a7eab7d6aec5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d151ae4a1a54396b4025dcabce71e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04cd93ac-8f5b-4770-a3a4-80c9b7465261 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Request method failure captured: Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/n-d-851337-5/startup HTTP/1.1 Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mzNzgmCkjjQkWlWBqJEOpdu9R3yOOYz8DGT6cZzuEDcC7RrgMdYSKSAudXL_ZeKhIs2cj3pLX9RFAiquQ1o-JJs65cA3dg657tvZk4HbPVFOTdlNeZHg9oQXz4tIf10Sn8GMq3tS1fMnrJG8sAhsYE2ACEBpAK2PQi38tBNqoWWTc Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:19.512841 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d151ae4a1a54396b4025dcabce71e35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c136b87a864046a3b1a7eab7d6aec5f4 Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'n-d-851337-5'} Aug 04 04:23:19.514065 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.514835 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 04:23:19.515998 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.517098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04cd93ac-8f5b-4770-a3a4-80c9b7465261 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.518543 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04cd93ac-8f5b-4770-a3a4-80c9b7465261 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-851337-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.021303 Aug 04 04:23:19.519136 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 72/155] 10.222.0.69 () {58 vars in 1191 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/n-d-851337-5/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:23:19.531224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92bc6ffd-6978-49d9-860d-60c328963dc5 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Calling method '.version_select at 0x7f191aa7d310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.549991 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-92bc6ffd-6978-49d9-860d-60c328963dc5 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92bc6ffd-6978-49d9-860d-60c328963dc5 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:19.555609 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'nonexistent_hostname'} Aug 04 04:23:19.556803 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:19.557453 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 04:23:19.558379 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92bc6ffd-6978-49d9-860d-60c328963dc5 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.559389 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92bc6ffd-6978-49d9-860d-60c328963dc5 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.034038 Aug 04 04:23:19.560907 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 73/156] 10.222.0.69 () {58 vars in 1215 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 04:23:19.575698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4138768-1d60-405b-b461-9d7fb2aa469d tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Action: 'update', calling method: .version_select at 0x7f191ab314c0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4138768-1d60-405b-b461-9d7fb2aa469d tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/os-hosts/n-d-851337-5 HTTP/1.1 Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 51 Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:19.590594 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: {"status": "enable", "maintenance_mode": "invalid"} Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:19.592125 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'n-d-851337-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance: Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.592990 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.595212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4138768-1d60-405b-b461-9d7fb2aa469d tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4138768-1d60-405b-b461-9d7fb2aa469d tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-851337-5" status: 400 len: 199 microversion: 2.1 time: 0.024904 Aug 04 04:23:19.596296 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 74/157] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:23:19 2022] PUT /compute/v2.1/os-hosts/n-d-851337-5 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:23:19.604106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:19.604729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:19.614230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:19.614564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:19.615415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:19.615857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:19.690557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:19.702429 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7cb4f07b-2162-452b-a802-beceef5f3863 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.484245 Aug 04 04:23:19.720626 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 84/158] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:19.727815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ee57363-a18f-4583-bd50-25234e498650 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Action: 'update', calling method: .version_select at 0x7f1920596820>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ee57363-a18f-4583-bd50-25234e498650 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/os-hosts/n-d-851337-5 HTTP/1.1 Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 51 Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:19.735824 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: {"status": "invalid", "maintenance_mode": "enable"} Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:19.737403 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'n-d-851337-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance: Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.738186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.739772 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.741302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.741302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:23:19.741302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:23:19.741302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 04:23:19.741302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.742039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ee57363-a18f-4583-bd50-25234e498650 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.743200 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6ee57363-a18f-4583-bd50-25234e498650 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-851337-5" status: 400 len: 189 microversion: 2.1 time: 0.019866 Aug 04 04:23:19.747222 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 85/159] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:23:19 2022] PUT /compute/v2.1/os-hosts/n-d-851337-5 => generated 189 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:23:19.758220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d933806d-adb9-4902-adad-45f5ca877b37 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Action: 'update', calling method: .version_select at 0x7f19205e6550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:19.765902 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:19.765902 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:19.769864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d933806d-adb9-4902-adad-45f5ca877b37 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c136b87a864046a3b1a7eab7d6aec5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d151ae4a1a54396b4025dcabce71e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d933806d-adb9-4902-adad-45f5ca877b37 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Request method failure captured: Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/os-hosts/n-d-851337-5 HTTP/1.1 Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 50 Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mzNzgmCkjjQkWlWBqJEOpdu9R3yOOYz8DGT6cZzuEDcC7RrgMdYSKSAudXL_ZeKhIs2cj3pLX9RFAiquQ1o-JJs65cA3dg657tvZk4HbPVFOTdlNeZHg9oQXz4tIf10Sn8GMq3tS1fMnrJG8sAhsYE2ACEBpAK2PQi38tBNqoWWTc Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:19.776865 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d151ae4a1a54396b4025dcabce71e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d151ae4a1a54396b4025dcabce71e35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7d151ae4a1a54396b4025dcabce71e35 Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1172516386 Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c136b87a864046a3b1a7eab7d6aec5f4 Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1172516386-project Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 04:23:19.778499 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'n-d-851337-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.779435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 04:23:19.780805 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.782472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d933806d-adb9-4902-adad-45f5ca877b37 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.783340 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d933806d-adb9-4902-adad-45f5ca877b37 tempest-HostsAdminNegativeTestJSON-1172516386 tempest-HostsAdminNegativeTestJSON-1172516386-project] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-851337-5" status: 403 len: 111 microversion: 2.1 time: 0.034330 Aug 04 04:23:19.786494 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 86/160] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:23:19 2022] PUT /compute/v2.1/os-hosts/n-d-851337-5 => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:19.801736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f10ec88-5b60-4efe-90f2-53c39e8bdce4 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Action: 'update', calling method: .version_select at 0x7f19205e6940>, body: {"status": null, "maintenance_mode": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f10ec88-5b60-4efe-90f2-53c39e8bdce4 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/os-hosts/n-d-851337-5 HTTP/1.1 Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 42 Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:19.811580 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: {"status": null, "maintenance_mode": null} Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 04:23:19.813080 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'n-d-851337-5', 'body': {'status': None, 'maintenance_mode': None}} Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance: Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi None Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.813841 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.815202 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.819014 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:23:19.819014 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:23:19.819014 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 04:23:19.819014 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.819014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f10ec88-5b60-4efe-90f2-53c39e8bdce4 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.819014 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f10ec88-5b60-4efe-90f2-53c39e8bdce4 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-851337-5" status: 400 len: 127 microversion: 2.1 time: 0.020844 Aug 04 04:23:19.819014 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 87/161] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:23:19 2022] PUT /compute/v2.1/os-hosts/n-d-851337-5 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:23:19.850990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ba012ab-7c54-450b-a9e3-9e3bf8f76dd8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Action: 'update', calling method: .version_select at 0x7f192064d280>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:19.865920 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.hosts [None req-1ba012ab-7c54-450b-a9e3-9e3bf8f76dd8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Enabling host nonexistent_hostname. Aug 04 04:23:19.890408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-1ba012ab-7c54-450b-a9e3-9e3bf8f76dd8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ba012ab-7c54-450b-a9e3-9e3bf8f76dd8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Request method failure captured: Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 50 Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60m166e2lfCPiyDC86kNrSw699uKSBFBgmUfQQbgvidEp8KFoaG-ra65E6qEpW9pSVa9sFXflgfmizvv__kG6GDpmEcDe_urmct13aX66g1f-bwYGwQaZid7fRaZOb8_hCVJQSerjcqw1tEFP1ZuNSKPd2QmA25zBr1q4Y--MoHtsHU Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:19.896117 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67b191882fac41b5b54299d9dd6fe43d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67b191882fac41b5b54299d9dd6fe43d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 67b191882fac41b5b54299d9dd6fe43d Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1614266172 Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 266ef67f370d4699a685883c201e6732 Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1614266172-project-admin Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.897259 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 04:23:19.898005 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:19.899162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:19.900240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ba012ab-7c54-450b-a9e3-9e3bf8f76dd8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:19.901025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ba012ab-7c54-450b-a9e3-9e3bf8f76dd8 tempest-HostsAdminNegativeTestJSON-1614266172 tempest-HostsAdminNegativeTestJSON-1614266172-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.062659 Aug 04 04:23:19.901025 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 88/162] 10.222.0.69 () {60 vars in 1211 bytes} [Thu Aug 4 04:23:19 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:20.147409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:20.163438 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-acd4de07-356a-46ee-9067-45b23132080e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.568040 Aug 04 04:23:20.164022 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 75/163] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:19 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:20.727730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:20.729061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:20.739092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:20.739766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:20.741469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:20.742164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:20.987100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:20.995717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-90348b8d-f502-4a52-9f61-cdc21c7b6904 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.273029 Aug 04 04:23:20.996942 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 89/164] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:20 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:21.017580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3201ab96-3e0c-4f3e-8fd7-30ea61290bc8 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Action: 'create', calling method: .version_select at 0x7f191aa5b940>, body: {"keypair": {"name": "tempest-keypair-1928397003", "type": "ssh", "user_id": "fbdfd9b8505640c783e6654e4348514b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaL500yGqKCZ2X1tGpiULfA2dq3vcn7Hbo/fBQ6ueV7KA2B8Nbby9NO5t+gTXzE/kgDXMeaMgksTPQe0k/XtktAQ68dXdCpuKJyzH1ZPcOSmyzVttMLjoWBZf9CgyxbLg=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:21.053461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3201ab96-3e0c-4f3e-8fd7-30ea61290bc8 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Getting quotas for project c381d3586d354895b2d09766922c11af. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:23:21.058213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3201ab96-3e0c-4f3e-8fd7-30ea61290bc8 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Getting quotas for user aac6877f3ea64fa5bdeccbdd7435e4f8 and project c381d3586d354895b2d09766922c11af. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:23:21.095806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3201ab96-3e0c-4f3e-8fd7-30ea61290bc8 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.314974 Aug 04 04:23:21.105920 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 76/165] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:23:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 326 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 04:23:21.119288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b66a767-0a57-4a96-94f1-19ba75ccacef tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Action: 'create', calling method: .version_select at 0x7f19203b9e50>, body: {"keypair": {"name": "tempest-keypair-1161817384", "type": "ssh", "user_id": "fbdfd9b8505640c783e6654e4348514b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8QEkfKYpC3KyVgkzKy9LNYMPzGtW7aoXfletF9jrCist/oE1651NBhWVNquPcBrDv3Cah83c19Wp8Xi16D6rOpQ6utPlu96uXKnOVu9EAG+1tB1GS1Q0PYJe8hoJMYuA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:21.179157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0b66a767-0a57-4a96-94f1-19ba75ccacef tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Getting quotas for project c381d3586d354895b2d09766922c11af. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:23:21.189962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:21.190976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:21.192243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0b66a767-0a57-4a96-94f1-19ba75ccacef tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Getting quotas for user aac6877f3ea64fa5bdeccbdd7435e4f8 and project c381d3586d354895b2d09766922c11af. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:23:21.215356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:21.216150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:21.220225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:21.223492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:21.247257 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b66a767-0a57-4a96-94f1-19ba75ccacef tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.140460 Aug 04 04:23:21.249124 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 90/166] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:23:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 04:23:21.260648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02293fb4-0a27-450f-a556-b669457093b3 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Calling method '.version_select at 0x7f19203b9d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:21.274942 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02293fb4-0a27-450f-a556-b669457093b3 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-1928397003?user_id=fbdfd9b8505640c783e6654e4348514b" status: 200 len: 512 microversion: 2.10 time: 0.018635 Aug 04 04:23:21.276249 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 91/167] 10.222.0.69 () {60 vars in 1340 bytes} [Thu Aug 4 04:23:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1928397003?user_id=fbdfd9b8505640c783e6654e4348514b => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:21.300886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c12fde40-45db-463d-bf84-0d51c08f99a0 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Action: 'create', calling method: .version_select at 0x7f19203b9dc0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1329517178", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4jH271gY9jfNJiZn6/RyLmYchgiAK6Y9KzYS7LzT0C3gzKOCa99q1//EL3wr0HKpOBcHWwDJh7QB1coiJ0Gjvpny3ThYB534vTiuVupVHf/hE9yE35qBpBx5qrGqT6ZA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:21.343638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c12fde40-45db-463d-bf84-0d51c08f99a0 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Getting quotas for project c381d3586d354895b2d09766922c11af. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:23:21.351974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c12fde40-45db-463d-bf84-0d51c08f99a0 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Getting quotas for user aac6877f3ea64fa5bdeccbdd7435e4f8 and project c381d3586d354895b2d09766922c11af. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:23:21.384321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:21.405319 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c12fde40-45db-463d-bf84-0d51c08f99a0 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.113030 Aug 04 04:23:21.408602 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 92/168] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:23:21 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 04:23:21.423281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-803e8b33-a5b8-4e01-b705-3b9411d28d89 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Calling method '.version_select at 0x7f19203c4d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:21.433177 n-d-851337-5 devstack@n-api.service[119343]: WARNING oslo_db.sqlalchemy.utils [None req-803e8b33-a5b8-4e01-b705-3b9411d28d89 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 04:23:21.442271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-803e8b33-a5b8-4e01-b705-3b9411d28d89 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "GET /compute/v2.1/os-keypairs?user_id=fbdfd9b8505640c783e6654e4348514b" status: 200 len: 726 microversion: 2.10 time: 0.026061 Aug 04 04:23:21.443647 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 93/169] 10.222.0.69 () {60 vars in 1259 bytes} [Thu Aug 4 04:23:21 2022] GET /compute/v2.1/os-keypairs?user_id=fbdfd9b8505640c783e6654e4348514b => generated 726 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:21.456210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11e21a32-7980-492a-ba42-120d2a80b338 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Calling method '.version_select at 0x7f19203b99d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:21.494740 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11e21a32-7980-492a-ba42-120d2a80b338 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1329517178" status: 204 len: 0 microversion: 2.10 time: 0.041331 Aug 04 04:23:21.517641 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 94/170] 10.222.0.69 () {60 vars in 1325 bytes} [Thu Aug 4 04:23:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1329517178 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:23:21.527923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0107e605-a9f8-4da1-aa3e-14914440e6a2 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Calling method '.version_select at 0x7f19203d44c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:21.576616 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0107e605-a9f8-4da1-aa3e-14914440e6a2 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161817384?user_id=fbdfd9b8505640c783e6654e4348514b" status: 204 len: 0 microversion: 2.10 time: 0.057397 Aug 04 04:23:21.577214 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 95/171] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:23:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161817384?user_id=fbdfd9b8505640c783e6654e4348514b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:23:21.587574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-622962be-f861-494f-9c0a-20ce6059c030 req-25709d95-5b54-4077-bf26-67a0a1057a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97ea115-9836-44d8-b12e-674b6434a8b7", "name": "network-vif-plugged", "status": "completed", "tag": "0548d468-cd23-4c32-ac67-82a9fc6f4186"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:21.608424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-622962be-f861-494f-9c0a-20ce6059c030 req-25709d95-5b54-4077-bf26-67a0a1057a32 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:21.609233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-622962be-f861-494f-9c0a-20ce6059c030 req-25709d95-5b54-4077-bf26-67a0a1057a32 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:21.622495 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-622962be-f861-494f-9c0a-20ce6059c030 req-25709d95-5b54-4077-bf26-67a0a1057a32 service nova] Creating event network-vif-plugged:0548d468-cd23-4c32-ac67-82a9fc6f4186 for instance a97ea115-9836-44d8-b12e-674b6434a8b7 on n-h2-851337-5 Aug 04 04:23:21.629548 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-622962be-f861-494f-9c0a-20ce6059c030 req-25709d95-5b54-4077-bf26-67a0a1057a32 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047792 Aug 04 04:23:21.634011 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 96/172] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:21.640243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ec816dfa-ef86-4041-b6d7-3c9f23f09615 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] Calling method '.version_select at 0x7f192041cca0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:21.722724 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ec816dfa-ef86-4041-b6d7-3c9f23f09615 tempest-KeyPairsV210TestJSON-1336898391 tempest-KeyPairsV210TestJSON-1336898391-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928397003?user_id=fbdfd9b8505640c783e6654e4348514b" status: 204 len: 0 microversion: 2.10 time: 0.087398 Aug 04 04:23:21.730362 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 97/173] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:23:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928397003?user_id=fbdfd9b8505640c783e6654e4348514b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:23:21.772499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:21.783484 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f8fb38b-6940-4463-83b6-84714d524ccf tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1336 microversion: 2.1 time: 0.599455 Aug 04 04:23:21.784708 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 77/174] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:21 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1336 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:22.020147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:22.021873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:22.032176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:22.033001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:22.034408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:22.035526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:22.241138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:22.253168 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0ce6e92-a67b-47da-ba14-675aa8020238 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1333 microversion: 2.1 time: 0.239619 Aug 04 04:23:22.271815 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 78/175] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:22 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1333 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:22.382881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6c7a619-711b-4caa-9596-23203871b2d9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:22.400584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d6c7a619-711b-4caa-9596-23203871b2d9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.473899 Aug 04 04:23:22.401359 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 98/176] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:23:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:22.772670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-904d47ae-1cf2-454c-b12b-4e82e38dc638 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-332590395", "id": 2119286000, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:22.782133 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:22.782133 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:22.805282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:22.806704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:22.811003 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-904d47ae-1cf2-454c-b12b-4e82e38dc638 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.399990 Aug 04 04:23:22.813506 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 79/177] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:22 2022] POST /compute/v2.1/flavors => generated 424 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:22.816313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:22.818361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:22.819413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:22.819918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:22.831191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c0095fb-fd24-46d2-99f2-033ded2b2db4 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:22.846223 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c0095fb-fd24-46d2-99f2-033ded2b2db4 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024013 Aug 04 04:23:22.851153 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 80/178] 10.222.0.69 () {58 vars in 1182 bytes} [Thu Aug 4 04:23:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:23:22.870566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16fe4520-9185-45ee-98ee-b81a3ee347b2 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-515281798", "id": 321708186, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:22.911342 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16fe4520-9185-45ee-98ee-b81a3ee347b2 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.049335 Aug 04 04:23:22.912637 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 81/179] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:22 2022] POST /compute/v2.1/flavors => generated 421 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:23:22.926861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e55c795-5d13-450f-bbcf-72c40e714062 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:22.942385 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e55c795-5d13-450f-bbcf-72c40e714062 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021920 Aug 04 04:23:22.945923 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 82/180] 10.222.0.69 () {58 vars in 1182 bytes} [Thu Aug 4 04:23:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:23:22.959579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab248274-7976-4021-a286-a7fa250cde99 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Action: 'create', calling method: .version_select at 0x7f191ab318b0>, body: {"keypair": {"name": "tempest-keypair-1257548634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP3M8fPf7yJKakQp4S6LXwA3GUYUPobAp6B9ZMDSQek0Tiyng/0P3e6+Ge29eOqynicmSb1m28Lo8fWB0J96j2Thi8f/9D7yBGhGUrTZoqgR+owxZHIwE3EgJ4Nnp3JAA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:23.000719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ab248274-7976-4021-a286-a7fa250cde99 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Getting quotas for project 5eb654e083014c3a9accbed2d9717a62. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:23:23.005244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ab248274-7976-4021-a286-a7fa250cde99 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Getting quotas for user 3cb9b7217fa945ad8778fc4c29f80fb3 and project 5eb654e083014c3a9accbed2d9717a62. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:23:23.035441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab248274-7976-4021-a286-a7fa250cde99 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079578 Aug 04 04:23:23.038014 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 83/181] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:23:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:23.096862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:23.107261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5b46db5-e067-4359-8bfc-a98db5a0c65b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1485 microversion: 2.1 time: 0.306239 Aug 04 04:23:23.108323 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 99/182] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:22 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1485 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:23.131010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-58f6d673-4080-4519-8131-06fcb1d7844e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:23.131929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-58f6d673-4080-4519-8131-06fcb1d7844e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:23.143559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f6d673-4080-4519-8131-06fcb1d7844e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:23.144225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f6d673-4080-4519-8131-06fcb1d7844e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:23.144855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f6d673-4080-4519-8131-06fcb1d7844e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:23.147861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f6d673-4080-4519-8131-06fcb1d7844e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:23.281437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:23.281849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:23.288783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:23.289380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:23.290258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:23.290762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:23.577233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:23.585525 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c065ead-4770-4039-ba8a-80bf714caf72 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1482 microversion: 2.1 time: 0.313215 Aug 04 04:23:23.604832 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 100/183] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:23 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1482 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:23.779840 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-58f6d673-4080-4519-8131-06fcb1d7844e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1636 microversion: 2.1 time: 0.650125 Aug 04 04:23:23.781897 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 84/184] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:23 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1636 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:23.805967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:23.806811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:23.821413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:23.826522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:23.827574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:23.828028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:23.899991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:23:24.153363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2fb3b99f-448c-493f-8482-3c1d3f897218 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:24.153975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2fb3b99f-448c-493f-8482-3c1d3f897218 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:24.169700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fb3b99f-448c-493f-8482-3c1d3f897218 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:24.173792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fb3b99f-448c-493f-8482-3c1d3f897218 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:24.175061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fb3b99f-448c-493f-8482-3c1d3f897218 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:24.175646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fb3b99f-448c-493f-8482-3c1d3f897218 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:24.197701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:24.207886 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ca8360f-1564-4d38-bad1-328ca82e7f1d tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "DELETE /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 204 len: 0 microversion: 2.1 time: 0.405703 Aug 04 04:23:24.209946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 85/185] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:23:23 2022] DELETE /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:23:24.221106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:24.224512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:24.240454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:24.241278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:24.242335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:24.243680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:24.635932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:24.652270 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6eedb271-98dc-402a-acf2-ac5d42e6bcd7 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1491 microversion: 2.1 time: 0.437245 Aug 04 04:23:24.668680 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 86/186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:24 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1491 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:24.990437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2fb3b99f-448c-493f-8482-3c1d3f897218 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1633 microversion: 2.1 time: 1.383445 Aug 04 04:23:24.992449 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 101/187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:23 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1633 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:25.011578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:25.012180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:25.022865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:25.023362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:25.024194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:25.024979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:25.679299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:25.680755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:25.693349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:25.693804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:25.694595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:25.695069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:26.089954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ddb47c0d58fb47eba4cc08933ba292c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22215bcace514a4b8d41c1c0872460a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:26.090548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] flavor_id is None. Assuming migration. {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 04:23:26.091257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 04:23:26.157228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bbfbe3ada6470997b454753788b86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b046531f3dc8443bad8b040202d8b432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:26.169190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-323e1a18-d50e-4c3b-af52-b5357b1d876e tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 200 len: 1491 microversion: 2.1 time: 0.496182 Aug 04 04:23:26.177723 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 102/188] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:25 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 1491 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:26.184533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-490591771", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "321708186", "adminPass": "***", "networks": [{"uuid": "12bdb45f-d8f5-4ab1-a4b8-8afe5c2a9499"}], "security_groups": [{"name": "tempest-securitygroup--1437432548"}], "key_name": "tempest-keypair-1257548634", "user_data": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:26.507964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] validate_networks() for [('12bdb45f-d8f5-4ab1-a4b8-8afe5c2a9499', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:23:27.189587 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32566940-1859-4552-96c2-f866c9bf9ac9 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7/action" status: 202 len: 0 microversion: 2.1 time: 2.181761 Aug 04 04:23:27.190188 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 87/189] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:23:25 2022] POST /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7/action => generated 0 bytes in 2183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:23:27.442622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8d747ff-d89b-4464-b158-7dbb268952e1 tempest-InstanceUsageAuditLogTestJSON-627406216 tempest-InstanceUsageAuditLogTestJSON-627406216-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:27.443571 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:27.443571 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:27.469213 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8d747ff-d89b-4464-b158-7dbb268952e1 tempest-InstanceUsageAuditLogTestJSON-627406216 tempest-InstanceUsageAuditLogTestJSON-627406216-project-admin] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 04:23:26" status: 200 len: 318 microversion: 2.1 time: 0.272775 Aug 04 04:23:27.478429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 88/190] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:23:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2004%3A23%3A26 => generated 318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:27.666905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3d7493e-d849-4796-af25-e73d061a1634 tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-824057360", "id": 344719984, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:27.672776 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:27.672776 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:27.705953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:23:27.706726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:23:27.707487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:23:27.708093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:23:27.708792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:23:27.723409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:27.724440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:27.725590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:27.726222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:27.755844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Getting quotas for project 5eb654e083014c3a9accbed2d9717a62. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:23:27.761704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Getting quotas for user 3cb9b7217fa945ad8778fc4c29f80fb3 and project 5eb654e083014c3a9accbed2d9717a62. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:23:27.780013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:23:27.784412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:23:27.911935 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d577d1b-d75e-47cd-814c-06ed47b8baab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.731194 Aug 04 04:23:27.914304 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 103/191] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:23:27.923925 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f3d7493e-d849-4796-af25-e73d061a1634 tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.444179 Aug 04 04:23:27.925130 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 89/192] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:23:27 2022] POST /compute/v2.1/flavors => generated 467 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:27.930565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-215e55ef-523c-49c1-80af-bb898a289b0e req-81af56a8-01cb-4866-ae9f-b2fbccd4d641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f7b417-b7c3-4a6b-a229-ab7b635a84fc", "name": "network-vif-deleted", "tag": "3179942a-f3a2-4e28-b99e-3553e28c7c62"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:27.930756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:27.931654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:27.940041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:27.940712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:27.942662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:27.943418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:27.960955 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] HTTP exception thrown: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Request method failure captured: Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc HTTP/1.1 Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mar60m0KmZ0eeW06gk3L8Guut05lhyc_6xpBvJRED2xLZYdfyYRPs-iD-MwCPW6fx4T7zL-CUklWEhxPZRwmZT5v_FlYAvTy-MHOcgyd9BduwKk6niWCWOUByZRmPc62Bv4lW77dYPZOHmxRR8gkozDJxCdYI4pklxFobzIcQGGok Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: b046531f3dc8443bad8b040202d8b432 Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:27.963635 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b046531f3dc8443bad8b040202d8b432", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: b046531f3dc8443bad8b040202d8b432 Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminTestJSON-552430792-project Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 31bbfbe3ada6470997b454753788b86e Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminTestJSON-552430792-project Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:27.965285 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '91f7b417-b7c3-4a6b-a229-ab7b635a84fc'} Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:27.966467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:27.967819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:27.970205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Returning 404 to user: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:27.971500 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-427cc8e5-f60a-4c6d-b96b-d831e352e262 tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 404 len: 111 microversion: 2.1 time: 0.045049 Aug 04 04:23:27.976178 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 90/193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:27 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:27.982053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:27.982820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:27.989910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:27.990528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:27.991333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:27.991772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:28.005475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-215e55ef-523c-49c1-80af-bb898a289b0e req-81af56a8-01cb-4866-ae9f-b2fbccd4d641 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:28.010055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-215e55ef-523c-49c1-80af-bb898a289b0e req-81af56a8-01cb-4866-ae9f-b2fbccd4d641 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:28.036318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-215e55ef-523c-49c1-80af-bb898a289b0e req-81af56a8-01cb-4866-ae9f-b2fbccd4d641 service nova] Creating event network-vif-deleted:3179942a-f3a2-4e28-b99e-3553e28c7c62 for instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc on n-h2-851337-5 Aug 04 04:23:28.057478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-215e55ef-523c-49c1-80af-bb898a289b0e req-81af56a8-01cb-4866-ae9f-b2fbccd4d641 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140133 Aug 04 04:23:28.058913 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 104/194] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:28.064904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-caf7f70e-0b4c-4ea8-ba75-c5077815e303 tempest-InstanceUsageAuditLogTestJSON-627406216 tempest-InstanceUsageAuditLogTestJSON-627406216-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:28.065917 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:28.065917 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:28.087670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-caf7f70e-0b4c-4ea8-ba75-c5077815e303 tempest-InstanceUsageAuditLogTestJSON-627406216 tempest-InstanceUsageAuditLogTestJSON-627406216-project-admin] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027361 Aug 04 04:23:28.089575 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 105/195] 10.222.0.69 () {58 vars in 1185 bytes} [Thu Aug 4 04:23:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:28.132974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad2af159-43b6-4b98-87b4-6f2bca7cd5fe tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:28.133959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad2af159-43b6-4b98-87b4-6f2bca7cd5fe tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:28.250039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad2af159-43b6-4b98-87b4-6f2bca7cd5fe tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:28.271739 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad2af159-43b6-4b98-87b4-6f2bca7cd5fe tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1262 microversion: 2.1 time: 0.177732 Aug 04 04:23:28.285790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 106/196] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:28 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:28.287349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-869e12cc-da5a-4d24-99d6-c4439944754a tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:28.289852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:28.300279 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-475f1249-7d43-4bfa-a941-6b0ad6501013 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1491 microversion: 2.1 time: 0.322837 Aug 04 04:23:28.302741 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 91/197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:27 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1491 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:28.304864 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:28.304864 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:28.307994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a543638f-efb7-4053-856c-5f13dafef3d2 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:28.311524 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:28.311524 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:28.321824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a543638f-efb7-4053-856c-5f13dafef3d2 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:28.323456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a543638f-efb7-4053-856c-5f13dafef3d2 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:28.629369 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-869e12cc-da5a-4d24-99d6-c4439944754a tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/344719984/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.343198 Aug 04 04:23:28.630736 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 107/198] 10.222.0.69 () {62 vars in 1262 bytes} [Thu Aug 4 04:23:28 2022] POST /compute/v2.1/flavors/344719984/os-extra_specs => generated 62 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:28.648223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e815e187-524f-499b-9256-4f32a89d15c0 tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:28.649762 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:28.649762 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:28.680721 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e815e187-524f-499b-9256-4f32a89d15c0 tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/344719984" status: 202 len: 0 microversion: 2.86 time: 0.043297 Aug 04 04:23:28.682080 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 108/199] 10.222.0.69 () {60 vars in 1199 bytes} [Thu Aug 4 04:23:28 2022] DELETE /compute/v2.1/flavors/344719984 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:23:28.696018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6d11401f-f898-46fb-9b2f-19361e109a0f tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:28.745799 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6d11401f-f898-46fb-9b2f-19361e109a0f tempest-FlavorMetadataValidation-1761490314 tempest-FlavorMetadataValidation-1761490314-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6680 microversion: 2.86 time: 0.059213 Aug 04 04:23:28.751352 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 109/200] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:23:28 2022] GET /compute/v2.1/flavors/detail => generated 6680 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:23:29.204635 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a543638f-efb7-4053-856c-5f13dafef3d2 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.899996 Aug 04 04:23:29.206004 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 92/201] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:28 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:29.217532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-71720218-b7fa-4705-83d5-af1d32e1b0a0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:29.218308 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:29.218308 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:29.261084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-71720218-b7fa-4705-83d5-af1d32e1b0a0 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.047929 Aug 04 04:23:29.261981 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 110/202] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:29 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 04:23:29.275271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f360b7f-0023-4ae4-8b14-436dacac822b tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1092146415"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:29.278098 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:29.278098 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:29.279113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-2f360b7f-0023-4ae4-8b14-436dacac822b tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid 7d624ff6-1a89-4e21-a6dd-27cddf316e66 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:29.294807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:29.295439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:29.312038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:29.313130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:29.313911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:29.314344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:29.341492 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f360b7f-0023-4ae4-8b14-436dacac822b tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069254 Aug 04 04:23:29.353232 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 93/203] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:29.366759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:29.369119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:29.383010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:29.385746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:29.386712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:29.389955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:29.395739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:29.476711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:29.493956 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0253dbde-1568-436a-90d9-620760671b30 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1314 microversion: 2.1 time: 0.200209 Aug 04 04:23:29.508778 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 111/204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:29 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:29.517316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0437bea2-5553-457b-9246-7473da48df53 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:29.519808 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:29.519808 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:29.567501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0437bea2-5553-457b-9246-7473da48df53 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:29.567950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0437bea2-5553-457b-9246-7473da48df53 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:29.784892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:29.800052 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-962b0c4c-3397-4e60-a4fd-b50ba50f1f61 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.444243 Aug 04 04:23:29.807443 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 94/205] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:29 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:29.826012 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0437bea2-5553-457b-9246-7473da48df53 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.323803 Aug 04 04:23:29.826693 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 112/206] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:29 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:29.839314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2fce421-55f9-488b-897d-1227a361a048 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:29.840632 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:29.840632 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:29.860102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2fce421-55f9-488b-897d-1227a361a048 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.023400 Aug 04 04:23:29.863723 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 95/207] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:23:29 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:23:29.877286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ee09cce-5a67-4e01-a41e-83c008474b82 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:29.881348 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:29.881348 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:29.915031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ee09cce-5a67-4e01-a41e-83c008474b82 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:29.917386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ee09cce-5a67-4e01-a41e-83c008474b82 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:30.188558 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ee09cce-5a67-4e01-a41e-83c008474b82 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.319284 Aug 04 04:23:30.190078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 113/208] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:29 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:30.202032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47724e1e-8bad-4ff1-9556-f2a3f9658af6 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:30.203630 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:30.203630 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:30.248075 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-47724e1e-8bad-4ff1-9556-f2a3f9658af6 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.050883 Aug 04 04:23:30.250437 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 96/209] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:30 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:30.259486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6fc51c1-e12f-4f00-b1e5-b3e12c5fd484 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1739328935"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:30.337604 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:30.337604 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:30.341346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.aggregate [None req-f6fc51c1-e12f-4f00-b1e5-b3e12c5fd484 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid 84d4f9ca-b4df-42b5-8b1c-37f6c6085e23 for aggregate {{(pid=119343) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:30.407168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:DELETE=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:30.449442 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6fc51c1-e12f-4f00-b1e5-b3e12c5fd484 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.192745 Aug 04 04:23:30.450370 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 114/210] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:30.463257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4d2eeb7-9d7a-4647-9c76-9c81a16a7569 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:30.468625 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:30.468625 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:30.479738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4d2eeb7-9d7a-4647-9c76-9c81a16a7569 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:30.480184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4d2eeb7-9d7a-4647-9c76-9c81a16a7569 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:30.518280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:30.519150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:30.528409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:30.535288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:30.537241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:30.549189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:30.713761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:30.727400 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ef3a2695-22ae-4941-891b-c656ce62cc8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1320 microversion: 2.1 time: 0.214516 Aug 04 04:23:30.735165 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 115/211] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:30 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:30.747357 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4d2eeb7-9d7a-4647-9c76-9c81a16a7569 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.289206 Aug 04 04:23:30.756258 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 97/212] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:30 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:30.759875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93418d6e-a659-4653-8b01-e80748af86a1 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:30.760561 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:30.760561 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:30.769232 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93418d6e-a659-4653-8b01-e80748af86a1 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013037 Aug 04 04:23:30.773492 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 116/213] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:23:30 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:30.786291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0cd2bbcb-e61a-4b13-81b9-ed0842a634bc tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:30.789818 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:30.789818 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:30.801295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cd2bbcb-e61a-4b13-81b9-ed0842a634bc tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:30.802123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cd2bbcb-e61a-4b13-81b9-ed0842a634bc tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:30.821491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:30.822476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:30.836298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:30.837413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:30.839063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:30.839679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:31.000521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0cd2bbcb-e61a-4b13-81b9-ed0842a634bc tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.215753 Aug 04 04:23:31.001727 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 98/214] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:30 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:31.012746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-969612ff-4d73-4761-bcdf-3f4042a168f9 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:31.013743 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.013743 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:31.062832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-969612ff-4d73-4761-bcdf-3f4042a168f9 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.053048 Aug 04 04:23:31.065391 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 99/215] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:31 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:31.076084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce184997-c298-48dc-a251-5ea4fd2c5b28 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2129282033"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:31.079581 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.079581 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:31.080839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-ce184997-c298-48dc-a251-5ea4fd2c5b28 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid a70fb216-109e-42b5-a79d-35035027c612 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:31.084813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:31.098559 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d10268d-1105-4897-8fe6-158feb7fe585 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.281250 Aug 04 04:23:31.105097 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 117/216] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:30 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:31.124447 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce184997-c298-48dc-a251-5ea4fd2c5b28 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052391 Aug 04 04:23:31.125958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 100/217] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:31.137223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a692916-bfbc-4d77-a796-290d089770b4 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:31.146801 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.146801 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:31.169699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a692916-bfbc-4d77-a796-290d089770b4 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:31.170749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a692916-bfbc-4d77-a796-290d089770b4 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:31.430289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a692916-bfbc-4d77-a796-290d089770b4 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.296334 Aug 04 04:23:31.431533 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 118/218] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:31 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:23:31.442845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e6ddb7f-5dee-4cdd-b72f-54ddef0c81bf tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:31.445412 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.445412 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:31.476159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb7f-5dee-4cdd-b72f-54ddef0c81bf tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:31.477481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb7f-5dee-4cdd-b72f-54ddef0c81bf tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:31.681752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e6ddb7f-5dee-4cdd-b72f-54ddef0c81bf tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.242550 Aug 04 04:23:31.684129 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 101/219] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:31 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:31.700733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1647c4a-994d-4141-93db-a3b034b1a07c tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:31.703904 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.703904 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:31.735232 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1647c4a-994d-4141-93db-a3b034b1a07c tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.040018 Aug 04 04:23:31.736445 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 119/220] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:31 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:31.750428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9081a5c6-3918-47ec-9734-fd40a4a4fb99 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1487236483"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:31.758255 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.758255 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:31.763756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-9081a5c6-3918-47ec-9734-fd40a4a4fb99 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid 92abc861-cedb-4af1-9676-6f0e3d803d11 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:31.768314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-69b78b5d-3793-4be3-a406-b649523bf8cd tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-710600506"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:31.783292 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.783292 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:31.788812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.aggregate [None req-69b78b5d-3793-4be3-a406-b649523bf8cd tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid 114ae185-d8a4-49b9-8f49-7095789bd64d for aggregate {{(pid=119343) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:31.873390 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9081a5c6-3918-47ec-9734-fd40a4a4fb99 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.130953 Aug 04 04:23:31.879623 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 102/221] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:31.909151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:31.910576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:31.911175 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-69b78b5d-3793-4be3-a406-b649523bf8cd tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.154750 Aug 04 04:23:31.912329 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 120/222] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:31 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:31.928030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-28500146-a320-4dd1-a82d-43a71cc43c43 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:31.929299 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:31.929299 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:31.948614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:31.948614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:31.957106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:31.957106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:31.987310 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-28500146-a320-4dd1-a82d-43a71cc43c43 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.070017 Aug 04 04:23:31.988456 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 121/223] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:31 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:32.001831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3aea1528-2928-4acb-bdba-a661a187115b tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:32.005264 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.005264 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:32.036915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aea1528-2928-4acb-bdba-a661a187115b tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:32.038131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aea1528-2928-4acb-bdba-a661a187115b tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:32.152491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:32.176196 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83f2a4bb-4245-4477-8340-ca27f62336a9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1320 microversion: 2.1 time: 0.280256 Aug 04 04:23:32.178530 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 103/224] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:31 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:32.204691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-617eebae-99ca-4bb4-9dc4-a4ebdfb32fc3 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:32.204691 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.204691 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:32.235732 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-617eebae-99ca-4bb4-9dc4-a4ebdfb32fc3 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-617eebae-99ca-4bb4-9dc4-a4ebdfb32fc3 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Request method failure captured: Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mcvIHhVCVAUe-2MrfAwGtxytZThh2lFmF-WTdC-vM1LrwzczU-vNoZZWn1rYVztL7k_WJl-3VflEoLwxxc0_kN9M1hrz84J7eoU_gHcPFwlfkT222dBn94teY-vxhmxJ0whi2Ip_cmq1gPBUH6ytKKSY0Q61k3b3a_CXJG1JoNRyE Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:32.242689 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f54be780d2d148c0ad3d915cd6cdfb74", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42951f5c7b3d4866b51f8e7a8b84bd6d Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: exception: Aggregate 5 could not be found. Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '5'} Aug 04 04:23:32.243908 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.244597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 04 04:23:32.245640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.246554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-617eebae-99ca-4bb4-9dc4-a4ebdfb32fc3 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:32.246554 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-617eebae-99ca-4bb4-9dc4-a4ebdfb32fc3 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.063997 Aug 04 04:23:32.251052 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 104/225] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:23:32 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:32.278380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:32.280258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:32.311972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:32.313016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:32.313822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:32.314262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:32.396820 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3aea1528-2928-4acb-bdba-a661a187115b tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.406991 Aug 04 04:23:32.402230 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 122/226] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:31 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:32.410865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-346ebfd7-bce2-48c1-8fc3-fd2cd89042dd tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:32.412659 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.412659 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:32.433055 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-346ebfd7-bce2-48c1-8fc3-fd2cd89042dd tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-346ebfd7-bce2-48c1-8fc3-fd2cd89042dd tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Request method failure captured: Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mcvIHhVCVAUe-2MrfAwGtxytZThh2lFmF-WTdC-vM1LrwzczU-vNoZZWn1rYVztL7k_WJl-3VflEoLwxxc0_kN9M1hrz84J7eoU_gHcPFwlfkT222dBn94teY-vxhmxJ0whi2Ip_cmq1gPBUH6ytKKSY0Q61k3b3a_CXJG1JoNRyE Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:32.441257 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f54be780d2d148c0ad3d915cd6cdfb74", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 42951f5c7b3d4866b51f8e7a8b84bd6d Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: exception: Aggregate 5 could not be found. Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5'} Aug 04 04:23:32.442653 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:32.443528 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.444520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-346ebfd7-bce2-48c1-8fc3-fd2cd89042dd tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-346ebfd7-bce2-48c1-8fc3-fd2cd89042dd tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.038343 Aug 04 04:23:32.445580 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 123/227] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:32 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:32.451913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1e76b80-98b8-48c9-a495-41a959287264 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:32.454623 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.454623 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:32.463792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1e76b80-98b8-48c9-a495-41a959287264 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:32.464233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1e76b80-98b8-48c9-a495-41a959287264 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:32.470817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:32.506565 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-c1e76b80-98b8-48c9-a495-41a959287264 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-851337-5. Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1e76b80-98b8-48c9-a495-41a959287264 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 39 Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:32.528344 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: {"add_host": {"host": "n-h2-851337-5"}} Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:32.529871 n-d-851337-5 devstack@n-api.service[119343]: exception: Aggregate 6 already has host n-h2-851337-5. Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-851337-5'}}} Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result.read() Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:23:32.530764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-851337-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:23:32.532547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:23:32.533786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:23:32.534945 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result.read() Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-851337-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 4, 23, 32, 494320), 'updated_at': None, 'host': 'n-h2-851337-5', 'aggregate_id': 6}] Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.540016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-851337-5. Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.543453 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-851337-5. Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:32.544856 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:32.546225 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-851337-5. Aug 04 04:23:32.546225 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.546225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1e76b80-98b8-48c9-a495-41a959287264 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-851337-5. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:32.551546 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1e76b80-98b8-48c9-a495-41a959287264 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.106000 Aug 04 04:23:32.553251 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 124/228] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:32 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 04 04:23:32.568071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f519d069-a170-4785-9899-c4f32917187e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1647391876", "name": "tempest-test_aggregate-494824892"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:32.613433 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.613433 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:32.618626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.aggregate [None req-f519d069-a170-4785-9899-c4f32917187e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid 1aa3fb8c-dd8f-4d24-819b-9156c730cc7e for aggregate {{(pid=119343) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:32.698348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f519d069-a170-4785-9899-c4f32917187e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.138620 Aug 04 04:23:32.700999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:32.706186 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 125/229] 10.222.0.69 () {60 vars in 1165 bytes} [Thu Aug 4 04:23:32 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:32.716958 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6999bd64-7109-4fd4-870b-f2a356771cfd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.463847 Aug 04 04:23:32.716958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 105/230] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:32 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:32.720764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-169f3717-9b99-480a-a624-fa7f207f8655 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:32.723266 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.723266 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:32.729461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f63a8012-6c42-4a55-9594-671345c8819e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:32.740075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-169f3717-9b99-480a-a624-fa7f207f8655 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:32.740825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-169f3717-9b99-480a-a624-fa7f207f8655 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:32.743966 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.743966 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:32.799597 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f63a8012-6c42-4a55-9594-671345c8819e tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.074950 Aug 04 04:23:32.800571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 106/231] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:32 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:32.809333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b19882a-73a8-420f-8f85-9da6c888bc3a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:32.810160 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.810160 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:32.850030 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1b19882a-73a8-420f-8f85-9da6c888bc3a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b19882a-73a8-420f-8f85-9da6c888bc3a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Request method failure captured: Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mcvIHhVCVAUe-2MrfAwGtxytZThh2lFmF-WTdC-vM1LrwzczU-vNoZZWn1rYVztL7k_WJl-3VflEoLwxxc0_kN9M1hrz84J7eoU_gHcPFwlfkT222dBn94teY-vxhmxJ0whi2Ip_cmq1gPBUH6ytKKSY0Q61k3b3a_CXJG1JoNRyE Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:32.852778 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f54be780d2d148c0ad3d915cd6cdfb74", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42951f5c7b3d4866b51f8e7a8b84bd6d Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: exception: Aggregate 7 could not be found. Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '7'} Aug 04 04:23:32.854522 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.855896 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 04 04:23:32.862627 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.865416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b19882a-73a8-420f-8f85-9da6c888bc3a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:32.866435 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b19882a-73a8-420f-8f85-9da6c888bc3a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.060919 Aug 04 04:23:32.867394 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 107/232] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:23:32 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 04:23:32.894582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69e7ab6c-df7c-4b29-97f1-c76b4b476869 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:32.895533 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.895533 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:32.909056 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-69e7ab6c-df7c-4b29-97f1-c76b4b476869 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69e7ab6c-df7c-4b29-97f1-c76b4b476869 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Request method failure captured: Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mcvIHhVCVAUe-2MrfAwGtxytZThh2lFmF-WTdC-vM1LrwzczU-vNoZZWn1rYVztL7k_WJl-3VflEoLwxxc0_kN9M1hrz84J7eoU_gHcPFwlfkT222dBn94teY-vxhmxJ0whi2Ip_cmq1gPBUH6ytKKSY0Q61k3b3a_CXJG1JoNRyE Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:32.910803 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f54be780d2d148c0ad3d915cd6cdfb74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f54be780d2d148c0ad3d915cd6cdfb74", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f54be780d2d148c0ad3d915cd6cdfb74 Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2001762172 Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42951f5c7b3d4866b51f8e7a8b84bd6d Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminTestJSON-2001762172-project-admin Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: exception: Aggregate 7 could not be found. Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '7'} Aug 04 04:23:32.912297 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:32.913118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:32.914320 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:32.915687 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:32.915687 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:32.915687 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:32.915687 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 04 04:23:32.915687 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:32.915687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69e7ab6c-df7c-4b29-97f1-c76b4b476869 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:32.916640 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69e7ab6c-df7c-4b29-97f1-c76b4b476869 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.035010 Aug 04 04:23:32.917238 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 108/233] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:32 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:32.937489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33319d33-a6f6-4bc2-a88a-0aaa23c0493f tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-410791690"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:32.941098 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.941098 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:32.942244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-33319d33-a6f6-4bc2-a88a-0aaa23c0493f tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid dd5c414a-57c9-446f-a11a-3cb002779e7f for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:32.969443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33319d33-a6f6-4bc2-a88a-0aaa23c0493f tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042450 Aug 04 04:23:32.970880 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 109/234] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:32 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:32.983416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15dc16ee-92cb-4b0e-968b-5f809d55076a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:32.984881 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:32.984881 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:32.994369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15dc16ee-92cb-4b0e-968b-5f809d55076a tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.015465 Aug 04 04:23:32.995177 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 110/235] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:23:32 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:33.007854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9db31463-1b68-41ba-9d8a-7182e2f9db7c tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:33.012245 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.012245 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:33.029358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:33.049379 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9db31463-1b68-41ba-9d8a-7182e2f9db7c tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.046187 Aug 04 04:23:33.058433 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 111/236] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:33 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:33.069344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c22016da-3153-4cc7-9347-7c6283c415c4 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:33.070662 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.070662 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:33.098892 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c22016da-3153-4cc7-9347-7c6283c415c4 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.032971 Aug 04 04:23:33.099992 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 112/237] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:23:33 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:23:33.117269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c6df3e59-d814-40cd-a477-1bbe93f9a080 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:33.118354 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.118354 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:33.161754 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c6df3e59-d814-40cd-a477-1bbe93f9a080 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.054409 Aug 04 04:23:33.163617 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 113/238] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:33 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 04:23:33.187034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b488412-5c5b-4e7e-afb3-80fe5f25ac51 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1996519185", "availability_zone": "tempest-test_az-1747880519"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:33.195746 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.195746 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:33.198452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-3b488412-5c5b-4e7e-afb3-80fe5f25ac51 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid 45efc8de-3e5d-419d-8075-c7972f6a2652 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:33.294583 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b488412-5c5b-4e7e-afb3-80fe5f25ac51 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.124764 Aug 04 04:23:33.295982 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 114/239] 10.222.0.69 () {60 vars in 1165 bytes} [Thu Aug 4 04:23:33 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:33.314061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:33.316166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:33.333798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:33.334330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:33.335183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:33.335617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:33.346001 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-169f3717-9b99-480a-a624-fa7f207f8655 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.637266 Aug 04 04:23:33.349882 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 126/240] 10.222.0.69 () {60 vars in 1191 bytes} [Thu Aug 4 04:23:32 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:33.364753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75688344-0e6c-40ca-9008-767626f19721 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1996519185_new", "availability_zone": "tempest-test_az-1747880519_new"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:33.536190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:33.550387 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f83d7007-cb7f-483a-b791-9320bb33e174 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1320 microversion: 2.1 time: 0.245491 Aug 04 04:23:33.556097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 115/241] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:33 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:33.569917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9fc6bdbc-1d46-4da9-8960-808d9df76648 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:33.575737 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.575737 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:33.605313 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.605313 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:33.621616 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9fc6bdbc-1d46-4da9-8960-808d9df76648 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.064032 Aug 04 04:23:33.622563 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 116/242] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:33.637815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3138de12-b06c-49dc-affc-dbc4efd0d920 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-810001129"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:33.649019 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.649019 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:33.653887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-3138de12-b06c-49dc-affc-dbc4efd0d920 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid da204662-93e4-43e0-b971-35c865a5bb4a for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:33.677464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75688344-0e6c-40ca-9008-767626f19721 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:33.680800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75688344-0e6c-40ca-9008-767626f19721 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:33.714392 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3138de12-b06c-49dc-affc-dbc4efd0d920 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084305 Aug 04 04:23:33.719416 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 117/243] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:33.735654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8c3a07e-42be-4a24-a2c2-c7c6f7ef9aca tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1210639419"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:33.745397 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:33.745397 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:33.747751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-a8c3a07e-42be-4a24-a2c2-c7c6f7ef9aca tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Generated uuid a9637f7f-a99c-42ef-8601-bc4d968fa353 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:33.778912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-75688344-0e6c-40ca-9008-767626f19721 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.425495 Aug 04 04:23:33.788398 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 127/244] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:23:33 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:33.802100 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8c3a07e-42be-4a24-a2c2-c7c6f7ef9aca tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.080803 Aug 04 04:23:33.805006 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 118/245] 10.222.0.69 () {62 vars in 1205 bytes} [Thu Aug 4 04:23:33 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:33.819656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:33.824947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:33.854662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:33.855603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:33.858126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:33.860568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:34.326174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:34.352493 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a912eb1-1949-4482-a112-886b87c14ffc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.542426 Aug 04 04:23:34.359919 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 119/246] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:33 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:34.378817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c0964c5-239a-4956-8bd3-d32f243786d9 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:34.383971 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.383971 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:34.386302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00baab65-87ad-4711-8240-74f7ff6e4200 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:34.390990 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.390990 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:34.392695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1c0964c5-239a-4956-8bd3-d32f243786d9 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '1487d472fe8a43598f20aa398b68273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a6e4fc79b147c0963d00d810e3c986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c0964c5-239a-4956-8bd3-d32f243786d9 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Request method failure captured: Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 39 Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mbsozV0BrqIWftHrPgAm_iJVd6Cr48ywDISRHIBWsVvX0mijFoLSipCPNYayhQSx43PzVcE-5tCgudZPwWa0LUkJyMhUJQxaFL-fj5EKKO0nbwSp9OlkJf1t7uUtBR9-CeSmUvqMXebyjUL5Wp1NIeavPit9ivrjkMdGroiQbJ3O0 Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:34.396527 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67a6e4fc79b147c0963d00d810e3c986", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 1487d472fe8a43598f20aa398b68273d Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: {"add_host": {"host": "n-h2-851337-5"}} Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:34.397641 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-851337-5'}}} Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:34.398327 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 04:23:34.399355 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:34.400352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c0964c5-239a-4956-8bd3-d32f243786d9 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:34.404005 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c0964c5-239a-4956-8bd3-d32f243786d9 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] 10.222.0.69 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.612622 Aug 04 04:23:34.407762 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 128/247] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 04:23:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 618 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:34.412573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40fe2030-e972-49a1-b6df-4fcd85ed4e91 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1480003119"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:34.424046 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.424046 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:34.429510 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00baab65-87ad-4711-8240-74f7ff6e4200 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 768 microversion: 2.1 time: 0.058068 Aug 04 04:23:34.430094 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 120/248] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:23:34 2022] GET /compute/v2.1/os-aggregates => generated 768 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:34.447082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa470af2-9902-4e74-a431-633e59467472 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:34.447867 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.447867 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:34.495986 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40fe2030-e972-49a1-b6df-4fcd85ed4e91 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.087007 Aug 04 04:23:34.497089 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 129/249] 10.222.0.69 () {62 vars in 1213 bytes} [Thu Aug 4 04:23:34 2022] PUT /compute/v2.1/os-aggregates/11 => generated 300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:34.505818 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa470af2-9902-4e74-a431-633e59467472 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.072646 Aug 04 04:23:34.507952 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 121/250] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:34 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:34.508192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d00a872-b80d-41a0-a133-125a5df20bb8 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:34.509302 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.509302 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:34.521592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36d3420f-e25b-4c24-ba02-194f112d5eb9 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:34.522559 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.522559 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:34.534274 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-36d3420f-e25b-4c24-ba02-194f112d5eb9 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.016232 Aug 04 04:23:34.535287 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 122/251] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Aug 4 04:23:34 2022] GET /compute/v2.1/os-aggregates/11 => generated 300 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:34.540209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbab0796-5eb2-4f0e-bc18-2e4e19b7483f tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1580790616"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:34.543946 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.543946 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:34.544827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-dbab0796-5eb2-4f0e-bc18-2e4e19b7483f tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid 774ac202-022c-4dce-9ed7-329a59f0f549 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:34.571420 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d00a872-b80d-41a0-a133-125a5df20bb8 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.070016 Aug 04 04:23:34.574862 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 130/252] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:34 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:34.587127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd6daa9b-dcfb-46d0-bb50-3963a4532a1d tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:34.595272 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.595272 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:34.627904 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbab0796-5eb2-4f0e-bc18-2e4e19b7483f tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091519 Aug 04 04:23:34.628527 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 123/253] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:34.635462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd6daa9b-dcfb-46d0-bb50-3963a4532a1d tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:34.636018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd6daa9b-dcfb-46d0-bb50-3963a4532a1d tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:34.656823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:34.657650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:34.675088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:34.675799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:34.676864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:34.677518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:34.861701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:34.878048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-288bc8b2-610f-45e8-84a4-12f91986baf4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1320 microversion: 2.1 time: 0.247634 Aug 04 04:23:34.878645 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 124/254] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:34 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:34.888514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba44e67b-a57f-4915-af40-53ba07de2ac5 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1486515955"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:34.896383 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.896383 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:34.903506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-ba44e67b-a57f-4915-af40-53ba07de2ac5 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Generated uuid 1ee3a33d-ce06-4982-bfba-e317d285c42f for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:34.960214 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba44e67b-a57f-4915-af40-53ba07de2ac5 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.080151 Aug 04 04:23:34.961259 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 125/255] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:34.970513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1790106059"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:34.976573 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:34.976573 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:34.987324 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd6daa9b-dcfb-46d0-bb50-3963a4532a1d tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 315 microversion: 2.41 time: 0.411161 Aug 04 04:23:34.992654 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 131/256] 10.222.0.69 () {62 vars in 1235 bytes} [Thu Aug 4 04:23:34 2022] POST /compute/v2.1/os-aggregates/11/action => generated 315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:35.002839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:35.003569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:35.019852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:35.020992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:35.052597 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1790106059 could not be found. Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 58 Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:35.055856 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: {"add_host": {"host": "tempest-nonexist_host-1790106059"}} Aug 04 04:23:35.057172 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: exception: Compute host tempest-nonexist_host-1790106059 could not be found. Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-1790106059'}}} Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1790106059' is not mapped to any cell Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:35.057902 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 04 04:23:35.059233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1790106059 could not be found. Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1790106059 could not be found. Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:35.060249 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.061507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:35.061507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:35.061507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:35.061507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:35.061507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:35.061507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1790106059 could not be found. Aug 04 04:23:35.061507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:35.064182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1790106059 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:35.065297 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb72ab24-c4ed-4126-bacb-4bb6857458f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.102869 Aug 04 04:23:35.066275 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 126/257] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 04:23:34 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:35.071610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c348f75-a648-42a5-b7be-39794f355f69 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:35.072582 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:35.072582 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:35.083829 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c348f75-a648-42a5-b7be-39794f355f69 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 700 microversion: 2.1 time: 0.015769 Aug 04 04:23:35.085011 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 127/258] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:23:35 2022] GET /compute/v2.1/os-aggregates => generated 700 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:35.090568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd937b36-f668-4bae-83f9-c612a3dee7a9 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:35.094053 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:35.094053 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:35.114360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd937b36-f668-4bae-83f9-c612a3dee7a9 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:35.114595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd937b36-f668-4bae-83f9-c612a3dee7a9 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:35.287424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-35675339", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:35.327362 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd937b36-f668-4bae-83f9-c612a3dee7a9 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 300 microversion: 2.41 time: 0.239408 Aug 04 04:23:35.330742 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 128/259] 10.222.0.69 () {62 vars in 1235 bytes} [Thu Aug 4 04:23:35 2022] POST /compute/v2.1/os-aggregates/11/action => generated 300 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:35.344746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1238224-996d-41bb-a17d-e3cc0494f9dc tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:35.346702 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:35.346702 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:35.422027 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1238224-996d-41bb-a17d-e3cc0494f9dc tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.089279 Aug 04 04:23:35.422623 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 129/260] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:35 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:35.426626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:23:35.431162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8e14c41-021d-4c9a-8981-ac71f7d86cf7 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:35.432036 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:35.432036 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:35.482640 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8e14c41-021d-4c9a-8981-ac71f7d86cf7 tempest-AggregatesAdminTestJSON-2001762172 tempest-AggregatesAdminTestJSON-2001762172-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.058839 Aug 04 04:23:35.490989 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 130/261] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:35 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:35.495132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2789cb80-5c0f-4ec7-a662-14845a286623 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:35.496658 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:35.496658 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:35.540183 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2789cb80-5c0f-4ec7-a662-14845a286623 tempest-AggregatesAdminTestV241-2005929259 tempest-AggregatesAdminTestV241-2005929259-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.043834 Aug 04 04:23:35.541199 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 131/262] 10.222.0.69 () {60 vars in 1196 bytes} [Thu Aug 4 04:23:35 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:35.575476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:35.579852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:35.601888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:35.602359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:35.605871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:35.606566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.265875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:23:36.266333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:23:36.266844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:23:36.267250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:23:36.267661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:23:36.293690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:36.303461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.303911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.308154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.309677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a9cebc0f-9f72-4aa2-9642-0a8edf1488c6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.764551 Aug 04 04:23:36.312592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.313102 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 132/263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:35 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:36.331603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-505b2b3d-52e2-48b0-95bc-e5abe6815322 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-505b2b3d-52e2-48b0-95bc-e5abe6815322 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 283 Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:36.337092 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:36.338316 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:23:36.338858 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:36.339470 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.340370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.341205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:23:36.341205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:23:36.341205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:23:36.341205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.341205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-505b2b3d-52e2-48b0-95bc-e5abe6815322 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:36.341508 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-505b2b3d-52e2-48b0-95bc-e5abe6815322 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.019128 Aug 04 04:23:36.341508 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 133/264] 10.222.0.69 () {60 vars in 1165 bytes} [Thu Aug 4 04:23:36 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:23:36.356976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:36.358420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:36.360888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Getting quotas for project df52a6a37edc4decb87471624d5ce915. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:23:36.372761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Getting quotas for user 878f8dd4c3b243e191bbb24696f5ebe3 and project df52a6a37edc4decb87471624d5ce915. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:23:36.378918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.380047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.383926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.384551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.399709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:UPDATE=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:36.404002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:23:36.411596 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] HTTP exception thrown: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.412837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Request method failure captured: Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc HTTP/1.1 Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mar60m0KmZ0eeW06gk3L8Guut05lhyc_6xpBvJRED2xLZYdfyYRPs-iD-MwCPW6fx4T7zL-CUklWEhxPZRwmZT5v_FlYAvTy-MHOcgyd9BduwKk6niWCWOUByZRmPc62Bv4lW77dYPZOHmxRR8gkozDJxCdYI4pklxFobzIcQGGok Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: b046531f3dc8443bad8b040202d8b432 Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:36.418594 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b046531f3dc8443bad8b040202d8b432", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: b046531f3dc8443bad8b040202d8b432 Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminTestJSON-552430792-project Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 31bbfbe3ada6470997b454753788b86e Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminTestJSON-552430792-project Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.419798 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '91f7b417-b7c3-4a6b-a229-ab7b635a84fc'} Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:36.420546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.422284 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.424602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Returning 404 to user: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:36.427014 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4f48af48-292c-411b-97bb-60b59d0fa76b tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "DELETE /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 404 len: 111 microversion: 2.1 time: 0.086590 Aug 04 04:23:36.436652 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 134/265] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:23:36 2022] DELETE /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:36.443902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:36.444787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:36.461014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.461650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.462662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.463402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.510377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c54efe24-cf16-4353-b4e6-e2e8d8175757 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.516347 Aug 04 04:23:36.518800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 132/266] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:23:36.527269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a2d590d-6627-4cd7-97f9-174cb4d3049d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a2d590d-6627-4cd7-97f9-174cb4d3049d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 27 Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:36.532806 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: {"aggregate": {"name": ""}} Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:36.534351 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '' Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:36.535174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:23:36.536523 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.541848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a2d590d-6627-4cd7-97f9-174cb4d3049d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:36.545915 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a2d590d-6627-4cd7-97f9-174cb4d3049d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023372 Aug 04 04:23:36.549482 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 133/267] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:36 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:23:36.561404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:36.563560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] [instance: 91f7b417-b7c3-4a6b-a229-ab7b635a84fc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:36.571782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.572524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.573521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:36.574410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:36.605153 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] HTTP exception thrown: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Request method failure captured: Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc HTTP/1.1 Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mar60m0KmZ0eeW06gk3L8Guut05lhyc_6xpBvJRED2xLZYdfyYRPs-iD-MwCPW6fx4T7zL-CUklWEhxPZRwmZT5v_FlYAvTy-MHOcgyd9BduwKk6niWCWOUByZRmPc62Bv4lW77dYPZOHmxRR8gkozDJxCdYI4pklxFobzIcQGGok Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b046531f3dc8443bad8b040202d8b432 Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:36.609344 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b046531f3dc8443bad8b040202d8b432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b046531f3dc8443bad8b040202d8b432", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b046531f3dc8443bad8b040202d8b432 Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-552430792 Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AggregatesAdminTestJSON-552430792-project Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 31bbfbe3ada6470997b454753788b86e Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AggregatesAdminTestJSON-552430792-project Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.610829 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '91f7b417-b7c3-4a6b-a229-ab7b635a84fc'} Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:36.611645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. Aug 04 04:23:36.612924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.616532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] Returning 404 to user: Instance 91f7b417-b7c3-4a6b-a229-ab7b635a84fc could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:36.618371 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c92c0ce9-7641-48a6-a917-fa41269517ca tempest-AggregatesAdminTestJSON-552430792 tempest-AggregatesAdminTestJSON-552430792-project] 10.222.0.69 "GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc" status: 404 len: 111 microversion: 2.1 time: 0.063138 Aug 04 04:23:36.619157 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 134/268] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:36 2022] GET /compute/v2.1/servers/91f7b417-b7c3-4a6b-a229-ab7b635a84fc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:36.625184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-025e8195-3fff-42e3-bb2f-a6c9bdc900af tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:36.626343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-025e8195-3fff-42e3-bb2f-a6c9bdc900af tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:36.636879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:36.651451 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1ef66a1-a711-434c-b7aa-13db655d9ed9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1320 microversion: 2.1 time: 0.213175 Aug 04 04:23:36.667169 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 135/269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:36 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:36.680588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2bc649cf-c875-4aa4-a1e7-1cd3d3ffb6d7 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2131984451"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:36.686597 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:36.686597 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:36.687680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2bc649cf-c875-4aa4-a1e7-1cd3d3ffb6d7 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '1487d472fe8a43598f20aa398b68273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a6e4fc79b147c0963d00d810e3c986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2bc649cf-c875-4aa4-a1e7-1cd3d3ffb6d7 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Request method failure captured: Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 60 Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mbsozV0BrqIWftHrPgAm_iJVd6Cr48ywDISRHIBWsVvX0mijFoLSipCPNYayhQSx43PzVcE-5tCgudZPwWa0LUkJyMhUJQxaFL-fj5EKKO0nbwSp9OlkJf1t7uUtBR9-CeSmUvqMXebyjUL5Wp1NIeavPit9ivrjkMdGroiQbJ3O0 Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:36.689366 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67a6e4fc79b147c0963d00d810e3c986", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1487d472fe8a43598f20aa398b68273d Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: {"aggregate": {"name": "tempest-test_aggregate-2131984451"}} Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:36.690887 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2131984451'}}} Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:36.691831 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:36.693015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 04:23:36.694265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.694265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2bc649cf-c875-4aa4-a1e7-1cd3d3ffb6d7 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:36.695082 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2bc649cf-c875-4aa4-a1e7-1cd3d3ffb6d7 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.026459 Aug 04 04:23:36.701909 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 136/270] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:36 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:36.711625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1acd767b-5fd7-48a7-a7de-b8251a039331 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1686435921"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:36.717674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-1acd767b-5fd7-48a7-a7de-b8251a039331 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid ca098bda-e346-4b92-81fd-f91d23fcc263 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:36.768334 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1acd767b-5fd7-48a7-a7de-b8251a039331 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064503 Aug 04 04:23:36.775010 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 137/271] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:36.780562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f4109d5-c420-45f0-9bde-2d514e0c80f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1686435921"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:36.783936 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:36.783936 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:36.785388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-5f4109d5-c420-45f0-9bde-2d514e0c80f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid a0981d50-9c5a-4e51-aec8-6ffb3b4dc228 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:36.806139 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5f4109d5-c420-45f0-9bde-2d514e0c80f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1686435921 already exists. Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f4109d5-c420-45f0-9bde-2d514e0c80f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 60 Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:36.809896 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: {"aggregate": {"name": "tempest-test_aggregate-1686435921"}} Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:36.811222 n-d-851337-5 devstack@n-api.service[119342]: exception: Aggregate tempest-test_aggregate-1686435921 already exists. Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1686435921'}}} Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 04 04:23:36.812605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1686435921 already exists. Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:36.814408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1686435921 already exists. Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1686435921 already exists. Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f4109d5-c420-45f0-9bde-2d514e0c80f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1686435921 already exists. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:36.815878 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f4109d5-c420-45f0-9bde-2d514e0c80f5 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.035187 Aug 04 04:23:36.819979 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 138/272] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:36 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:36.829198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7888c5c4-505d-46d6-9693-cefcd348ee74 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:36.832271 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:36.832271 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:36.840121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-025e8195-3fff-42e3-bb2f-a6c9bdc900af tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:36.850884 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-025e8195-3fff-42e3-bb2f-a6c9bdc900af tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1217 microversion: 2.1 time: 0.230298 Aug 04 04:23:36.853880 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 135/273] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:36 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:36.865513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:DELETE=14 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:36.880151 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7888c5c4-505d-46d6-9693-cefcd348ee74 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.057645 Aug 04 04:23:36.888656 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 139/274] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:36 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:36.900068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1e5d049-ac99-4e6c-97f3-f98e4f7e124c tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-11461281"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:36.902942 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:36.902942 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:36.904079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.aggregate [None req-e1e5d049-ac99-4e6c-97f3-f98e4f7e124c tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid 7481ac41-2574-45c3-bdb2-4a631e395c3c for aggregate {{(pid=119343) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:36.961163 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1e5d049-ac99-4e6c-97f3-f98e4f7e124c tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.069235 Aug 04 04:23:36.962824 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 136/275] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:36.975367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67672743-b620-4e75-aa16-279215275805 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:36.976367 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:36.976367 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:36.977333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67672743-b620-4e75-aa16-279215275805 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '1487d472fe8a43598f20aa398b68273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a6e4fc79b147c0963d00d810e3c986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67672743-b620-4e75-aa16-279215275805 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Request method failure captured: Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mbsozV0BrqIWftHrPgAm_iJVd6Cr48ywDISRHIBWsVvX0mijFoLSipCPNYayhQSx43PzVcE-5tCgudZPwWa0LUkJyMhUJQxaFL-fj5EKKO0nbwSp9OlkJf1t7uUtBR9-CeSmUvqMXebyjUL5Wp1NIeavPit9ivrjkMdGroiQbJ3O0 Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:36.978908 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67a6e4fc79b147c0963d00d810e3c986", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1487d472fe8a43598f20aa398b68273d Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 04:23:36.980360 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '15'} Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:36.981315 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 04:23:36.982750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:36.986128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67672743-b620-4e75-aa16-279215275805 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:36.989437 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67672743-b620-4e75-aa16-279215275805 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.019663 Aug 04 04:23:37.005472 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 140/276] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:37.006596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c4e20a59-2e77-4cd2-84a9-65358b8a4c86 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.008159 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:37.008159 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:37.045521 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c4e20a59-2e77-4cd2-84a9-65358b8a4c86 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.043683 Aug 04 04:23:37.055121 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 137/277] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:37 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:37.064474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86fe076f-bea2-441b-9be1-b6997c02ad52 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.081607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-86fe076f-bea2-441b-9be1-b6997c02ad52 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86fe076f-bea2-441b-9be1-b6997c02ad52 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:37.083707 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: exception: Aggregate -1 could not be found. Aug 04 04:23:37.088625 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '-1'} Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 04:23:37.089496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.090649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.091964 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.091964 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.091964 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:37.091964 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:37.091964 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 04:23:37.091964 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.095602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86fe076f-bea2-441b-9be1-b6997c02ad52 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:37.096733 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-86fe076f-bea2-441b-9be1-b6997c02ad52 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042767 Aug 04 04:23:37.101669 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 141/278] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:37 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:37.112008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddea58e4-dc85-43e7-82f8-7fa7a0009826 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1382331414"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:37.116011 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:37.116011 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:37.117570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.aggregate [None req-ddea58e4-dc85-43e7-82f8-7fa7a0009826 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid 7f7944fb-6923-4151-9f7c-2d0d7993ccb2 for aggregate {{(pid=119343) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:37.173785 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ddea58e4-dc85-43e7-82f8-7fa7a0009826 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070462 Aug 04 04:23:37.181632 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 138/279] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:37.191773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a5587b4-af7a-4207-9634-ecbf9cfbe569 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.193751 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:37.193751 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:37.195108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a5587b4-af7a-4207-9634-ecbf9cfbe569 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '1487d472fe8a43598f20aa398b68273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a6e4fc79b147c0963d00d810e3c986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a5587b4-af7a-4207-9634-ecbf9cfbe569 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Request method failure captured: Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mbsozV0BrqIWftHrPgAm_iJVd6Cr48ywDISRHIBWsVvX0mijFoLSipCPNYayhQSx43PzVcE-5tCgudZPwWa0LUkJyMhUJQxaFL-fj5EKKO0nbwSp9OlkJf1t7uUtBR9-CeSmUvqMXebyjUL5Wp1NIeavPit9ivrjkMdGroiQbJ3O0 Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:37.197973 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67a6e4fc79b147c0963d00d810e3c986", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1487d472fe8a43598f20aa398b68273d Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 04:23:37.199164 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '16'} Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:37.199781 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 04:23:37.200943 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.205074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a5587b4-af7a-4207-9634-ecbf9cfbe569 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:37.207725 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a5587b4-af7a-4207-9634-ecbf9cfbe569 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] 10.222.0.69 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.023796 Aug 04 04:23:37.222358 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 142/280] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:37 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:37.227471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60ad5fd8-63e1-4372-87e9-78646571d459 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.228637 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:37.228637 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:37.280154 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60ad5fd8-63e1-4372-87e9-78646571d459 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.056331 Aug 04 04:23:37.285340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 139/281] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:37 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 04:23:37.294992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbcf87fb-b11d-4e23-bbc1-b1586559e117 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.315710 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-fbcf87fb-b11d-4e23-bbc1-b1586559e117 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbcf87fb-b11d-4e23-bbc1-b1586559e117 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:37.319401 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: exception: Aggregate -1 could not be found. Aug 04 04:23:37.320777 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '-1'} Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.321497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 04:23:37.322757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.325777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbcf87fb-b11d-4e23-bbc1-b1586559e117 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:37.328731 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fbcf87fb-b11d-4e23-bbc1-b1586559e117 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040883 Aug 04 04:23:37.334047 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 143/282] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:23:37 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:37.337242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.338370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:37.342810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ceacc6fe-6018-4189-806a-70a8443c22d6 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.343957 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:37.343957 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:37.345653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ceacc6fe-6018-4189-806a-70a8443c22d6 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '1487d472fe8a43598f20aa398b68273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a6e4fc79b147c0963d00d810e3c986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ceacc6fe-6018-4189-806a-70a8443c22d6 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Request method failure captured: Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mbsozV0BrqIWftHrPgAm_iJVd6Cr48ywDISRHIBWsVvX0mijFoLSipCPNYayhQSx43PzVcE-5tCgudZPwWa0LUkJyMhUJQxaFL-fj5EKKO0nbwSp9OlkJf1t7uUtBR9-CeSmUvqMXebyjUL5Wp1NIeavPit9ivrjkMdGroiQbJ3O0 Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:37.347766 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67a6e4fc79b147c0963d00d810e3c986", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1487d472fe8a43598f20aa398b68273d Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 04:23:37.349072 n-d-851337-5 devstack@n-api.service[119342]: action_args: {} Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:37.349828 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 04:23:37.351869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:37.354563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ceacc6fe-6018-4189-806a-70a8443c22d6 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:37.356310 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ceacc6fe-6018-4189-806a-70a8443c22d6 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020611 Aug 04 04:23:37.357036 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 144/283] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:23:37 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:37.359709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:37.359709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:37.372620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:37.373361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:37.379004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-342c43f4-05e7-49a0-8935-1d931e94e786 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-59427840"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:37.387045 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:37.387045 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:37.390637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-342c43f4-05e7-49a0-8935-1d931e94e786 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid 9cb8c9c2-2687-430f-bb71-441c6a49c507 for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:37.451969 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-342c43f4-05e7-49a0-8935-1d931e94e786 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083921 Aug 04 04:23:37.459627 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 145/284] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:37.464927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e22f2d96-c70f-41ef-8fa3-b0a4550c383d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:37.468241 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:37.468241 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:37.475677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:37.480427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e22f2d96-c70f-41ef-8fa3-b0a4550c383d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:37.481257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e22f2d96-c70f-41ef-8fa3-b0a4550c383d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:37.769806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e22f2d96-c70f-41ef-8fa3-b0a4550c383d tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 241 microversion: 2.1 time: 0.308570 Aug 04 04:23:37.771810 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 146/285] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 04:23:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 241 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:37.866995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:37.878413 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ed0d4dc-5e2b-4c32-9058-3bccd36bf2c1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.547974 Aug 04 04:23:37.896034 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 140/286] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:37 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:37.913577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:37.914406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:37.926087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:37.934653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:37.939291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:37.944114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:38.095863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1607182964", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "43ba4413-025c-42c5-b78e-e061b11c7a96"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:38.225335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] validate_networks() for [('43ba4413-025c-42c5-b78e-e061b11c7a96', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:23:38.377413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:38.389372 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a33e77b-f924-4061-a15d-00ffd5a5a997 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1320 microversion: 2.1 time: 0.489498 Aug 04 04:23:38.392986 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 141/287] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:37 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:38.406088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19bfb845-3cc9-4995-b443-f094a0497ae4 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:38.418867 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:38.418867 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:38.419897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19bfb845-3cc9-4995-b443-f094a0497ae4 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '1487d472fe8a43598f20aa398b68273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a6e4fc79b147c0963d00d810e3c986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19bfb845-3cc9-4995-b443-f094a0497ae4 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Request method failure captured: Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 42 Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mbsozV0BrqIWftHrPgAm_iJVd6Cr48ywDISRHIBWsVvX0mijFoLSipCPNYayhQSx43PzVcE-5tCgudZPwWa0LUkJyMhUJQxaFL-fj5EKKO0nbwSp9OlkJf1t7uUtBR9-CeSmUvqMXebyjUL5Wp1NIeavPit9ivrjkMdGroiQbJ3O0 Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:38.428240 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/67a6e4fc79b147c0963d00d810e3c986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_67a6e4fc79b147c0963d00d810e3c986", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 67a6e4fc79b147c0963d00d810e3c986 Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764 Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 1487d472fe8a43598f20aa398b68273d Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2074713764-project Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: {"remove_host": {"host": "n-h2-851337-5"}} Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:38.429771 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-851337-5'}}} Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:38.430699 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 04:23:38.431973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:38.433325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19bfb845-3cc9-4995-b443-f094a0497ae4 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:38.433325 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19bfb845-3cc9-4995-b443-f094a0497ae4 tempest-AggregatesAdminNegativeTestJSON-2074713764 tempest-AggregatesAdminNegativeTestJSON-2074713764-project] 10.222.0.69 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.031460 Aug 04 04:23:38.441536 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 142/288] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 04:23:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:38.446811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:38.447727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:38.457870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:38.458331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:38.463448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:38.463955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:38.658611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:38.675705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-faa430b0-8730-4826-9f50-9ca88b8e307f tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1269 microversion: 2.1 time: 0.225305 Aug 04 04:23:38.676542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 143/289] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:38 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1269 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:38.682461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-402a8ea0-0192-4703-8b9c-a90342caa5df tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:38.690821 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:38.690821 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:38.709709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-402a8ea0-0192-4703-8b9c-a90342caa5df tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:38.710180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-402a8ea0-0192-4703-8b9c-a90342caa5df tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:38.958253 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-402a8ea0-0192-4703-8b9c-a90342caa5df tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 226 microversion: 2.1 time: 0.280011 Aug 04 04:23:38.966733 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 144/290] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 04:23:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 226 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:38.980241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:38.980870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:39.002613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:39.003282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:39.004347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:39.004923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:39.664912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:39.686459 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-823a5e2b-4ec4-4e28-8bc6-b3b2691c99ce tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.718024 Aug 04 04:23:39.687603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 145/291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:38 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:39.711543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ab1839c-b954-43d1-94e2-8071e0ef4e01 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:39.712847 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:39.712847 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:39.794637 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ab1839c-b954-43d1-94e2-8071e0ef4e01 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.104166 Aug 04 04:23:39.796524 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 146/292] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:39 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:39.807514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:39.813258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:39.829491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:39.830216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:39.831475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:39.831914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:40.564270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:23:40.564802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:23:40.565398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:23:40.565825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:23:40.566556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:23:40.590979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:40.592369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:40.595717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:40.597792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:40.656363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Getting quotas for project 0e0e8ff7d8cc4a40930e75fa08cc1aef. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:23:40.676157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Getting quotas for user b526ee29d8c04e069a61722fc3192502 and project 0e0e8ff7d8cc4a40930e75fa08cc1aef. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:23:40.709721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:23:40.716950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:23:40.777034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:40.798088 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-39184c3d-431b-42a9-8f05-85a854705ccd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 0.996758 Aug 04 04:23:40.801592 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 147/293] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:39 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:40.825973 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8064c814-7a9b-4ee4-9076-9eae4fafb8f7 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.044813 Aug 04 04:23:40.828478 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 147/294] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:23:40.844901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:40.845693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ef372f86-b84f-40b2-a091-1d151efee775 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-848575230"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:40.847979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:40.852170 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:40.852170 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:40.853269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.aggregate [None req-ef372f86-b84f-40b2-a091-1d151efee775 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Generated uuid fbcca096-052f-4d9b-9c39-58cd4608b8eb for aggregate {{(pid=119342) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 04:23:40.869047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:40.873486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:40.876861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:40.877993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:40.893397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ef372f86-b84f-40b2-a091-1d151efee775 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062401 Aug 04 04:23:40.896826 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 148/295] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 04:23:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:40.908586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:40.910401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:40.928485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:40.932385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:40.933429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:40.934030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:41.187541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:41.206436 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba957c1b-7bba-4154-b4c7-d5c80e8efa24 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1275 microversion: 2.1 time: 0.380850 Aug 04 04:23:41.207420 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 148/296] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:40 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1275 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:41.217128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab88802a-8654-46ff-a2ba-37c99763a2c3 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:41.217765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab88802a-8654-46ff-a2ba-37c99763a2c3 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:41.601173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ab88802a-8654-46ff-a2ba-37c99763a2c3 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:41.618584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab88802a-8654-46ff-a2ba-37c99763a2c3 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1216 microversion: 2.1 time: 0.407827 Aug 04 04:23:41.620869 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 149/297] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:41 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1216 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:41.644871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:41.653879 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:41.653879 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:41.670708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:41.681550 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-daae6d8b-53da-4ae5-a249-dd87538690c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1470 microversion: 2.1 time: 0.783170 Aug 04 04:23:41.693243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:41.693826 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 149/298] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:40 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1470 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:41.694169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:41.711285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=9 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:41.719664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:41.722110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:41.742135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.compute.aggregates [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 04:23:41.744413 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Request method failure captured: Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 42 Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mdAMO3eYafJs85qZavn0JCFck-3WbXWR61d2g1He7_C_McyO0hLvC_uIF0r_ADzzHzsaZvkYi6sIq37nTu1wOkGathF_e23-HB3DESb9Oy5FvZ8Mqig6KV-LrmvTLG-vnQYYqPmNxUXfznO0RfwWyrQveLTyE8BuHaMZziwlNfLBw Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:41.747644 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5f8962a8cff24b46b49542a425ebde34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5f8962a8cff24b46b49542a425ebde34", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5f8962a8cff24b46b49542a425ebde34 Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320 Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 1a58e9e8f7c64727b4682835baab57ff Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: {"remove_host": {"host": "nonexist_host"}} Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:23:41.749955 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 04:23:41.751224 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 04 04:23:41.752951 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.754645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:41.756107 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:41.756107 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:41.756107 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:41.756107 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:41.756107 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 04 04:23:41.756107 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:41.760391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:41.767681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c3da1762-ff1e-497e-a330-cd4448506625 tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.142309 Aug 04 04:23:41.768295 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 150/299] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 04:23:41 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:23:41.778504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff218bdf-d5c1-4aa0-9029-dae6bf17289c tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:41.780012 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:41.780012 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:41.826109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:41.826671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:41.835743 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff218bdf-d5c1-4aa0-9029-dae6bf17289c tempest-AggregatesAdminNegativeTestJSON-1796289320 tempest-AggregatesAdminNegativeTestJSON-1796289320-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.062117 Aug 04 04:23:41.841457 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 150/300] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:23:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:23:41.848036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:41.849312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:41.851684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:41.894116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:42.232221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:42.233250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:42.260636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:42.269129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:42.273674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:42.277649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:42.518915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:42.528015 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8d161f6-cdc7-44cd-b38e-bcf3471159a1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1275 microversion: 2.1 time: 0.300062 Aug 04 04:23:42.531693 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 151/301] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:42 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:42.556309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:42.570399 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9286a75d-b8c5-4474-8188-9b5ee9501ff2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 0.750612 Aug 04 04:23:42.572486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 151/302] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:41 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:42.654273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:42.655134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:42.677791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:42.678634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:42.681040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:42.682011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:42.706099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:42.706716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:42.721062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:42.721516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:42.737482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:42.738054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:43.158865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:43.183071 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c2c36de-5750-4c3b-a178-adaf7c048d03 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1212 microversion: 2.1 time: 0.533397 Aug 04 04:23:43.185743 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 152/303] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:42 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1212 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:43.397848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:43.423098 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f53b3ed6-1587-4406-bce0-8c987ea188a0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1475 microversion: 2.1 time: 0.721180 Aug 04 04:23:43.428503 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 152/304] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:42 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1475 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:43.564090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:43.565503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:43.581821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:43.600324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:43.602888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:43.619322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:43.624777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:43.631001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:43.639376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:43.640909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:43.643233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:43.646198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.265309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:44.277592 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d69a247a-549f-4e91-a328-4eb4a92b9ad6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.727893 Aug 04 04:23:44.291127 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 153/305] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:43 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:44.668603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Calling method '.version_select at 0x7f191a724310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:44.671530 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:44.671530 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:44.673335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.674606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.697996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:44.703480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.704078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.726068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:44.727001 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9e8ea3b-91cd-463f-89a3-f27ef1919c24 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 1.131120 Aug 04 04:23:44.739423 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 153/306] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:43 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:44.749931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:44.750566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:44.768725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.769450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.770426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.771049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.797646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.798100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.840874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.842640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.875200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.875809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.885351 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c4e25d7-a406-49a1-aa16-0e8239d4d0eb tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.592797 Aug 04 04:23:44.886709 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 154/307] 10.222.0.69 () {60 vars in 1243 bytes} [Thu Aug 4 04:23:44 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:23:44.893621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:44.894552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:44.904181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.904757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:44.907071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:44.907743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.109333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:45.120851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73c4d23f-3671-4f7f-a249-e73e3d0f05aa tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1274 microversion: 2.1 time: 0.379518 Aug 04 04:23:45.121809 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 154/308] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:44 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1274 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:45.350443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f9735de2-b2d0-4090-a362-8e15331fb697 req-df788356-213c-4707-9929-0e7676f72ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a408a4e-9b6f-468f-9db8-155a85a0f96d", "tag": "f96eb774-8631-49c6-b48b-69bd803736d9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:45.362715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9735de2-b2d0-4090-a362-8e15331fb697 req-df788356-213c-4707-9929-0e7676f72ea4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.363836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9735de2-b2d0-4090-a362-8e15331fb697 req-df788356-213c-4707-9929-0e7676f72ea4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.376342 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f9735de2-b2d0-4090-a362-8e15331fb697 req-df788356-213c-4707-9929-0e7676f72ea4 service nova] Creating event network-changed:f96eb774-8631-49c6-b48b-69bd803736d9 for instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d on n-h1-851337-5 Aug 04 04:23:45.381816 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f9735de2-b2d0-4090-a362-8e15331fb697 req-df788356-213c-4707-9929-0e7676f72ea4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258787 Aug 04 04:23:45.382719 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 155/309] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:45.389190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Calling method '.version_select at 0x7f19202c9940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:45.392685 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:45.392685 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:45.394262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.394995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.415558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.416379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.467313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.468090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.482125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.482772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.523476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.524011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.531479 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7c90a0f5-ec0b-44ef-b638-e758707343a6 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.147307 Aug 04 04:23:45.532654 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 156/310] 10.222.0.69 () {60 vars in 1222 bytes} [Thu Aug 4 04:23:45 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:45.538499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:45.539425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:45.548142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.548650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.549448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.549948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.573747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:45.651032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:45.668106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ac7d8e6-2052-4815-a910-51b50675395a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1475 microversion: 2.1 time: 0.771278 Aug 04 04:23:45.669068 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 155/311] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:44 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1475 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:45.737221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e992ad51-4cfe-46c5-8c2e-d72e697cd4f0 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1104234539", "id": 921061607, "os-flavor-access:is_public": "False"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:45.740556 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:45.740556 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:45.760918 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e992ad51-4cfe-46c5-8c2e-d72e697cd4f0 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.090714 Aug 04 04:23:45.762390 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 156/312] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:45 2022] POST /compute/v2.1/flavors => generated 428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:45.768401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c228d5f-6a18-4db2-96c2-5be92209ade7 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Calling method '.version_select at 0x7f191ab3c310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:45.772538 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:45.772538 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:45.774344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c228d5f-6a18-4db2-96c2-5be92209ade7 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.774986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c228d5f-6a18-4db2-96c2-5be92209ade7 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.796718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c228d5f-6a18-4db2-96c2-5be92209ade7 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.797312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c228d5f-6a18-4db2-96c2-5be92209ade7 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.804867 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c228d5f-6a18-4db2-96c2-5be92209ade7 tempest-HypervisorAdminV253TestBase-423041901 tempest-HypervisorAdminV253TestBase-423041901-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/edb7af3a-edea-4fb5-b281-95cc4b648002" status: 200 len: 792 microversion: 2.53 time: 0.041095 Aug 04 04:23:45.806009 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 157/313] 10.222.0.69 () {60 vars in 1298 bytes} [Thu Aug 4 04:23:45 2022] GET /compute/v2.1/os-hypervisors/edb7af3a-edea-4fb5-b281-95cc4b648002 => generated 792 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:23:45.810804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:45.811820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:45.822745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.823332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:45.828701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:45.829950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:46.442001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:46.452223 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1bd5b75e-357b-4355-8961-5c6fc97fa66a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.918142 Aug 04 04:23:46.456078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 157/314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:45 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:46.460862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-607de782-e200-41e9-8a32-c08228a83fba tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0392379974524c20b8f7642bd74db441"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:46.470837 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:46.470837 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:46.701194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:46.710023 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7e52e1f-e3b9-457c-8b4a-83a7fecc4f5b tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 0.902807 Aug 04 04:23:46.715914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 158/315] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:45 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:46.725700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:46.726660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:46.737883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:46.749505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:46.751092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:46.751758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:46.927076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:46.940131 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c13f9fb9-5825-4c46-9c57-1540e4f4e3d8 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1274 microversion: 2.1 time: 0.222606 Aug 04 04:23:46.941280 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 159/316] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:46 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:46.954217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:46.955704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:46.975021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:46.975776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:46.977596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:46.979035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:47.139445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-607de782-e200-41e9-8a32-c08228a83fba tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/921061607/action" status: 200 len: 96 microversion: 2.1 time: 0.682050 Aug 04 04:23:47.142147 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 158/317] 10.222.0.69 () {60 vars in 1197 bytes} [Thu Aug 4 04:23:46 2022] POST /compute/v2.1/flavors/921061607/action => generated 96 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:23:47.379405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:47.395858 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f668671d-7def-4311-8de0-39f3f405814c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1475 microversion: 2.1 time: 0.446002 Aug 04 04:23:47.397017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 160/318] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:46 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:47.478332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:47.479184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:47.490623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:47.491351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:47.498053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:47.498806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:47.768458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:47.781243 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33bc870f-2782-45e7-8310-477fdb825b52 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.307480 Aug 04 04:23:47.795147 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 161/319] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:47 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:47.801153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d51cca0a-e89d-4670-8f12-0cf6691bb042 req-a1ff8e19-d7b6-46c6-98f3-86f910c6354b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dee7941-b83b-457d-a8c8-93411b771af0", "tag": "9a354b82-3810-4a56-b2a6-d94f70e97ec5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:47.824935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d51cca0a-e89d-4670-8f12-0cf6691bb042 req-a1ff8e19-d7b6-46c6-98f3-86f910c6354b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:47.826092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d51cca0a-e89d-4670-8f12-0cf6691bb042 req-a1ff8e19-d7b6-46c6-98f3-86f910c6354b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:47.828681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be99a7b6-48c9-4168-8306-0344ae4e8283 tempest-FlavorsAccessTestJSON-228300951 tempest-FlavorsAccessTestJSON-228300951-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:47.857794 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d51cca0a-e89d-4670-8f12-0cf6691bb042 req-a1ff8e19-d7b6-46c6-98f3-86f910c6354b service nova] Creating event network-changed:9a354b82-3810-4a56-b2a6-d94f70e97ec5 for instance 6dee7941-b83b-457d-a8c8-93411b771af0 on n-h2-851337-5 Aug 04 04:23:47.864065 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d51cca0a-e89d-4670-8f12-0cf6691bb042 req-a1ff8e19-d7b6-46c6-98f3-86f910c6354b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067449 Aug 04 04:23:47.869775 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 162/320] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:47.870524 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-be99a7b6-48c9-4168-8306-0344ae4e8283 tempest-FlavorsAccessTestJSON-228300951 tempest-FlavorsAccessTestJSON-228300951-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.1 time: 0.721676 Aug 04 04:23:47.871146 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 159/321] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:47 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:47.886007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:47.887540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:47.892619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8f92b26-4e9b-4640-a29c-ab5766c37cc7 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0392379974524c20b8f7642bd74db441"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:47.894793 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:47.894793 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:47.896410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:47.897060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:47.898280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:47.900360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:48.535588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:48.563666 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69560bd0-ecc3-4a70-9186-2b57d258b8f4 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 0.683359 Aug 04 04:23:48.563666 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 163/322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:47 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:48.563666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:48.564332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:48.574344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:48.575350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:48.576317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:48.577433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:48.694103 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8f92b26-4e9b-4640-a29c-ab5766c37cc7 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/921061607/action" status: 200 len: 21 microversion: 2.1 time: 0.805525 Aug 04 04:23:48.696708 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 160/323] 10.222.0.69 () {60 vars in 1197 bytes} [Thu Aug 4 04:23:47 2022] POST /compute/v2.1/flavors/921061607/action => generated 21 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:23:48.704482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:48.706308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:48.714917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:48.715704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:48.717013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:48.718386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:49.245676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:49.270180 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-62d4b95b-49e1-4c18-bc26-8b581ea61e39 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.711731 Aug 04 04:23:49.282990 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 164/324] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:48 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:49.287640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15248f02-9bc4-4329-ab5c-126d0a2337be tempest-FlavorsAccessTestJSON-228300951 tempest-FlavorsAccessTestJSON-228300951-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:49.339808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15248f02-9bc4-4329-ab5c-126d0a2337be tempest-FlavorsAccessTestJSON-228300951 tempest-FlavorsAccessTestJSON-228300951-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.063590 Aug 04 04:23:49.341022 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 165/325] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:49 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:49.355884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:49.359512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:49.372850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:49.373302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:49.374645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:49.377288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:49.595572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:49.610066 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7732a64-5911-4bc3-9983-e1b0dd07717a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1475 microversion: 2.1 time: 0.908672 Aug 04 04:23:49.611106 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 161/326] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:48 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1475 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:49.633476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1ed1b74-a852-41bb-9a37-284b6ee5db26 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:49.634268 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:49.634268 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:49.648943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:49.669495 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1ed1b74-a852-41bb-9a37-284b6ee5db26 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/921061607" status: 202 len: 0 microversion: 2.1 time: 0.056682 Aug 04 04:23:49.669886 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 162/327] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:23:49 2022] DELETE /compute/v2.1/flavors/921061607 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:23:49.676482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:49.679711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:49.695135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:49.695750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:49.703620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:49.703620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:50.469032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:50.477616 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93c50b76-585f-46d4-9538-24fc027e8ad1 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 1.132656 Aug 04 04:23:50.483322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 166/328] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:49 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:50.488191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce1a00b9-b03e-4fcb-bbb4-4e60ea495769 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:50.535195 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce1a00b9-b03e-4fcb-bbb4-4e60ea495769 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.050348 Aug 04 04:23:50.563540 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 167/329] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:50 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:50.626440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:50.670049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:50.680023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d5de66d-b198-4cea-a940-81c26049498c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 1.008680 Aug 04 04:23:50.694530 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 163/330] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:49 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:50.694530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:50.694530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:50.696510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:50.707113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:50.707634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:50.708471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:50.708908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:50.977353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-293287bb-ff67-4cda-816f-ff7e495bf94b tempest-AZAdminNegativeTestJSON-1078417424 tempest-AZAdminNegativeTestJSON-1078417424-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:50.978297 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:50.978297 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:50.979256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-293287bb-ff67-4cda-816f-ff7e495bf94b tempest-AZAdminNegativeTestJSON-1078417424 tempest-AZAdminNegativeTestJSON-1078417424-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '6142794fac734a7687a3571dec1ad0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d38f6c993f4b7f84f98ab3bad9e573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-293287bb-ff67-4cda-816f-ff7e495bf94b tempest-AZAdminNegativeTestJSON-1078417424 tempest-AZAdminNegativeTestJSON-1078417424-project] Request method failure captured: Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nVLFLPhQMLTavBnNMbibpURgrN5Re0sprTU6z8OQxaK4FSkRqZNavmdeBXq8yksxbTkW0Ze3TSKdndKJDuxaBUVfKLVTvhgUeDDrZqCOzL0xji5BkIVognd_7rpLCWcAwl02F1dcSzlHYbTXpqlolScgDCxssr7wBqTB5ixxxVIas Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 08d38f6c993f4b7f84f98ab3bad9e573 Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1078417424 Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:50.981467 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/08d38f6c993f4b7f84f98ab3bad9e573"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/08d38f6c993f4b7f84f98ab3bad9e573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/08d38f6c993f4b7f84f98ab3bad9e573"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_08d38f6c993f4b7f84f98ab3bad9e573", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AZAdminNegativeTestJSON-1078417424 Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 08d38f6c993f4b7f84f98ab3bad9e573 Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1078417424 Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AZAdminNegativeTestJSON-1078417424-project Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6142794fac734a7687a3571dec1ad0e5 Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AZAdminNegativeTestJSON-1078417424-project Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 04:23:50.982662 n-d-851337-5 devstack@n-api.service[119342]: action_args: {} Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:50.984154 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 04:23:50.985250 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:50.988724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-293287bb-ff67-4cda-816f-ff7e495bf94b tempest-AZAdminNegativeTestJSON-1078417424 tempest-AZAdminNegativeTestJSON-1078417424-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:50.990108 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-293287bb-ff67-4cda-816f-ff7e495bf94b tempest-AZAdminNegativeTestJSON-1078417424 tempest-AZAdminNegativeTestJSON-1078417424-project] 10.222.0.69 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.425368 Aug 04 04:23:50.991360 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 168/331] 10.222.0.69 () {58 vars in 1185 bytes} [Thu Aug 4 04:23:50 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 427 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:50.997951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-77ca2dff-223a-4d8e-b0f3-3e7177b2ab77 req-64715334-b550-45dc-8356-6431b3ca5817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97ea115-9836-44d8-b12e-674b6434a8b7", "name": "network-vif-unplugged", "status": "completed", "tag": "0548d468-cd23-4c32-ac67-82a9fc6f4186"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:51.019266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-77ca2dff-223a-4d8e-b0f3-3e7177b2ab77 req-64715334-b550-45dc-8356-6431b3ca5817 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:51.020121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-77ca2dff-223a-4d8e-b0f3-3e7177b2ab77 req-64715334-b550-45dc-8356-6431b3ca5817 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:51.039299 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-77ca2dff-223a-4d8e-b0f3-3e7177b2ab77 req-64715334-b550-45dc-8356-6431b3ca5817 service nova] Creating event network-vif-unplugged:0548d468-cd23-4c32-ac67-82a9fc6f4186 for instance a97ea115-9836-44d8-b12e-674b6434a8b7 on n-h1-851337-5 Aug 04 04:23:51.060513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-77ca2dff-223a-4d8e-b0f3-3e7177b2ab77 req-64715334-b550-45dc-8356-6431b3ca5817 service nova] Instance a97ea115-9836-44d8-b12e-674b6434a8b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:23:51.083322 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-77ca2dff-223a-4d8e-b0f3-3e7177b2ab77 req-64715334-b550-45dc-8356-6431b3ca5817 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090149 Aug 04 04:23:51.084817 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 169/332] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:51.095001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ef37f128-f2a1-43d5-8104-ee883ee5493c tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-316976721", "id": 793650196, "os-flavor-access:is_public": "False"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:51.099899 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:51.099899 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:51.137284 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ef37f128-f2a1-43d5-8104-ee883ee5493c tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.049512 Aug 04 04:23:51.138805 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 170/333] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:51 2022] POST /compute/v2.1/flavors => generated 427 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:51.144044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:51.147911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:51.164349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:51.164891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:51.167542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:51.175204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:51.535619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:51.543034 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1359ae8a-ef39-426c-af08-e3582d9ea6d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.859848 Aug 04 04:23:51.543622 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 164/334] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:50 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:51.559846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35bd31a4-781b-4d6e-8f23-187db2818ebf tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:51.560998 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:51.560998 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:51.583644 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35bd31a4-781b-4d6e-8f23-187db2818ebf tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/793650196/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.027367 Aug 04 04:23:51.591586 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 165/335] 10.222.0.69 () {58 vars in 1206 bytes} [Thu Aug 4 04:23:51 2022] GET /compute/v2.1/flavors/793650196/os-flavor-access => generated 21 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:23:51.597293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:51.598223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:51.611504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=30 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:51.616387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:51.616833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:51.617618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:51.618052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:51.832477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:51.893676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:51.910526 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53b73803-2d0c-40ac-85a1-6d175245ca9c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1474 microversion: 2.1 time: 0.770228 Aug 04 04:23:51.923420 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 171/336] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:51 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1474 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:51.931651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffd333b2-68c1-4499-8620-3697acf6bcb0 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:51.932653 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:51.932653 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:51.945546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:51.955033 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffd333b2-68c1-4499-8620-3697acf6bcb0 tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/793650196" status: 202 len: 0 microversion: 2.1 time: 0.029317 Aug 04 04:23:51.957038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 172/337] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:23:51 2022] DELETE /compute/v2.1/flavors/793650196 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:23:51.963375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:51.965103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:51.996460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:51.999581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.000709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:52.003142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.291625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:52.300347 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d2b7645-ad52-4a28-a289-eff9dbb9f957 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.707288 Aug 04 04:23:52.301649 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 166/338] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:51 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:52.306929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b91ccf4-db62-465b-b212-4c78b2eac75a tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:52.340990 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b91ccf4-db62-465b-b212-4c78b2eac75a tempest-FlavorsAccessTestJSON-543281543 tempest-FlavorsAccessTestJSON-543281543-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.037633 Aug 04 04:23:52.342227 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 167/339] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:52 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:52.419557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-82b24981-0c7d-48ce-a9a9-e4f8db9db4a8 req-2f86bef7-500c-40b3-87f6-af509555335d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0369c85-48d1-4749-8548-3e7fb8d1cac6", "tag": "f7771695-b299-4d9f-aac3-35674f82d732"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:52.445296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-82b24981-0c7d-48ce-a9a9-e4f8db9db4a8 req-2f86bef7-500c-40b3-87f6-af509555335d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:52.446120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-82b24981-0c7d-48ce-a9a9-e4f8db9db4a8 req-2f86bef7-500c-40b3-87f6-af509555335d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.465918 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-82b24981-0c7d-48ce-a9a9-e4f8db9db4a8 req-2f86bef7-500c-40b3-87f6-af509555335d service nova] Creating event network-changed:f7771695-b299-4d9f-aac3-35674f82d732 for instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 on n-h1-851337-5 Aug 04 04:23:52.478653 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-82b24981-0c7d-48ce-a9a9-e4f8db9db4a8 req-2f86bef7-500c-40b3-87f6-af509555335d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069827 Aug 04 04:23:52.481196 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 168/340] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:23:52.757117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:52.779880 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-619a7327-d9b9-4899-82d0-23e03bedaf17 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 0.808657 Aug 04 04:23:52.794925 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 173/341] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:51 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:52.803960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:52.804664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:52.824991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Calling method '.version_select at 0x7f191afcb820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:52.826054 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:52.826054 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:52.827885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:52.828341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.830477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:52.834053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.836200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:52.838657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.896900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:52.906898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.942353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:52.943088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:52.958010 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74dc6f15-8548-4789-b234-a2054fa5362d tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.389846 Aug 04 04:23:52.963185 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 169/342] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:52.973336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8011dfa3-afec-4a07-bc56-a7a6d1a7e086 req-2f91bc72-1e81-49a8-ae93-ee8a1c59cf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a408a4e-9b6f-468f-9db8-155a85a0f96d", "name": "network-vif-plugged", "status": "completed", "tag": "f96eb774-8631-49c6-b48b-69bd803736d9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:53.023111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8011dfa3-afec-4a07-bc56-a7a6d1a7e086 req-2f91bc72-1e81-49a8-ae93-ee8a1c59cf1d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.023620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8011dfa3-afec-4a07-bc56-a7a6d1a7e086 req-2f91bc72-1e81-49a8-ae93-ee8a1c59cf1d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.064303 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8011dfa3-afec-4a07-bc56-a7a6d1a7e086 req-2f91bc72-1e81-49a8-ae93-ee8a1c59cf1d service nova] Creating event network-vif-plugged:f96eb774-8631-49c6-b48b-69bd803736d9 for instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d on n-h1-851337-5 Aug 04 04:23:53.078801 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8011dfa3-afec-4a07-bc56-a7a6d1a7e086 req-2f91bc72-1e81-49a8-ae93-ee8a1c59cf1d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109308 Aug 04 04:23:53.080626 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 170/343] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:53.085877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.086591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:53.125174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.127110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.129823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.131185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.291162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:53.301448 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d178ede1-2c48-4423-98fe-58df075cb1c2 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.505252 Aug 04 04:23:53.301949 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 174/344] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:52 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:53.442777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:53.455650 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8e4ccb4d-78f9-4957-b694-a86bf6bef576 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1472 microversion: 2.1 time: 0.373897 Aug 04 04:23:53.456831 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 171/345] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:53.463578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-02bad84b-9db6-4495-bf45-e2ff81a09576 req-9c261bff-7d91-4fa9-866c-2fbd80fa6583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97ea115-9836-44d8-b12e-674b6434a8b7", "tag": "0548d468-cd23-4c32-ac67-82a9fc6f4186"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:53.477653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-02bad84b-9db6-4495-bf45-e2ff81a09576 req-9c261bff-7d91-4fa9-866c-2fbd80fa6583 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.478261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-02bad84b-9db6-4495-bf45-e2ff81a09576 req-9c261bff-7d91-4fa9-866c-2fbd80fa6583 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.497408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-02bad84b-9db6-4495-bf45-e2ff81a09576 req-9c261bff-7d91-4fa9-866c-2fbd80fa6583 service nova] Creating event network-changed:0548d468-cd23-4c32-ac67-82a9fc6f4186 for instance a97ea115-9836-44d8-b12e-674b6434a8b7 on n-h1-851337-5 Aug 04 04:23:53.513046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-02bad84b-9db6-4495-bf45-e2ff81a09576 req-9c261bff-7d91-4fa9-866c-2fbd80fa6583 service nova] Instance a97ea115-9836-44d8-b12e-674b6434a8b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:23:53.526529 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-02bad84b-9db6-4495-bf45-e2ff81a09576 req-9c261bff-7d91-4fa9-866c-2fbd80fa6583 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068015 Aug 04 04:23:53.527542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 172/346] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:53.537687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.537876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:53.545444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.546513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.547469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.547990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.767526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8415b20-0acd-4c8f-9e69-91fe146478f7 tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Calling method '.version_select at 0x7f191a69b700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.769133 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:53.769133 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:23:53.771343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e8415b20-0acd-4c8f-9e69-91fe146478f7 tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '7c580f3a3fd24667ba76ca9697ea7191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee16b55a378498e8752bb102bacaea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8415b20-0acd-4c8f-9e69-91fe146478f7 tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Request method failure captured: Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hypervisors/n-h2-851337-5/search HTTP/1.1 Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nXIL-ivql03O4N5HXBH3RvZ8p3lazMrvHq2OYWyHosOtzf8qQeUpTzvCZa1IjTQBPLKbq4deOJO0Zloc3XZ-qR9ff8YHhh06naMseuWl5NvTNggxw2IhikI-1yvvbsMro6ux1Ok5GisCP8Sv9SJ7N1_0X1unCeG_EwKDwElAcdRhU Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: bee16b55a378498e8752bb102bacaea3 Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345345600 Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:23:53.773416 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bee16b55a378498e8752bb102bacaea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bee16b55a378498e8752bb102bacaea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bee16b55a378498e8752bb102bacaea3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bee16b55a378498e8752bb102bacaea3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1345345600 Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: bee16b55a378498e8752bb102bacaea3 Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345345600 Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 7c580f3a3fd24667ba76ca9697ea7191 Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 04:23:53.774669 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'n-h2-851337-5'} Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:53.775553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 04:23:53.776566 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.780536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8415b20-0acd-4c8f-9e69-91fe146478f7 tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:53.781681 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8415b20-0acd-4c8f-9e69-91fe146478f7 tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/n-h2-851337-5/search" status: 403 len: 117 microversion: 2.1 time: 0.476055 Aug 04 04:23:53.782762 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 175/347] 10.222.0.69 () {58 vars in 1209 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/os-hypervisors/n-h2-851337-5/search => generated 117 bytes in 477 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:53.796330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3444883-eba1-4d52-8950-ed889f132858 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Calling method '.version_select at 0x7f191b74ee50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.800718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3444883-eba1-4d52-8950-ed889f132858 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.801620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3444883-eba1-4d52-8950-ed889f132858 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.817553 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-f3444883-eba1-4d52-8950-ed889f132858 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3444883-eba1-4d52-8950-ed889f132858 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Request method failure captured: Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nYGSmgS7aZ7C3qiCv_TPXA4muCqEHE29TZQPynMQcqE5S_Y9KuX7KeOmDeyrwBRsdWErYwkJGZhoAFihg8HC7bjg5wDljAX8xra9ARfKbKKH961aK7AfbImYO7XtWivqPMbIsqmC8vldCNDxDfTatI6nqDpVviAcFTmCBbG_p8MZo Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3925f00194894daeaeffe899360b52b9 Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-837705807 Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:23:53.819347 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3925f00194894daeaeffe899360b52b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3925f00194894daeaeffe899360b52b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3925f00194894daeaeffe899360b52b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3925f00194894daeaeffe899360b52b9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-837705807 Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3925f00194894daeaeffe899360b52b9 Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-837705807 Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ac9dd33e13a747f184ae789af605784e Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 04:23:53.820636 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:53.821291 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:53.822442 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:53.822442 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:53.822442 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:53.822442 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 04:23:53.822442 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.830528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:53.839546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3444883-eba1-4d52-8950-ed889f132858 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:53.843222 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f3444883-eba1-4d52-8950-ed889f132858 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.053510 Aug 04 04:23:53.846663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ecc09991-9660-46b8-a565-62ba2b4af3d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.317628 Aug 04 04:23:53.848364 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 173/349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:53.848639 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 176/349] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:53.860940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.862535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Calling method '.version_select at 0x7f192005a700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.863436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:53.864637 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:53.864637 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:53.867720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.870035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.880319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.881972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.883003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.886456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.914645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.915747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.929077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.929831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:53.936682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-45d028b8-da40-4151-8e15-0ce7b1e2e8b0 tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.084337 Aug 04 04:23:53.938193 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 174/350] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:53.950339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76b98e7b-2e1c-4eef-b112-faf9650ba8ea tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Calling method '.version_select at 0x7f192193e8b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.951496 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:23:53.951496 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:23:53.953303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76b98e7b-2e1c-4eef-b112-faf9650ba8ea tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '7c580f3a3fd24667ba76ca9697ea7191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee16b55a378498e8752bb102bacaea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76b98e7b-2e1c-4eef-b112-faf9650ba8ea tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Request method failure captured: Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nXIL-ivql03O4N5HXBH3RvZ8p3lazMrvHq2OYWyHosOtzf8qQeUpTzvCZa1IjTQBPLKbq4deOJO0Zloc3XZ-qR9ff8YHhh06naMseuWl5NvTNggxw2IhikI-1yvvbsMro6ux1Ok5GisCP8Sv9SJ7N1_0X1unCeG_EwKDwElAcdRhU Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: bee16b55a378498e8752bb102bacaea3 Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345345600 Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:23:53.956664 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bee16b55a378498e8752bb102bacaea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bee16b55a378498e8752bb102bacaea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bee16b55a378498e8752bb102bacaea3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bee16b55a378498e8752bb102bacaea3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1345345600 Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: bee16b55a378498e8752bb102bacaea3 Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345345600 Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7c580f3a3fd24667ba76ca9697ea7191 Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 04:23:53.957884 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1'} Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:23:53.958545 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 04:23:53.959598 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:53.962460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76b98e7b-2e1c-4eef-b112-faf9650ba8ea tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:53.963597 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76b98e7b-2e1c-4eef-b112-faf9650ba8ea tempest-HypervisorAdminNegativeUnderV252Test-1345345600 tempest-HypervisorAdminNegativeUnderV252Test-1345345600-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017352 Aug 04 04:23:53.964286 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 175/351] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:53.975558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d228193b-4732-48e0-a02f-6101bd99faea tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Calling method '.version_select at 0x7f191afa8790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:53.983900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d228193b-4732-48e0-a02f-6101bd99faea tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:53.984358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d228193b-4732-48e0-a02f-6101bd99faea tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:54.026920 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-d228193b-4732-48e0-a02f-6101bd99faea tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] HTTP exception thrown: No hypervisor matching '0a44a922-23ab-49d6-a23a-e2c0c61a6c5e' could be found. Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d228193b-4732-48e0-a02f-6101bd99faea tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Request method failure captured: Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-hypervisors/0a44a922-23ab-49d6-a23a-e2c0c61a6c5e/servers HTTP/1.1 Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nYGSmgS7aZ7C3qiCv_TPXA4muCqEHE29TZQPynMQcqE5S_Y9KuX7KeOmDeyrwBRsdWErYwkJGZhoAFihg8HC7bjg5wDljAX8xra9ARfKbKKH961aK7AfbImYO7XtWivqPMbIsqmC8vldCNDxDfTatI6nqDpVviAcFTmCBbG_p8MZo Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 3925f00194894daeaeffe899360b52b9 Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-837705807 Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:23:54.032476 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3925f00194894daeaeffe899360b52b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3925f00194894daeaeffe899360b52b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3925f00194894daeaeffe899360b52b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3925f00194894daeaeffe899360b52b9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-837705807 Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 3925f00194894daeaeffe899360b52b9 Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-837705807 Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: ac9dd33e13a747f184ae789af605784e Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: exception: No hypervisor matching '0a44a922-23ab-49d6-a23a-e2c0c61a6c5e' could be found. Aug 04 04:23:54.033799 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0a44a922-23ab-49d6-a23a-e2c0c61a6c5e'} Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '0a44a922-23ab-49d6-a23a-e2c0c61a6c5e' could be found. Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:54.034437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:23:54.035513 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:23:54.035513 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:23:54.035513 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:23:54.035513 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:23:54.035513 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '0a44a922-23ab-49d6-a23a-e2c0c61a6c5e' could be found. Aug 04 04:23:54.035513 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:23:54.037503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d228193b-4732-48e0-a02f-6101bd99faea tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] Returning 404 to user: No hypervisor matching '0a44a922-23ab-49d6-a23a-e2c0c61a6c5e' could be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:23:54.038033 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d228193b-4732-48e0-a02f-6101bd99faea tempest-HypervisorAdminNegativeUnderV252Test-837705807 tempest-HypervisorAdminNegativeUnderV252Test-837705807-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/0a44a922-23ab-49d6-a23a-e2c0c61a6c5e/servers" status: 404 len: 123 microversion: 2.1 time: 0.067578 Aug 04 04:23:54.038844 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 176/352] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/os-hypervisors/0a44a922-23ab-49d6-a23a-e2c0c61a6c5e/servers => generated 123 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:23:54.230146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:54.241101 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-88ee1622-ff5e-409a-9c2e-7f42c11ea9e8 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 0.391052 Aug 04 04:23:54.243583 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 177/353] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:53 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:54.324377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:54.325240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:54.336558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:54.339765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:54.344567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:54.345226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:54.476949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:54.478309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:54.495718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:54.496475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:54.497424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:54.498003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:54.826122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:54.834540 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-578a92e1-c146-4f10-b225-dae7e57c3de0 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.514329 Aug 04 04:23:54.869833 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 177/354] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:54 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:54.876327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:54.877039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:54.891639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:54.892090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:54.892876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:54.893315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:55.088293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:55.094118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:55.100631 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f426732e-f216-4b1c-a78c-728a857012ca tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1472 microversion: 2.1 time: 0.627708 Aug 04 04:23:55.102239 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 178/355] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:54 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1472 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:55.149304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:55.167335 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d13dfa23-bac1-408f-9d0d-6b81a71b908c tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.296282 Aug 04 04:23:55.168234 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 178/356] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:54 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:55.273755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:55.275800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:55.306301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:55.306740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:55.317870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:55.318361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:55.568047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:55.579301 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f96436ce-e308-4a45-97e9-cf7b7ce67c3a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 0.315476 Aug 04 04:23:55.584154 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 179/357] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:55 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:55.872579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:55.873772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:55.884066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:55.889704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:55.890809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:55.892162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:56.128222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:56.129307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:56.152252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:56.156781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:56.157973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:56.158568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:56.303407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:56.316064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c45e7bd4-4cd9-43d8-bd14-a2b10650ab6d tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.447569 Aug 04 04:23:56.316779 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 179/358] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:55 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:56.340388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:56.343069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:56.366298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:56.370233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:56.371283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:56.371955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:56.740928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:56.755505 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96a39418-96e4-4aae-aae0-9b8c1a68d529 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1472 microversion: 2.1 time: 0.634169 Aug 04 04:23:56.770559 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 180/359] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:56 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1472 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:56.779568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:56.780768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:56.785540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:56.796546 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fc5a7790-4272-463a-829c-7e5c17e79685 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.478696 Aug 04 04:23:56.806303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 180/360] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:56 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:56.810505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:56.811738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:56.812920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:56.816144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:57.346731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:57.348026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:57.369820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:57.372108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:57.373406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:57.376764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.157220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:58.169327 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5497476f-ade0-4cab-a534-357b55547374 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1388 microversion: 2.1 time: 1.394706 Aug 04 04:23:58.191698 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 181/361] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:56 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1388 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:58.199988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:58.201067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:58.206816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:58.213683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.215788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.216641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.218612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.224576 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-496847fd-7ba9-4e21-85d5-5fe442c3c258 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.887788 Aug 04 04:23:58.229146 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 181/362] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:57 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:23:58.244200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:58.246899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:58.265450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.266265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.267681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.268315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.702212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:58.709989 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82bc9889-74b5-43b5-8988-9494b04d1d8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1469 microversion: 2.1 time: 0.516887 Aug 04 04:23:58.710568 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 182/363] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:58 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:58.747999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-775dd7d8-0ee1-43f4-a5d0-8934bc57821f req-01e8eb46-5006-4e0d-9393-36f51e22b5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dee7941-b83b-457d-a8c8-93411b771af0", "name": "network-vif-plugged", "status": "completed", "tag": "9a354b82-3810-4a56-b2a6-d94f70e97ec5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:58.756324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:58.767864 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43149508-6178-4fc0-90f3-4ad99634f664 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1317 microversion: 2.1 time: 0.537125 Aug 04 04:23:58.768700 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 182/364] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:58 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:58.779198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b898554b-8c96-4e76-a5c2-fac3ff54facc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:58.780728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b898554b-8c96-4e76-a5c2-fac3ff54facc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:58.789275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-775dd7d8-0ee1-43f4-a5d0-8934bc57821f req-01e8eb46-5006-4e0d-9393-36f51e22b5fd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.789725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-775dd7d8-0ee1-43f4-a5d0-8934bc57821f req-01e8eb46-5006-4e0d-9393-36f51e22b5fd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.799745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b898554b-8c96-4e76-a5c2-fac3ff54facc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.801968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b898554b-8c96-4e76-a5c2-fac3ff54facc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.803122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b898554b-8c96-4e76-a5c2-fac3ff54facc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.804117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b898554b-8c96-4e76-a5c2-fac3ff54facc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.819765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-775dd7d8-0ee1-43f4-a5d0-8934bc57821f req-01e8eb46-5006-4e0d-9393-36f51e22b5fd service nova] Creating event network-vif-plugged:9a354b82-3810-4a56-b2a6-d94f70e97ec5 for instance 6dee7941-b83b-457d-a8c8-93411b771af0 on n-h2-851337-5 Aug 04 04:23:58.833742 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-775dd7d8-0ee1-43f4-a5d0-8934bc57821f req-01e8eb46-5006-4e0d-9393-36f51e22b5fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105412 Aug 04 04:23:58.835928 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 183/365] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:23:58.843825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:23:58.954245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b898554b-8c96-4e76-a5c2-fac3ff54facc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7/action" status: 204 len: 0 microversion: 2.1 time: 0.184136 Aug 04 04:23:58.955668 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 183/366] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:23:58 2022] POST /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7/action => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:23:58.974304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:58.976170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:58.996243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:58.997078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:58.997907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:59.012950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:59.199140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:59.200058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:59.226082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:59.229264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:59.234613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:59.235103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:59.706667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:59.716325 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8c15cab2-f775-48f3-bc91-a3b725a2f613 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1469 microversion: 2.1 time: 0.756399 Aug 04 04:23:59.730349 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 184/367] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:58 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1469 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:59.731282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:23:59.734263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:23:59.735700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:23:59.739141 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d77f1f3-225d-43b8-8af8-1a671b18f68a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1586 microversion: 2.1 time: 0.546014 Aug 04 04:23:59.739715 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 184/368] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:59 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1586 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:23:59.743892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:59.744562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:59.745479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:23:59.746304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:23:59.972990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-817214683", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:23:59.994275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:00.003648 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0d15f49d-a6ce-4505-a531-e0f1290f3013 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.277509 Aug 04 04:24:00.004873 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 185/369] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:23:59 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:00.075667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:00.461788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b5940e30-8cdc-42b5-8cbb-4baaa8a3e496 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-711545739", "ram": 512, "vcpus": 1, "disk": 10, "id": 1252335243, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:00.464984 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:00.464984 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:00.501482 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b5940e30-8cdc-42b5-8cbb-4baaa8a3e496 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.495191 Aug 04 04:24:00.509913 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 186/370] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:00 2022] POST /compute/v2.1/flavors => generated 415 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:00.523856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0655e926-e188-407b-b174-3935dac99d15 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:00.524691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0655e926-e188-407b-b174-3935dac99d15 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:00.543316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0655e926-e188-407b-b174-3935dac99d15 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:00.546043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0655e926-e188-407b-b174-3935dac99d15 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:00.550862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0655e926-e188-407b-b174-3935dac99d15 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:00.551655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0655e926-e188-407b-b174-3935dac99d15 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:00.787471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0655e926-e188-407b-b174-3935dac99d15 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275782 Aug 04 04:24:00.788344 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 187/371] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:24:00 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:00.793216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:00.794017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:00.801511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:00.801958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:00.802919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:00.803350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:01.165915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:01.167047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:01.167745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:01.170187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:01.170858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:01.189118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:01.190052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:01.191931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:01.193122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:01.217137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Getting quotas for project 7302d2cfb3d546f4ab737bb03886bdcc. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:01.221499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Getting quotas for user 7c46d9915a0b4eb89dabc8a0796331fa and project 7302d2cfb3d546f4ab737bb03886bdcc. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:01.243736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:01.247678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:01.325844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:01.334339 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d552aabd-9245-4b68-a537-02c08e4e990e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593343 Aug 04 04:24:01.338313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-592b141c-5810-448d-9da8-b4906b80f486 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1466 microversion: 2.1 time: 0.547394 Aug 04 04:24:01.339585 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 188/372] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:00 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:01.346537 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 185/373] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:24:01.353913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:01.355089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0296bdd-39da-4fb8-b5a5-5bf766e10c53 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:01.359824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:01.362187 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:01.362187 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:01.377726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:01.378182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:01.378995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:01.379438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:01.457311 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0296bdd-39da-4fb8-b5a5-5bf766e10c53 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1252335243/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115454 Aug 04 04:24:01.458359 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 189/374] 10.222.0.69 () {60 vars in 1224 bytes} [Thu Aug 4 04:24:01 2022] POST /compute/v2.1/flavors/1252335243/os-extra_specs => generated 66 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:01.729813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:01.742131 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a57371d9-fb0b-48bd-a2a4-3f144dbca97c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1469 microversion: 2.1 time: 0.393173 Aug 04 04:24:01.742739 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 186/375] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:01 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:01.770837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-922f482f-d91c-4b19-b819-0522b735d891 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] Action: 'create', calling method: .version_select at 0x7f191a810b80>, body: {"security_group": {"name": "tempest-securitygroup-1426479032", "description": "tempest-description-744563344"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:01.772360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-30beedc9-3591-4e62-b5f7-77463d25d6c3 req-cff7e320-399b-4748-95a9-9dc30a8903ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97ea115-9836-44d8-b12e-674b6434a8b7", "name": "network-vif-plugged", "status": "completed", "tag": "0548d468-cd23-4c32-ac67-82a9fc6f4186"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:01.795706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-30beedc9-3591-4e62-b5f7-77463d25d6c3 req-cff7e320-399b-4748-95a9-9dc30a8903ea service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:01.796059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-30beedc9-3591-4e62-b5f7-77463d25d6c3 req-cff7e320-399b-4748-95a9-9dc30a8903ea service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:01.816381 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-30beedc9-3591-4e62-b5f7-77463d25d6c3 req-cff7e320-399b-4748-95a9-9dc30a8903ea service nova] Creating event network-vif-plugged:0548d468-cd23-4c32-ac67-82a9fc6f4186 for instance a97ea115-9836-44d8-b12e-674b6434a8b7 on n-h1-851337-5 Aug 04 04:24:01.828303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-30beedc9-3591-4e62-b5f7-77463d25d6c3 req-cff7e320-399b-4748-95a9-9dc30a8903ea service nova] Instance a97ea115-9836-44d8-b12e-674b6434a8b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:24:01.857889 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-30beedc9-3591-4e62-b5f7-77463d25d6c3 req-cff7e320-399b-4748-95a9-9dc30a8903ea service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096143 Aug 04 04:24:01.867418 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 187/376] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:01.883140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:01.886508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:01.904241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:01.905599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:01.908691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:01.910453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:02.248197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:02.257463 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe7f3b20-b916-4f5d-b446-94be6f496e1c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.387457 Aug 04 04:24:02.271163 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 188/377] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:01 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:02.291362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:02.295691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:02.304705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:02.311936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:02.313039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:02.313475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:02.460681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:02.480772 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e83c5993-008c-46bb-9f82-7fb87d99e1d1 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1223 microversion: 2.1 time: 0.206022 Aug 04 04:24:02.481401 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 189/378] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:02 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1223 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:02.589297 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-922f482f-d91c-4b19-b819-0522b735d891 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.129580 Aug 04 04:24:02.591845 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 190/379] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:02.739942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1022484306", "block_migration": true, "disk_over_commit": false}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:02.746071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:02.765784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:02.766915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:02.767786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:02.768227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:02.804960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-349d73c4-c9b3-42c1-b919-db3fb064313d tempest-FlavorsExtraSpecsTestJSON-1260611247 tempest-FlavorsExtraSpecsTestJSON-1260611247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:02.815428 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-349d73c4-c9b3-42c1-b919-db3fb064313d tempest-FlavorsExtraSpecsTestJSON-1260611247 tempest-FlavorsExtraSpecsTestJSON-1260611247-project] 10.222.0.69 "GET /compute/v2.1/flavors/1252335243/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.221642 Aug 04 04:24:02.816315 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 191/380] 10.222.0.69 () {58 vars in 1203 bytes} [Thu Aug 4 04:24:02 2022] GET /compute/v2.1/flavors/1252335243/os-extra_specs => generated 66 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:02.871542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lazy-loading 'flavor' on Instance uuid 6dee7941-b83b-457d-a8c8-93411b771af0 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:02.898079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-464388752", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "50e30f39-3ea7-4335-a7da-5dfd49b29ac4"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:02.931924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Going to try to live migrate instance to tempest-host-1022484306 {{(pid=119343) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:24:02.939881 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] HTTP exception thrown: Compute host tempest-host-1022484306 could not be found. Aug 04 04:24:02.969028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] validate_networks() for [('50e30f39-3ea7-4335-a7da-5dfd49b29ac4', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Request method failure captured: Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0/action HTTP/1.1 Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 107 Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nGE4fDP--ICGMp47b3AohMMdERmWHRzYW4YmiH_K33jzQYQfK9kJeYjNYV3KYmQI4w3-lyCIoHkUlXM-ory0fT2ON5aNedgFa5U1hNKv3mMxb8XbkfLLXYM6IVsS2zYM-zKnrg-kExUuxGfw71YZmufVTfa0zXEOD06JB1UdD4-vo Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b3fe8851eadc470088ca602e8a877f1c Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveMigrationNegativeTest-1534544331 Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:24:02.969257 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b3fe8851eadc470088ca602e8a877f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b3fe8851eadc470088ca602e8a877f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b3fe8851eadc470088ca602e8a877f1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b3fe8851eadc470088ca602e8a877f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveMigrationNegativeTest-1534544331 Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b3fe8851eadc470088ca602e8a877f1c Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1534544331 Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveMigrationNegativeTest-1534544331-project-admin Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: cc07aa077d964aaab9002615c659c07f Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveMigrationNegativeTest-1534544331-project-admin Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: {"os-migrateLive": {"host": "tempest-host-1022484306", "block_migration": true, "disk_over_commit": false}} Aug 04 04:24:02.970695 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: exception: Compute host tempest-host-1022484306 could not be found. Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6dee7941-b83b-457d-a8c8-93411b771af0', 'body': {'os-migrateLive': {'host': 'tempest-host-1022484306', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:24:02.971403 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1022484306 could not be found. Aug 04 04:24:02.972412 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1022484306 could not be found. Aug 04 04:24:02.973409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1022484306 could not be found. Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Returning 400 to user: Compute host tempest-host-1022484306 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f8f3431-f2cd-4fb2-a7e9-d49476f1f169 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0/action" status: 400 len: 100 microversion: 2.1 time: 0.470479 Aug 04 04:24:02.974450 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 190/381] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Aug 4 04:24:02 2022] POST /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0/action => generated 100 bytes in 492 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:24:02.988534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf3a251b-5afb-4d98-9a82-bb7d2ecfb454 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] Action: 'create', calling method: .version_select at 0x7f191afbde50>, body: {"security_group": {"name": "tempest-securitygroup-1656222138", "description": "tempest-description-1211526299"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:03.747395 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf3a251b-5afb-4d98-9a82-bb7d2ecfb454 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.772463 Aug 04 04:24:03.755812 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 191/382] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:02 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:03.763677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:03.765040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:03.783215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:03.783847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:03.784808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:03.786377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.251239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:04.263320 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b191ae6-aef3-4780-b0f9-1b1a64d0aac7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1461 microversion: 2.1 time: 0.506278 Aug 04 04:24:04.264161 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 192/383] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:03 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1461 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:04.281006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06a178fb-d018-4f25-a69f-96d2627d0d82 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:04.293808 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:04.293808 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:04.317137 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06a178fb-d018-4f25-a69f-96d2627d0d82 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1252335243/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046450 Aug 04 04:24:04.317729 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 193/384] 10.222.0.69 () {60 vars in 1224 bytes} [Thu Aug 4 04:24:04 2022] POST /compute/v2.1/flavors/1252335243/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:04.323455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:04.324069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:04.330366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.330809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.331615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.332049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.549784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:04.550353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:04.550587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:04.551084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:04.551511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:04.561436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.562185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.563933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.564373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.586165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:04.592721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for user eaff90b8a434488f9d2731070edf30fe and project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:04.606636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:04.610344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:04.691585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:04.701722 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-499c6c75-ef74-4d3a-b385-3a914ad870e8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1466 microversion: 2.1 time: 0.382869 Aug 04 04:24:04.705963 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 194/385] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:04 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1466 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:04.707090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb93f6bf-a0c1-47f0-a368-0bb23e0544d4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.889364 Aug 04 04:24:04.713746 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 192/386] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:24:04.714372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:04.715409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:04.723077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-73ac82e6-9262-4aa1-b4fd-26f1ca300359 req-b4bca9b9-6885-4e9c-81ca-8d4ac5bb5f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a408a4e-9b6f-468f-9db8-155a85a0f96d", "tag": "f96eb774-8631-49c6-b48b-69bd803736d9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:04.740646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.741299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.742327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.742923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.746138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-73ac82e6-9262-4aa1-b4fd-26f1ca300359 req-b4bca9b9-6885-4e9c-81ca-8d4ac5bb5f9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.747352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-73ac82e6-9262-4aa1-b4fd-26f1ca300359 req-b4bca9b9-6885-4e9c-81ca-8d4ac5bb5f9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.760464 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-73ac82e6-9262-4aa1-b4fd-26f1ca300359 req-b4bca9b9-6885-4e9c-81ca-8d4ac5bb5f9d service nova] Creating event network-changed:f96eb774-8631-49c6-b48b-69bd803736d9 for instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d on n-h1-851337-5 Aug 04 04:24:04.765770 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-73ac82e6-9262-4aa1-b4fd-26f1ca300359 req-b4bca9b9-6885-4e9c-81ca-8d4ac5bb5f9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050789 Aug 04 04:24:04.766914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 193/387] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:04.772832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:04.773946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:04.782922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.783507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:04.784919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:04.785373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:05.314668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:05.328139 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-321ba326-77f4-4325-abbd-93ab95a82977 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.557822 Aug 04 04:24:05.331139 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 194/388] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:04 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:05.343219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:05.344221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:05.348656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:05.357180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8f39ee2-98c1-49fc-87a8-59498bde44ab tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 200 len: 1586 microversion: 2.1 time: 0.649792 Aug 04 04:24:05.358793 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 195/389] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:04 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 1586 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:05.368108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:05.368762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:05.372025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:05.372500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:05.438631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0abd482-9609-466d-a78e-3898f403f078 tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] Action: 'create', calling method: .version_select at 0x7f191ae60a60>, body: {"security_group": {"name": "tempest-securitygroup-81380760", "description": "tempest-description-1620379340"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:05.526069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:05.534474 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-36569d7c-0c58-4bf5-a473-54c57b40545a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1277 microversion: 2.1 time: 0.201928 Aug 04 04:24:05.535486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 195/390] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:05 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:05.540399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e77dd083-9763-4c68-b66f-3ea18e176b9c req-55348bf5-1c53-431d-bf91-9fd5f6e6c676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0369c85-48d1-4749-8548-3e7fb8d1cac6", "name": "network-vif-plugged", "status": "completed", "tag": "f7771695-b299-4d9f-aac3-35674f82d732"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:05.552192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e77dd083-9763-4c68-b66f-3ea18e176b9c req-55348bf5-1c53-431d-bf91-9fd5f6e6c676 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:05.552827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e77dd083-9763-4c68-b66f-3ea18e176b9c req-55348bf5-1c53-431d-bf91-9fd5f6e6c676 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:05.566118 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e77dd083-9763-4c68-b66f-3ea18e176b9c req-55348bf5-1c53-431d-bf91-9fd5f6e6c676 service nova] Creating event network-vif-plugged:f7771695-b299-4d9f-aac3-35674f82d732 for instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 on n-h1-851337-5 Aug 04 04:24:05.573464 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e77dd083-9763-4c68-b66f-3ea18e176b9c req-55348bf5-1c53-431d-bf91-9fd5f6e6c676 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036399 Aug 04 04:24:05.580151 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 196/391] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:05.586676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2af3a134-5fef-42c8-ae81-3d58579c3618 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:05.587509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2af3a134-5fef-42c8-ae81-3d58579c3618 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:05.595507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2af3a134-5fef-42c8-ae81-3d58579c3618 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:05.595962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2af3a134-5fef-42c8-ae81-3d58579c3618 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:05.596979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2af3a134-5fef-42c8-ae81-3d58579c3618 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:05.597486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2af3a134-5fef-42c8-ae81-3d58579c3618 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:05.934324 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2af3a134-5fef-42c8-ae81-3d58579c3618 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1612 microversion: 2.1 time: 0.352634 Aug 04 04:24:05.934887 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 197/392] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:05 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1612 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:05.946652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c9098dc-c940-4b9f-8fa4-d5da0def48d9 tempest-FlavorsExtraSpecsTestJSON-1260611247 tempest-FlavorsExtraSpecsTestJSON-1260611247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:05.958471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c9098dc-c940-4b9f-8fa4-d5da0def48d9 tempest-FlavorsExtraSpecsTestJSON-1260611247 tempest-FlavorsExtraSpecsTestJSON-1260611247-project] 10.222.0.69 "GET /compute/v2.1/flavors/1252335243/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019257 Aug 04 04:24:05.959380 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 198/393] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:24:05 2022] GET /compute/v2.1/flavors/1252335243/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:05.964218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:05.964839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:05.971480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:05.972004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:05.972721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:05.973156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:06.096828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:06.108081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:06.112607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:06.115468 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f4190398-50ce-4ac9-baa4-c746c79883e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1313 microversion: 2.25 time: 0.155002 Aug 04 04:24:06.116149 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 199/394] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:05 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:06.143751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-221492726", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:06.221536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:06.390824 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0abd482-9609-466d-a78e-3898f403f078 tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.023914 Aug 04 04:24:06.391494 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 196/395] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:05 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:06.396167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ba120d3-2dee-4ded-a86d-61320065e6f8 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '.version_select at 0x7f191ae60550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:06.401057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ba120d3-2dee-4ded-a86d-61320065e6f8 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:06.401505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ba120d3-2dee-4ded-a86d-61320065e6f8 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:06.415513 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ba120d3-2dee-4ded-a86d-61320065e6f8 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.022934 Aug 04 04:24:06.416380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 197/396] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:24:06 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:06.420891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a61a94ca-7917-4f9d-a9c8-10e251cc3f7d tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:06.423965 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:06.423965 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:06.452413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:06.456956 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a61a94ca-7917-4f9d-a9c8-10e251cc3f7d tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1252335243/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039419 Aug 04 04:24:06.457745 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 198/397] 10.222.0.69 () {60 vars in 1224 bytes} [Thu Aug 4 04:24:06 2022] POST /compute/v2.1/flavors/1252335243/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:06.462809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:06.463593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:06.472525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:06.472968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:06.473744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:06.474172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:06.746839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:06.747362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:06.747942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:06.748418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:06.748902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:06.758942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:06.759566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:06.760366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:06.760809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:06.771623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:06.780414 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0bd4ffd3-7ef3-4af6-8134-7f68a0c9b5e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1316 microversion: 2.1 time: 0.321485 Aug 04 04:24:06.780869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Getting quotas for project df52a6a37edc4decb87471624d5ce915. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:06.781369 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 199/398] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:06 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:06.793865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Getting quotas for user 878f8dd4c3b243e191bbb24696f5ebe3 and project df52a6a37edc4decb87471624d5ce915. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:06.796987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:06.799055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5c1a4f1d-0eee-4580-9fa8-4562c8d2d5b1 tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] Action: 'create', calling method: .version_select at 0x7f191ae608b0>, body: {"security_group": {"name": "tempest-securitygroup-284914528", "description": "tempest-description-561696111"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:06.799276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:06.846164 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-62d68e67-34ef-45f9-a836-a5111ac7717d tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709668 Aug 04 04:24:06.852883 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 200/399] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:24:06.852883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-593209fa-77fb-44e5-a79f-9ea97c37ceb3 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:06.862669 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-593209fa-77fb-44e5-a79f-9ea97c37ceb3 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1252335243/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014300 Aug 04 04:24:06.863617 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 201/400] 10.222.0.69 () {58 vars in 1203 bytes} [Thu Aug 4 04:24:06 2022] GET /compute/v2.1/flavors/1252335243/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:06.869999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1001536682", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:06.936175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:07.504830 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5c1a4f1d-0eee-4580-9fa8-4562c8d2d5b1 tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.709207 Aug 04 04:24:07.505350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 200/401] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:06 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:07.509491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:07.510116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:07.526679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.542100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.543132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.544323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.631638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:07.632071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:07.632581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:07.632992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:07.633500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:07.650165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.650986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.651811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.652238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.671762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:07.700169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:07.713486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for user 80bef27d84824d25b096a8507009d824 and project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:07.754047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:07.757225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:07.784243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:07.793255 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ec8cea5-fdc1-4bcc-8cae-15df157f7ef3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1319 microversion: 2.1 time: 0.287175 Aug 04 04:24:07.794445 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 201/402] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:07 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:07.800029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:07.801654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:07.809906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.811017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.812992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.813752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.840853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2687ff4-ae92-4954-a6eb-c55ae0f5bbc6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975815 Aug 04 04:24:07.852301 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 202/403] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:24:07.865605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0dad524-1a53-4fad-a061-31baf6405a07 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:07.870598 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:07.870598 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:07.923730 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0dad524-1a53-4fad-a061-31baf6405a07 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/1252335243/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.066944 Aug 04 04:24:07.923730 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 203/404] 10.222.0.69 () {60 vars in 1265 bytes} [Thu Aug 4 04:24:07 2022] PUT /compute/v2.1/flavors/1252335243/os-extra_specs/hw:numa_nodes => generated 22 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:07.942969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:07.943591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:07.953436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.953887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.954659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:07.955115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:07.955244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:07.966385 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13498d3e-9cb1-4e20-bd5e-5e4b46ee8963 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1270 microversion: 2.1 time: 0.170389 Aug 04 04:24:07.969665 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 202/405] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:07 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:07.975253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f15bb036-6bf1-4794-9020-05a54872532b tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] Calling method '.version_select at 0x7f191ae60700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:08.178157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:08.189431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:08.191145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:08.192390 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-87b5faed-2aab-4e53-89ae-442befc9a2a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1319 microversion: 2.25 time: 0.267820 Aug 04 04:24:08.193364 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 204/406] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:07 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:08.198440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4b965f63-9534-43d9-a542-9d729cde5179 req-d6377ad3-c9e9-4bb4-af1a-25240dd92a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d4a93d-313d-4a4c-8b99-95aa07ccf1a6", "tag": "55e4bc02-15d0-46e5-8073-cab3f1c9a581"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:08.211596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4b965f63-9534-43d9-a542-9d729cde5179 req-d6377ad3-c9e9-4bb4-af1a-25240dd92a08 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:08.212533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4b965f63-9534-43d9-a542-9d729cde5179 req-d6377ad3-c9e9-4bb4-af1a-25240dd92a08 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:08.227710 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4b965f63-9534-43d9-a542-9d729cde5179 req-d6377ad3-c9e9-4bb4-af1a-25240dd92a08 service nova] Creating event network-changed:55e4bc02-15d0-46e5-8073-cab3f1c9a581 for instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 on n-h2-851337-5 Aug 04 04:24:08.234891 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4b965f63-9534-43d9-a542-9d729cde5179 req-d6377ad3-c9e9-4bb4-af1a-25240dd92a08 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039830 Aug 04 04:24:08.236025 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 205/407] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:08.241388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:08.242154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:08.249064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:08.249512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:08.250290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:08.250717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:08.708297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:08.720660 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d52b7d99-caf1-42ea-b915-89d368cbc7ac tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1504 microversion: 2.1 time: 0.483152 Aug 04 04:24:08.721868 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 206/408] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:08 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:08.729220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:08.730046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:08.739515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:08.740058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:08.740971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:08.741638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:08.761770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:08.860608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:08.868783 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fc7bd79d-1e92-4cde-b6c2-d34c94a0bcda tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1265 microversion: 2.1 time: 0.145584 Aug 04 04:24:08.882796 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 207/409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:08 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:08.882796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed0327c7-8354-4b66-bbbd-78a00d012194 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:08.889404 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed0327c7-8354-4b66-bbbd-78a00d012194 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1252335243/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015887 Aug 04 04:24:08.889985 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 208/410] 10.222.0.69 () {58 vars in 1203 bytes} [Thu Aug 4 04:24:08 2022] GET /compute/v2.1/flavors/1252335243/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:08.896619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:08.897238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:08.903871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:08.904477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:08.905337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:08.905994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:08.935400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:24:09.030440 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-edd80139-78bd-4bf1-9394-d108088391e4 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 204 len: 0 microversion: 2.1 time: 0.138747 Aug 04 04:24:09.032115 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 209/411] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:08 2022] DELETE /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:24:09.048114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:09.049371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:09.061417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.062190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:09.063713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.064539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:09.374205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:09.382090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c726c02-afbf-45b4-b9c6-c06f01379f24 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1319 microversion: 2.1 time: 0.347541 Aug 04 04:24:09.382674 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 210/412] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:09 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:09.387072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bbf153d4-f49c-455a-904b-e3a11e120069 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:09.388582 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:09.388582 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:09.418137 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bbf153d4-f49c-455a-904b-e3a11e120069 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1252335243/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.034291 Aug 04 04:24:09.419268 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 211/413] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:24:09 2022] DELETE /compute/v2.1/flavors/1252335243/os-extra_specs/hw:numa_nodes => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:24:09.427849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:09.428720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:09.436064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.436730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:09.437640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.438768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:09.543268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:09.554677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-271aab36-b405-4a7a-9a6f-72f1e97da0a6 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1276 microversion: 2.1 time: 0.131536 Aug 04 04:24:09.567864 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 212/414] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:09 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:09.575676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:09.576546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:09.594763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.595443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:09.596346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.596951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:09.863315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:09.871734 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c377e46a-1f88-4fac-91bf-322ca501e5d6 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1510 microversion: 2.1 time: 0.302520 Aug 04 04:24:09.872330 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 213/415] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:09 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:09.877719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:09.878325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:09.886188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.886815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:09.887778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:09.888438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:10.257113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:10.265128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:10.266635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:10.267888 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab18fc0d-8854-4238-95be-805f5cd3fd5f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.394055 Aug 04 04:24:10.269340 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 214/416] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:09 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:10.273012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-048346bb-7378-4225-8185-b73de2d829f0 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:10.273764 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:10.273764 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:10.297938 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-048346bb-7378-4225-8185-b73de2d829f0 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1252335243/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.027464 Aug 04 04:24:10.298744 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 215/417] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:24:10 2022] DELETE /compute/v2.1/flavors/1252335243/os-extra_specs/hw:cpu_policy => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 04:24:10.306873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6f4bf1f9-c307-4b84-856e-73dc50ca8658 req-bcdff996-88ca-4916-96d6-e7d764267cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a042fbb-c3f2-4215-8132-6d5f33961b30", "tag": "312e5f6a-5467-4b81-b150-30a4209bcd76"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:10.316964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6f4bf1f9-c307-4b84-856e-73dc50ca8658 req-bcdff996-88ca-4916-96d6-e7d764267cfd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:10.317398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6f4bf1f9-c307-4b84-856e-73dc50ca8658 req-bcdff996-88ca-4916-96d6-e7d764267cfd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:10.331536 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6f4bf1f9-c307-4b84-856e-73dc50ca8658 req-bcdff996-88ca-4916-96d6-e7d764267cfd service nova] Creating event network-changed:312e5f6a-5467-4b81-b150-30a4209bcd76 for instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 on n-h1-851337-5 Aug 04 04:24:10.337497 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6f4bf1f9-c307-4b84-856e-73dc50ca8658 req-bcdff996-88ca-4916-96d6-e7d764267cfd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037119 Aug 04 04:24:10.338591 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 216/418] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:10.343858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:10.344582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:10.351321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:10.352012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:10.352554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:10.352986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:10.742836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:10.750937 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eea66a72-57eb-46b2-908b-e9beb2f32496 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1273 microversion: 2.1 time: 0.410943 Aug 04 04:24:10.751542 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 217/419] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:10 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:10.756234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bdcffdae-8d14-455d-a6e6-015344961816 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:10.764927 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bdcffdae-8d14-455d-a6e6-015344961816 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1252335243/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012341 Aug 04 04:24:10.765500 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 218/420] 10.222.0.69 () {58 vars in 1203 bytes} [Thu Aug 4 04:24:10 2022] GET /compute/v2.1/flavors/1252335243/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:10.770200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:10.770579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:10.777006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:10.777463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:10.778243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:10.778675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:11.205035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:11.235761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:11.310274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:11.320360 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fc435731-b3ea-4ad5-b1bd-28a4f3e2d60f tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1319 microversion: 2.1 time: 0.553815 Aug 04 04:24:11.321920 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 219/421] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:10 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:11.340239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:11.340860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:11.348524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:11.348966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:11.349925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:11.350360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:11.808666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:11.819803 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00755205-98e1-4bff-af2f-451958b1e6d8 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1318 microversion: 2.1 time: 0.496084 Aug 04 04:24:11.820940 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 220/422] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:11 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:11.829410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eeb3cee7-c9f3-49e0-ae4f-627b755637a3 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:11.830646 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:11.830646 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:11.881027 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eeb3cee7-c9f3-49e0-ae4f-627b755637a3 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1252335243" status: 202 len: 0 microversion: 2.1 time: 0.058616 Aug 04 04:24:11.882175 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 221/423] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:24:11 2022] DELETE /compute/v2.1/flavors/1252335243 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:11.891202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:11.891838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:11.911313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:11.911886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:11.917199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:11.917939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:12.089727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526ee29d8c04e069a61722fc3192502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0e8ff7d8cc4a40930e75fa08cc1aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:12.129056 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55559ead-01d3-4685-b3fa-2c25f32dc91a tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 200 len: 1468 microversion: 2.1 time: 0.242922 Aug 04 04:24:12.131334 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 222/424] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:11 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:12.149862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:12.150509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:12.163979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:12.164445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:12.165238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:12.165680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:12.606782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:12.629941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:12.637449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:12.639406 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1e2ee12-b300-43c1-8abd-2095d2e04e7f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.506226 Aug 04 04:24:12.640396 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 223/425] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:12 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:12.647701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:12.648983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:12.659200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:12.660589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:12.662313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:12.663443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.223994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:13.231965 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-335000a1-c15a-4d60-9f6f-3312842ba759 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.589792 Aug 04 04:24:13.239338 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 224/426] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:12 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:13.245551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93debab2-9db7-4996-99cb-5f0edb38dec8 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:13.283332 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93debab2-9db7-4996-99cb-5f0edb38dec8 tempest-FlavorsExtraSpecsTestJSON-1995974503 tempest-FlavorsExtraSpecsTestJSON-1995974503-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.042087 Aug 04 04:24:13.284131 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 225/427] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:24:13 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:13.288889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5a0b9f8d-a215-4f43-bc35-06e07c17b3da req-8e9d288c-fee9-4d38-860f-63df59d67ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a15fee3-6243-4dac-a053-6e72fdd7cf22", "tag": "75a20b02-4197-40c2-9e40-2d5f6994619e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:13.303163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5a0b9f8d-a215-4f43-bc35-06e07c17b3da req-8e9d288c-fee9-4d38-860f-63df59d67ef9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.303635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5a0b9f8d-a215-4f43-bc35-06e07c17b3da req-8e9d288c-fee9-4d38-860f-63df59d67ef9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.316477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5a0b9f8d-a215-4f43-bc35-06e07c17b3da req-8e9d288c-fee9-4d38-860f-63df59d67ef9 service nova] Creating event network-changed:75a20b02-4197-40c2-9e40-2d5f6994619e for instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 on n-h2-851337-5 Aug 04 04:24:13.321902 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5a0b9f8d-a215-4f43-bc35-06e07c17b3da req-8e9d288c-fee9-4d38-860f-63df59d67ef9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036371 Aug 04 04:24:13.323051 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 226/428] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:13.329422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:13.330122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:13.336758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.337386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.338502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.339138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.588298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:13.599160 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38231f04-3794-487a-be8b-55760d67d886 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1319 microversion: 2.1 time: 0.274548 Aug 04 04:24:13.600282 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 227/429] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:13 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:13.609289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-fcf4c838-992f-4296-9690-739993beafcc req-5ddcb69d-700b-44d5-bf11-b145716cd55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0369c85-48d1-4749-8548-3e7fb8d1cac6", "name": "network-vif-deleted", "tag": "f7771695-b299-4d9f-aac3-35674f82d732"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:13.627045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fcf4c838-992f-4296-9690-739993beafcc req-5ddcb69d-700b-44d5-bf11-b145716cd55c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.627652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fcf4c838-992f-4296-9690-739993beafcc req-5ddcb69d-700b-44d5-bf11-b145716cd55c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.640387 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-fcf4c838-992f-4296-9690-739993beafcc req-5ddcb69d-700b-44d5-bf11-b145716cd55c service nova] Creating event network-vif-deleted:f7771695-b299-4d9f-aac3-35674f82d732 for instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 on n-h1-851337-5 Aug 04 04:24:13.645683 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-fcf4c838-992f-4296-9690-739993beafcc req-5ddcb69d-700b-44d5-bf11-b145716cd55c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044009 Aug 04 04:24:13.649571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 228/430] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:13.655836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:13.657126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:13.671433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.672105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.673049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.673659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.836580 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f15bb036-6bf1-4794-9020-05a54872532b tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] 10.222.0.69 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11054 microversion: 2.1 time: 5.865649 Aug 04 04:24:13.841048 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 203/431] 10.222.0.69 () {58 vars in 1191 bytes} [Thu Aug 4 04:24:07 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11054 bytes in 5867 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:24:13.843057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:13.843838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:13.850548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.851007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.852104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.852541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.867401 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] HTTP exception thrown: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:13.869097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Request method failure captured: Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 HTTP/1.1 Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nJ5i6l6a29V4eUd-UKLsnGVFytMtQw6CEXRh3kfCMMkRwTs5eEW3qo9mg2VUkLyMheAFkFj7Pi9irhs3NJzwmF7ZE_aO1SqPWFVBEo46N4P_aGaHIyHcwe7UXrz_Enc1cyj0SPkMknrSZfyRH2mF-yLI6Vr50T85tMPiIUiWuhLZI Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:13.869315 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0e0e8ff7d8cc4a40930e75fa08cc1aef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b526ee29d8c04e069a61722fc3192502 Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:13.871147 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'c0369c85-48d1-4749-8548-3e7fb8d1cac6'} Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:13.873379 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:13.874747 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:13.877892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Returning 404 to user: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:13.877892 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b8a5c8f3-57c8-4297-9f8e-9cfa6d17b285 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 404 len: 111 microversion: 2.1 time: 0.032032 Aug 04 04:24:13.877892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 204/432] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:13 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:13.879758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-15d41146-6b48-49a7-ada8-02c4d9892769 req-23e6834c-aac2-497b-8a55-0dc65be01d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d4a93d-313d-4a4c-8b99-95aa07ccf1a6", "name": "network-vif-plugged", "status": "completed", "tag": "55e4bc02-15d0-46e5-8073-cab3f1c9a581"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:13.882522 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c3b2ad9-47cc-4e8a-bfac-6511bf9067f7 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1318 microversion: 2.1 time: 0.231608 Aug 04 04:24:13.883289 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 229/433] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:13 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:13.890415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-15d41146-6b48-49a7-ada8-02c4d9892769 req-23e6834c-aac2-497b-8a55-0dc65be01d44 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.890842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-15d41146-6b48-49a7-ada8-02c4d9892769 req-23e6834c-aac2-497b-8a55-0dc65be01d44 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.903058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:13.903245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-15d41146-6b48-49a7-ada8-02c4d9892769 req-23e6834c-aac2-497b-8a55-0dc65be01d44 service nova] Creating event network-vif-plugged:55e4bc02-15d0-46e5-8073-cab3f1c9a581 for instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 on n-h2-851337-5 Aug 04 04:24:13.903502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:13.908694 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-15d41146-6b48-49a7-ada8-02c4d9892769 req-23e6834c-aac2-497b-8a55-0dc65be01d44 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035534 Aug 04 04:24:13.909924 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 205/434] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:13.910725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.911272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.912166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:13.913349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:13.914986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4382bb78-3beb-4188-832a-ea45c6f0edc8 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] Calling method '.version_select at 0x7f191afbd310>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:13.934359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:14.128583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:14.140805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:14.142643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:14.144006 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a3ac349-a9bf-4d04-a2c5-eeab15482ffa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.247965 Aug 04 04:24:14.155889 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 230/435] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:13 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:14.164900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-922331676", "metadata": {"image_type": "test"}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:14.168389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:14.171851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:14.178267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.179165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.179952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.180387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.189239 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4382bb78-3beb-4188-832a-ea45c6f0edc8 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.278051 Aug 04 04:24:14.189856 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 206/436] 10.222.0.69 () {58 vars in 1191 bytes} [Thu Aug 4 04:24:13 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:14.198281 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] HTTP exception thrown: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Request method failure captured: Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6/action HTTP/1.1 Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 111 Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nJ5i6l6a29V4eUd-UKLsnGVFytMtQw6CEXRh3kfCMMkRwTs5eEW3qo9mg2VUkLyMheAFkFj7Pi9irhs3NJzwmF7ZE_aO1SqPWFVBEo46N4P_aGaHIyHcwe7UXrz_Enc1cyj0SPkMknrSZfyRH2mF-yLI6Vr50T85tMPiIUiWuhLZI Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:14.200381 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0e0e8ff7d8cc4a40930e75fa08cc1aef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b526ee29d8c04e069a61722fc3192502 Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-922331676", "metadata": {"image_type": "test"}}} Aug 04 04:24:14.201843 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'c0369c85-48d1-4749-8548-3e7fb8d1cac6', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-922331676', 'metadata': {'image_type': 'test'}}}} Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.202620 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.203863 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.205147 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.205147 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:14.205147 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:14.205147 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.205147 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.205487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-736e5735-2855-4b6c-9901-811b13ddb2da tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] Calling method '.version_select at 0x7f191ae60940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:14.206543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Returning 404 to user: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:14.207579 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ead88deb-1292-459e-87f6-3de606a60cab tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "POST /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6/action" status: 404 len: 111 microversion: 2.1 time: 0.050644 Aug 04 04:24:14.208302 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 231/437] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Aug 4 04:24:14 2022] POST /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:14.219986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b749f56d-b34e-4af1-8ffb-afd63e5f1d87 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1269520316", "metadata": {"image_type": "test"}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:14.223581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b749f56d-b34e-4af1-8ffb-afd63e5f1d87 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Failed to fetch instance by id tempest-invalid-28295141 {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 04:24:14.224173 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b749f56d-b34e-4af1-8ffb-afd63e5f1d87 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] HTTP exception thrown: Instance tempest-invalid-28295141 could not be found. Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b749f56d-b34e-4af1-8ffb-afd63e5f1d87 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Request method failure captured: Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/tempest-invalid-28295141/action HTTP/1.1 Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 112 Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nJ5i6l6a29V4eUd-UKLsnGVFytMtQw6CEXRh3kfCMMkRwTs5eEW3qo9mg2VUkLyMheAFkFj7Pi9irhs3NJzwmF7ZE_aO1SqPWFVBEo46N4P_aGaHIyHcwe7UXrz_Enc1cyj0SPkMknrSZfyRH2mF-yLI6Vr50T85tMPiIUiWuhLZI Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:14.226881 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0e0e8ff7d8cc4a40930e75fa08cc1aef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b526ee29d8c04e069a61722fc3192502 Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1269520316", "metadata": {"image_type": "test"}}} Aug 04 04:24:14.228102 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance tempest-invalid-28295141 could not be found. Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'tempest-invalid-28295141', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1269520316', 'metadata': {'image_type': 'test'}}}} Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-28295141 could not be found. Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:14.228757 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-28295141 could not be found. Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-28295141 could not be found. Aug 04 04:24:14.229841 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.231008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b749f56d-b34e-4af1-8ffb-afd63e5f1d87 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Returning 404 to user: Instance tempest-invalid-28295141 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:14.231008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b749f56d-b34e-4af1-8ffb-afd63e5f1d87 tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "POST /compute/v2.1/servers/tempest-invalid-28295141/action" status: 404 len: 99 microversion: 2.1 time: 0.013733 Aug 04 04:24:14.231008 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 232/438] 10.222.0.69 () {60 vars in 1243 bytes} [Thu Aug 4 04:24:14 2022] POST /compute/v2.1/servers/tempest-invalid-28295141/action => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:14.240616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0f30559-7a43-44aa-b3a7-ca5c783d4a8e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-170695457"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:14.243671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0f30559-7a43-44aa-b3a7-ca5c783d4a8e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 04:24:14.244396 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a0f30559-7a43-44aa-b3a7-ca5c783d4a8e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0f30559-7a43-44aa-b3a7-ca5c783d4a8e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Request method failure captured: Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 56 Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nJ5i6l6a29V4eUd-UKLsnGVFytMtQw6CEXRh3kfCMMkRwTs5eEW3qo9mg2VUkLyMheAFkFj7Pi9irhs3NJzwmF7ZE_aO1SqPWFVBEo46N4P_aGaHIyHcwe7UXrz_Enc1cyj0SPkMknrSZfyRH2mF-yLI6Vr50T85tMPiIUiWuhLZI Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:14.245937 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0e0e8ff7d8cc4a40930e75fa08cc1aef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b526ee29d8c04e069a61722fc3192502 Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: {"createImage": {"name": "tempest-test-snap-170695457"}} Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:14.247262 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-170695457'}}} Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.248658 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.249746 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.250861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0f30559-7a43-44aa-b3a7-ca5c783d4a8e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:14.250861 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0f30559-7a43-44aa-b3a7-ca5c783d4a8e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010943 Aug 04 04:24:14.251617 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 233/439] 10.222.0.69 () {60 vars in 1275 bytes} [Thu Aug 4 04:24:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:14.258376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:14.259379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:14.267084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.268023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.269112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.269702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.506804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:14.516492 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ae6de8c-0e4b-49a4-9499-6e23da41fda8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.263174 Aug 04 04:24:14.517147 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 234/440] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:14 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:14.521271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-736e5735-2855-4b6c-9901-811b13ddb2da tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/e06f4ec9-f0bc-4a67-8e48-1df9f328ba11" status: 202 len: 0 microversion: 2.1 time: 0.321970 Aug 04 04:24:14.533150 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 207/441] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:24:14 2022] DELETE /compute/v2.1/os-security-groups/e06f4ec9-f0bc-4a67-8e48-1df9f328ba11 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:14.543418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f97fc96d-7eb5-4b12-812d-1f3b55d9b57f tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] Calling method '.version_select at 0x7f1920871c10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:14.547432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-226c8c97-a68e-4f7b-b59a-eebb5c44889c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1646107773"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:14.553534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-226c8c97-a68e-4f7b-b59a-eebb5c44889c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 04:24:14.562607 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-226c8c97-a68e-4f7b-b59a-eebb5c44889c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-226c8c97-a68e-4f7b-b59a-eebb5c44889c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Request method failure captured: Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 57 Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nJ5i6l6a29V4eUd-UKLsnGVFytMtQw6CEXRh3kfCMMkRwTs5eEW3qo9mg2VUkLyMheAFkFj7Pi9irhs3NJzwmF7ZE_aO1SqPWFVBEo46N4P_aGaHIyHcwe7UXrz_Enc1cyj0SPkMknrSZfyRH2mF-yLI6Vr50T85tMPiIUiWuhLZI Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:14.565991 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0e0e8ff7d8cc4a40930e75fa08cc1aef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b526ee29d8c04e069a61722fc3192502 Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: {"createImage": {"name": "tempest-test-snap-1646107773"}} Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:14.567523 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1646107773'}}} Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.568409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 04:24:14.569694 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.571593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-226c8c97-a68e-4f7b-b59a-eebb5c44889c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:14.571593 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-226c8c97-a68e-4f7b-b59a-eebb5c44889c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.034445 Aug 04 04:24:14.571593 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 208/442] 10.222.0.69 () {60 vars in 1281 bytes} [Thu Aug 4 04:24:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:14.584622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:14.585511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:14.600820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.601268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.602202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.602740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.626171 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] HTTP exception thrown: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Request method failure captured: Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 HTTP/1.1 Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nJ5i6l6a29V4eUd-UKLsnGVFytMtQw6CEXRh3kfCMMkRwTs5eEW3qo9mg2VUkLyMheAFkFj7Pi9irhs3NJzwmF7ZE_aO1SqPWFVBEo46N4P_aGaHIyHcwe7UXrz_Enc1cyj0SPkMknrSZfyRH2mF-yLI6Vr50T85tMPiIUiWuhLZI Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:14.628272 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0e0e8ff7d8cc4a40930e75fa08cc1aef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b526ee29d8c04e069a61722fc3192502 Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.630009 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'c0369c85-48d1-4749-8548-3e7fb8d1cac6'} Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:14.630829 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.632212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.637915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Returning 404 to user: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:14.639917 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e7854b39-0bfe-4d10-ab66-a0fd99c9216c tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 404 len: 111 microversion: 2.1 time: 0.062748 Aug 04 04:24:14.645574 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 209/443] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:14 2022] DELETE /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:24:14.653645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:14.655169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:14.661734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.662498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.663506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.664941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.907004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:14.923068 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ad78af4-715c-4aa3-81fc-ef95fb68d4f3 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1319 microversion: 2.1 time: 0.277719 Aug 04 04:24:14.925078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 210/444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:14 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:14.930164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:14.931347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] [instance: c0369c85-48d1-4749-8548-3e7fb8d1cac6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:14.938096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.938793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.939725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.940416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.960761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] HTTP exception thrown: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Request method failure captured: Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 HTTP/1.1 Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nJ5i6l6a29V4eUd-UKLsnGVFytMtQw6CEXRh3kfCMMkRwTs5eEW3qo9mg2VUkLyMheAFkFj7Pi9irhs3NJzwmF7ZE_aO1SqPWFVBEo46N4P_aGaHIyHcwe7UXrz_Enc1cyj0SPkMknrSZfyRH2mF-yLI6Vr50T85tMPiIUiWuhLZI Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:14.963398 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0e0e8ff7d8cc4a40930e75fa08cc1aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0e0e8ff7d8cc4a40930e75fa08cc1aef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 0e0e8ff7d8cc4a40930e75fa08cc1aef Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1594370701 Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b526ee29d8c04e069a61722fc3192502 Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesNegativeTestJSON-1594370701-project Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.964658 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'c0369c85-48d1-4749-8548-3e7fb8d1cac6'} Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:14.965349 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. Aug 04 04:24:14.967017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:14.971320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] Returning 404 to user: Instance c0369c85-48d1-4749-8548-3e7fb8d1cac6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:14.972633 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a80a4fb7-b017-4122-8bed-f391fbd00b5e tempest-ImagesNegativeTestJSON-1594370701 tempest-ImagesNegativeTestJSON-1594370701-project] 10.222.0.69 "GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6" status: 404 len: 111 microversion: 2.1 time: 0.046361 Aug 04 04:24:14.973829 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 211/445] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:14 2022] GET /compute/v2.1/servers/c0369c85-48d1-4749-8548-3e7fb8d1cac6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:14.983527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:14.984200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:14.995540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.996297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:14.997635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:14.998342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:15.007817 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f97fc96d-7eb5-4b12-812d-1f3b55d9b57f tempest-SecurityGroupsTestAdminJSON-254777961 tempest-SecurityGroupsTestAdminJSON-254777961-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/7f281481-5d0e-4d5d-a43b-30d7f9b4722b" status: 202 len: 0 microversion: 2.1 time: 0.469358 Aug 04 04:24:15.008400 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 235/446] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:24:14 2022] DELETE /compute/v2.1/os-security-groups/7f281481-5d0e-4d5d-a43b-30d7f9b4722b => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:15.017183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8575c4e8-af0f-4b72-82db-c25730714292 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] Calling method '.version_select at 0x7f191b7dadc0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:15.031067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:15.311163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:15.321977 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c0a089b8-a124-4a78-9e35-dd4ff127c9d9 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1318 microversion: 2.1 time: 0.346904 Aug 04 04:24:15.331892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 212/447] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:14 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:15.340465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:15.346007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:15.363234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:15.364662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:15.365861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:15.367564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:15.632472 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8575c4e8-af0f-4b72-82db-c25730714292 tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/8988180f-03b0-4316-9124-c5f9a69676a4" status: 202 len: 0 microversion: 2.1 time: 0.619823 Aug 04 04:24:15.633373 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 236/448] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:24:15 2022] DELETE /compute/v2.1/os-security-groups/8988180f-03b0-4316-9124-c5f9a69676a4 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:24:15.647084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:15.649009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:15.678866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:15.679363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:15.681146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:15.681587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.032943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:16.047901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:16.051830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:16.057742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e4bc3632-8a84-44de-ac43-b5868081bb63 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.720953 Aug 04 04:24:16.072137 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 213/449] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:15 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:16.079994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1fec959-1b57-47e5-811b-b44e8114124d tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] Calling method '.version_select at 0x7f191af03dc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:16.189853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:16.197606 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bdacc42c-624f-4963-bd0a-579eb5ed0c66 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.562990 Aug 04 04:24:16.199619 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 237/450] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:15 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:16.217970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8877e483-71f1-4315-b606-cb051069ecb2 req-d6a007cf-d6cd-4ec3-a1db-b2964a4851f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce46d12e-0073-4f73-86fa-25bf2aac23f6", "tag": "03e5c638-30f6-4365-bbec-9c7499d43113"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:16.230657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8877e483-71f1-4315-b606-cb051069ecb2 req-d6a007cf-d6cd-4ec3-a1db-b2964a4851f1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:16.231146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8877e483-71f1-4315-b606-cb051069ecb2 req-d6a007cf-d6cd-4ec3-a1db-b2964a4851f1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.264646 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8877e483-71f1-4315-b606-cb051069ecb2 req-d6a007cf-d6cd-4ec3-a1db-b2964a4851f1 service nova] Creating event network-changed:03e5c638-30f6-4365-bbec-9c7499d43113 for instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 on n-h1-851337-5 Aug 04 04:24:16.271262 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8877e483-71f1-4315-b606-cb051069ecb2 req-d6a007cf-d6cd-4ec3-a1db-b2964a4851f1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062565 Aug 04 04:24:16.271954 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 238/451] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:16.280894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:16.281871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:16.304543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:16.309771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.310879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:16.312665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.508843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b1fec959-1b57-47e5-811b-b44e8114124d tempest-SecurityGroupsTestAdminJSON-1192740519 tempest-SecurityGroupsTestAdminJSON-1192740519-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/19ef44f0-061e-44a3-8700-0da9b9e4aba0" status: 202 len: 0 microversion: 2.1 time: 0.433638 Aug 04 04:24:16.510683 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 214/452] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:24:16 2022] DELETE /compute/v2.1/os-security-groups/19ef44f0-061e-44a3-8700-0da9b9e4aba0 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:16.533394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:16.535964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:16.541912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:16.552705 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e71f789-bb96-4b53-b4b5-1bf497204f66 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1469 microversion: 2.1 time: 0.279529 Aug 04 04:24:16.563179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:16.564010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.565764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:16.566213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.572142 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 239/453] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:16 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1469 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:16.746588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:16.755365 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9a6bb179-87e7-45c4-8705-e186cd1eac88 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1318 microversion: 2.1 time: 0.243323 Aug 04 04:24:16.755951 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 215/454] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:16 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:16.942735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:16.943266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:16.949275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:16.949919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.951376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:16.951987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:16.983059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:24:17.084481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:17.085856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:17.096026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.096710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:17.097970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.098865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:17.181303 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5da8fb23-1c86-4024-8365-3ccfa33b32f8 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] 10.222.0.69 "DELETE /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 204 len: 0 microversion: 2.1 time: 0.598996 Aug 04 04:24:17.182234 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 240/455] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:16 2022] DELETE /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:24:17.196570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:17.198052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:17.219996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.224483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:17.225390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.225840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:17.497518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:17.510113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:17.513924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:17.515277 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e57022d7-c832-4d4c-a802-098235f7faa2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.434783 Aug 04 04:24:17.518284 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 216/456] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:17 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:24:17.526353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:17.528284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:17.542003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.543567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:17.544814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.546833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:17.556095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:17.568045 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c48a92b4-98fd-476b-a4c7-2976e1f549fc tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1475 microversion: 2.1 time: 0.380616 Aug 04 04:24:17.569214 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 241/457] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:17 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1475 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:17.778119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:17.779768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:17.783563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:17.787506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=18 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:17.825049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.827736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:17.829923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:17.831340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:18.062925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:18.074566 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77c9323b-eeea-45ad-a65e-8ac3175cd77e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.555079 Aug 04 04:24:18.076660 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 217/458] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:17 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:18.085505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-5ccf4543-9860-4c29-a09b-a00d56faf779 req-85c0978f-1ca6-470e-8e5e-10d05abf6e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a15fee3-6243-4dac-a053-6e72fdd7cf22", "name": "network-vif-plugged", "status": "completed", "tag": "75a20b02-4197-40c2-9e40-2d5f6994619e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:18.101049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5ccf4543-9860-4c29-a09b-a00d56faf779 req-85c0978f-1ca6-470e-8e5e-10d05abf6e70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:18.101049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5ccf4543-9860-4c29-a09b-a00d56faf779 req-85c0978f-1ca6-470e-8e5e-10d05abf6e70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:18.118569 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-5ccf4543-9860-4c29-a09b-a00d56faf779 req-85c0978f-1ca6-470e-8e5e-10d05abf6e70 service nova] Creating event network-vif-plugged:75a20b02-4197-40c2-9e40-2d5f6994619e for instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 on n-h2-851337-5 Aug 04 04:24:18.125121 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-5ccf4543-9860-4c29-a09b-a00d56faf779 req-85c0978f-1ca6-470e-8e5e-10d05abf6e70 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046106 Aug 04 04:24:18.129061 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 218/459] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:18.170170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:18.179382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-90173842-c4e6-4dd6-8fbd-9026a334c797 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1318 microversion: 2.1 time: 0.403886 Aug 04 04:24:18.180775 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 242/460] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:17 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:18.545039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:18.546246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:18.553934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:18.554643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:18.555451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:18.556031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:18.596584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:18.597605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:18.606038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:18.606586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:18.608667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:18.609463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:19.317860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:19.328374 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a66c2886-9e35-4964-969d-7344affee926 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1475 microversion: 2.1 time: 0.737999 Aug 04 04:24:19.341305 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 243/461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:18 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1475 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:19.348923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:19.350394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:19.357341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:19.358037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:19.359318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:19.359936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:19.370450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:19.383141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:19.385022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:19.386901 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3f602fd-6a4f-42ec-8e4e-c20f79abbe68 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.847020 Aug 04 04:24:19.391091 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 219/462] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:18 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:19.394413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:19.395869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:19.404074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:19.404573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:19.405691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:19.407708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:19.934128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:19.947779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:19.957852 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea65c471-1b5c-42f5-aaf8-8a602479ff99 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1318 microversion: 2.1 time: 0.567722 Aug 04 04:24:19.961710 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 220/463] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:19 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:19.962570 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-224daec8-7a6d-4b21-9804-c4ffd0e7f302 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.619396 Aug 04 04:24:19.963731 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 244/464] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:19 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:20.213045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-90a28452-f2b3-48b5-ab15-b87b1c424166 req-3b2791a1-fd42-445c-92e4-2b9e49c190f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a042fbb-c3f2-4215-8132-6d5f33961b30", "name": "network-vif-plugged", "status": "completed", "tag": "312e5f6a-5467-4b81-b150-30a4209bcd76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:20.240490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90a28452-f2b3-48b5-ab15-b87b1c424166 req-3b2791a1-fd42-445c-92e4-2b9e49c190f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.241182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90a28452-f2b3-48b5-ab15-b87b1c424166 req-3b2791a1-fd42-445c-92e4-2b9e49c190f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.255935 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-90a28452-f2b3-48b5-ab15-b87b1c424166 req-3b2791a1-fd42-445c-92e4-2b9e49c190f5 service nova] Creating event network-vif-plugged:312e5f6a-5467-4b81-b150-30a4209bcd76 for instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 on n-h1-851337-5 Aug 04 04:24:20.270521 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-90a28452-f2b3-48b5-ab15-b87b1c424166 req-3b2791a1-fd42-445c-92e4-2b9e49c190f5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061003 Aug 04 04:24:20.271160 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 221/465] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:20.350188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:20.350810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:20.367278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.368069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.369125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.369828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.414717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:20.416063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:20.430024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.431069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.434360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.439423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.644634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:20.653343 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f323ced-0d1e-4ed3-8202-c424cf801cee tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 200 len: 1433 microversion: 2.1 time: 0.307165 Aug 04 04:24:20.679062 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 245/466] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:20 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 1433 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:20.816610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-45685f00-5013-4613-adf9-8db444dcd450 req-33800c83-1b95-45a8-b150-81c6e76cd2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d4a93d-313d-4a4c-8b99-95aa07ccf1a6", "name": "network-vif-deleted", "tag": "55e4bc02-15d0-46e5-8073-cab3f1c9a581"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:20.838465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45685f00-5013-4613-adf9-8db444dcd450 req-33800c83-1b95-45a8-b150-81c6e76cd2f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.839020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45685f00-5013-4613-adf9-8db444dcd450 req-33800c83-1b95-45a8-b150-81c6e76cd2f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.852766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:20.862972 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-45685f00-5013-4613-adf9-8db444dcd450 req-33800c83-1b95-45a8-b150-81c6e76cd2f4 service nova] Creating event network-vif-deleted:55e4bc02-15d0-46e5-8073-cab3f1c9a581 for instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 on n-h2-851337-5 Aug 04 04:24:20.865859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:20.869416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:20.878400 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-793e2d07-2677-484b-bdb5-c93f8337f974 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.468113 Aug 04 04:24:20.881771 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 222/467] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:20 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:24:20.882661 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-45685f00-5013-4613-adf9-8db444dcd450 req-33800c83-1b95-45a8-b150-81c6e76cd2f4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067451 Aug 04 04:24:20.884537 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 246/468] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:20.978581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:20.978981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:20.985143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:20.985842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:20.989676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.990412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.991427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.992674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.996776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:20.997239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:20.998540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.000506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.506218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:21.511041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:21.516596 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5fef7ae1-a022-4643-ba93-83053d452b2a tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1468 microversion: 2.1 time: 0.541950 Aug 04 04:24:21.517185 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 223/469] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:20 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1468 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:21.540269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:21.540955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:21.542828 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ced889fd-1a05-4248-b48a-55999df785b2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.562323 Aug 04 04:24:21.555261 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 247/470] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:20 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:21.561007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.563116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.566244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.566732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.639674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lazy-loading 'flavor' on Instance uuid 6a15fee3-6243-4dac-a053-6e72fdd7cf22 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:21.688723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:21.689502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:21.699436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.700623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.704708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.705345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.744516 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] HTTP exception thrown: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Request method failure captured: Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 HTTP/1.1 Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nd6sPRMv1du438ciVOnMT6kpXYY6dIMn99fkPb75sCKJCaF2yu4bMKw66R8P-l2TH9srvXFS9rc7AgFm_KXr74H7vwFyFLoFkTnxUbjgaq45l8aGZmKWrplX37KUG9P8Py7uKzOg7K59BN57U3lKX5zZtQWwqrtvoTn4S85UHNN98 Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:21.748135 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7302d2cfb3d546f4ab737bb03886bdcc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 7c46d9915a0b4eb89dabc8a0796331fa Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:21.749687 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '49d4a93d-313d-4a4c-8b99-95aa07ccf1a6'} Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:21.750353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:21.751728 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:21.752782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Returning 404 to user: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:21.752853 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-905bf4f1-fe0f-49e0-a788-ba73357b3c66 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22/action" status: 202 len: 0 microversion: 2.1 time: 0.216079 Aug 04 04:24:21.752853 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 224/471] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:24:21 2022] POST /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:21.754346 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-906bc46f-d228-41e4-9ff4-b9abe15a8b81 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 404 len: 111 microversion: 2.1 time: 0.067248 Aug 04 04:24:21.763789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:21.764772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:21.770848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 248/472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:21 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:21.774845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.775568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.778003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.779198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.910230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:21.910863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:21.920691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.921125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.921932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:21.922373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:21.984158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:21.995214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-830cb1e0-d4cc-469d-b58e-5ae6ef332040 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1476 microversion: 2.1 time: 0.236956 Aug 04 04:24:21.995811 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 225/473] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:21 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1476 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:22.030221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1491159530", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:22.119970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:22.292071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:22.305835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:22.311996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:22.318431 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e2759cb-7aec-4399-b5af-dccb3d8af058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1361 microversion: 2.25 time: 0.413116 Aug 04 04:24:22.322457 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 249/474] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:21 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:24:22.377275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9aca1b38-4836-4a72-8fab-8ee1c4dde735 req-3c055529-bd2d-4055-b229-332dff0f4599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce46d12e-0073-4f73-86fa-25bf2aac23f6", "name": "network-vif-plugged", "status": "completed", "tag": "03e5c638-30f6-4365-bbec-9c7499d43113"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:22.400601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9aca1b38-4836-4a72-8fab-8ee1c4dde735 req-3c055529-bd2d-4055-b229-332dff0f4599 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:22.401804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9aca1b38-4836-4a72-8fab-8ee1c4dde735 req-3c055529-bd2d-4055-b229-332dff0f4599 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:22.442664 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9aca1b38-4836-4a72-8fab-8ee1c4dde735 req-3c055529-bd2d-4055-b229-332dff0f4599 service nova] Creating event network-vif-plugged:03e5c638-30f6-4365-bbec-9c7499d43113 for instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 on n-h1-851337-5 Aug 04 04:24:22.457767 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9aca1b38-4836-4a72-8fab-8ee1c4dde735 req-3c055529-bd2d-4055-b229-332dff0f4599 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086063 Aug 04 04:24:22.460063 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 250/475] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:22.559164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:22.559745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:22.560371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:22.561126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:22.562252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:22.568954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:22.569991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:22.577134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:22.578871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:22.580223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:22.581035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:22.585918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:22.592140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:22.593232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:22.593731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:22.630651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Getting quotas for project 7302d2cfb3d546f4ab737bb03886bdcc. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:22.641634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Getting quotas for user 7c46d9915a0b4eb89dabc8a0796331fa and project 7302d2cfb3d546f4ab737bb03886bdcc. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:22.680819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:22.683894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:22.760756 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4362ff8a-c528-4dcb-b796-1327f2aa0434 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734590 Aug 04 04:24:22.762110 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 226/476] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:24:22.773224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93f55225-3782-4501-b1d1-15eaa1f24902 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:22.773967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93f55225-3782-4501-b1d1-15eaa1f24902 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:22.893618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:22.905359 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-397b1470-9305-4e77-a73d-2389fa60a215 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.341526 Aug 04 04:24:22.905689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-93f55225-3782-4501-b1d1-15eaa1f24902 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:22.906251 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 251/477] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:22 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:22.920109 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93f55225-3782-4501-b1d1-15eaa1f24902 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1220 microversion: 2.1 time: 0.150588 Aug 04 04:24:22.924851 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 227/478] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:22 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:23.021027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:23.021639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:23.029177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.029514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.030310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.030702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.191878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:23.207790 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-553e750a-79bc-4623-91d3-398d5794dfe0 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1459 microversion: 2.1 time: 0.190895 Aug 04 04:24:23.208401 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 228/479] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:23 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1459 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:23.227649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9aadb249-3147-4ef9-b353-409c9308de86 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:23.228632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9aadb249-3147-4ef9-b353-409c9308de86 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:23.235766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aadb249-3147-4ef9-b353-409c9308de86 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.236471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aadb249-3147-4ef9-b353-409c9308de86 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.237465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aadb249-3147-4ef9-b353-409c9308de86 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.237934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aadb249-3147-4ef9-b353-409c9308de86 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.248771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Action: 'update', calling method: .version_select at 0x7f191a5b6280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:23.251392 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:23.251392 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:23.252610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.253068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.271478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.272020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.291244 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] HTTP exception thrown: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Request method failure captured: Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae HTTP/1.1 Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 56 Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n2sf7REicIgdy28YfntHeg5MPaqbH8Yk_WHK9NldqMudK2bArQ0UaiKtpg481TcFryzrs5dIY5P5v5zGsk9hpxJajXrRzZKlgO7zsolc0TgiCUKup-vBzyYlWQwkoXj9LRYZgDLwedY0lTx4yrU4NbV6P2l0LafDGwu-FE6BISFdw Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f31b1d8fec684dcbb25fbe27091ffa22 Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:24:23.293590 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f31b1d8fec684dcbb25fbe27091ffa22", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f31b1d8fec684dcbb25fbe27091ffa22 Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4434aaef89ec40cabdc452d39e13a5b4 Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:24:23.296125 n-d-851337-5 devstack@n-api.service[119342]: exception: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '359f1227-b062-4956-9151-df7c10bf9bae', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.297032 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:23.298401 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:23.299800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:23.299800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.299800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.300928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Returning 404 to user: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:23.302006 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3bb5f206-f888-4de0-ad8d-b6747b3e5e44 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae" status: 404 len: 110 microversion: 2.53 time: 0.393988 Aug 04 04:24:23.302767 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 252/480] 10.222.0.69 () {62 vars in 1309 bytes} [Thu Aug 4 04:24:22 2022] PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae => generated 110 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:24:23.313029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Action: 'update', calling method: .version_select at 0x7f191a5b6940>, body: {"status": "disabled"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:23.319343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.320021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.326434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.327505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.333157 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] HTTP exception thrown: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Request method failure captured: Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae HTTP/1.1 Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 22 Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n2sf7REicIgdy28YfntHeg5MPaqbH8Yk_WHK9NldqMudK2bArQ0UaiKtpg481TcFryzrs5dIY5P5v5zGsk9hpxJajXrRzZKlgO7zsolc0TgiCUKup-vBzyYlWQwkoXj9LRYZgDLwedY0lTx4yrU4NbV6P2l0LafDGwu-FE6BISFdw Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f31b1d8fec684dcbb25fbe27091ffa22 Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:24:23.334862 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f31b1d8fec684dcbb25fbe27091ffa22", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f31b1d8fec684dcbb25fbe27091ffa22 Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4434aaef89ec40cabdc452d39e13a5b4 Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: {"status": "disabled"} Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: exception: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.342039 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '359f1227-b062-4956-9151-df7c10bf9bae', 'body': {'status': 'disabled'}} Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.343118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:23.344233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:23.345403 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.345403 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.345403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Returning 404 to user: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:23.345403 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-af913fad-5d02-4782-b4bd-e324ed3ef717 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae" status: 404 len: 110 microversion: 2.53 time: 0.031940 Aug 04 04:24:23.345403 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 253/481] 10.222.0.69 () {62 vars in 1309 bytes} [Thu Aug 4 04:24:23 2022] PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:24:23.354910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:23.355550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:23.368677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.369327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.370160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.370637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.376444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:23.578874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:23.587604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:23.589492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:23.590757 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-566f6e41-7968-4e5f-b000-a1995e6efdbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1558 microversion: 2.25 time: 0.242005 Aug 04 04:24:23.591975 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 254/482] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:23 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1558 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:23.611732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Action: 'update', calling method: .version_select at 0x7f191a6d00d0>, body: {"status": "enabled"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:23.615092 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:23.615092 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:23.616358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.616814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.623873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.624319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.630276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] HTTP exception thrown: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Request method failure captured: Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae HTTP/1.1 Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 21 Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n2sf7REicIgdy28YfntHeg5MPaqbH8Yk_WHK9NldqMudK2bArQ0UaiKtpg481TcFryzrs5dIY5P5v5zGsk9hpxJajXrRzZKlgO7zsolc0TgiCUKup-vBzyYlWQwkoXj9LRYZgDLwedY0lTx4yrU4NbV6P2l0LafDGwu-FE6BISFdw Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f31b1d8fec684dcbb25fbe27091ffa22 Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:24:23.632169 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f31b1d8fec684dcbb25fbe27091ffa22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f31b1d8fec684dcbb25fbe27091ffa22", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f31b1d8fec684dcbb25fbe27091ffa22 Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559 Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4434aaef89ec40cabdc452d39e13a5b4 Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: {"status": "enabled"} Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: exception: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.633403 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '359f1227-b062-4956-9151-df7c10bf9bae', 'body': {'status': 'enabled'}} Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.634141 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:23.635276 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:23.636414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. Aug 04 04:24:23.636414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:23.636414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Returning 404 to user: Service 359f1227-b062-4956-9151-df7c10bf9bae could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:23.636414 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7cad56a-eb07-4676-8a2b-d2e99cc8109e tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae" status: 404 len: 110 microversion: 2.53 time: 0.037256 Aug 04 04:24:23.636414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 255/483] 10.222.0.69 () {62 vars in 1309 bytes} [Thu Aug 4 04:24:23 2022] PUT /compute/v2.1/os-services/359f1227-b062-4956-9151-df7c10bf9bae => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:24:23.677053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9aadb249-3147-4ef9-b353-409c9308de86 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1610 microversion: 2.1 time: 0.453280 Aug 04 04:24:23.678936 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 229/484] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:23 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1610 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:23.912749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:23.913374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:23.920004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.920643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.921634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:23.922267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:23.947175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-410437699", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:24.025828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:24.162929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 9a042fbb-c3f2-4215-8132-6d5f33961b30 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:24.200555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:24.220442 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a2a92cf8-e3cf-4f29-aed1-2bb09385acd6 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 2050 microversion: 2.25 time: 0.540422 Aug 04 04:24:24.221023 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 230/485] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:23 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 2050 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:24.225381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89245549-f921-4df2-83d8-54d74fe964c8 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:24.228031 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:24.228031 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:24.229416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89245549-f921-4df2-83d8-54d74fe964c8 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.229701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89245549-f921-4df2-83d8-54d74fe964c8 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.230496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89245549-f921-4df2-83d8-54d74fe964c8 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.230924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89245549-f921-4df2-83d8-54d74fe964c8 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.259077 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-89245549-f921-4df2-83d8-54d74fe964c8 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036829 Aug 04 04:24:24.259532 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 231/486] 10.222.0.69 () {60 vars in 1178 bytes} [Thu Aug 4 04:24:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:24.263922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-868ee0ed-54fb-451c-9c4d-483f1ce6cca2 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:24.266433 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:24.266433 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:24.267859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-868ee0ed-54fb-451c-9c4d-483f1ce6cca2 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.268302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-868ee0ed-54fb-451c-9c4d-483f1ce6cca2 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.269200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-868ee0ed-54fb-451c-9c4d-483f1ce6cca2 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.269520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-868ee0ed-54fb-451c-9c4d-483f1ce6cca2 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.277773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:24.278375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:24.279006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:24.279624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:24.280050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:24.289144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.289596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.290402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.290846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.296147 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-868ee0ed-54fb-451c-9c4d-483f1ce6cca2 tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035566 Aug 04 04:24:24.297637 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 232/487] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:24:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:24.303713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:24.304412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:24.314775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.315146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.315931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.316456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.316893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Getting quotas for project 35738b32c46f438dbd72b3204cfcb474. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:24.322187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Getting quotas for user 6ad16b7ab4cf4e008fe7c3f373140b8e and project 35738b32c46f438dbd72b3204cfcb474. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:24.338397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:24.340753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:24.394443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-94be1949-0840-45c1-adbd-7a4f2be37766 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758388 Aug 04 04:24:24.395380 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 256/488] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:24:24.400187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:24.401007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:24.408120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.408630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.409412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.409851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.482446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:24.491011 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-af00ca1a-e64a-4c42-9034-3564026f88e5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1272 microversion: 2.1 time: 0.094365 Aug 04 04:24:24.491609 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 257/489] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:24 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:24.498875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:24.507128 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a20fc199-4b80-460b-807e-a39bd7582756 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1313 microversion: 2.1 time: 0.208767 Aug 04 04:24:24.507951 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 233/490] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:24 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:24.512597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:24.513714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:24.521340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.521978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.523043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.523487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.565095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-633615045", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:24.648155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:24.718428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 9a042fbb-c3f2-4215-8132-6d5f33961b30 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:24.747026 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9dbb5c87-8ea9-4873-93ec-32b8c9ccd953 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 2050 microversion: 2.25 time: 0.238129 Aug 04 04:24:24.760418 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 234/491] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:24 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 2050 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:24.769909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-858771b6-cb68-4a52-bcd9-31ad54c125a0 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:24.772479 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:24.772479 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:24.774264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-858771b6-cb68-4a52-bcd9-31ad54c125a0 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.776239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-858771b6-cb68-4a52-bcd9-31ad54c125a0 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.777450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-858771b6-cb68-4a52-bcd9-31ad54c125a0 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.778048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-858771b6-cb68-4a52-bcd9-31ad54c125a0 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.810807 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-858771b6-cb68-4a52-bcd9-31ad54c125a0 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.048974 Aug 04 04:24:24.814641 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 235/492] 10.222.0.69 () {60 vars in 1211 bytes} [Thu Aug 4 04:24:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:24.822305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851337-5", "block_migration": true, "disk_over_commit": false}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:24.825178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:24.842500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.843022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.843763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:24.844201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:24.878378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Lazy-loading 'flavor' on Instance uuid 6a15fee3-6243-4dac-a053-6e72fdd7cf22 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:24.896390 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 while it is in vm_state suspended Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Request method failure captured: Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22/action HTTP/1.1 Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 97 Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nGE4fDP--ICGMp47b3AohMMdERmWHRzYW4YmiH_K33jzQYQfK9kJeYjNYV3KYmQI4w3-lyCIoHkUlXM-ory0fT2ON5aNedgFa5U1hNKv3mMxb8XbkfLLXYM6IVsS2zYM-zKnrg-kExUuxGfw71YZmufVTfa0zXEOD06JB1UdD4-vo Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b3fe8851eadc470088ca602e8a877f1c Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveMigrationNegativeTest-1534544331 Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:24:24.898677 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b3fe8851eadc470088ca602e8a877f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b3fe8851eadc470088ca602e8a877f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b3fe8851eadc470088ca602e8a877f1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b3fe8851eadc470088ca602e8a877f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveMigrationNegativeTest-1534544331 Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b3fe8851eadc470088ca602e8a877f1c Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1534544331 Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveMigrationNegativeTest-1534544331-project-admin Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: cc07aa077d964aaab9002615c659c07f Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveMigrationNegativeTest-1534544331-project-admin Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: {"os-migrateLive": {"host": "n-h1-851337-5", "block_migration": true, "disk_over_commit": false}} Aug 04 04:24:24.900258 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'os-migrateLive' instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 while it is in vm_state suspended Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6a15fee3-6243-4dac-a053-6e72fdd7cf22', 'body': {'os-migrateLive': {'host': 'n-h1-851337-5', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 04:24:24.901088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:24.902257 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 while it is in vm_state suspended Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 while it is in vm_state suspended Aug 04 04:24:24.904364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:24.905835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 while it is in vm_state suspended {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:24.906318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aff3931a-be83-4325-9c27-b941de598f0d tempest-LiveMigrationNegativeTest-1534544331 tempest-LiveMigrationNegativeTest-1534544331-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22/action" status: 409 len: 155 microversion: 2.1 time: 0.088866 Aug 04 04:24:24.913351 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 236/493] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:24:24 2022] POST /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22/action => generated 155 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:24.923303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62978ee3-2a79-4a47-99a2-98dcd631a8b3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:24.924168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62978ee3-2a79-4a47-99a2-98dcd631a8b3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:25.160503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:25.161112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:25.161739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:25.162339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:25.162904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:25.173136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.173961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.175074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.175561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.194701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Getting quotas for project 57a51098088246149423af91de8d2167. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:25.197502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62978ee3-2a79-4a47-99a2-98dcd631a8b3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:25.199179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Getting quotas for user aa8824426a46496aaaf6cc1640f18519 and project 57a51098088246149423af91de8d2167. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:25.205080 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62978ee3-2a79-4a47-99a2-98dcd631a8b3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1221 microversion: 2.1 time: 0.288217 Aug 04 04:24:25.207540 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 237/494] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:24 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1221 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:25.216971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:25.220129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2994f61c-9975-4098-a149-076dfdea0329 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:25.222463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:25.224390 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:25.224390 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:25.226054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2994f61c-9975-4098-a149-076dfdea0329 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.226738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2994f61c-9975-4098-a149-076dfdea0329 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.227808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2994f61c-9975-4098-a149-076dfdea0329 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.228448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2994f61c-9975-4098-a149-076dfdea0329 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.257407 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2994f61c-9975-4098-a149-076dfdea0329 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046665 Aug 04 04:24:25.258341 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 238/495] 10.222.0.69 () {60 vars in 1217 bytes} [Thu Aug 4 04:24:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:24:25.263268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74f25efd-f745-4b12-aabf-76ef1e18ae3c tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:25.265688 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:25.265688 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:25.267280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74f25efd-f745-4b12-aabf-76ef1e18ae3c tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.267947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74f25efd-f745-4b12-aabf-76ef1e18ae3c tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.269148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74f25efd-f745-4b12-aabf-76ef1e18ae3c tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.270475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74f25efd-f745-4b12-aabf-76ef1e18ae3c tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.296478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74f25efd-f745-4b12-aabf-76ef1e18ae3c tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036837 Aug 04 04:24:25.297664 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 239/496] 10.222.0.69 () {60 vars in 1178 bytes} [Thu Aug 4 04:24:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:25.302343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:25.303243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:25.307653 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a803f38c-b5f2-4da1-bdc2-3c9a992fa506 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814754 Aug 04 04:24:25.308598 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 258/497] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:24:25.312392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:25.313960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-5", "block_migration": "auto"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:25.314362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.315353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.316614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.317041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:25.325833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.326388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.327290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.327801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.330082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.375186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:24:25.411264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'flavor' on Instance uuid 9a042fbb-c3f2-4215-8132-6d5f33961b30 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:25.467747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Going to try to live migrate instance to n-h2-851337-5 {{(pid=119342) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:24:25.545967 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c288b9c5-f852-4e04-8234-cf67394ef17b tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 204 len: 0 microversion: 2.1 time: 0.245771 Aug 04 04:24:25.547009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 240/498] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:25 2022] DELETE /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:24:25.552407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ca509403-ee67-4428-987a-8f771c04c288 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:25.555862 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:25.555862 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:25.557774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca509403-ee67-4428-987a-8f771c04c288 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.558368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca509403-ee67-4428-987a-8f771c04c288 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.559221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca509403-ee67-4428-987a-8f771c04c288 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.560348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca509403-ee67-4428-987a-8f771c04c288 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.585723 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ca509403-ee67-4428-987a-8f771c04c288 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=n-d-851337-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.037401 Aug 04 04:24:25.586998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 241/499] 10.222.0.69 () {60 vars in 1235 bytes} [Thu Aug 4 04:24:25 2022] GET /compute/v2.1/os-services?host=n-d-851337-5&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:25.592244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9f74b817-6f12-4b11-b735-27f2b9a63c16 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:25.592978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9f74b817-6f12-4b11-b735-27f2b9a63c16 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:25.663085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9f74b817-6f12-4b11-b735-27f2b9a63c16 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:25.671099 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9f74b817-6f12-4b11-b735-27f2b9a63c16 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1216 microversion: 2.1 time: 0.083008 Aug 04 04:24:25.673457 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 242/500] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:25 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:25.679481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:25.680945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:25.688659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.690015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.691059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.691710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.948691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:25.962102 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cbc7f860-a83a-455c-90d4-c58ecf0b6be5 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.286454 Aug 04 04:24:25.963989 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 243/501] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:25 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:25.971635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:25.979665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:25.992540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.994931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:25.998887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:25.999494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.194528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:26.211434 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5c6e32b3-6055-48bf-bb08-9b09f494bae5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1462 microversion: 2.1 time: 0.242079 Aug 04 04:24:26.215303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 244/502] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:25 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1462 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:26.225059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:26.226374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:26.234052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.234495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.235611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.236719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.406804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:26.418645 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57f96de8-7e68-44e3-831a-99e555782f0e tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1465 microversion: 2.1 time: 0.201555 Aug 04 04:24:26.420147 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 245/503] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:26 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1465 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:26.424761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8577cda-d1ee-49c9-83e8-1e37a281c2d4 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:26.427851 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:26.427851 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:26.429538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8577cda-d1ee-49c9-83e8-1e37a281c2d4 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.430194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8577cda-d1ee-49c9-83e8-1e37a281c2d4 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.431231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8577cda-d1ee-49c9-83e8-1e37a281c2d4 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.431862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8577cda-d1ee-49c9-83e8-1e37a281c2d4 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.459741 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8577cda-d1ee-49c9-83e8-1e37a281c2d4 tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038320 Aug 04 04:24:26.460467 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 246/504] 10.222.0.69 () {60 vars in 1178 bytes} [Thu Aug 4 04:24:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:26.468471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:26.469666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:26.477188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.477641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.478448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.478866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.553821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:26.561832 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d17cd8af-1f7e-4b32-9378-a7213d78b7f7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1281 microversion: 2.1 time: 0.100032 Aug 04 04:24:26.562459 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 247/505] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:26 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:26.575028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:26.575028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:26.577339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.577824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.578653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.579134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.667474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:26.674148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Old instance type m1.heat2, new instance type m1.heat {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 04:24:26.680355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:26.680771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:26.681314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:26.681646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:26.682054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:26.800736 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9a31c274-53f8-4a77-a80f-3e9fa0683d39 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6/action" status: 202 len: 0 microversion: 2.1 time: 0.236349 Aug 04 04:24:26.802075 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 248/506] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:24:26 2022] POST /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:26.808607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9a7af81-5d5d-4cd8-a101-300239ced2fd tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:26.811720 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:26.811720 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:26.813140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9a7af81-5d5d-4cd8-a101-300239ced2fd tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.813670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9a7af81-5d5d-4cd8-a101-300239ced2fd tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.814579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9a7af81-5d5d-4cd8-a101-300239ced2fd tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.815266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9a7af81-5d5d-4cd8-a101-300239ced2fd tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.848785 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9a7af81-5d5d-4cd8-a101-300239ced2fd tempest-ServicesAdminNegativeV253TestJSON-659570559 tempest-ServicesAdminNegativeV253TestJSON-659570559-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.045147 Aug 04 04:24:26.851226 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 249/507] 10.222.0.69 () {60 vars in 1239 bytes} [Thu Aug 4 04:24:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:26.858743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ac719e9e-08a4-466f-bd87-4e9e26a5aed3 req-4eb35147-306c-4e11-b390-aa303af923cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30979a84-42ba-46d3-8195-f98ba52b364b", "tag": "95dd00be-14d9-4967-a10b-d9910558960f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:26.870523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ac719e9e-08a4-466f-bd87-4e9e26a5aed3 req-4eb35147-306c-4e11-b390-aa303af923cc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.872517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ac719e9e-08a4-466f-bd87-4e9e26a5aed3 req-4eb35147-306c-4e11-b390-aa303af923cc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.920090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ac719e9e-08a4-466f-bd87-4e9e26a5aed3 req-4eb35147-306c-4e11-b390-aa303af923cc service nova] Creating event network-changed:95dd00be-14d9-4967-a10b-d9910558960f for instance 30979a84-42ba-46d3-8195-f98ba52b364b on n-h1-851337-5 Aug 04 04:24:26.927049 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ac719e9e-08a4-466f-bd87-4e9e26a5aed3 req-4eb35147-306c-4e11-b390-aa303af923cc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074257 Aug 04 04:24:26.928842 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 250/508] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:26.936239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:26.937886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:26.946544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.947670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:26.949469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:26.951510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:27.046701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:27.056432 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-038c978d-e3ad-4fc6-a64d-fa698466fdb1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1286 microversion: 2.1 time: 0.126113 Aug 04 04:24:27.070498 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 251/509] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:26 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:27.070498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:27.070498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:27.075584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:27.076485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:27.077450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:27.078234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:27.085069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:27.578062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:27.586646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb89024f-b761-45b9-a9af-4d0ee6d33bf8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1471 microversion: 2.1 time: 0.528594 Aug 04 04:24:27.587825 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 252/510] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:27 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:27.770149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5f98b7d6-448a-4b41-914e-509c69ba3586 tempest-ServicesAdminNegativeV253TestJSON-216172240 tempest-ServicesAdminNegativeV253TestJSON-216172240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:27.773899 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:27.773899 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:24:27.775690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5f98b7d6-448a-4b41-914e-509c69ba3586 tempest-ServicesAdminNegativeV253TestJSON-216172240 tempest-ServicesAdminNegativeV253TestJSON-216172240-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e63290efa69946c28061479c0cc9645a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd917788394744ee58dda0f701e8a4452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5f98b7d6-448a-4b41-914e-509c69ba3586 tempest-ServicesAdminNegativeV253TestJSON-216172240 tempest-ServicesAdminNegativeV253TestJSON-216172240-project] Request method failure captured: Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60n15kAKGbVnN5dXaIeGzhbEgC1gXSdSUW9mmxOoMLRquIfm-I-0XRCzq3rbDLWFVAb2xFoaLyx4Y744d_Ahw8t9NfNeLQeiPKnB9fPEwvDs27Y6WG59jzfApOFAJNIbsf8WxrUDaQN64sy5bQOerU1b0z4WBQExApl6ZKy212b1VLI Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d917788394744ee58dda0f701e8a4452 Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-216172240 Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:27.779570 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d917788394744ee58dda0f701e8a4452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d917788394744ee58dda0f701e8a4452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d917788394744ee58dda0f701e8a4452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d917788394744ee58dda0f701e8a4452", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-216172240 Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d917788394744ee58dda0f701e8a4452 Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-216172240 Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServicesAdminNegativeV253TestJSON-216172240-project Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: e63290efa69946c28061479c0cc9645a Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-216172240-project Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 04:24:27.781248 n-d-851337-5 devstack@n-api.service[119343]: action_args: {} Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:24:27.782056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 04:24:27.783235 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:27.789200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5f98b7d6-448a-4b41-914e-509c69ba3586 tempest-ServicesAdminNegativeV253TestJSON-216172240 tempest-ServicesAdminNegativeV253TestJSON-216172240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:27.790474 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5f98b7d6-448a-4b41-914e-509c69ba3586 tempest-ServicesAdminNegativeV253TestJSON-216172240 tempest-ServicesAdminNegativeV253TestJSON-216172240-project] 10.222.0.69 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.201576 Aug 04 04:24:27.791675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 253/511] 10.222.0.69 () {60 vars in 1178 bytes} [Thu Aug 4 04:24:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:24:27.817091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:27.818905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:27.832558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:27.833383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:27.842170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:27.842863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.096944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29adba4c-5f57-49ba-a434-6052a2520a2b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30/action" status: 202 len: 0 microversion: 2.25 time: 2.784287 Aug 04 04:24:28.099615 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 259/512] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:24:25 2022] POST /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30/action => generated 0 bytes in 2791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:24:28.107698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:28.109105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:28.118216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.118982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.119972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.120508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.470762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:28.479554 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02c941c1-2d51-4010-9c18-c32debf745b0 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.686573 Aug 04 04:24:28.480390 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 254/513] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:27 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:28.487776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:28.488690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:28.500367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.501091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.503170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.503573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.617884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:28.626668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:28.633571 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-adead60d-b4f8-446b-aa3f-84dcd09930c9 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1279 microversion: 2.1 time: 0.151876 Aug 04 04:24:28.637144 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ecf5d96-2e3e-4b87-92e5-43a73a4798fe tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 200 len: 1465 microversion: 2.1 time: 0.535900 Aug 04 04:24:28.647547 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 255/514] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:28 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:28.654674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:28.655048 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 260/515] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:28 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 1465 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:28.656111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:28.662316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:28.663389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:28.672555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.673054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.673751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.674045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.674761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.675216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.675662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.675933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.797458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:28.807860 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60c4ed8d-300c-47a9-9400-62d69ce9772f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1274 microversion: 2.1 time: 0.158822 Aug 04 04:24:28.808738 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 256/516] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:28 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:28.815422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:28.816225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:28.826773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.827263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:28.828051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:28.828486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:29.097439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:29.107921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:29.109733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:29.110998 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0df0b73-8d7b-45c3-be37-bda91d962405 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.454774 Aug 04 04:24:29.112041 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 261/517] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:28 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:29.120688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-644ddf12-1ef4-4157-bc5f-8ef5e85cb9d6 req-a4165c60-8bed-4698-b9ae-e200d45c751b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a15fee3-6243-4dac-a053-6e72fdd7cf22", "name": "network-vif-deleted", "tag": "75a20b02-4197-40c2-9e40-2d5f6994619e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:29.132757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:29.142947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c77ebc53-4d3a-4a2c-92db-86965cf82f3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1471 microversion: 2.1 time: 0.332937 Aug 04 04:24:29.144060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-644ddf12-1ef4-4157-bc5f-8ef5e85cb9d6 req-a4165c60-8bed-4698-b9ae-e200d45c751b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:29.145014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-644ddf12-1ef4-4157-bc5f-8ef5e85cb9d6 req-a4165c60-8bed-4698-b9ae-e200d45c751b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:29.158601 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 257/518] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:28 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:29.163450 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-644ddf12-1ef4-4157-bc5f-8ef5e85cb9d6 req-a4165c60-8bed-4698-b9ae-e200d45c751b service nova] Creating event network-vif-deleted:75a20b02-4197-40c2-9e40-2d5f6994619e for instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 on n-h2-851337-5 Aug 04 04:24:29.169264 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-644ddf12-1ef4-4157-bc5f-8ef5e85cb9d6 req-a4165c60-8bed-4698-b9ae-e200d45c751b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055612 Aug 04 04:24:29.170359 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 262/519] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:29.501830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:29.503177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:29.523619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:29.525393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:29.527008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:29.527629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:29.659476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:29.661362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:29.676291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:29.677986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:29.679067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:29.680023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.142478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:30.159102 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-072e2567-da93-4e70-b3ec-8d70ae719bf8 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.659334 Aug 04 04:24:30.160441 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 258/520] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:29 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:30.167553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:30.168279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6a15fee3-6243-4dac-a053-6e72fdd7cf22] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:30.206428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.207424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.208249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.208695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.224922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:30.241616 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d119c445-656c-4083-8e2b-8615a263f3eb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1321 microversion: 2.1 time: 0.587802 Aug 04 04:24:30.242218 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 263/521] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:29 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:30.248933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:30.249561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:30.262309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.262805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.263622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.264051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.272498 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] HTTP exception thrown: Instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 could not be found. Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Request method failure captured: Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 HTTP/1.1 Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nFZO9cg2T7T9ekybCJcdBV-agx4vseTdT7yrpo2Q8W_OtaBofgpiSVgTqMaNJbqtrFzzHS0nMV7iS7IMEp7_FxFTGHB2DG4HxFlV7fCt208dUmKGJw6raz8MDEBXzL2eJ_JRYzOkNWT0U3Ts6VFR4nL8bZtAPeHRloKlkxlxU-Fyg Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: df52a6a37edc4decb87471624d5ce915 Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveMigrationNegativeTest-1569123829 Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:30.278006 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/df52a6a37edc4decb87471624d5ce915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/df52a6a37edc4decb87471624d5ce915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/df52a6a37edc4decb87471624d5ce915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_df52a6a37edc4decb87471624d5ce915", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveMigrationNegativeTest-1569123829 Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: df52a6a37edc4decb87471624d5ce915 Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1569123829 Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveMigrationNegativeTest-1569123829-project Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 878f8dd4c3b243e191bbb24696f5ebe3 Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveMigrationNegativeTest-1569123829-project Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 could not be found. Aug 04 04:24:30.279595 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6a15fee3-6243-4dac-a053-6e72fdd7cf22'} Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 could not be found. Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:30.280454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 could not be found. Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 could not be found. Aug 04 04:24:30.281817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:30.284794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Returning 404 to user: Instance 6a15fee3-6243-4dac-a053-6e72fdd7cf22 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:30.286267 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0f79826f-e14b-4062-a5d3-ae3434108808 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22" status: 404 len: 111 microversion: 2.1 time: 0.124434 Aug 04 04:24:30.288144 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 259/522] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:30 2022] GET /compute/v2.1/servers/6a15fee3-6243-4dac-a053-6e72fdd7cf22 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:30.296239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:30.297158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:30.306102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.306878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.307856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.308555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.852552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:30.860196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:30.872936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:30.874043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:30.878034 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2e2fa57d-2d85-457c-ad31-b0441445b585 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.634725 Aug 04 04:24:30.890982 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 264/523] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:30 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:30.891167 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2e86cc6a-3f47-4201-ae41-0b55483e3692 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.594811 Aug 04 04:24:30.897744 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 260/524] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:30 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:30.899906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:30.900779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:30.904831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:30.905507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:30.910506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.911123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.911648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.912104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.912223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.912774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.912888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:30.913455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:30.943888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:24:31.048361 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ce495fe1-371f-4730-827f-cc5745a40762 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 204 len: 0 microversion: 2.1 time: 0.149211 Aug 04 04:24:31.048954 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 261/525] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:30 2022] DELETE /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:24:31.180027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73e76d96-8e8a-4272-a357-3bfbba7e9c65 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.188394 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73e76d96-8e8a-4272-a357-3bfbba7e9c65 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.137897 Aug 04 04:24:31.189049 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 262/526] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:31.193687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.194712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:31.202232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.202679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.203480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.203910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.239102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:31.246849 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e2f13a4-b68c-4fe4-aab5-16a96ce1bda1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1471 microversion: 2.1 time: 0.366024 Aug 04 04:24:31.247460 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 265/527] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:30 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:31.252149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.252752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:31.258834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.259489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.261110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.261742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.548604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:31.557939 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-97cc6d05-238d-4679-a737-9c2e637d3db5 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1472 microversion: 2.1 time: 0.367670 Aug 04 04:24:31.558502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 263/528] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:31.564416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1662cbb-c7a8-4bd9-a666-2b0bf8ac5982 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.588138 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1662cbb-c7a8-4bd9-a666-2b0bf8ac5982 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors" status: 200 len: 3077 microversion: 2.1 time: 0.027536 Aug 04 04:24:31.588950 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 264/529] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors => generated 3077 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:31.594153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.594765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:31.601375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.601830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.602615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.603077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.651231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:31.659010 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6ffa389-666f-471d-a6a2-431832f0494a tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.410510 Aug 04 04:24:31.659600 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 266/530] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:31.665510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c9c0d425-eb5f-439b-a339-df519d2a7af4 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.675806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c9c0d425-eb5f-439b-a339-df519d2a7af4 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015001 Aug 04 04:24:31.676672 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 267/531] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:31.689763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ba9e074-21ff-494a-9579-47bb45ef42d2 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.698157 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ba9e074-21ff-494a-9579-47bb45ef42d2 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012023 Aug 04 04:24:31.699664 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 268/532] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:24:31.712734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8006ad5-0755-4d19-afff-582188ca7c19 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.740651 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8006ad5-0755-4d19-afff-582188ca7c19 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032713 Aug 04 04:24:31.741239 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 269/533] 10.222.0.69 () {58 vars in 1165 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:31.760289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2715abf7-a00e-4926-8952-96c46545fd99 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.764847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:31.769477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2715abf7-a00e-4926-8952-96c46545fd99 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013546 Aug 04 04:24:31.770061 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 270/534] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:24:31.785498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f0647537-8b00-4254-b2c2-ebe0d7d707d7 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.813054 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f0647537-8b00-4254-b2c2-ebe0d7d707d7 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.032774 Aug 04 04:24:31.813643 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 271/535] 10.222.0.69 () {58 vars in 1169 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:31.824607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0a445762-2209-49ba-831b-98e4ac3865ba req-f82ad02b-ee9a-4f23-a2e5-a2bff7fa704e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead118c2-ebfb-4040-8a2a-7e89d2c504f2", "tag": "e3085237-07be-47a5-adb5-78638b3d9288"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:31.837221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0a445762-2209-49ba-831b-98e4ac3865ba req-f82ad02b-ee9a-4f23-a2e5-a2bff7fa704e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.837675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0a445762-2209-49ba-831b-98e4ac3865ba req-f82ad02b-ee9a-4f23-a2e5-a2bff7fa704e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.849276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0a445762-2209-49ba-831b-98e4ac3865ba req-f82ad02b-ee9a-4f23-a2e5-a2bff7fa704e service nova] Creating event network-changed:e3085237-07be-47a5-adb5-78638b3d9288 for instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 on n-h1-851337-5 Aug 04 04:24:31.853975 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0a445762-2209-49ba-831b-98e4ac3865ba req-f82ad02b-ee9a-4f23-a2e5-a2bff7fa704e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039182 Aug 04 04:24:31.854571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 272/536] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:31.860589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8b942105-de80-49f4-bf44-e060e76c45ee tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.875823 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8b942105-de80-49f4-bf44-e060e76c45ee tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019830 Aug 04 04:24:31.876939 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 273/537] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:31.890227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-977bdd5b-4bbc-4388-a51c-c7d79116f3bc tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.901613 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-977bdd5b-4bbc-4388-a51c-c7d79116f3bc tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015389 Aug 04 04:24:31.909622 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 274/538] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:24:31.909622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.909622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:31.916485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.917026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.918234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.918352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.944203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:31.957950 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5bede7d1-ecb3-407e-a37d-5f1261b8d46b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1321 microversion: 2.1 time: 0.367489 Aug 04 04:24:31.958623 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 265/539] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:31.970820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:31.971459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:31.977588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.978032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:31.978807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:31.979305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:32.614082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:32.625012 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6981d7d9-ad23-4c57-a99c-ba13c4d283b9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.720942 Aug 04 04:24:32.638389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 275/540] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:32.643531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-159dec48-3f06-4932-aa09-fb7baa897faf tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:32.686328 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-159dec48-3f06-4932-aa09-fb7baa897faf tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.046425 Aug 04 04:24:32.687440 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 276/541] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Aug 4 04:24:32 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:32.692240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:32.692851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:32.706278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:32.706736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:32.707569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:32.708067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:32.726726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:32.738310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:32.740131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:32.744352 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76469bf7-3bda-4412-b941-9ca79b534b97 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.784400 Aug 04 04:24:32.747107 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 266/542] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:31 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:32.764538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:32.765154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:32.772613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:32.773061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:32.773834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:32.774263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:32.986845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f8dd4c3b243e191bbb24696f5ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df52a6a37edc4decb87471624d5ce915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:33.004899 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f0fa8219-5373-4140-830e-4b5b262e4206 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 200 len: 1430 microversion: 2.1 time: 0.254863 Aug 04 04:24:33.007002 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 267/543] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:32 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 1430 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:33.025808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.026772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:33.039505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.041057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.043743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.046230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.320927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:33.331775 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-662f6d52-91d9-42fe-9700-9897ea1232e9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.641292 Aug 04 04:24:33.332752 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 277/544] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:32 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:33.340041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1dfd5d35-7340-4a22-a65e-096336f9d86b tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.359560 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1dfd5d35-7340-4a22-a65e-096336f9d86b tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024522 Aug 04 04:24:33.360889 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 278/545] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:33.370244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9c566545-49d8-42bc-972e-45797a767d10 req-7c128b13-faef-4ec2-8964-11b561e68ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dee7941-b83b-457d-a8c8-93411b771af0", "name": "network-vif-deleted", "tag": "9a354b82-3810-4a56-b2a6-d94f70e97ec5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:33.381299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9c566545-49d8-42bc-972e-45797a767d10 req-7c128b13-faef-4ec2-8964-11b561e68ac2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.381798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9c566545-49d8-42bc-972e-45797a767d10 req-7c128b13-faef-4ec2-8964-11b561e68ac2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.395652 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9c566545-49d8-42bc-972e-45797a767d10 req-7c128b13-faef-4ec2-8964-11b561e68ac2 service nova] Creating event network-vif-deleted:9a354b82-3810-4a56-b2a6-d94f70e97ec5 for instance 6dee7941-b83b-457d-a8c8-93411b771af0 on n-h2-851337-5 Aug 04 04:24:33.400964 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9c566545-49d8-42bc-972e-45797a767d10 req-7c128b13-faef-4ec2-8964-11b561e68ac2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038619 Aug 04 04:24:33.401559 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 279/546] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:33.408988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.409700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:33.416535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.417316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.418663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.419169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.441295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:33.449181 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-39145d3b-2e40-4ec5-9a53-41dd9b71c60e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.440811 Aug 04 04:24:33.462633 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 268/547] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:33.467688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae358945-59d5-41de-a979-24177be3df34 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.495215 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae358945-59d5-41de-a979-24177be3df34 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.031006 Aug 04 04:24:33.496040 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 269/548] 10.222.0.69 () {58 vars in 1144 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:33.511489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a005171-416a-4543-b861-da500278b43d tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.526252 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a005171-416a-4543-b861-da500278b43d tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017286 Aug 04 04:24:33.531004 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 270/549] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:24:33.544036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-397fdbb0-a92e-400a-aa15-ad223ce928a9 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.588019 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-397fdbb0-a92e-400a-aa15-ad223ce928a9 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.053010 Aug 04 04:24:33.589133 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 271/550] 10.222.0.69 () {58 vars in 1148 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:33.606773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a3379581-c7f7-44b2-96fd-27c39d00ad1f tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.623522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a3379581-c7f7-44b2-96fd-27c39d00ad1f tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.023991 Aug 04 04:24:33.624796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 272/551] 10.222.0.69 () {58 vars in 1140 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:24:33.637018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d22dde88-e7bc-4e2a-9c30-68c36937336a tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.660524 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d22dde88-e7bc-4e2a-9c30-68c36937336a tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027564 Aug 04 04:24:33.661686 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 273/552] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:33.668367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.669386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:33.680266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.680722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.681509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.681944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.830039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:33.837813 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffd8cd86-5698-4176-b36b-0e567b8b4575 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1321 microversion: 2.1 time: 0.434892 Aug 04 04:24:33.838387 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 280/553] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:33.858798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c41507f5-3311-41be-9b20-9448b747a70d tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.883630 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c41507f5-3311-41be-9b20-9448b747a70d tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.043935 Aug 04 04:24:33.885350 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 281/554] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:33.891164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:33.891988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:33.899774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.900930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:33.902251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:33.903115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.064873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:34.074732 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ec4c2a9-614c-45eb-901c-e610a407a7f0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.411838 Aug 04 04:24:34.076116 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 274/555] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:34.083328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bf6ddd5a-a670-4942-8b3b-76719e81c05f tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:34.118930 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bf6ddd5a-a670-4942-8b3b-76719e81c05f tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.041026 Aug 04 04:24:34.120003 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 275/556] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:24:34 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:34.144252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b77680d0-640a-4c27-b905-5b09ebc6aff7 req-413a9c67-4efd-4157-9ae2-e32f5774a4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b95e2bb4-37ce-4790-a791-d9fd173d7008", "tag": "4ec4c4c0-7a37-4cf6-8d70-69044a2f9f8f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:34.166871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b77680d0-640a-4c27-b905-5b09ebc6aff7 req-413a9c67-4efd-4157-9ae2-e32f5774a4a5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.167574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b77680d0-640a-4c27-b905-5b09ebc6aff7 req-413a9c67-4efd-4157-9ae2-e32f5774a4a5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.179975 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b77680d0-640a-4c27-b905-5b09ebc6aff7 req-413a9c67-4efd-4157-9ae2-e32f5774a4a5 service nova] Creating event network-changed:4ec4c4c0-7a37-4cf6-8d70-69044a2f9f8f for instance b95e2bb4-37ce-4790-a791-d9fd173d7008 on n-h2-851337-5 Aug 04 04:24:34.185213 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b77680d0-640a-4c27-b905-5b09ebc6aff7 req-413a9c67-4efd-4157-9ae2-e32f5774a4a5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051106 Aug 04 04:24:34.186441 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 276/557] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:34.189324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:34.192469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:34.193326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] [instance: 6dee7941-b83b-457d-a8c8-93411b771af0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:34.199856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.200515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.201293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.201412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:34.201723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.207387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:34.208982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:34.210145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d440374-57f7-4de6-a0fc-3796e7494975 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.323204 Aug 04 04:24:34.210913 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 282/558] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:33 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:34.215293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] HTTP exception thrown: Instance 6dee7941-b83b-457d-a8c8-93411b771af0 could not be found. Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Request method failure captured: Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 HTTP/1.1 Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nFZO9cg2T7T9ekybCJcdBV-agx4vseTdT7yrpo2Q8W_OtaBofgpiSVgTqMaNJbqtrFzzHS0nMV7iS7IMEp7_FxFTGHB2DG4HxFlV7fCt208dUmKGJw6raz8MDEBXzL2eJ_JRYzOkNWT0U3Ts6VFR4nL8bZtAPeHRloKlkxlxU-Fyg Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: df52a6a37edc4decb87471624d5ce915 Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveMigrationNegativeTest-1569123829 Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:34.217626 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/df52a6a37edc4decb87471624d5ce915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/df52a6a37edc4decb87471624d5ce915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/df52a6a37edc4decb87471624d5ce915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_df52a6a37edc4decb87471624d5ce915", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveMigrationNegativeTest-1569123829 Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: df52a6a37edc4decb87471624d5ce915 Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1569123829 Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveMigrationNegativeTest-1569123829-project Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 878f8dd4c3b243e191bbb24696f5ebe3 Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveMigrationNegativeTest-1569123829-project Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6dee7941-b83b-457d-a8c8-93411b771af0 could not be found. Aug 04 04:24:34.219199 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6dee7941-b83b-457d-a8c8-93411b771af0'} Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dee7941-b83b-457d-a8c8-93411b771af0 could not be found. Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:34.220343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dee7941-b83b-457d-a8c8-93411b771af0 could not be found. Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dee7941-b83b-457d-a8c8-93411b771af0 could not be found. Aug 04 04:24:34.221679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:34.222885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d2b9a395-66b8-438f-b2fc-3376a5ccbeb0 req-fed8b254-1eba-4b09-9e40-cba2d4fe8c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30979a84-42ba-46d3-8195-f98ba52b364b", "name": "network-vif-plugged", "status": "completed", "tag": "95dd00be-14d9-4967-a10b-d9910558960f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:34.223649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] Returning 404 to user: Instance 6dee7941-b83b-457d-a8c8-93411b771af0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:34.224659 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6049e49b-ebe8-4a3e-84d8-a68d39cc0cf3 tempest-LiveMigrationNegativeTest-1569123829 tempest-LiveMigrationNegativeTest-1569123829-project] 10.222.0.69 "GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0" status: 404 len: 111 microversion: 2.1 time: 0.036975 Aug 04 04:24:34.225794 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 277/559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:34 2022] GET /compute/v2.1/servers/6dee7941-b83b-457d-a8c8-93411b771af0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:34.240867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f9ea3aaa-61da-4e03-89b1-9fabb91f2902 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:34.242426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d2b9a395-66b8-438f-b2fc-3376a5ccbeb0 req-fed8b254-1eba-4b09-9e40-cba2d4fe8c55 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.242871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d2b9a395-66b8-438f-b2fc-3376a5ccbeb0 req-fed8b254-1eba-4b09-9e40-cba2d4fe8c55 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.251977 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f9ea3aaa-61da-4e03-89b1-9fabb91f2902 tempest-FlavorsV2TestJSON-797655351 tempest-FlavorsV2TestJSON-797655351-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024690 Aug 04 04:24:34.261266 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 278/560] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:34.265034 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d2b9a395-66b8-438f-b2fc-3376a5ccbeb0 req-fed8b254-1eba-4b09-9e40-cba2d4fe8c55 service nova] Creating event network-vif-plugged:95dd00be-14d9-4967-a10b-d9910558960f for instance 30979a84-42ba-46d3-8195-f98ba52b364b on n-h1-851337-5 Aug 04 04:24:34.271663 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d2b9a395-66b8-438f-b2fc-3376a5ccbeb0 req-fed8b254-1eba-4b09-9e40-cba2d4fe8c55 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058729 Aug 04 04:24:34.272325 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 283/561] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:34.359845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:34.360496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:34.363445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:34.383136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.383857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.384838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.385541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.395664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:34.472432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:34.473573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:34.483580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.484323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:34.485366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:34.485953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:35.001797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:35.011046 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-30737683-e55b-4628-ba9d-3e851d620416 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.658910 Aug 04 04:24:35.022979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 279/562] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:34 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:35.031719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:35.032942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:35.041160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:35.041903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:35.043085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:35.044331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:35.056242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:35.072737 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0712daa-bf9b-483f-ac6e-9f7f21cc2b70 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.604552 Aug 04 04:24:35.085877 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 284/563] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:34 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:35.130775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:35.136649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:35.155641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:35.156162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:35.157000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:35.157436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:35.206331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:35.207230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:35.491501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:35.501738 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eac7b700-e036-415c-ada8-ebb0d28573db tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1321 microversion: 2.1 time: 0.487049 Aug 04 04:24:35.503272 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 280/564] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:35 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:35.520321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:35.520935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:35.529714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:35.530390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:35.531374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:35.531994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:35.591434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:35.600022 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1c267de-9469-4b55-98ce-75ff239e8111 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.493713 Aug 04 04:24:35.618845 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 285/565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:35 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:35.674056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:35.865710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:35.876834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:35.880228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:35.883368 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e360a6e6-d5ef-44e5-ac47-2dbc10e1080a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.378727 Aug 04 04:24:35.890669 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 281/566] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:35 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:36.036676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:36.037296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:36.049643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.050110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.050896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.051359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.096441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:36.097821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:36.108322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.109990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.111423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.112071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.320688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:36.336315 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2fc14fcb-1fcf-414a-9d00-05322b2db0a8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.303287 Aug 04 04:24:36.347605 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 286/567] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:36 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:36.356710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8453c14e-211a-4a3e-8e4d-f7bf45cf2ca8 req-7cfb048c-ff13-4ac5-9b0c-bc3461a5ccd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a042fbb-c3f2-4215-8132-6d5f33961b30", "name": "network-vif-unplugged", "status": "completed", "tag": "312e5f6a-5467-4b81-b150-30a4209bcd76"}, {"name": "network-changed", "server_uuid": "9a042fbb-c3f2-4215-8132-6d5f33961b30", "tag": "312e5f6a-5467-4b81-b150-30a4209bcd76"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:36.366005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:36.369297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8453c14e-211a-4a3e-8e4d-f7bf45cf2ca8 req-7cfb048c-ff13-4ac5-9b0c-bc3461a5ccd7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.370106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8453c14e-211a-4a3e-8e4d-f7bf45cf2ca8 req-7cfb048c-ff13-4ac5-9b0c-bc3461a5ccd7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.374378 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e46040b2-f31e-4f08-8a96-456edd311a1e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.282760 Aug 04 04:24:36.387313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8453c14e-211a-4a3e-8e4d-f7bf45cf2ca8 req-7cfb048c-ff13-4ac5-9b0c-bc3461a5ccd7 service nova] Creating event network-vif-unplugged:312e5f6a-5467-4b81-b150-30a4209bcd76 for instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 on n-h1-851337-5 Aug 04 04:24:36.387313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8453c14e-211a-4a3e-8e4d-f7bf45cf2ca8 req-7cfb048c-ff13-4ac5-9b0c-bc3461a5ccd7 service nova] Creating event network-changed:312e5f6a-5467-4b81-b150-30a4209bcd76 for instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 on n-h1-851337-5 Aug 04 04:24:36.388393 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 282/568] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:36 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:36.393110 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8453c14e-211a-4a3e-8e4d-f7bf45cf2ca8 req-7cfb048c-ff13-4ac5-9b0c-bc3461a5ccd7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.044216 Aug 04 04:24:36.394353 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 287/569] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:36.527127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:36.528077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:36.537910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.538447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.539983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.540806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.624054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:36.624794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:36.631431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.631880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.633120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.633525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.690100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:36.702131 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0fea70c0-67f4-491e-b969-5f7428d88a2b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1321 microversion: 2.1 time: 0.179878 Aug 04 04:24:36.703489 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 283/570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:36 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:36.850622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:36.859821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6387d95c-51a1-45c1-ae3f-39958af68e90 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.242059 Aug 04 04:24:36.860732 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 288/571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:36 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:36.906867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:36.907517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:36.910423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=18 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:36.914981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.915429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:36.916381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:36.917302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:37.063637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:37.072023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:37.073485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:37.074511 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-53f19c97-7747-40fe-960f-88cdf96fd3b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.172412 Aug 04 04:24:37.089722 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 284/572] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:36 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:37.164533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-614661f0-046e-40b9-801e-d65a3f917254 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Calling method '.version_select at 0x7f191a406c10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:37.186318 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-614661f0-046e-40b9-801e-d65a3f917254 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] HTTP exception thrown: Image not found. Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-614661f0-046e-40b9-801e-d65a3f917254 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Request method failure captured: Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/images/94dd96e5-9827-4bd9-8aa7-3f1fe00223a0/metadata/os_distro HTTP/1.1 Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oE9OSnXLaJiVoJhLwsKAH-b8cT56BT9Jrgd0ThkJPdK6HOVPjjhD40WfsOHGWXgwALn0MC6uBYtMcmRg9CUzx_I-MawdKd7TJWFVWWW1msoLHaOcyrkRo6nCjJGyk-KSm6shjIPVcZItDHgS0Swjs7yy5PSrrCzsnHBn_q_j8xSBg Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:37.208392 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d9f7761065344731af87400bd0c22733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d9f7761065344731af87400bd0c22733", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b43ef0c76c3240f1ab603a46d36cc16d Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'image_id': '94dd96e5-9827-4bd9-8aa7-3f1fe00223a0', 'id': 'os_distro'} Aug 04 04:24:37.209645 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.210488 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 94dd96e5-9827-4bd9-8aa7-3f1fe00223a0 Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.211622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94dd96e5-9827-4bd9-8aa7-3f1fe00223a0 could not be found. Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:37.212694 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:24:37.213724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.216706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-614661f0-046e-40b9-801e-d65a3f917254 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:37.217767 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-614661f0-046e-40b9-801e-d65a3f917254 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] 10.222.0.69 "DELETE /compute/v2.1/images/94dd96e5-9827-4bd9-8aa7-3f1fe00223a0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.253542 Aug 04 04:24:37.218332 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 289/573] 10.222.0.69 () {58 vars in 1293 bytes} [Thu Aug 4 04:24:36 2022] DELETE /compute/v2.1/images/94dd96e5-9827-4bd9-8aa7-3f1fe00223a0/metadata/os_distro => generated 62 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:37.229557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e768cb2-9ec3-4cb4-a466-eaa9e59b7b29 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Calling method '.version_select at 0x7f191abc7790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:37.266974 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4e768cb2-9ec3-4cb4-a466-eaa9e59b7b29 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] HTTP exception thrown: Image not found. Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e768cb2-9ec3-4cb4-a466-eaa9e59b7b29 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Request method failure captured: Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/images/3fe5884a-351a-495d-a6ff-5e5a9441ee0f/metadata/os_version HTTP/1.1 Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60oE9OSnXLaJiVoJhLwsKAH-b8cT56BT9Jrgd0ThkJPdK6HOVPjjhD40WfsOHGWXgwALn0MC6uBYtMcmRg9CUzx_I-MawdKd7TJWFVWWW1msoLHaOcyrkRo6nCjJGyk-KSm6shjIPVcZItDHgS0Swjs7yy5PSrrCzsnHBn_q_j8xSBg Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:37.270748 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d9f7761065344731af87400bd0c22733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d9f7761065344731af87400bd0c22733", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b43ef0c76c3240f1ab603a46d36cc16d Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'image_id': '3fe5884a-351a-495d-a6ff-5e5a9441ee0f', 'id': 'os_version'} Aug 04 04:24:37.272346 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.273261 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3fe5884a-351a-495d-a6ff-5e5a9441ee0f Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.281831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3fe5884a-351a-495d-a6ff-5e5a9441ee0f could not be found. Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:37.283332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.285905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e768cb2-9ec3-4cb4-a466-eaa9e59b7b29 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:37.288339 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e768cb2-9ec3-4cb4-a466-eaa9e59b7b29 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] 10.222.0.69 "GET /compute/v2.1/images/3fe5884a-351a-495d-a6ff-5e5a9441ee0f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.046842 Aug 04 04:24:37.288339 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 285/574] 10.222.0.69 () {58 vars in 1293 bytes} [Thu Aug 4 04:24:37 2022] GET /compute/v2.1/images/3fe5884a-351a-495d-a6ff-5e5a9441ee0f/metadata/os_version => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:37.290339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75ea1e90-cb28-425d-834f-99f997699d9d tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Calling method '.version_select at 0x7f191a495c10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:37.316539 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-75ea1e90-cb28-425d-834f-99f997699d9d tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] HTTP exception thrown: Image not found. Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75ea1e90-cb28-425d-834f-99f997699d9d tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Request method failure captured: Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/images/26d23a38-c55b-41d6-90f0-40c62e5c13d1/metadata HTTP/1.1 Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oE9OSnXLaJiVoJhLwsKAH-b8cT56BT9Jrgd0ThkJPdK6HOVPjjhD40WfsOHGWXgwALn0MC6uBYtMcmRg9CUzx_I-MawdKd7TJWFVWWW1msoLHaOcyrkRo6nCjJGyk-KSm6shjIPVcZItDHgS0Swjs7yy5PSrrCzsnHBn_q_j8xSBg Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:37.318564 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d9f7761065344731af87400bd0c22733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d9f7761065344731af87400bd0c22733", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b43ef0c76c3240f1ab603a46d36cc16d Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'image_id': '26d23a38-c55b-41d6-90f0-40c62e5c13d1'} Aug 04 04:24:37.319941 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.320691 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 26d23a38-c55b-41d6-90f0-40c62e5c13d1 Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.324223 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26d23a38-c55b-41d6-90f0-40c62e5c13d1 could not be found. Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:37.325493 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.326595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75ea1e90-cb28-425d-834f-99f997699d9d tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:37.327941 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-75ea1e90-cb28-425d-834f-99f997699d9d tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] 10.222.0.69 "GET /compute/v2.1/images/26d23a38-c55b-41d6-90f0-40c62e5c13d1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039075 Aug 04 04:24:37.327941 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 290/575] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:24:37 2022] GET /compute/v2.1/images/26d23a38-c55b-41d6-90f0-40c62e5c13d1/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:37.331603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-560b5834-218b-48e5-b34a-3ea618461916 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Action: 'update_all', calling method: .version_select at 0x7f191acbf700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:37.372086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:37.375608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:37.385400 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-560b5834-218b-48e5-b34a-3ea618461916 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] HTTP exception thrown: Image not found. Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-560b5834-218b-48e5-b34a-3ea618461916 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Request method failure captured: Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/images/3d0ed005-7875-4d31-9fdf-c2d8db6e4291/metadata HTTP/1.1 Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 57 Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60oE9OSnXLaJiVoJhLwsKAH-b8cT56BT9Jrgd0ThkJPdK6HOVPjjhD40WfsOHGWXgwALn0MC6uBYtMcmRg9CUzx_I-MawdKd7TJWFVWWW1msoLHaOcyrkRo6nCjJGyk-KSm6shjIPVcZItDHgS0Swjs7yy5PSrrCzsnHBn_q_j8xSBg Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:37.388317 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d9f7761065344731af87400bd0c22733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d9f7761065344731af87400bd0c22733", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b43ef0c76c3240f1ab603a46d36cc16d Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:24:37.389592 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'image_id': '3d0ed005-7875-4d31-9fdf-c2d8db6e4291', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.390369 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3d0ed005-7875-4d31-9fdf-c2d8db6e4291 Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.392497 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3d0ed005-7875-4d31-9fdf-c2d8db6e4291 could not be found. Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:37.399329 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:24:37.400636 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.404977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-560b5834-218b-48e5-b34a-3ea618461916 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:37.404977 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-560b5834-218b-48e5-b34a-3ea618461916 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] 10.222.0.69 "PUT /compute/v2.1/images/3d0ed005-7875-4d31-9fdf-c2d8db6e4291/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062253 Aug 04 04:24:37.404977 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 286/576] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:24:37 2022] PUT /compute/v2.1/images/3d0ed005-7875-4d31-9fdf-c2d8db6e4291/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:37.404977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:37.409739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:37.411732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:37.412253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:37.413131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:37.413863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:37.419540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:37.420362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:37.421425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:37.421912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:37.638779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:37.645771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:37.649283 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cefb56e0-6cd0-4eeb-954e-99d8a4ae643e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.285505 Aug 04 04:24:37.659623 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9cc21002-b50c-4c8e-8958-74fc97fa3c3c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.265844 Aug 04 04:24:37.660864 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 287/577] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:37 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:37.663678 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 291/578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:37 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:37.666592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56c8e41c-9be1-496c-893e-c10cb5a0f348 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Action: 'update', calling method: .version_select at 0x7f191abe3dc0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:37.695612 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-56c8e41c-9be1-496c-893e-c10cb5a0f348 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] HTTP exception thrown: Image not found. Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56c8e41c-9be1-496c-893e-c10cb5a0f348 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Request method failure captured: Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/images/de92de75-924e-46f3-92ff-b659d3ee759d/metadata/os_distro HTTP/1.1 Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 30 Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60oE9OSnXLaJiVoJhLwsKAH-b8cT56BT9Jrgd0ThkJPdK6HOVPjjhD40WfsOHGWXgwALn0MC6uBYtMcmRg9CUzx_I-MawdKd7TJWFVWWW1msoLHaOcyrkRo6nCjJGyk-KSm6shjIPVcZItDHgS0Swjs7yy5PSrrCzsnHBn_q_j8xSBg Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:37.697802 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d9f7761065344731af87400bd0c22733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d9f7761065344731af87400bd0c22733", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b43ef0c76c3240f1ab603a46d36cc16d Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: {"meta": {"os_distro": "alt"}} Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:24:37.699074 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'image_id': 'de92de75-924e-46f3-92ff-b659d3ee759d', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.700878 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID de92de75-924e-46f3-92ff-b659d3ee759d Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.701895 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image de92de75-924e-46f3-92ff-b659d3ee759d could not be found. Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:37.702936 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:24:37.705377 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.707350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56c8e41c-9be1-496c-893e-c10cb5a0f348 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:37.707350 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56c8e41c-9be1-496c-893e-c10cb5a0f348 tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] 10.222.0.69 "PUT /compute/v2.1/images/de92de75-924e-46f3-92ff-b659d3ee759d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.037118 Aug 04 04:24:37.707350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 288/579] 10.222.0.69 () {60 vars in 1310 bytes} [Thu Aug 4 04:24:37 2022] PUT /compute/v2.1/images/de92de75-924e-46f3-92ff-b659d3ee759d/metadata/os_distro => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:37.714186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23ad3409-b01a-4c18-bef7-7c7d939add6f tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Action: 'create', calling method: .version_select at 0x7f191a5b65e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:37.729196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:37.730043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:37.739215 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-23ad3409-b01a-4c18-bef7-7c7d939add6f tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] HTTP exception thrown: Image not found. Aug 04 04:24:37.740760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:37.741215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:37.742053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23ad3409-b01a-4c18-bef7-7c7d939add6f tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Request method failure captured: Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/images/2d73d516-e52a-47b0-8400-de4e97ab7457/metadata HTTP/1.1 Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 57 Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oE9OSnXLaJiVoJhLwsKAH-b8cT56BT9Jrgd0ThkJPdK6HOVPjjhD40WfsOHGWXgwALn0MC6uBYtMcmRg9CUzx_I-MawdKd7TJWFVWWW1msoLHaOcyrkRo6nCjJGyk-KSm6shjIPVcZItDHgS0Swjs7yy5PSrrCzsnHBn_q_j8xSBg Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:37.742294 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d9f7761065344731af87400bd0c22733"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d9f7761065344731af87400bd0c22733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d9f7761065344731af87400bd0c22733", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d9f7761065344731af87400bd0c22733 Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174 Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b43ef0c76c3240f1ab603a46d36cc16d Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1210622174-project Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:24:37.743518 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'image_id': '2d73d516-e52a-47b0-8400-de4e97ab7457', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.744303 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2d73d516-e52a-47b0-8400-de4e97ab7457 Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:24:37.750898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2d73d516-e52a-47b0-8400-de4e97ab7457 could not be found. Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:37.753012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:24:37.755996 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:37.759142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:37.759533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23ad3409-b01a-4c18-bef7-7c7d939add6f tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:37.759533 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-23ad3409-b01a-4c18-bef7-7c7d939add6f tempest-ImagesMetadataNegativeTestJSON-1210622174 tempest-ImagesMetadataNegativeTestJSON-1210622174-project] 10.222.0.69 "POST /compute/v2.1/images/2d73d516-e52a-47b0-8400-de4e97ab7457/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034224 Aug 04 04:24:37.759533 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 292/580] 10.222.0.69 () {60 vars in 1281 bytes} [Thu Aug 4 04:24:37 2022] POST /compute/v2.1/images/2d73d516-e52a-47b0-8400-de4e97ab7457/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:24:37.990273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:37.999253 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bf13b67f-1c16-4998-bed8-ccb58f001464 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1321 microversion: 2.1 time: 0.276964 Aug 04 04:24:38.000267 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 289/581] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:37 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:38.008097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b0a62ce6-2d3e-495c-81e1-c03b0247917d req-4211822a-911c-4a02-89e1-1de7f0eb8631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95e2bb4-37ce-4790-a791-d9fd173d7008", "name": "network-vif-plugged", "status": "completed", "tag": "4ec4c4c0-7a37-4cf6-8d70-69044a2f9f8f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:38.024394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00bc6af5-8c8c-4b0c-ad90-5dfe5bf49c16 tempest-NetworksTest-1600090107 tempest-NetworksTest-1600090107-project-admin] Calling method '.version_select at 0x7f191a3d9ee0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:38.026825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b0a62ce6-2d3e-495c-81e1-c03b0247917d req-4211822a-911c-4a02-89e1-1de7f0eb8631 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.027490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b0a62ce6-2d3e-495c-81e1-c03b0247917d req-4211822a-911c-4a02-89e1-1de7f0eb8631 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.045684 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b0a62ce6-2d3e-495c-81e1-c03b0247917d req-4211822a-911c-4a02-89e1-1de7f0eb8631 service nova] Creating event network-vif-plugged:4ec4c4c0-7a37-4cf6-8d70-69044a2f9f8f for instance b95e2bb4-37ce-4790-a791-d9fd173d7008 on n-h2-851337-5 Aug 04 04:24:38.053274 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b0a62ce6-2d3e-495c-81e1-c03b0247917d req-4211822a-911c-4a02-89e1-1de7f0eb8631 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050559 Aug 04 04:24:38.053888 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 290/582] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:38.061091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:38.061784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:38.076676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.077233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.078044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.078482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.392246 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00bc6af5-8c8c-4b0c-ad90-5dfe5bf49c16 tempest-NetworksTest-1600090107 tempest-NetworksTest-1600090107-project-admin] 10.222.0.69 "GET /compute/v2.1/os-networks" status: 200 len: 4710 microversion: 2.1 time: 0.582953 Aug 04 04:24:38.392896 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 293/583] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:37 2022] GET /compute/v2.1/os-networks => generated 4710 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:38.403406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:38.404041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:38.410833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.411527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.412100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.412538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.430578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:38.439761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f88bc2c8-dbaf-4ad2-bf56-9e57f0ecc974 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.383225 Aug 04 04:24:38.440750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 291/584] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:38 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:38.457943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e079b039-dc09-4815-a78c-7238102c1bfa tempest-NetworksTest-1600090107 tempest-NetworksTest-1600090107-project-admin] Calling method '.version_select at 0x7f191ae220d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:38.701295 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e079b039-dc09-4815-a78c-7238102c1bfa tempest-NetworksTest-1600090107 tempest-NetworksTest-1600090107-project-admin] 10.222.0.69 "GET /compute/v2.1/os-networks/f32dc227-4b62-4e6a-8762-1ae683269841" status: 200 len: 652 microversion: 2.1 time: 0.246855 Aug 04 04:24:38.705933 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 292/585] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:24:38 2022] GET /compute/v2.1/os-networks/f32dc227-4b62-4e6a-8762-1ae683269841 => generated 652 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:38.708605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:38.709339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:38.720211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.721245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.722074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.722562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.757583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:38.765755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:38.767304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:38.768475 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db58c2bc-320c-47bc-b848-05e3e280169a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.369606 Aug 04 04:24:38.783355 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 294/586] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:38 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:38.788865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:38.789905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:38.796697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.797260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:38.797915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:38.798511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:39.034286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:39.044116 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-efb9bbd5-c9c5-4d5b-8044-820d138badbb tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.340203 Aug 04 04:24:39.045095 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 293/587] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:38 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:39.057359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ece1148-2c86-4260-82af-f0555f32ca87 tempest-NetworksTest-1600090107 tempest-NetworksTest-1600090107-project-admin] Calling method '.version_select at 0x7f191abc79d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:39.086501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:39.102163 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9c5bf9fe-153b-4309-8913-4a44209fd8a7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1320 microversion: 2.1 time: 0.317101 Aug 04 04:24:39.102761 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 295/588] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:38 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:39.109571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:39.110710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:39.118745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:39.119241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:39.120056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:39.120496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:39.495057 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ece1148-2c86-4260-82af-f0555f32ca87 tempest-NetworksTest-1600090107 tempest-NetworksTest-1600090107-project-admin] 10.222.0.69 "GET /compute/v2.1/os-networks" status: 200 len: 4710 microversion: 2.1 time: 0.448719 Aug 04 04:24:39.495651 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 294/589] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:24:39 2022] GET /compute/v2.1/os-networks => generated 4710 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:39.502800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:39.503687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:39.510288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:39.511067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:39.512150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:39.513314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:39.536276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:39.556917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d770d36f-5916-439e-963d-e6fa155597ff tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1321 microversion: 2.1 time: 0.452931 Aug 04 04:24:39.561083 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 296/590] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:39 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:39.679385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:39.687705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9e5cfe9-271b-4e6c-b732-53f3c36bfa64 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.190886 Aug 04 04:24:39.702250 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 295/591] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:39 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:39.795180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:39.796082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:39.802766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:39.803403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:39.804186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:39.804750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.037015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:40.050156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:40.051830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:40.055042 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b200bd14-2153-4ab8-bb75-799fc4daac85 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.264134 Aug 04 04:24:40.057896 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 297/592] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:39 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:40.067810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:40.068445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:40.077168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.077841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.078825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.079608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.132237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:40.135700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:40.142520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.152849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.154517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.158319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.448903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:40.459329 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-52dd0f7d-cf8e-4278-a96d-92d14eae1b71 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.396611 Aug 04 04:24:40.473672 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 296/593] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:40 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:40.477506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:40.479805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f64a6442-bc3a-4c77-97f8-ad527b089ae7 req-bd2b7c75-feb6-4683-8586-e3cf2a575e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead118c2-ebfb-4040-8a2a-7e89d2c504f2", "name": "network-vif-plugged", "status": "completed", "tag": "e3085237-07be-47a5-adb5-78638b3d9288"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:40.492858 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6ebe7075-de8f-4039-a280-0e6b7c9beba7 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1469 microversion: 2.1 time: 0.368772 Aug 04 04:24:40.493172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f64a6442-bc3a-4c77-97f8-ad527b089ae7 req-bd2b7c75-feb6-4683-8586-e3cf2a575e9b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.493893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f64a6442-bc3a-4c77-97f8-ad527b089ae7 req-bd2b7c75-feb6-4683-8586-e3cf2a575e9b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.494102 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 298/594] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:40 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:40.514569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a6763c7-dc28-4941-9c4f-c1af5151ea29 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:40.517714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a6763c7-dc28-4941-9c4f-c1af5151ea29 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:40.522930 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f64a6442-bc3a-4c77-97f8-ad527b089ae7 req-bd2b7c75-feb6-4683-8586-e3cf2a575e9b service nova] Creating event network-vif-plugged:e3085237-07be-47a5-adb5-78638b3d9288 for instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 on n-h1-851337-5 Aug 04 04:24:40.524565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a6763c7-dc28-4941-9c4f-c1af5151ea29 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.525070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a6763c7-dc28-4941-9c4f-c1af5151ea29 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.526106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a6763c7-dc28-4941-9c4f-c1af5151ea29 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.526761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a6763c7-dc28-4941-9c4f-c1af5151ea29 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.528439 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f64a6442-bc3a-4c77-97f8-ad527b089ae7 req-bd2b7c75-feb6-4683-8586-e3cf2a575e9b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051622 Aug 04 04:24:40.529357 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 297/595] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:40.586461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:40.588196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:40.596803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.597862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.599114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.599808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.692504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a6763c7-dc28-4941-9c4f-c1af5151ea29 tempest-DeleteServersAdminTestJSON-1069597831 tempest-DeleteServersAdminTestJSON-1069597831-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b/action" status: 202 len: 0 microversion: 2.1 time: 0.182325 Aug 04 04:24:40.693801 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 299/596] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:24:40 2022] POST /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:40.702986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:40.703652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:40.710533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.711279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.712249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.712841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.750690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:40.751430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:40.752114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lazy-loading 'fault' on Instance uuid 30979a84-42ba-46d3-8195-f98ba52b364b {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:41.035857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:41.045571 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-288fd080-4d4f-49da-9381-a94bf5609378 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1471 microversion: 2.1 time: 0.467640 Aug 04 04:24:41.046433 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 298/597] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:40 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:41.063923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:41.064804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:41.078576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.079138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.080894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.081579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.149648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:41.158222 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02215d29-e42c-4d3e-b789-f6cf6f0130af tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1452 microversion: 2.1 time: 0.460171 Aug 04 04:24:41.161834 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 300/598] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:40 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1452 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:41.388072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:41.398038 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b6ec5f76-a94d-44f7-8a07-ba0098a816b0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.350109 Aug 04 04:24:41.399970 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 299/599] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:41 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:41.409824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:41.415808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:41.430891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.431389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.434981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.435531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.571805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c059021a-d957-4f64-aaa6-eb6c32aa496e tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:41.572399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c059021a-d957-4f64-aaa6-eb6c32aa496e tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] [instance: 3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:41.583642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c059021a-d957-4f64-aaa6-eb6c32aa496e tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] HTTP exception thrown: Instance 3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06 could not be found. Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c059021a-d957-4f64-aaa6-eb6c32aa496e tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Request method failure captured: Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06/action HTTP/1.1 Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 15 Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n2cHtAEqrIxYtnvk6SIl-fEHLC3SupSw3Dv-CgzMKyhdSr1H1JcdbMFeUYyVrFpuQL4J3fKm0vtmON7V7L2NVkgC7-lfBJCQAY2BgrdrGKzKveDa9Uo3S91ZVbd-hdNt6WreDbssaacv0RKNYIIAVJjztQzopZQPwSf5mOqtdOyfs Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:24:41.585525 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5c205d143aeb4ab58866488228693c2d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ffd0ca2bff8f43e3bfe9ec24dc77d287 Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: {"migrate": {}} Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:41.587394 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06 could not be found. Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06', 'body': {'migrate': {}}} Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06 could not be found. Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:41.588212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06 could not be found. Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06 could not be found. Aug 04 04:24:41.589523 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:41.590727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c059021a-d957-4f64-aaa6-eb6c32aa496e tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Returning 404 to user: Instance 3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:41.590727 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c059021a-d957-4f64-aaa6-eb6c32aa496e tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06/action" status: 404 len: 111 microversion: 2.1 time: 0.424347 Aug 04 04:24:41.590727 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 301/600] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:24:41 2022] POST /compute/v2.1/servers/3a2dbc2c-0f11-4a7b-9faa-f17ae3721d06/action => generated 111 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:41.603387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:41.603887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:41.616191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.616814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.617763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.618361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.648992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:24:41.718838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:41.788594 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3bf3fee5-b916-477f-904d-ac1332d0b21e tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 204 len: 0 microversion: 2.1 time: 0.188685 Aug 04 04:24:41.793122 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 302/601] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:41 2022] DELETE /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:24:41.798725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:41.800419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:41.801318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:41.809154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.809846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.810441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:41.811053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:41.811652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:41.811992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:41.817786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e4121eda-bc26-4b4c-ac88-4a497fb23b38 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.414713 Aug 04 04:24:41.818751 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 300/602] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:41 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:41.839993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1791723568", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:41.914787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:42.148986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:42.162504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73daa8fa-5296-4c17-b433-0f841ae829a2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.363983 Aug 04 04:24:42.163443 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 303/603] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:41 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:42.172820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:42.173789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:42.183320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.184148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.185186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.185742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.235494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.237044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.238329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lazy-loading 'fault' on Instance uuid 30979a84-42ba-46d3-8195-f98ba52b364b {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:42.406371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:42.407078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:42.407340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:42.407696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:42.408108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:42.432515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.433187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.434224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.434853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.464605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Getting quotas for project 35738b32c46f438dbd72b3204cfcb474. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:42.478483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Getting quotas for user 6ad16b7ab4cf4e008fe7c3f373140b8e and project 35738b32c46f438dbd72b3204cfcb474. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:42.502117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:42.505495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:42.572522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3d934b1b-c15e-4fab-abe0-d935cf8ad9cd tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738325 Aug 04 04:24:42.573497 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 301/604] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:24:42.579048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:42.579865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:42.592874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.593425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.594105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.594541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.615823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:42.624733 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4b21a9b4-2816-4295-9776-8d11f8fb6964 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1458 microversion: 2.1 time: 0.460046 Aug 04 04:24:42.628456 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 304/605] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:42 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1458 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:42.640485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfa8d0ca-482a-4604-82b5-edb301960f8d tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:42.642093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dfa8d0ca-482a-4604-82b5-edb301960f8d tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:42.773452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dfa8d0ca-482a-4604-82b5-edb301960f8d tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:42.783671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dfa8d0ca-482a-4604-82b5-edb301960f8d tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1222 microversion: 2.1 time: 0.153408 Aug 04 04:24:42.784317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 305/606] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:42 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:42.849331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:42.849712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:42.859207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.859659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:42.860485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:42.861413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.028430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:43.031221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:43.041448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5ddc49f-1f10-49cd-bf22-3a1d63817ea8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1316 microversion: 2.1 time: 0.466568 Aug 04 04:24:43.045232 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 302/607] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:42 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:43.187443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:43.188400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:43.196936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.197969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.199549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.200392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.202323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:43.212338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:43.213835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:43.215541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-74ebc159-14e9-4c92-b2fa-9d4fdc9ec1dd tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.376595 Aug 04 04:24:43.216112 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 306/608] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:42 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:43.501847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:43.518616 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c3ed5a5f-d5f1-405a-88d2-1dfe6d199c73 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.335143 Aug 04 04:24:43.519954 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 303/609] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:43 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:43.655601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:43.657123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:43.665526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.666872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.667939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.668578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.701185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.701764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.702293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lazy-loading 'fault' on Instance uuid 30979a84-42ba-46d3-8195-f98ba52b364b {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:43.779615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-462744f5-09fd-4428-afef-e8bc45d1bfa9 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Action: 'update', calling method: .version_select at 0x7f191a3fd1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:43.846603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462744f5-09fd-4428-afef-e8bc45d1bfa9 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.847283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462744f5-09fd-4428-afef-e8bc45d1bfa9 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.848175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462744f5-09fd-4428-afef-e8bc45d1bfa9 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.848617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462744f5-09fd-4428-afef-e8bc45d1bfa9 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.923530 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-462744f5-09fd-4428-afef-e8bc45d1bfa9 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8" status: 200 len: 148 microversion: 2.57 time: 0.287528 Aug 04 04:24:43.924367 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 307/610] 10.222.0.69 () {62 vars in 1303 bytes} [Thu Aug 4 04:24:43 2022] PUT /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8 => generated 148 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:24:43.931221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:43.931993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:43.942325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.943042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:43.943926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:43.944588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:44.192645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:44.206160 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20845c9c-c75f-4509-a3b1-f8aafb64d6cb tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1282 microversion: 2.1 time: 0.279976 Aug 04 04:24:44.207570 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 308/611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:43 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1282 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:44.212726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21fc4c3e-7be1-40ff-b9e3-56eef202ddb8 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Calling method '.version_select at 0x7f191a3ab790>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:44.318598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21fc4c3e-7be1-40ff-b9e3-56eef202ddb8 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:44.319195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21fc4c3e-7be1-40ff-b9e3-56eef202ddb8 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:44.320105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21fc4c3e-7be1-40ff-b9e3-56eef202ddb8 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:44.320651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21fc4c3e-7be1-40ff-b9e3-56eef202ddb8 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:44.351170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:44.356917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21fc4c3e-7be1-40ff-b9e3-56eef202ddb8 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8/detail" status: 200 len: 463 microversion: 2.57 time: 0.147054 Aug 04 04:24:44.365567 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 309/612] 10.222.0.69 () {60 vars in 1304 bytes} [Thu Aug 4 04:24:44 2022] GET /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8/detail => generated 463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:24:44.365567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:44.365567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:44.386454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:44.388118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:44.389176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:44.389871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:44.401911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c46d9915a0b4eb89dabc8a0796331fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7302d2cfb3d546f4ab737bb03886bdcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:44.415636 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf268bc7-700d-4231-919d-66fddffd9e6c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 200 len: 1458 microversion: 2.1 time: 0.769160 Aug 04 04:24:44.423005 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 304/613] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:43 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 1458 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:44.429367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:44.431806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:44.451742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:44.453876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:44.456977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:44.457883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:44.944620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:44.955019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:44.963946 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-073d5624-bc6c-4461-abaa-f42e9ebbe640 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1466 microversion: 2.1 time: 0.604498 Aug 04 04:24:44.964348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:44.966751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:44.968169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb693d9f-2900-47e0-8ae2-84ac1997b957 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.548423 Aug 04 04:24:44.972200 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 310/614] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:44 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1466 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:44.984740 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 305/615] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:44 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:44.991695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Action: 'update', calling method: .version_select at 0x7f191ab65550>, body: {"quota_set": {"ram": "2048"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:45.000888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:45.001530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:45.016441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.016898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.017678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.022747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.132260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.132739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.135577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.136254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.237231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.237922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.238891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.239502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.331296 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c273d36-e542-437e-aa57-d2805a495e00 tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8?user_id=5d3cad344e5140cc9b46af8a1f34fa6c" status: 200 len: 148 microversion: 2.57 time: 0.345379 Aug 04 04:24:45.332297 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 306/616] 10.222.0.69 () {62 vars in 1384 bytes} [Thu Aug 4 04:24:44 2022] PUT /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8?user_id=5d3cad344e5140cc9b46af8a1f34fa6c => generated 148 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:24:45.346756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-87a57bdc-a606-40d1-94d2-a9b27d328bdd req-c81ed2d1-fb81-4e62-85cf-4637ea10265f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30979a84-42ba-46d3-8195-f98ba52b364b", "name": "network-vif-deleted", "tag": "95dd00be-14d9-4967-a10b-d9910558960f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:45.360720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-87a57bdc-a606-40d1-94d2-a9b27d328bdd req-c81ed2d1-fb81-4e62-85cf-4637ea10265f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.361445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-87a57bdc-a606-40d1-94d2-a9b27d328bdd req-c81ed2d1-fb81-4e62-85cf-4637ea10265f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.375070 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-87a57bdc-a606-40d1-94d2-a9b27d328bdd req-c81ed2d1-fb81-4e62-85cf-4637ea10265f service nova] Creating event network-vif-deleted:95dd00be-14d9-4967-a10b-d9910558960f for instance 30979a84-42ba-46d3-8195-f98ba52b364b on n-h1-851337-5 Aug 04 04:24:45.381687 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-87a57bdc-a606-40d1-94d2-a9b27d328bdd req-c81ed2d1-fb81-4e62-85cf-4637ea10265f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041458 Aug 04 04:24:45.382516 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 307/617] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:45.388077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-187392388", "metadata": {"image_type": "test"}}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:45.391635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:45.399097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.401017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.402229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.403648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.450165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Getting quotas for project 57a51098088246149423af91de8d2167. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:45.454779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Getting quotas for user aa8824426a46496aaaf6cc1640f18519 and project 57a51098088246149423af91de8d2167. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:45.498514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:45.507508 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8040e188-3ebf-4149-9e93-001fdc9de612 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.522708 Aug 04 04:24:45.508052 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 311/618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:44 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:45.517158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:45.522822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:45.541185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.541750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.542662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.544803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.807774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:45.814851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e0008d52-0876-4f34-8e7f-9554df072d44 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "POST /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2/action" status: 202 len: 0 microversion: 2.1 time: 0.429596 Aug 04 04:24:45.816996 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 308/619] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:24:45 2022] POST /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:24:45.825657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d31d0d38-a5fb-4f6b-8964-d00890a624d1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1280 microversion: 2.1 time: 0.312063 Aug 04 04:24:45.826728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5fa1f9d0-cba3-4f55-a0c0-3e4462f3e60f tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] Calling method '.version_select at 0x7f191abe3f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:45.841846 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 312/620] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:45 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:45.846892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:45.847516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:45.855282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.856270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.857488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:45.858405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:45.876950 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] HTTP exception thrown: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Request method failure captured: Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b HTTP/1.1 Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nd6sPRMv1du438ciVOnMT6kpXYY6dIMn99fkPb75sCKJCaF2yu4bMKw66R8P-l2TH9srvXFS9rc7AgFm_KXr74H7vwFyFLoFkTnxUbjgaq45l8aGZmKWrplX37KUG9P8Py7uKzOg7K59BN57U3lKX5zZtQWwqrtvoTn4S85UHNN98 Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:45.880017 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7302d2cfb3d546f4ab737bb03886bdcc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 7c46d9915a0b4eb89dabc8a0796331fa Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:45.881394 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '30979a84-42ba-46d3-8195-f98ba52b364b'} Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:45.882118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:45.883421 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:45.888054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Returning 404 to user: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:45.889268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34673b25-4c35-4854-a9ae-17c23e9732ab tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 404 len: 111 microversion: 2.1 time: 0.046353 Aug 04 04:24:45.890112 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 313/621] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:45 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:45.907123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5289ac96-7e55-468c-afa2-24889390321f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a3bd040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:45.998893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:46.010240 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5fa1f9d0-cba3-4f55-a0c0-3e4462f3e60f tempest-QuotasAdminTestV257-615296344 tempest-QuotasAdminTestV257-615296344-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8?user_id=5d3cad344e5140cc9b46af8a1f34fa6c" status: 200 len: 190 microversion: 2.57 time: 0.191672 Aug 04 04:24:46.014220 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 309/622] 10.222.0.69 () {60 vars in 1364 bytes} [Thu Aug 4 04:24:45 2022] GET /compute/v2.1/os-quota-sets/b988d4dbabac4826ab19b4c7ef5363e8?user_id=5d3cad344e5140cc9b46af8a1f34fa6c => generated 190 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:24:46.016569 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5289ac96-7e55-468c-afa2-24889390321f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.124958 Aug 04 04:24:46.017150 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 314/623] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:45 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:46.023203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:46.023203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:46.031970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:46.032607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:46.046201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.047114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.049150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.049987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.063794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.064261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.065078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.068645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.088174 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] HTTP exception thrown: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Request method failure captured: Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b HTTP/1.1 Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nd6sPRMv1du438ciVOnMT6kpXYY6dIMn99fkPb75sCKJCaF2yu4bMKw66R8P-l2TH9srvXFS9rc7AgFm_KXr74H7vwFyFLoFkTnxUbjgaq45l8aGZmKWrplX37KUG9P8Py7uKzOg7K59BN57U3lKX5zZtQWwqrtvoTn4S85UHNN98 Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:46.091480 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7302d2cfb3d546f4ab737bb03886bdcc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7c46d9915a0b4eb89dabc8a0796331fa Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.092766 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '30979a84-42ba-46d3-8195-f98ba52b364b'} Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:46.093467 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.094614 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.100167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Returning 404 to user: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:46.101582 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd1767ca-2309-4209-98b3-ed1acd8c0b29 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 404 len: 111 microversion: 2.1 time: 0.087905 Aug 04 04:24:46.102449 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 310/624] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:46 2022] DELETE /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:46.114242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:46.115032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 30979a84-42ba-46d3-8195-f98ba52b364b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:46.132475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.132941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.133739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.134177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.171726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] HTTP exception thrown: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Request method failure captured: Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b HTTP/1.1 Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nd6sPRMv1du438ciVOnMT6kpXYY6dIMn99fkPb75sCKJCaF2yu4bMKw66R8P-l2TH9srvXFS9rc7AgFm_KXr74H7vwFyFLoFkTnxUbjgaq45l8aGZmKWrplX37KUG9P8Py7uKzOg7K59BN57U3lKX5zZtQWwqrtvoTn4S85UHNN98 Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:46.173472 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7302d2cfb3d546f4ab737bb03886bdcc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7c46d9915a0b4eb89dabc8a0796331fa Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.175986 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '30979a84-42ba-46d3-8195-f98ba52b364b'} Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:46.176744 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. Aug 04 04:24:46.177893 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.178902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Returning 404 to user: Instance 30979a84-42ba-46d3-8195-f98ba52b364b could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:46.178902 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-347a829c-3797-4e19-ae43-5aa69f050e8d tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b" status: 404 len: 111 microversion: 2.1 time: 0.065914 Aug 04 04:24:46.179957 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 311/625] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:46 2022] GET /compute/v2.1/servers/30979a84-42ba-46d3-8195-f98ba52b364b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:46.191750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:46.194106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:46.220135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.221916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.224930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.226011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.273214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] HTTP exception thrown: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Request method failure captured: Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 HTTP/1.1 Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nd6sPRMv1du438ciVOnMT6kpXYY6dIMn99fkPb75sCKJCaF2yu4bMKw66R8P-l2TH9srvXFS9rc7AgFm_KXr74H7vwFyFLoFkTnxUbjgaq45l8aGZmKWrplX37KUG9P8Py7uKzOg7K59BN57U3lKX5zZtQWwqrtvoTn4S85UHNN98 Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:46.278291 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7302d2cfb3d546f4ab737bb03886bdcc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7c46d9915a0b4eb89dabc8a0796331fa Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.279807 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '49d4a93d-313d-4a4c-8b99-95aa07ccf1a6'} Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:46.280490 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.281644 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.282796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Returning 404 to user: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:46.282796 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eed704d2-4495-4a54-b060-0b7ce0cb6454 tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 404 len: 111 microversion: 2.1 time: 0.098716 Aug 04 04:24:46.285556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 312/626] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:24:46 2022] DELETE /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:46.294970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:46.296222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] [instance: 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:46.304957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.305553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.325845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.327207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.346600 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] HTTP exception thrown: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Request method failure captured: Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 HTTP/1.1 Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nd6sPRMv1du438ciVOnMT6kpXYY6dIMn99fkPb75sCKJCaF2yu4bMKw66R8P-l2TH9srvXFS9rc7AgFm_KXr74H7vwFyFLoFkTnxUbjgaq45l8aGZmKWrplX37KUG9P8Py7uKzOg7K59BN57U3lKX5zZtQWwqrtvoTn4S85UHNN98 Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:24:46.349336 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7302d2cfb3d546f4ab737bb03886bdcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7302d2cfb3d546f4ab737bb03886bdcc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7302d2cfb3d546f4ab737bb03886bdcc Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-295650471 Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7c46d9915a0b4eb89dabc8a0796331fa Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersAdminTestJSON-295650471-project Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.350684 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '49d4a93d-313d-4a4c-8b99-95aa07ccf1a6'} Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:46.351460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. Aug 04 04:24:46.352595 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:24:46.354998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] Returning 404 to user: Instance 49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:46.354998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-670587cd-822b-44ea-8255-2a125973f08c tempest-DeleteServersAdminTestJSON-295650471 tempest-DeleteServersAdminTestJSON-295650471-project] 10.222.0.69 "GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6" status: 404 len: 111 microversion: 2.1 time: 0.061504 Aug 04 04:24:46.356595 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 313/627] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:46 2022] GET /compute/v2.1/servers/49d4a93d-313d-4a4c-8b99-95aa07ccf1a6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:46.530666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:46.531802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:46.543663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.544240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.551253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.551860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.731358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:46.742045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:46.749232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:46.750673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41cf9c8e-c300-44e8-a30b-e3d7c8afc1fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.732599 Aug 04 04:24:46.761299 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 315/628] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:46 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:46.851480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:46.852516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:46.888360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.890835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:46.894741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:46.899632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:47.350063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:47.364800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-75cc0a4a-7dcb-48e5-bfe1-e4f9754299a7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.837859 Aug 04 04:24:47.365404 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 314/629] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:46 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:47.376939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20baeae4-bcd1-42da-bc1f-cafe769b2923 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aad3550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:47.458453 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20baeae4-bcd1-42da-bc1f-cafe769b2923 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.091983 Aug 04 04:24:47.459261 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 315/630] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:47 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:47.661535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:47.677607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-be6b3a8e-fd7e-4be6-ab5f-5639df957dea tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.829873 Aug 04 04:24:47.678792 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 316/631] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:46 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:47.785403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:47.786174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:47.797593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:47.800160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:47.801661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:47.805423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:47.863321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02698449-6e8e-4281-8bb9-e1c612043bb8 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191afcb700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1931994926", "description": "tempest-description-1028513112"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:48.633857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:48.650130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:48.653485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:48.654932 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f77fed5f-3c60-414d-90f2-42f8824a718d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1568 microversion: 2.25 time: 0.874062 Aug 04 04:24:48.677283 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 317/632] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:47 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1568 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:48.684817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:48.685691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:48.696227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:48.697310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:48.698501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:48.699647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:48.973025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02698449-6e8e-4281-8bb9-e1c612043bb8 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.267743 Aug 04 04:24:48.974645 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 316/633] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:47 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:48.980884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6fd0199d-69fb-41aa-a324-5434c3e03ae9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aacaee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:49.049873 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6fd0199d-69fb-41aa-a324-5434c3e03ae9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.073841 Aug 04 04:24:49.051474 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 317/634] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:48 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:49.066155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:49.067812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:49.076141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:49.076871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:49.077944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:49.078971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:49.180758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:49.190856 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cb94930c-f96b-4b0b-9137-c61e8605fcbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.512660 Aug 04 04:24:49.194537 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 318/635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:48 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:49.201951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1547f484-31d1-4aec-9b16-e493e8a5962c tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191a495700>, body: {"security_group_rule": {"parent_group_id": "6c02864f-8a84-4c27-9f40-922c8f5a46aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:49.459667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:49.490480 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-97600442-a2a3-453d-80c6-cea1cf16d1b0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.418736 Aug 04 04:24:49.491485 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 318/636] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:49 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:49.604041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-24bb6d5e-534f-4d31-81cd-2065f7cc340d req-5a43be92-879b-4731-bde4-52e90fc5c68c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc62ae1d-558b-47d6-8dea-d1f284aa6b79", "tag": "993a8c11-c3ba-444f-8b3d-f8a5dc0c98be"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:49.626748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-24bb6d5e-534f-4d31-81cd-2065f7cc340d req-5a43be92-879b-4731-bde4-52e90fc5c68c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:49.628364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-24bb6d5e-534f-4d31-81cd-2065f7cc340d req-5a43be92-879b-4731-bde4-52e90fc5c68c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:49.649032 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-24bb6d5e-534f-4d31-81cd-2065f7cc340d req-5a43be92-879b-4731-bde4-52e90fc5c68c service nova] Creating event network-changed:993a8c11-c3ba-444f-8b3d-f8a5dc0c98be for instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 on n-h2-851337-5 Aug 04 04:24:49.657041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-24bb6d5e-534f-4d31-81cd-2065f7cc340d req-5a43be92-879b-4731-bde4-52e90fc5c68c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061958 Aug 04 04:24:49.658459 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 319/637] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:49.685914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:49.688593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:49.698550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:49.699832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:49.700893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:49.701519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.095786 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1547f484-31d1-4aec-9b16-e493e8a5962c tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.899820 Aug 04 04:24:50.096959 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 319/638] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:24:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:50.105382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c77c861c-441d-4246-9e1e-9aef45ee7d28 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a36d1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:50.219222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:50.232628 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c77c861c-441d-4246-9e1e-9aef45ee7d28 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.134150 Aug 04 04:24:50.233495 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 320/639] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:50 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:50.240351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:50.242058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:50.245159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-62187a5a-c7d4-433c-bce2-85e65960ab65 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191a39baf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1672078149", "description": "tempest-description-1672283513"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:50.245723 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b88967c-03c0-4997-b3cc-924803a9353a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1558 microversion: 2.25 time: 0.565475 Aug 04 04:24:50.249532 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 320/640] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:49 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1558 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:24:50.262438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:50.264160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:50.281963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:50.282651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.285797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:50.286454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.692566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:50.700756 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb07f97f-b9aa-4d6b-ad0f-eca95462e107 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.449269 Aug 04 04:24:50.703648 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 321/641] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:50 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:50.709339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a7aa507-97cb-4e9a-9c64-0e38de888298 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '.version_select at 0x7f191acbfc10>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:50.725520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a7aa507-97cb-4e9a-9c64-0e38de888298 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:50.725965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a7aa507-97cb-4e9a-9c64-0e38de888298 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.745316 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a7aa507-97cb-4e9a-9c64-0e38de888298 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.039443 Aug 04 04:24:50.746756 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 322/642] 10.222.0.69 () {60 vars in 1184 bytes} [Thu Aug 4 04:24:50 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:50.759192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:50.760141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:50.767938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:50.768885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.770022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:50.770939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.854673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-62187a5a-c7d4-433c-bce2-85e65960ab65 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.616966 Aug 04 04:24:50.855920 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 321/643] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:50 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:50.860992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:50.861793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:50.883553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:50.884463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.887583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:50.890685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:50.996451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:51.008925 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-14fb7a3f-fb1c-491c-9771-16572a554f21 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.261057 Aug 04 04:24:51.012607 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 323/644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:50 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:51.021519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ccedafd-52fa-4b01-8dd5-70b9a9948af5 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191aad3ca0>, body: {"security_group_rule": {"parent_group_id": "6379ad78-7845-425c-92a4-7fae66632a80", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:51.230077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 9a042fbb-c3f2-4215-8132-6d5f33961b30 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:24:51.310696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92838601-0783-423f-8132-3fa00d016d6c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 2050 microversion: 2.25 time: 0.453485 Aug 04 04:24:51.312622 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 322/645] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:50 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 2050 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:51.319649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-799fb42d-0234-4642-8513-699b276870ec tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a355af0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:51.347187 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ccedafd-52fa-4b01-8dd5-70b9a9948af5 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.332464 Aug 04 04:24:51.356180 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 324/646] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:24:51 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:51.367456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23e9ae2a-4520-40dd-a055-fc33b5c237d9 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191aad3700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1546266717", "description": "tempest-description-1968177205"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:51.384607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-799fb42d-0234-4642-8513-699b276870ec tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.068859 Aug 04 04:24:51.386030 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 323/647] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:51 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:51.597312 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23e9ae2a-4520-40dd-a055-fc33b5c237d9 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.238903 Aug 04 04:24:51.597980 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 325/648] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:51 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:24:51.599311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1084502930", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "50e30f39-3ea7-4335-a7da-5dfd49b29ac4"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:51.615895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e57660b2-464c-41b6-9f4a-2b7b091edef4 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191aacaca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1126902882", "description": "tempest-description-696905475"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:51.756840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] validate_networks() for [('50e30f39-3ea7-4335-a7da-5dfd49b29ac4', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:24:52.097844 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e57660b2-464c-41b6-9f4a-2b7b091edef4 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.485645 Aug 04 04:24:52.098691 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 326/649] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:52.111469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:52.112830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:52.125885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:52.127351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:52.128545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:52.129543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:52.708003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:52.722793 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a1f7785-38ab-4e1b-bb04-048727f125bd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.617468 Aug 04 04:24:52.734016 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 327/650] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:52 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:52.743055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:52.744561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:52.752397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:52.752842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:52.758721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:52.759270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:52.799072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:52.799575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:52.799973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:52.800525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:52.801116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:52.812577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:52.813353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:52.814317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:52.814937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:52.837115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:52.841788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for user eaff90b8a434488f9d2731070edf30fe and project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:52.855665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:52.858480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:52.918580 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8501b023-5765-448c-83ab-626e4bc4882a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.324039 Aug 04 04:24:52.919901 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 324/651] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:24:53.164260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55085267-e8f4-435b-a930-1e07ce125cc2 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1827810979", "ram": 512, "vcpus": 1, "disk": 10, "id": 1136016225, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:53.168488 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:53.168488 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:53.196393 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55085267-e8f4-435b-a930-1e07ce125cc2 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.275012 Aug 04 04:24:53.205997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 325/652] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:24:52 2022] POST /compute/v2.1/flavors => generated 416 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:53.205997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba75463a-e6a4-464f-9d59-b393315f9a5c tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191a36b430>, body: {"security_group_rule": {"parent_group_id": "3ccf2c67-a2ba-48ef-9b8f-6faa66823291", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8a07c94b-4ef2-4997-af97-52b0ee166f14"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:53.398878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:53.403389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:53.411671 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c521d4ac-baa9-4330-b896-98fc6336c1a0 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.674970 Aug 04 04:24:53.426251 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 328/653] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:52 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:53.431765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-716cb83b-2971-4269-98b1-8d98489ad5e8 req-cfa39dcb-125f-45a2-8750-80c3578c0e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead118c2-ebfb-4040-8a2a-7e89d2c504f2", "name": "network-vif-plugged", "status": "completed", "tag": "e3085237-07be-47a5-adb5-78638b3d9288"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:53.445602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-716cb83b-2971-4269-98b1-8d98489ad5e8 req-cfa39dcb-125f-45a2-8750-80c3578c0e9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:53.446059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-716cb83b-2971-4269-98b1-8d98489ad5e8 req-cfa39dcb-125f-45a2-8750-80c3578c0e9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:53.461065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-716cb83b-2971-4269-98b1-8d98489ad5e8 req-cfa39dcb-125f-45a2-8750-80c3578c0e9d service nova] Creating event network-vif-plugged:e3085237-07be-47a5-adb5-78638b3d9288 for instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 on n-h1-851337-5 Aug 04 04:24:53.466946 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-716cb83b-2971-4269-98b1-8d98489ad5e8 req-cfa39dcb-125f-45a2-8750-80c3578c0e9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039047 Aug 04 04:24:53.468111 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 329/654] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:53.475483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-99b90776-33f3-4102-8be5-debabd2a060b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aaf3940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:53.538775 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-99b90776-33f3-4102-8be5-debabd2a060b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.069040 Aug 04 04:24:53.551141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 330/655] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:53 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:53.556493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:53.557519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:53.564374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:53.564844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:53.565586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:53.566081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:53.657978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:53.674530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:53.676208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:53.677452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-411fd644-bd99-47bc-92a3-e744fb2a5ead tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1266 microversion: 2.25 time: 0.124814 Aug 04 04:24:53.678019 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 331/656] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:53 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:53.722798 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba75463a-e6a4-464f-9d59-b393315f9a5c tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.523300 Aug 04 04:24:53.723363 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 326/657] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:24:53 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:53.754930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1515289645", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": "none"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:53.811489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:24:53.811919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:24:53.812402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:24:53.812817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:24:53.813235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:24:53.822747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:53.823234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:53.824104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:53.824544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:53.843000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Getting quotas for project 68ee2d0ed95e4d41bca3aa809aee19fe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:24:53.847214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Getting quotas for user 5d1f299e211e4211916e6e2ddedcf407 and project 68ee2d0ed95e4d41bca3aa809aee19fe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:24:53.854695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5892e7a-ed4a-43fb-8a21-8505be8d5a01 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:53.860148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:24:53.862422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:24:53.865441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a5892e7a-ed4a-43fb-8a21-8505be8d5a01 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] HTTP exception thrown: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5892e7a-ed4a-43fb-8a21-8505be8d5a01 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Request method failure captured: Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/flavors/1136016225/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oSY6mAdZEf7XYsmpPlf9qgVkVvn2e9xb_-Lb-FW54ikitEheDgVkbElknfzzczptGzCATqkT5oJpK836EQ-rAwvN__0fPlJjVcqum1miH933hKcvqImgqDGaTWHq51EMweGqxUqLuZpM_E_GEw71f5n9voBhPao9drJUk6cS_vRAE Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:53.867820 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_183f2352b7d6443593ef5fd4fce40f7d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4129187e7c4e4042bd7021264bcd752d Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:53.869265 n-d-851337-5 devstack@n-api.service[119342]: exception: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'flavor_id': '1136016225', 'id': 'hw:cpu_thread_policy'} Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:53.870078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5892e7a-ed4a-43fb-8a21-8505be8d5a01 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Returning 404 to user: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5892e7a-ed4a-43fb-8a21-8505be8d5a01 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] 10.222.0.69 "GET /compute/v2.1/flavors/1136016225/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.134805 Aug 04 04:24:53.871593 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 327/658] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:24:53 2022] GET /compute/v2.1/flavors/1136016225/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:53.880038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2c1b0294-8831-44a2-af70-08347263df43 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191a36dee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1925129047", "description": "tempest-description-901465010"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:53.919025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b43937b-fb66-4bcc-b9db-618af9512d20 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.239769 Aug 04 04:24:53.920164 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 332/659] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:24:53.927301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:53.928189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:53.937194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:53.938060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:53.939312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:53.939963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:54.140980 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2c1b0294-8831-44a2-af70-08347263df43 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.270363 Aug 04 04:24:54.141559 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 328/660] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:54.161427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f1eefe1-4966-44d1-b38c-7185e7b040a3 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:54.164401 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:54.164401 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:54.165276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f1eefe1-4966-44d1-b38c-7185e7b040a3 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '4129187e7c4e4042bd7021264bcd752d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183f2352b7d6443593ef5fd4fce40f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f1eefe1-4966-44d1-b38c-7185e7b040a3 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Request method failure captured: Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/flavors/1136016225/os-extra_specs HTTP/1.1 Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 66 Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oSY6mAdZEf7XYsmpPlf9qgVkVvn2e9xb_-Lb-FW54ikitEheDgVkbElknfzzczptGzCATqkT5oJpK836EQ-rAwvN__0fPlJjVcqum1miH933hKcvqImgqDGaTWHq51EMweGqxUqLuZpM_E_GEw71f5n9voBhPao9drJUk6cS_vRAE Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:54.166885 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_183f2352b7d6443593ef5fd4fce40f7d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4129187e7c4e4042bd7021264bcd752d Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 04 04:24:54.169348 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'flavor_id': '1136016225', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:24:54.170094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 04:24:54.173435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:54.174618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f1eefe1-4966-44d1-b38c-7185e7b040a3 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:54.174618 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f1eefe1-4966-44d1-b38c-7185e7b040a3 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] 10.222.0.69 "POST /compute/v2.1/flavors/1136016225/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.025660 Aug 04 04:24:54.177277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.179145 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 329/661] 10.222.0.69 () {60 vars in 1224 bytes} [Thu Aug 4 04:24:54 2022] POST /compute/v2.1/flavors/1136016225/os-extra_specs => generated 124 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:54.188198 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-614a39f6-b78e-418a-b174-230f5c3ddc69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.266594 Aug 04 04:24:54.188566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e7c066d-861c-4a37-8cce-b7b11d24f955 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:54.190036 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 333/662] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:53 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:54.194106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e7c066d-861c-4a37-8cce-b7b11d24f955 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:54.228756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab43a2e0-0f85-41b9-aa6e-1c37ac4584f2 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191aaf3430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-4865604", "description": "tempest-description-2034131136"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:54.412758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e7c066d-861c-4a37-8cce-b7b11d24f955 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.424120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e7c066d-861c-4a37-8cce-b7b11d24f955 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.425650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e7c066d-861c-4a37-8cce-b7b11d24f955 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.436612 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e7c066d-861c-4a37-8cce-b7b11d24f955 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "PUT /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1359 microversion: 2.75 time: 0.256114 Aug 04 04:24:54.438933 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 330/663] 10.222.0.69 () {62 vars in 1297 bytes} [Thu Aug 4 04:24:54 2022] PUT /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:54.444745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a55335a7-1aa0-48eb-b260-a19d43949aae tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:54.459632 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:54.459632 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:54.497237 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a55335a7-1aa0-48eb-b260-a19d43949aae tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1136016225/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056802 Aug 04 04:24:54.499997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 331/664] 10.222.0.69 () {60 vars in 1224 bytes} [Thu Aug 4 04:24:54 2022] POST /compute/v2.1/flavors/1136016225/os-extra_specs => generated 66 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:54.506178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:54.506718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:54.515681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:54.516940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:54.517891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:54.518735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:54.721098 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab43a2e0-0f85-41b9-aa6e-1c37ac4584f2 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.514775 Aug 04 04:24:54.722413 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 334/665] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:54 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:54.729063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:54.731080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:54.738736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:54.740673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:54.742001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:54.742653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:54.836300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.848014 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a46bbc44-702c-4f0e-8cee-c5873be1312a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.346504 Aug 04 04:24:54.859732 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 332/666] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:54 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:54.859732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73d250d1-c0a3-41f4-a038-e8ff3776a2ad tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:54.859732 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:54.859732 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:54.859732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73d250d1-c0a3-41f4-a038-e8ff3776a2ad tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '4129187e7c4e4042bd7021264bcd752d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183f2352b7d6443593ef5fd4fce40f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73d250d1-c0a3-41f4-a038-e8ff3776a2ad tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Request method failure captured: Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oSY6mAdZEf7XYsmpPlf9qgVkVvn2e9xb_-Lb-FW54ikitEheDgVkbElknfzzczptGzCATqkT5oJpK836EQ-rAwvN__0fPlJjVcqum1miH933hKcvqImgqDGaTWHq51EMweGqxUqLuZpM_E_GEw71f5n9voBhPao9drJUk6cS_vRAE Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:54.860571 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_183f2352b7d6443593ef5fd4fce40f7d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4129187e7c4e4042bd7021264bcd752d Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:54.862141 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'flavor_id': '1136016225', 'id': 'hw:numa_nodes'} Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:24:54.867140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:54.868449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73d250d1-c0a3-41f4-a038-e8ff3776a2ad tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:54.869423 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73d250d1-c0a3-41f4-a038-e8ff3776a2ad tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] 10.222.0.69 "DELETE /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010578 Aug 04 04:24:54.869423 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 333/667] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:24:54 2022] DELETE /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:54.869423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b29bdcea-199c-483a-a472-e923007b68ef tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a3ab9d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:54.926638 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b29bdcea-199c-483a-a472-e923007b68ef tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.062752 Aug 04 04:24:54.927055 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 334/668] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:54 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:54.934324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:54.935247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:54.943699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:54.944182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:54.945049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:54.945425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:54.981667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.992455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:54.994329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:55.003454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fa9928ac-91da-4cd8-9d20-632bcd558dc9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1355 microversion: 2.75 time: 0.279458 Aug 04 04:24:55.004345 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 335/669] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:54 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1355 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:55.009276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f81b5dff-2144-45c7-940d-4dac194b77c0 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191aacaf70>, body: {"security_group_rule": {"parent_group_id": "37aa6fbd-0837-44fb-b278-73255e37695e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c54b7423-4b1d-4bef-b3cc-a5c373977b87"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:55.061736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:55.074208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:55.077174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:55.079268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4fa30a32-dcdf-439d-89c9-371d7475e539 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1320 microversion: 2.25 time: 0.150754 Aug 04 04:24:55.080027 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 335/670] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:54 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:55.085286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6c7317a1-db0c-4edf-93f5-ad71d8aae79f tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:55.092305 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:55.092305 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:55.126343 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6c7317a1-db0c-4edf-93f5-ad71d8aae79f tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1136016225/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045010 Aug 04 04:24:55.132467 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 336/671] 10.222.0.69 () {60 vars in 1224 bytes} [Thu Aug 4 04:24:55 2022] POST /compute/v2.1/flavors/1136016225/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:24:55.137618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f184dc10-5911-4815-abc5-72a06451976e tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:55.140119 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:55.140119 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:55.141006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f184dc10-5911-4815-abc5-72a06451976e tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '4129187e7c4e4042bd7021264bcd752d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183f2352b7d6443593ef5fd4fce40f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f184dc10-5911-4815-abc5-72a06451976e tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Request method failure captured: Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 22 Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oSY6mAdZEf7XYsmpPlf9qgVkVvn2e9xb_-Lb-FW54ikitEheDgVkbElknfzzczptGzCATqkT5oJpK836EQ-rAwvN__0fPlJjVcqum1miH933hKcvqImgqDGaTWHq51EMweGqxUqLuZpM_E_GEw71f5n9voBhPao9drJUk6cS_vRAE Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:24:55.142607 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/183f2352b7d6443593ef5fd4fce40f7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_183f2352b7d6443593ef5fd4fce40f7d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 183f2352b7d6443593ef5fd4fce40f7d Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4129187e7c4e4042bd7021264bcd752d Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: {"hw:numa_nodes": "1"} Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:55.143917 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'flavor_id': '1136016225', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:24:55.144807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 04:24:55.145870 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.146925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f184dc10-5911-4815-abc5-72a06451976e tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:55.146925 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f184dc10-5911-4815-abc5-72a06451976e tempest-FlavorsExtraSpecsNegativeTestJSON-327775751 tempest-FlavorsExtraSpecsNegativeTestJSON-327775751-project] 10.222.0.69 "PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011069 Aug 04 04:24:55.146925 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 337/672] 10.222.0.69 () {60 vars in 1265 bytes} [Thu Aug 4 04:24:55 2022] PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:24:55.157948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5433fcb1-3d73-4dd4-b822-6fcaf07838a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:55.158933 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:55.158933 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:55.168667 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5433fcb1-3d73-4dd4-b822-6fcaf07838a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] HTTP exception thrown: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5433fcb1-3d73-4dd4-b822-6fcaf07838a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Request method failure captured: Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/flavors/1136016225/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oT2DRTktLJ1e_dmr5W5GFgdJ1oLbAVlyV5Dkx0EurpTNxB6I4hS7dXjIdgVGA0ugg0-_IrgtADLuSwhs3MQnXbVBq2Dtz6WrVHx453t7ElKpD4J7xySpfTs6CTCDt5EtrjcVJo0I7icEJWIryS_YovpIrCvjS53ESgW0T3hAZbfWg Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fa43857d98784324a0c2dbaff035d1d2 Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:24:55.170378 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fa43857d98784324a0c2dbaff035d1d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fa43857d98784324a0c2dbaff035d1d2 Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 524d5cfe80134e03a468e81ec5e04d18 Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:55.172035 n-d-851337-5 devstack@n-api.service[119342]: exception: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'flavor_id': '1136016225', 'id': 'hw:cpu_thread_policy'} Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:55.172706 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5433fcb1-3d73-4dd4-b822-6fcaf07838a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Returning 404 to user: Flavor 1136016225 has no extra specs with key hw:cpu_thread_policy. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5433fcb1-3d73-4dd4-b822-6fcaf07838a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1136016225/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.021683 Aug 04 04:24:55.173978 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 338/673] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:24:55 2022] DELETE /compute/v2.1/flavors/1136016225/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:24:55.187204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f22c7cc2-7570-4e69-ab27-2add2fac5ec3 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:55.190770 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-f22c7cc2-7570-4e69-ab27-2add2fac5ec3 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f22c7cc2-7570-4e69-ab27-2add2fac5ec3 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Request method failure captured: Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 27 Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oT2DRTktLJ1e_dmr5W5GFgdJ1oLbAVlyV5Dkx0EurpTNxB6I4hS7dXjIdgVGA0ugg0-_IrgtADLuSwhs3MQnXbVBq2Dtz6WrVHx453t7ElKpD4J7xySpfTs6CTCDt5EtrjcVJo0I7icEJWIryS_YovpIrCvjS53ESgW0T3hAZbfWg Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fa43857d98784324a0c2dbaff035d1d2 Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:24:55.193767 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fa43857d98784324a0c2dbaff035d1d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fa43857d98784324a0c2dbaff035d1d2 Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 524d5cfe80134e03a468e81ec5e04d18 Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: {"hw:cpu_policy": "shared"} Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:55.196980 n-d-851337-5 devstack@n-api.service[119342]: exception: Request body and URI mismatch Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'flavor_id': '1136016225', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.197725 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.199483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:24:55.199483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:24:55.199483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 04 04:24:55.199483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.212899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f22c7cc2-7570-4e69-ab27-2add2fac5ec3 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:55.213961 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f22c7cc2-7570-4e69-ab27-2add2fac5ec3 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.032029 Aug 04 04:24:55.221134 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 339/674] 10.222.0.69 () {60 vars in 1265 bytes} [Thu Aug 4 04:24:55 2022] PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:24:55.228717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:55.229761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:55.238593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:55.239441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:55.240445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:55.242613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:55.248076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:55.533176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:55.542200 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99e4e211-21a6-40bb-a652-84a7b324c2b5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.318524 Aug 04 04:24:55.542859 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 340/675] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:55 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:55.559524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95c7e71d-fe36-4651-b222-1888e0d60b38 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95c7e71d-fe36-4651-b222-1888e0d60b38 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Request method failure captured: Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 49 Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oT2DRTktLJ1e_dmr5W5GFgdJ1oLbAVlyV5Dkx0EurpTNxB6I4hS7dXjIdgVGA0ugg0-_IrgtADLuSwhs3MQnXbVBq2Dtz6WrVHx453t7ElKpD4J7xySpfTs6CTCDt5EtrjcVJo0I7icEJWIryS_YovpIrCvjS53ESgW0T3hAZbfWg Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fa43857d98784324a0c2dbaff035d1d2 Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:24:55.564105 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fa43857d98784324a0c2dbaff035d1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fa43857d98784324a0c2dbaff035d1d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fa43857d98784324a0c2dbaff035d1d2 Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 524d5cfe80134e03a468e81ec5e04d18 Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 04 04:24:55.565486 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'flavor_id': '1136016225', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance: Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 04 04:24:55.566236 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.567685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:24:55.569028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:24:55.569028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:24:55.569028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:24:55.569028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:24:55.569028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 04:24:55.569028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:24:55.584270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95c7e71d-fe36-4651-b222-1888e0d60b38 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:24:55.585648 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-95c7e71d-fe36-4651-b222-1888e0d60b38 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.039593 Aug 04 04:24:55.586458 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 341/676] 10.222.0.69 () {60 vars in 1265 bytes} [Thu Aug 4 04:24:55 2022] PUT /compute/v2.1/flavors/1136016225/os-extra_specs/hw:numa_nodes => generated 117 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:24:55.600579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-77f3dd71-95dd-4e7d-a7da-0a8bab3ebe39 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:55.603755 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:24:55.603755 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:24:55.634428 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-77f3dd71-95dd-4e7d-a7da-0a8bab3ebe39 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1136016225" status: 202 len: 0 microversion: 2.1 time: 0.041821 Aug 04 04:24:55.635981 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 342/677] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:24:55 2022] DELETE /compute/v2.1/flavors/1136016225 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:24:55.659121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93df5a93-3b9e-497a-80a5-20a30de4395e tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:55.694176 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93df5a93-3b9e-497a-80a5-20a30de4395e tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956 tempest-FlavorsExtraSpecsNegativeTestJSON-1353459956-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.040367 Aug 04 04:24:55.696348 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 343/678] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:24:55 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:55.758537 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f81b5dff-2144-45c7-940d-4dac194b77c0 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 328 microversion: 2.1 time: 0.752720 Aug 04 04:24:55.759536 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 336/679] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:24:55 2022] POST /compute/v2.1/os-security-group-rules => generated 328 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:55.773402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0622d232-6551-42d7-ad67-698a61c13020 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191a3ab8b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:55.881350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:55.882744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:55.899573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:55.900177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:55.901037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:55.901625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:56.228677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:56.241098 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-25a9e069-233d-41ff-bc78-fb340a42b8e3 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.364410 Aug 04 04:24:56.256350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 337/680] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:55 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:56.262654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46678808-3e20-4f4f-ac17-b7eb55189fe3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191ae0f8b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:56.319505 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46678808-3e20-4f4f-ac17-b7eb55189fe3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.061468 Aug 04 04:24:56.320434 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 338/681] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:56 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:56.326719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:56.327660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:56.337161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:56.338038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:56.339133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:56.340473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:56.458600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:56.469578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:56.474397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:56.481293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e28f295e-bc43-43df-afa3-07f5a849afbe tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1417 microversion: 2.75 time: 0.159328 Aug 04 04:24:56.482216 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 339/682] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:56 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1417 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:56.487705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:56.488646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:56.495348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:56.496118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:56.497709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:56.498209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:56.862331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:56.870664 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0622d232-6551-42d7-ad67-698a61c13020 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/c54b7423-4b1d-4bef-b3cc-a5c373977b87" status: 202 len: 0 microversion: 2.1 time: 1.102895 Aug 04 04:24:56.872389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 344/683] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:24:55 2022] DELETE /compute/v2.1/os-security-groups/c54b7423-4b1d-4bef-b3cc-a5c373977b87 => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:24:56.877387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:56.878253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:56.880609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:56.882838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:56.884959 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bdc4a62b-e7a7-4747-ad2b-75256b2736b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.400771 Aug 04 04:24:56.885962 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 340/684] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:56 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:56.895237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-58d9449f-16ba-4c8f-9941-fbec1803bbd9 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191aaca310>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:56.899149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:56.899610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:56.900423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:56.900842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:57.121536 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-58d9449f-16ba-4c8f-9941-fbec1803bbd9 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/37aa6fbd-0837-44fb-b278-73255e37695e" status: 200 len: 247 microversion: 2.1 time: 0.233537 Aug 04 04:24:57.122346 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 341/685] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:24:56 2022] GET /compute/v2.1/os-security-groups/37aa6fbd-0837-44fb-b278-73255e37695e => generated 247 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:57.148202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b158682b-ccbb-4ff9-9165-ca33c3d22ab5 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191ae60dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1932070575", "description": "tempest-description-1315213940"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:57.209552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:57.224188 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-048d0af6-09e9-4306-a8c4-3c9e2fac228a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.349259 Aug 04 04:24:57.228308 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 345/686] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:56 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:57.264001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:57.264911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:57.272513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:57.273489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:57.274527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:57.275239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:57.581686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:57.596635 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0c9a21af-3870-4004-9a20-7ca30e08c151 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.333081 Aug 04 04:24:57.598357 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 346/687] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:57 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:24:57.608512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b42543ca-ad07-4f5a-bae3-0205c554c32b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a3eaee0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:57.669868 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b42543ca-ad07-4f5a-bae3-0205c554c32b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.070065 Aug 04 04:24:57.670610 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 347/688] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:57 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:57.677061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:57.678180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:57.700009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:57.702670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:57.703876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:57.704634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:57.757680 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b158682b-ccbb-4ff9-9165-ca33c3d22ab5 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.619276 Aug 04 04:24:57.758781 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 342/689] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:24:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:57.772365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd1a8c4a-6bbf-4674-8e4a-a1d955e7c132 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191ab65790>, body: {"security_group_rule": {"parent_group_id": "72a4e68f-cbb5-4817-b8c0-ac100cc65d9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:57.856508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:57.879059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:57.882494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:57.889267 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba9636f3-33b4-468b-8e16-852c4550b060 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1417 microversion: 2.75 time: 0.217566 Aug 04 04:24:57.890367 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 348/690] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:57 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1417 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:57.917861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:57.918702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:57.928730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:57.929647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:57.930864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:57.932408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:58.508088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:58.522098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:58.524142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:58.531979 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f074ed6-99f3-4ea1-a8af-004de27a534e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.621822 Aug 04 04:24:58.534046 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 349/691] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:57 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:58.547127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-89f7ef9d-98b5-4e79-a581-636214c77a7c req-44f4f0bd-145a-4eab-ba61-1bb67263f236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc62ae1d-558b-47d6-8dea-d1f284aa6b79", "name": "network-vif-plugged", "status": "completed", "tag": "993a8c11-c3ba-444f-8b3d-f8a5dc0c98be"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:58.561446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:24:58.580793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-89f7ef9d-98b5-4e79-a581-636214c77a7c req-44f4f0bd-145a-4eab-ba61-1bb67263f236 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:58.581824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-89f7ef9d-98b5-4e79-a581-636214c77a7c req-44f4f0bd-145a-4eab-ba61-1bb67263f236 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:58.630698 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bd1a8c4a-6bbf-4674-8e4a-a1d955e7c132 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.862750 Aug 04 04:24:58.631390 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 343/692] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:24:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:24:58.637614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-736a070d-60ae-4411-9006-1da5ee6a7584 req-3cafda76-9331-48cf-8ec0-d288bf9729d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47b14c1-c8b1-4fdf-b601-48b469cda68e", "tag": "64e2eaf4-f301-4449-9ef9-f80bf581a3cf"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:58.649064 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-89f7ef9d-98b5-4e79-a581-636214c77a7c req-44f4f0bd-145a-4eab-ba61-1bb67263f236 service nova] Creating event network-vif-plugged:993a8c11-c3ba-444f-8b3d-f8a5dc0c98be for instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 on n-h2-851337-5 Aug 04 04:24:58.663885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-736a070d-60ae-4411-9006-1da5ee6a7584 req-3cafda76-9331-48cf-8ec0-d288bf9729d2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:58.668752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-89f7ef9d-98b5-4e79-a581-636214c77a7c req-44f4f0bd-145a-4eab-ba61-1bb67263f236 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133220 Aug 04 04:24:58.672421 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 350/693] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:58.681049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-736a070d-60ae-4411-9006-1da5ee6a7584 req-3cafda76-9331-48cf-8ec0-d288bf9729d2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:58.691950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:58.693554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:58.705025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:58.706039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:58.707299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:58.707933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:58.709450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-736a070d-60ae-4411-9006-1da5ee6a7584 req-3cafda76-9331-48cf-8ec0-d288bf9729d2 service nova] Creating event network-changed:64e2eaf4-f301-4449-9ef9-f80bf581a3cf for instance b47b14c1-c8b1-4fdf-b601-48b469cda68e on n-h2-851337-5 Aug 04 04:24:58.736005 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-736a070d-60ae-4411-9006-1da5ee6a7584 req-3cafda76-9331-48cf-8ec0-d288bf9729d2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102689 Aug 04 04:24:58.737049 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 344/694] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:58.745124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:58.746599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:58.754089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:58.754927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:58.756096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:58.756698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:59.148528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.159019 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6776dfac-0a93-4b15-94ee-fcb02ffc3bb6 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.420534 Aug 04 04:24:59.162448 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 345/695] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:58 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:59.174758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b160f5d-d0b8-4f7a-9fb1-0a604fe96582 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Action: 'create', calling method: .version_select at 0x7f191aacaf70>, body: {"security_group_rule": {"parent_group_id": "72a4e68f-cbb5-4817-b8c0-ac100cc65d9d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:24:59.262704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.273064 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cf98b8e-63af-4805-9729-ea7b57e0cc8f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.599010 Aug 04 04:24:59.273647 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 351/696] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:24:58 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:59.279066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e9a5011e-bd8d-49f8-81eb-afe5df7f4a54 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a5b68b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:59.355588 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e9a5011e-bd8d-49f8-81eb-afe5df7f4a54 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.079419 Aug 04 04:24:59.356593 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 352/697] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:24:59 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:24:59.368049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:59.368720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:59.382092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:59.385047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:59.389058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:59.390151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:59.604025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.618268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.621323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.628340 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca74b584-264c-4a90-a575-e0cdd7365c83 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1417 microversion: 2.75 time: 0.269557 Aug 04 04:24:59.629564 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 353/698] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:59 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1417 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:59.635221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:59.636764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:24:59.644540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:59.645306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:59.646411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:24:59.647700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:24:59.886826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.898866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.904401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:24:59.905529 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f988292-3e34-4922-85f6-99048e107e22 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.274737 Aug 04 04:24:59.908075 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 354/699] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:24:59 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:24:59.909966 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b160f5d-d0b8-4f7a-9fb1-0a604fe96582 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.745993 Aug 04 04:24:59.911943 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 346/700] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:24:59 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:24:59.922697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c361cc1f-98c8-4fed-bbb2-8e27451f3cda tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191a3fd430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:24:59.988932 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c361cc1f-98c8-4fed-bbb2-8e27451f3cda tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/72a4e68f-cbb5-4817-b8c0-ac100cc65d9d" status: 200 len: 665 microversion: 2.1 time: 0.069916 Aug 04 04:24:59.989520 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 355/701] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:24:59 2022] GET /compute/v2.1/os-security-groups/72a4e68f-cbb5-4817-b8c0-ac100cc65d9d => generated 665 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:00.002281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f412ac52-fa4b-4308-acd0-04483be9eaf1 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191aa88790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.189291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.190159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:00.191375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f412ac52-fa4b-4308-acd0-04483be9eaf1 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-group-rules/86f3c4a6-71e4-4b47-b882-b3d16b50436c" status: 202 len: 0 microversion: 2.1 time: 0.190176 Aug 04 04:25:00.196021 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 347/702] 10.222.0.69 () {58 vars in 1287 bytes} [Thu Aug 4 04:24:59 2022] DELETE /compute/v2.1/os-security-group-rules/86f3c4a6-71e4-4b47-b882-b3d16b50436c => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:00.202906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2c09428-1039-4099-9243-c46ac8dbeb9f tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191aad3a60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.230090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.233209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.236616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.237544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.471421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:00.489408 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-51ed4c8e-d695-4dee-838c-d23f840fdbe7 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1322 microversion: 2.1 time: 0.304784 Aug 04 04:25:00.504941 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 356/703] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:00 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:00.519032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.520755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:00.529871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.530495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.531708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.532470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.567804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2c09428-1039-4099-9243-c46ac8dbeb9f tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/72a4e68f-cbb5-4817-b8c0-ac100cc65d9d" status: 202 len: 0 microversion: 2.1 time: 0.370324 Aug 04 04:25:00.568670 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 348/704] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:25:00 2022] DELETE /compute/v2.1/os-security-groups/72a4e68f-cbb5-4817-b8c0-ac100cc65d9d => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:00.577803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a29ef994-2bf6-4e93-86db-cda0e61df83d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aad34c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.679517 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a29ef994-2bf6-4e93-86db-cda0e61df83d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.102427 Aug 04 04:25:00.681069 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 349/705] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:00 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:00.687782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c37e2ab-a497-47aa-838d-89784085f024 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191aad31f0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.723835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-9c37e2ab-a497-47aa-838d-89784085f024 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:25:00.724417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-9c37e2ab-a497-47aa-838d-89784085f024 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Neutron security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:25:00.724949 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-9c37e2ab-a497-47aa-838d-89784085f024 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] HTTP exception thrown: Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist Aug 04 04:25:00.724949 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-42c112d4-3522-4363-beb4-37a6ae51ef7c'] Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c37e2ab-a497-47aa-838d-89784085f024 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Request method failure captured: Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-security-groups/c54b7423-4b1d-4bef-b3cc-a5c373977b87 HTTP/1.1 Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60oPkkWfgdxrvOGfmgTM994AQ5fdXfGG-_rqhLUzNlU8x57SnGMKdc8AILmUPqHKoe45jEy4yC0SMHhcSUwuMNGaIKoL0e7e6KEo_D10aPd2oC9M6_bmVn0pz_QGTQeGeN0WVORlFIDLHKWsPEb-UUgdhhoOwfWwtC9Rz8n62H4hKMg Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f1ee8e42859b42e7a42ecadbb2049a48 Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-324302502 Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:25:00.735161 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f1ee8e42859b42e7a42ecadbb2049a48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f1ee8e42859b42e7a42ecadbb2049a48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f1ee8e42859b42e7a42ecadbb2049a48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f1ee8e42859b42e7a42ecadbb2049a48", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupRulesTestJSON-324302502 Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f1ee8e42859b42e7a42ecadbb2049a48 Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-324302502 Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupRulesTestJSON-324302502-project Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c8379479506a4b7d94d3147a3fd86271 Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupRulesTestJSON-324302502-project Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-42c112d4-3522-4363-beb4-37a6ae51ef7c'] Aug 04 04:25:00.736844 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'c54b7423-4b1d-4bef-b3cc-a5c373977b87'} Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:25:00.737817 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42c112d4-3522-4363-beb4-37a6ae51ef7c'] Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:25:00.739126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42c112d4-3522-4363-beb4-37a6ae51ef7c'] Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42c112d4-3522-4363-beb4-37a6ae51ef7c'] Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:00.740520 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:00.742017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:00.742017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:00.742017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:00.742017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:00.742017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist Aug 04 04:25:00.742017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42c112d4-3522-4363-beb4-37a6ae51ef7c'] Aug 04 04:25:00.742017 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:00.743740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c37e2ab-a497-47aa-838d-89784085f024 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Returning 404 to user: Security group c54b7423-4b1d-4bef-b3cc-a5c373977b87 does not exist Aug 04 04:25:00.743740 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-42c112d4-3522-4363-beb4-37a6ae51ef7c'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:00.744622 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c37e2ab-a497-47aa-838d-89784085f024 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/c54b7423-4b1d-4bef-b3cc-a5c373977b87" status: 404 len: 194 microversion: 2.1 time: 0.062210 Aug 04 04:25:00.745200 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 350/706] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:25:00 2022] DELETE /compute/v2.1/os-security-groups/c54b7423-4b1d-4bef-b3cc-a5c373977b87 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:25:00.796857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:00.805417 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d048ac0-649b-49ab-9b83-a788873dd7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1476 microversion: 2.1 time: 0.298665 Aug 04 04:25:00.806376 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 357/707] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:00 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:00.811839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.812739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:00.818880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.819417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.820352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.820797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.894232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84a7301b-4049-4961-8916-7407bc9487d9 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191a9f9f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.897137 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:00.897137 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:00.898240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84a7301b-4049-4961-8916-7407bc9487d9 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.898693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84a7301b-4049-4961-8916-7407bc9487d9 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.903119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:00.904342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84a7301b-4049-4961-8916-7407bc9487d9 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.904981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84a7301b-4049-4961-8916-7407bc9487d9 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.915377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:00.917093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:00.924097 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c1c2aa9-f57b-4832-b9c0-e462c8f4b13e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1417 microversion: 2.75 time: 0.116246 Aug 04 04:25:00.933671 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84a7301b-4049-4961-8916-7407bc9487d9 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.187233 Aug 04 04:25:00.934856 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 351/708] 10.222.0.69 () {58 vars in 1128 bytes} [Thu Aug 4 04:25:00 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:00.941119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-085ee30d-cd32-4e9f-9168-5be056421045 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191aa07dc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.942191 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 358/709] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:00 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1417 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:00.951238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:00.952418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:00.963669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.964991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:00.966296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:00.967342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:01.347192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:01.362216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:01.364934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:01.366334 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-80f97c09-e177-4c0b-bfb3-ae09ca77fbe0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.423105 Aug 04 04:25:01.367673 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 359/710] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:00 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:01.373882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-905ef77e-cfb7-46e6-bdc0-6f9a0176e6f3 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191a250a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:01.376899 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:01.376899 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:25:01.378755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-905ef77e-cfb7-46e6-bdc0-6f9a0176e6f3 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:01.379874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-905ef77e-cfb7-46e6-bdc0-6f9a0176e6f3 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:01.381090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-905ef77e-cfb7-46e6-bdc0-6f9a0176e6f3 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:01.381835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-905ef77e-cfb7-46e6-bdc0-6f9a0176e6f3 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:01.431398 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-905ef77e-cfb7-46e6-bdc0-6f9a0176e6f3 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.062311 Aug 04 04:25:01.432339 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 360/711] 10.222.0.69 () {58 vars in 1139 bytes} [Thu Aug 4 04:25:01 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:01.443788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c6da26f6-5ad6-4460-9b2f-3c0205fdf49d tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191a3fd160>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:01.446410 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:01.446410 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:25:01.447757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6da26f6-5ad6-4460-9b2f-3c0205fdf49d tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:01.448458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6da26f6-5ad6-4460-9b2f-3c0205fdf49d tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:01.449962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6da26f6-5ad6-4460-9b2f-3c0205fdf49d tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:01.450397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6da26f6-5ad6-4460-9b2f-3c0205fdf49d tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:01.515632 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-085ee30d-cd32-4e9f-9168-5be056421045 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/37aa6fbd-0837-44fb-b278-73255e37695e" status: 202 len: 0 microversion: 2.1 time: 0.579457 Aug 04 04:25:01.516509 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 352/712] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:25:00 2022] DELETE /compute/v2.1/os-security-groups/37aa6fbd-0837-44fb-b278-73255e37695e => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:01.521630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:01.522337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:01.530121 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c6da26f6-5ad6-4460-9b2f-3c0205fdf49d tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.090346 Aug 04 04:25:01.532720 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 361/713] 10.222.0.69 () {58 vars in 1145 bytes} [Thu Aug 4 04:25:01 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:25:01.535203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:01.537844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:01.539845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:01.541486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:01.541921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a56a662b-e5d5-4a52-a2a0-dd3a86ef0515 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191a3abaf0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:01.958946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:01.970098 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95d3c197-c3e2-4590-9601-50b3ea73476a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1471 microversion: 2.1 time: 0.452679 Aug 04 04:25:01.970673 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 353/714] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:01 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:01.980009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f151e310-8211-4194-87ca-c71efa1c3c52 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191aad3670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:01.996880 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:01.996880 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:01.998815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f151e310-8211-4194-87ca-c71efa1c3c52 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:01.999296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f151e310-8211-4194-87ca-c71efa1c3c52 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.000108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f151e310-8211-4194-87ca-c71efa1c3c52 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.000541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f151e310-8211-4194-87ca-c71efa1c3c52 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.081088 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f151e310-8211-4194-87ca-c71efa1c3c52 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.106151 Aug 04 04:25:02.085821 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 354/715] 10.222.0.69 () {58 vars in 1128 bytes} [Thu Aug 4 04:25:01 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:02.094085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32647897-a9c5-4183-8b7c-afc345012a54 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a9f9b80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:02.156364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-32647897-a9c5-4183-8b7c-afc345012a54 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.067189 Aug 04 04:25:02.157353 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 355/716] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:02 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:02.162180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:02.163101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:02.170619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.171579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.173273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.173999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.353696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a56a662b-e5d5-4a52-a2a0-dd3a86ef0515 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/8a07c94b-4ef2-4997-af97-52b0ee166f14" status: 202 len: 0 microversion: 2.1 time: 0.819356 Aug 04 04:25:02.354511 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 362/717] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:25:01 2022] DELETE /compute/v2.1/os-security-groups/8a07c94b-4ef2-4997-af97-52b0ee166f14 => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:02.359745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:02.360346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:02.366651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.367142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.367924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.368365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.478486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:02.491112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:02.493018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:02.507737 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48c04153-7100-41ce-903a-d1c5be52a837 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1438 microversion: 2.75 time: 0.151001 Aug 04 04:25:02.510644 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 363/718] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:02 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1438 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:02.517091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:02.518228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:02.524679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.525501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.526508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.528035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.541131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:02.554227 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e2f2cbbb-2e1b-4818-9eb6-c575b65abd65 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1475 microversion: 2.1 time: 0.394506 Aug 04 04:25:02.556186 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 356/719] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:02 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1475 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:02.561745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92c0f318-e905-44ee-947d-d46d0d25cf37 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191ae220d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:02.564725 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:02.564725 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:02.566164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92c0f318-e905-44ee-947d-d46d0d25cf37 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.567624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92c0f318-e905-44ee-947d-d46d0d25cf37 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.568833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92c0f318-e905-44ee-947d-d46d0d25cf37 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.569484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92c0f318-e905-44ee-947d-d46d0d25cf37 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.589491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lazy-loading 'flavor' on Instance uuid dc62ae1d-558b-47d6-8dea-d1f284aa6b79 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:02.610210 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92c0f318-e905-44ee-947d-d46d0d25cf37 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.052709 Aug 04 04:25:02.611210 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 357/720] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:25:02 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:02.616747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fedf50a8-9e34-48e2-8635-b233bc4ec1e1 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191a9f9e50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:02.691713 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3dd827bc-3ec0-40fa-a5ae-2ad0cab7d806 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79/action" status: 202 len: 0 microversion: 2.1 time: 0.178038 Aug 04 04:25:02.692747 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 364/721] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:25:02 2022] POST /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:02.699102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:02.699819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:02.709645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.710095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.711193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:02.711387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:02.741255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:03.065753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:03.083280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:03.083280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:03.083280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-023456ce-73d7-45e1-b19d-7af10b2941d6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.382901 Aug 04 04:25:03.092280 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 365/722] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:02 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:03.098729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:03.101435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:03.117971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.119102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.119330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.119947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.259739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:25:03.260068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:25:03.261049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:25:03.261506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:25:03.261966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:25:03.285035 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fedf50a8-9e34-48e2-8635-b233bc4ec1e1 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/3ccf2c67-a2ba-48ef-9b8f-6faa66823291" status: 202 len: 0 microversion: 2.1 time: 0.672366 Aug 04 04:25:03.285709 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 358/723] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:25:02 2022] DELETE /compute/v2.1/os-security-groups/3ccf2c67-a2ba-48ef-9b8f-6faa66823291 => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:03.293170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56b5abf2-5248-4cc1-95f8-00248d36e851 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191aad3310>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:03.296602 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:03.296602 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:03.298101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56b5abf2-5248-4cc1-95f8-00248d36e851 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.298907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56b5abf2-5248-4cc1-95f8-00248d36e851 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.300740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56b5abf2-5248-4cc1-95f8-00248d36e851 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.301378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56b5abf2-5248-4cc1-95f8-00248d36e851 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.340032 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56b5abf2-5248-4cc1-95f8-00248d36e851 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.052651 Aug 04 04:25:03.341198 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 359/724] 10.222.0.69 () {58 vars in 1128 bytes} [Thu Aug 4 04:25:03 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:03.351813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-39411a6c-357c-4aca-9ad8-66cb0ff93309 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:03.352893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-39411a6c-357c-4aca-9ad8-66cb0ff93309 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:03.361770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39411a6c-357c-4aca-9ad8-66cb0ff93309 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.362616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39411a6c-357c-4aca-9ad8-66cb0ff93309 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.363671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39411a6c-357c-4aca-9ad8-66cb0ff93309 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.364332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39411a6c-357c-4aca-9ad8-66cb0ff93309 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.376918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:03.387372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.388152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.392595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.393025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.561867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:03.570876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:03.572423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:03.591394 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e7882cd1-a77b-4656-89ac-0f4b72f37172 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "POST /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee/action" status: 202 len: 1495 microversion: 2.75 time: 0.498175 Aug 04 04:25:03.595971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 366/725] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:25:03 2022] POST /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee/action => generated 1495 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 04:25:03.603039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4164e7b3-acde-4ee1-bc6e-8033e73b818f req-d5577c59-e805-4e48-a066-eae9bda585d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce46d12e-0073-4f73-86fa-25bf2aac23f6", "name": "network-vif-unplugged", "status": "completed", "tag": "03e5c638-30f6-4365-bbec-9c7499d43113"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:03.615078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4164e7b3-acde-4ee1-bc6e-8033e73b818f req-d5577c59-e805-4e48-a066-eae9bda585d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:03.615770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4164e7b3-acde-4ee1-bc6e-8033e73b818f req-d5577c59-e805-4e48-a066-eae9bda585d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:03.632782 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4164e7b3-acde-4ee1-bc6e-8033e73b818f req-d5577c59-e805-4e48-a066-eae9bda585d6 service nova] Creating event network-vif-unplugged:03e5c638-30f6-4365-bbec-9c7499d43113 for instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 on n-h2-851337-5 Aug 04 04:25:03.646494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-4164e7b3-acde-4ee1-bc6e-8033e73b818f req-d5577c59-e805-4e48-a066-eae9bda585d6 service nova] Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:25:03.662345 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4164e7b3-acde-4ee1-bc6e-8033e73b818f req-d5577c59-e805-4e48-a066-eae9bda585d6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064538 Aug 04 04:25:03.664312 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 367/726] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:03.671309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6c2531c0-93ed-45d2-b945-9e1b52ea8375 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a28e700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:03.739055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6c2531c0-93ed-45d2-b945-9e1b52ea8375 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.073486 Aug 04 04:25:03.740126 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 368/727] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:03 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:03.746255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bcee6ef8-feac-40bb-b491-23d436fa3ce8 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191a266280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:03.853985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=28 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:04.235657 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-39411a6c-357c-4aca-9ad8-66cb0ff93309 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1613 microversion: 2.1 time: 0.893172 Aug 04 04:25:04.251106 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 360/728] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:03 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1613 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:04.257419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b41a4631-7ffe-45c9-a6d6-77ac89f66e99 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191ab65790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:04.258473 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:04.258473 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:04.265599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b41a4631-7ffe-45c9-a6d6-77ac89f66e99 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.266289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b41a4631-7ffe-45c9-a6d6-77ac89f66e99 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.280868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b41a4631-7ffe-45c9-a6d6-77ac89f66e99 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.281620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b41a4631-7ffe-45c9-a6d6-77ac89f66e99 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.306741 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b41a4631-7ffe-45c9-a6d6-77ac89f66e99 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-h2-851337-5" status: 200 len: 729 microversion: 2.1 time: 0.053965 Aug 04 04:25:04.307985 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 361/729] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Aug 4 04:25:04 2022] GET /compute/v2.1/os-hosts/n-h2-851337-5 => generated 729 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:04.315867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:04.316745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:04.323550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.324246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.325363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.325957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.390592 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bcee6ef8-feac-40bb-b491-23d436fa3ce8 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/6379ad78-7845-425c-92a4-7fae66632a80" status: 202 len: 0 microversion: 2.1 time: 0.647636 Aug 04 04:25:04.392021 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 369/730] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:25:03 2022] DELETE /compute/v2.1/os-security-groups/6379ad78-7845-425c-92a4-7fae66632a80 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:04.404147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:04.404987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:04.412268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.412808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.413651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.414257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.442913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=20 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:04.570101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:04.589919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:04.591293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:04.605619 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd0cdc20-9c94-4a50-93bf-708fd8699a6f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.206138 Aug 04 04:25:04.623782 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 370/731] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:04 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:04.630826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:04.631825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:04.638830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.645450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.646366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.646814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.830811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:04.840120 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8811525-d617-408a-8fd9-a8f1fabc6103 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1475 microversion: 2.1 time: 0.530826 Aug 04 04:25:04.859718 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 362/732] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:04 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1475 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:04.886781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:04.887320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:04.905017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.905470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.906264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.906699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:04.946346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:04.959477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:04.961119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:04.962288 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8cf2532d-38e8-4d2f-ac62-d5ce47d4222d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.338492 Aug 04 04:25:04.968716 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 371/733] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:04 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:04.975686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6bce3247-d6cf-4143-a06a-202880e45ea6 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Calling method '.version_select at 0x7f191a266d30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:04.976580 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:04.976580 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:25:04.994485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bce3247-d6cf-4143-a06a-202880e45ea6 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:04.994880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bce3247-d6cf-4143-a06a-202880e45ea6 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:05.015171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bce3247-d6cf-4143-a06a-202880e45ea6 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:05.015877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bce3247-d6cf-4143-a06a-202880e45ea6 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:05.026224 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] HTTP exception thrown: Cannot 'migrate' instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 while it is in vm_state suspended Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Request method failure captured: Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79/action HTTP/1.1 Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 15 Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60n2cHtAEqrIxYtnvk6SIl-fEHLC3SupSw3Dv-CgzMKyhdSr1H1JcdbMFeUYyVrFpuQL4J3fKm0vtmON7V7L2NVkgC7-lfBJCQAY2BgrdrGKzKveDa9Uo3S91ZVbd-hdNt6WreDbssaacv0RKNYIIAVJjztQzopZQPwSf5mOqtdOyfs Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 04:25:05.029086 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5c205d143aeb4ab58866488228693c2d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: ffd0ca2bff8f43e3bfe9ec24dc77d287 Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: {"migrate": {}} Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:25:05.030649 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'migrate' instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 while it is in vm_state suspended Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'dc62ae1d-558b-47d6-8dea-d1f284aa6b79', 'body': {'migrate': {}}} Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 in vm_state suspended. Cannot resize while the instance is in this state. Aug 04 04:25:05.031615 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 while it is in vm_state suspended Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.033050 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.034508 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.034508 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.034508 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:05.034508 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:05.034508 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 while it is in vm_state suspended Aug 04 04:25:05.034508 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.035883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Returning 409 to user: Cannot 'migrate' instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 while it is in vm_state suspended {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:05.036916 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1fd5d0a0-2a77-4acb-98f7-d5773417d8a4 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79/action" status: 409 len: 148 microversion: 2.1 time: 0.175211 Aug 04 04:25:05.038676 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 363/734] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:25:04 2022] POST /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79/action => generated 148 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:25:05.044576 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6bce3247-d6cf-4143-a06a-202880e45ea6 tempest-HostsAdminTestJSON-1438834879 tempest-HostsAdminTestJSON-1438834879-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-h1-851337-5" status: 200 len: 860 microversion: 2.1 time: 0.074690 Aug 04 04:25:05.045632 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 372/735] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Aug 4 04:25:04 2022] GET /compute/v2.1/os-hosts/n-h1-851337-5 => generated 860 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:05.051966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6798af76-1067-48e8-be67-dd3c05b6a208 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] Calling method '.version_select at 0x7f191aad3a60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:05.064393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03a2d849-48df-437c-8eda-51abd1ccc0a7 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a5b68b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:05.128806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03a2d849-48df-437c-8eda-51abd1ccc0a7 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.081869 Aug 04 04:25:05.139674 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 373/736] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:05 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:05.144831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c07f3984-a3d1-43fa-94e7-4845391e7395 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c07f3984-a3d1-43fa-94e7-4845391e7395 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Request method failure captured: Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008/action HTTP/1.1 Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 39 Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n2cHtAEqrIxYtnvk6SIl-fEHLC3SupSw3Dv-CgzMKyhdSr1H1JcdbMFeUYyVrFpuQL4J3fKm0vtmON7V7L2NVkgC7-lfBJCQAY2BgrdrGKzKveDa9Uo3S91ZVbd-hdNt6WreDbssaacv0RKNYIIAVJjztQzopZQPwSf5mOqtdOyfs Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:25:05.148731 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5c205d143aeb4ab58866488228693c2d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ffd0ca2bff8f43e3bfe9ec24dc77d287 Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: {"os-resetState": {"state": "invalid"}} Aug 04 04:25:05.150286 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b95e2bb4-37ce-4790-a791-d9fd173d7008', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.151243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:25:05.153408 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 04:25:05.154712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.154712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c07f3984-a3d1-43fa-94e7-4845391e7395 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:05.155819 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c07f3984-a3d1-43fa-94e7-4845391e7395 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008/action" status: 400 len: 144 microversion: 2.1 time: 0.014711 Aug 04 04:25:05.156705 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 374/737] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:25:05 2022] POST /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008/action => generated 144 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:25:05.166786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d89b3e4d-5083-45f0-ba0b-9603bd9c4d40 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d89b3e4d-5083-45f0-ba0b-9603bd9c4d40 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Request method failure captured: Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008/action HTTP/1.1 Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 31 Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n2cHtAEqrIxYtnvk6SIl-fEHLC3SupSw3Dv-CgzMKyhdSr1H1JcdbMFeUYyVrFpuQL4J3fKm0vtmON7V7L2NVkgC7-lfBJCQAY2BgrdrGKzKveDa9Uo3S91ZVbd-hdNt6WreDbssaacv0RKNYIIAVJjztQzopZQPwSf5mOqtdOyfs Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:25:05.171987 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5c205d143aeb4ab58866488228693c2d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ffd0ca2bff8f43e3bfe9ec24dc77d287 Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: {"os-resetState": {"state": 1}} Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:25:05.173524 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b95e2bb4-37ce-4790-a791-d9fd173d7008', 'body': {'os-resetState': {'state': 1}}} Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 1 Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:05.174430 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 04:25:05.176021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.177407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d89b3e4d-5083-45f0-ba0b-9603bd9c4d40 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:05.178359 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d89b3e4d-5083-45f0-ba0b-9603bd9c4d40 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008/action" status: 400 len: 120 microversion: 2.1 time: 0.015972 Aug 04 04:25:05.180311 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 375/738] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:25:05 2022] POST /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:25:05.190539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a7a1abe-d668-4788-9a0a-49e622dafc05 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:05.194267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4a7a1abe-d668-4788-9a0a-49e622dafc05 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Failed to fetch instance by id 999 {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 04:25:05.195014 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4a7a1abe-d668-4788-9a0a-49e622dafc05 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a7a1abe-d668-4788-9a0a-49e622dafc05 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Request method failure captured: Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 37 Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n2cHtAEqrIxYtnvk6SIl-fEHLC3SupSw3Dv-CgzMKyhdSr1H1JcdbMFeUYyVrFpuQL4J3fKm0vtmON7V7L2NVkgC7-lfBJCQAY2BgrdrGKzKveDa9Uo3S91ZVbd-hdNt6WreDbssaacv0RKNYIIAVJjztQzopZQPwSf5mOqtdOyfs Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:25:05.197118 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5c205d143aeb4ab58866488228693c2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5c205d143aeb4ab58866488228693c2d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5c205d143aeb4ab58866488228693c2d Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1534808692 Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ffd0ca2bff8f43e3bfe9ec24dc77d287 Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1534808692-project-admin Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: {"os-resetState": {"state": "error"}} Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:25:05.199259 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 999 could not be found. Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:25:05.200150 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 04:25:05.201704 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:05.203192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a7a1abe-d668-4788-9a0a-49e622dafc05 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:05.215856 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4a7a1abe-d668-4788-9a0a-49e622dafc05 tempest-ServersAdminNegativeTestJSON-1534808692 tempest-ServersAdminNegativeTestJSON-1534808692-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018786 Aug 04 04:25:05.216949 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 376/739] 10.222.0.69 () {60 vars in 1179 bytes} [Thu Aug 4 04:25:05 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 04:25:05.225742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:05.226398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:05.236521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:05.237185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:05.238377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:05.239731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:05.275934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:25:05.395697 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-043df269-019d-41df-b6f6-6e21ee1056df tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 204 len: 0 microversion: 2.1 time: 0.173110 Aug 04 04:25:05.397057 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 377/740] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:25:05 2022] DELETE /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:05.405870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:05.407241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:05.417700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:05.418515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:05.419544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:05.420330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:05.970659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:05.987556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fc943c9c-3216-45bb-b531-dc16ec1db76a tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1468 microversion: 2.1 time: 0.586050 Aug 04 04:25:05.988666 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 378/741] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:05 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1468 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:06.007015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:06.007599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:06.021032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.022130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.026336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.027173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.031174 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6798af76-1067-48e8-be67-dd3c05b6a208 tempest-SecurityGroupRulesTestJSON-324302502 tempest-SecurityGroupRulesTestJSON-324302502-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/6c02864f-8a84-4c27-9f40-922c8f5a46aa" status: 202 len: 0 microversion: 2.1 time: 0.991119 Aug 04 04:25:06.035295 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 364/742] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:25:05 2022] DELETE /compute/v2.1/os-security-groups/6c02864f-8a84-4c27-9f40-922c8f5a46aa => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:06.040034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-46bd257d-edf5-40b8-b508-b78a177f5662 req-0a3dd9cf-6601-4986-91c7-36ec4d9ef22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce46d12e-0073-4f73-86fa-25bf2aac23f6", "tag": "03e5c638-30f6-4365-bbec-9c7499d43113"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:06.073293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-46bd257d-edf5-40b8-b508-b78a177f5662 req-0a3dd9cf-6601-4986-91c7-36ec4d9ef22b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.074442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-46bd257d-edf5-40b8-b508-b78a177f5662 req-0a3dd9cf-6601-4986-91c7-36ec4d9ef22b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.096426 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-46bd257d-edf5-40b8-b508-b78a177f5662 req-0a3dd9cf-6601-4986-91c7-36ec4d9ef22b service nova] Creating event network-changed:03e5c638-30f6-4365-bbec-9c7499d43113 for instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 on n-h2-851337-5 Aug 04 04:25:06.103466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-46bd257d-edf5-40b8-b508-b78a177f5662 req-0a3dd9cf-6601-4986-91c7-36ec4d9ef22b service nova] Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:25:06.118515 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-46bd257d-edf5-40b8-b508-b78a177f5662 req-0a3dd9cf-6601-4986-91c7-36ec4d9ef22b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081721 Aug 04 04:25:06.119873 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 365/743] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:06.141446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:06.143167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:06.165407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.166349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.167705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.168507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.203191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:06.222227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:06.223837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:06.234162 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50cee0fc-8872-4b5f-9503-3fb606664d39 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.227679 Aug 04 04:25:06.237396 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 379/744] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:05 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:06.246694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:06.247328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:06.275247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.275724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.276899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.277360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.547883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:06.562667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:06.563012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:06.564685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:06.566218 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9bdc09c2-47bb-410d-afe0-d7f8b8f2fa29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.323781 Aug 04 04:25:06.569109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:06.580336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 380/745] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:06 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:06.592515 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-790b95ca-1343-42df-84b0-d635ecfae740 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1473 microversion: 2.1 time: 0.457391 Aug 04 04:25:06.593081 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 366/746] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:06 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:06.606406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-933d518b-784a-412c-a415-808327e39ecf tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aa07e50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:06.607149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2968683d-db7e-4a40-805a-3553b529f341 req-c5749650-9625-48b4-a213-4e49e27c50c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47b14c1-c8b1-4fdf-b601-48b469cda68e", "name": "network-vif-plugged", "status": "completed", "tag": "64e2eaf4-f301-4449-9ef9-f80bf581a3cf"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:06.634138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2968683d-db7e-4a40-805a-3553b529f341 req-c5749650-9625-48b4-a213-4e49e27c50c2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:06.635363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2968683d-db7e-4a40-805a-3553b529f341 req-c5749650-9625-48b4-a213-4e49e27c50c2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:06.669067 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2968683d-db7e-4a40-805a-3553b529f341 req-c5749650-9625-48b4-a213-4e49e27c50c2 service nova] Creating event network-vif-plugged:64e2eaf4-f301-4449-9ef9-f80bf581a3cf for instance b47b14c1-c8b1-4fdf-b601-48b469cda68e on n-h2-851337-5 Aug 04 04:25:06.678400 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2968683d-db7e-4a40-805a-3553b529f341 req-c5749650-9625-48b4-a213-4e49e27c50c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092880 Aug 04 04:25:06.679511 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 381/747] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:06.714356 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-933d518b-784a-412c-a415-808327e39ecf tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.120106 Aug 04 04:25:06.723200 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 367/748] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:06 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:07.009520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:07.010226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:07.024830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.025345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:07.028835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.029673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:07.264527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:07.265141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:07.278411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.283276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:07.284335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.284972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:07.336399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:07.345207 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d367ca22-4202-4ce9-bcd6-87a86d42775b tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1468 microversion: 2.1 time: 0.340006 Aug 04 04:25:07.351427 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 382/749] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:07 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1468 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:07.389480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:07.405418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:07.407393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:07.412616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:07.414641 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5474f711-b4b8-4e96-b997-d0b6df7526e8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.154133 Aug 04 04:25:07.417993 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 368/750] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:07 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:25:07.621312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:07.621538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:07.621538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:07.632136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:07.638748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.639230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:07.640441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.641238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:07.652907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.655338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:07.657058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:07.661106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:08.281596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.290724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.305071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.306593 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3e5bb2c3-dee8-44d0-b05d-b5b6dc895654 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.715750 Aug 04 04:25:08.307744 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 383/751] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:07 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:08.312690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-632dbfd8-3cc6-4f8d-bba2-f6c88e628b0f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a266550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:08.333840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.345140 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6872fa9c-f0f6-4fe0-bac2-a2034e4caa25 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1473 microversion: 2.1 time: 0.733288 Aug 04 04:25:08.345140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 369/752] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:07 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1473 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:08.377866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:08.379167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:08.393599 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-632dbfd8-3cc6-4f8d-bba2-f6c88e628b0f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1421 microversion: 2.1 time: 0.084094 Aug 04 04:25:08.396629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:08.397047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:08.397822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:08.402561 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 384/753] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:08 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:08.403395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:08.441824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:08.442622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:08.456119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:08.456966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:08.460996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:08.465562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:08.656534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.658853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:08.673000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.674527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.690686 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d5a8890-1d2f-4494-ad30-66680b9b2620 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.252663 Aug 04 04:25:08.720539 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 385/754] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:08 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:08.856566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:08.867370 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e3322543-365b-429e-ad10-e6cf998586fe tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1468 microversion: 2.1 time: 0.493250 Aug 04 04:25:08.882795 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 370/755] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:08 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:09.072751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-07ee448b-dbb5-49f3-b95c-d4c8bb8a9fd8 req-3c4c2cfd-4550-4f7a-b4ff-eb7cdc2946a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc62ae1d-558b-47d6-8dea-d1f284aa6b79", "name": "network-vif-deleted", "tag": "993a8c11-c3ba-444f-8b3d-f8a5dc0c98be"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:09.088650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-07ee448b-dbb5-49f3-b95c-d4c8bb8a9fd8 req-3c4c2cfd-4550-4f7a-b4ff-eb7cdc2946a7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.089026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-07ee448b-dbb5-49f3-b95c-d4c8bb8a9fd8 req-3c4c2cfd-4550-4f7a-b4ff-eb7cdc2946a7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.297142 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-07ee448b-dbb5-49f3-b95c-d4c8bb8a9fd8 req-3c4c2cfd-4550-4f7a-b4ff-eb7cdc2946a7 service nova] Creating event network-vif-deleted:993a8c11-c3ba-444f-8b3d-f8a5dc0c98be for instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 on n-h2-851337-5 Aug 04 04:25:09.303880 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-07ee448b-dbb5-49f3-b95c-d4c8bb8a9fd8 req-3c4c2cfd-4550-4f7a-b4ff-eb7cdc2946a7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235459 Aug 04 04:25:09.305053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 386/756] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:09.334032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:09.335429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:09.341916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.342717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.343781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.344425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.364895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:09.365970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:09.379541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.380343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.381326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.381962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.716121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:09.727473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:09.730227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:09.731715 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e64d446a-66b0-4642-98fa-3c8ceed7cf24 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1362 microversion: 2.25 time: 0.401931 Aug 04 04:25:09.732940 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 371/757] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:09 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:09.739756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-99e1863c-4b1d-40ca-89cd-d82b18b4e802 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a9f9ca0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:09.767624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:09.777257 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-80e39942-645b-4671-bbf4-5d6314106dbf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1470 microversion: 2.1 time: 0.416326 Aug 04 04:25:09.803635 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 387/758] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:09 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1470 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:09.814092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:09.819783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:09.832795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.837541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.841692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.842264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.856647 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-99e1863c-4b1d-40ca-89cd-d82b18b4e802 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1430 microversion: 2.1 time: 0.122106 Aug 04 04:25:09.857349 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 372/759] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:09 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1430 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:09.883820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06624fa9-098b-4773-85ce-d34c536740ed tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:09.887202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06624fa9-098b-4773-85ce-d34c536740ed tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:09.897147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06624fa9-098b-4773-85ce-d34c536740ed tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.898589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06624fa9-098b-4773-85ce-d34c536740ed tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.899674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06624fa9-098b-4773-85ce-d34c536740ed tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:09.900767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06624fa9-098b-4773-85ce-d34c536740ed tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:09.968475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:09.988094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:09.995978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:10.016378 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-71017612-c5ca-40a8-8fdc-7f8154138aef tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.209853 Aug 04 04:25:10.018006 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 388/760] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:09 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:10.033011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cfabc0fc-0a43-45f0-bfef-342740285d91 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a33c940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:10.045082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06624fa9-098b-4773-85ce-d34c536740ed tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6/action" status: 204 len: 0 microversion: 2.1 time: 0.175965 Aug 04 04:25:10.048639 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 373/761] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:25:09 2022] POST /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6/action => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:10.061352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:10.064997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:10.084471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.085213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.086873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.089791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.129112 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cfabc0fc-0a43-45f0-bfef-342740285d91 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 200 len: 1430 microversion: 2.1 time: 0.109095 Aug 04 04:25:10.129795 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 389/762] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 1430 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:10.145521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:10.148308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:10.173637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.175506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.176484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.178780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.221545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.233512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.234062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lazy-loading 'fault' on Instance uuid dc62ae1d-558b-47d6-8dea-d1f284aa6b79 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:10.363790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:10.372543 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93aaac65-2136-4fc7-b9fa-5e8ecbc35ecf tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 200 len: 1312 microversion: 2.1 time: 0.320880 Aug 04 04:25:10.372987 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 374/763] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:10.398831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:10.399480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:10.412161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.412589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.413409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.413799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.700435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:10.709399 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15443620-0f24-4772-9b6d-9eb5831c4764 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1470 microversion: 2.1 time: 0.574481 Aug 04 04:25:10.724034 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 390/764] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1470 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:10.743768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:10.752450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1bd8f854-ba12-40f6-a0ae-7c55f74e78b3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1466 microversion: 2.1 time: 0.360179 Aug 04 04:25:10.767429 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 375/765] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1466 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:10.777008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:10.777921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:10.786838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.787578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.788540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:10.789143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:10.896592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-304b4f9b-3690-48f8-a85f-fcf31830429d tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:10.899070 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:10.899070 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:25:10.901060 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-304b4f9b-3690-48f8-a85f-fcf31830429d tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-304b4f9b-3690-48f8-a85f-fcf31830429d tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230-project-admin] Request method failure captured: Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60om_1FLs3oQUhyyZeEM-rd6sUsSWAqmIGloOXrjUcEUhwvU-TCZ0yGUig0NELmSm4HKl98VyEQrdyjG0fQXbVD-VitE6Aa_HCpe4Cn7lXS8hxMrlMoyLb4zMa_yJxFG3AacqCYcWecb24q4GH5guHHq04dwH3z2XxzDfgQq5_ru1ak Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 1663e110490b472bae33daeb9ab8c83e Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:25:10.906312 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1663e110490b472bae33daeb9ab8c83e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1663e110490b472bae33daeb9ab8c83e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1663e110490b472bae33daeb9ab8c83e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1663e110490b472bae33daeb9ab8c83e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 1663e110490b472bae33daeb9ab8c83e Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230-project-admin Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f394bd49c12b4bcbb768a6a0dfd36a42 Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230-project-admin Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:25:10.908000 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid timestamp for date invalid_time Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'invalid_time'} Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:10.908832 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 04 04:25:10.911420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:10.915827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-304b4f9b-3690-48f8-a85f-fcf31830429d tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:10.917576 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-304b4f9b-3690-48f8-a85f-fcf31830429d tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230 tempest-InstanceUsageAuditLogNegativeTestJSON-2117592230-project-admin] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.191483 Aug 04 04:25:10.918367 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 391/766] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:25:10.925455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cb8bbb3b-3958-4d37-a4b9-75ba5e7c788c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a2ba0d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:10.988387 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cb8bbb3b-3958-4d37-a4b9-75ba5e7c788c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/9aa8a0ec-360d-40bf-b352-1066adb51df0" status: 200 len: 784 microversion: 2.1 time: 0.068660 Aug 04 04:25:10.989817 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 392/767] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/images/9aa8a0ec-360d-40bf-b352-1066adb51df0 => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:11.137701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a9e9b23-9c93-43b2-af8e-11dcf9ce1071 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.138458 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:11.138458 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:25:11.139611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4a9e9b23-9c93-43b2-af8e-11dcf9ce1071 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '6feef26627b343c8a1e9a3cff4bb2259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b06e81199284956b8d95c0e121549a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a9e9b23-9c93-43b2-af8e-11dcf9ce1071 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Request method failure captured: Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60olIocxliNa7QaxmPZToimWUEUh011oE6C4OyqzBmAn-dbrjBl1-v6NCE__Emrjf3GHe_91iSNbtkwQGov8c0S3lw7c3cK7J_fWTIfBeCp_KSWmdNLywYDBI6m6tkCx1SRV3RArI7rA-xBZBMGThyrqllyfKIxp-NKpls-Z1iFqKr4 Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 0b06e81199284956b8d95c0e121549a1 Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:25:11.141319 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b06e81199284956b8d95c0e121549a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0b06e81199284956b8d95c0e121549a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b06e81199284956b8d95c0e121549a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0b06e81199284956b8d95c0e121549a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 0b06e81199284956b8d95c0e121549a1 Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6feef26627b343c8a1e9a3cff4bb2259 Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project Aug 04 04:25:11.142726 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: action_args: {} Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:25:11.143476 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 04:25:11.144766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.147128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a9e9b23-9c93-43b2-af8e-11dcf9ce1071 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:11.148334 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4a9e9b23-9c93-43b2-af8e-11dcf9ce1071 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.157402 Aug 04 04:25:11.153159 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 393/768] 10.222.0.69 () {58 vars in 1185 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:25:11.158030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca4751c0-6696-4eb8-bf46-2eff95361bf0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.166796 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca4751c0-6696-4eb8-bf46-2eff95361bf0 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012411 Aug 04 04:25:11.167967 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 394/769] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:25:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:11.178093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.178934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:11.185931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.186599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:11.187571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.188021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:11.267309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.275522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.277885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.278352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.279473 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fdb91900-3cd4-4df7-89d3-7153e69b9a1d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1558 microversion: 2.25 time: 0.509129 Aug 04 04:25:11.280609 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 376/770] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:10 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1558 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:11.285759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77f1d75a-a0c8-4981-b2cf-fb2c9976e32a tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.286610 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:11.286610 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:11.287996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77f1d75a-a0c8-4981-b2cf-fb2c9976e32a tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '6feef26627b343c8a1e9a3cff4bb2259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b06e81199284956b8d95c0e121549a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77f1d75a-a0c8-4981-b2cf-fb2c9976e32a tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Request method failure captured: Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2004:25:11 HTTP/1.1 Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60olIocxliNa7QaxmPZToimWUEUh011oE6C4OyqzBmAn-dbrjBl1-v6NCE__Emrjf3GHe_91iSNbtkwQGov8c0S3lw7c3cK7J_fWTIfBeCp_KSWmdNLywYDBI6m6tkCx1SRV3RArI7rA-xBZBMGThyrqllyfKIxp-NKpls-Z1iFqKr4 Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 0b06e81199284956b8d95c0e121549a1 Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:25:11.289955 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b06e81199284956b8d95c0e121549a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0b06e81199284956b8d95c0e121549a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b06e81199284956b8d95c0e121549a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0b06e81199284956b8d95c0e121549a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 0b06e81199284956b8d95c0e121549a1 Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6feef26627b343c8a1e9a3cff4bb2259 Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project Aug 04 04:25:11.291342 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '2022-08-04 04:25:11'} Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:25:11.291996 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 04:25:11.293122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.294882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77f1d75a-a0c8-4981-b2cf-fb2c9976e32a tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:11.295900 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77f1d75a-a0c8-4981-b2cf-fb2c9976e32a tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286 tempest-InstanceUsageAuditLogNegativeTestJSON-1129525286-project] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 04:25:11" status: 403 len: 128 microversion: 2.1 time: 0.014053 Aug 04 04:25:11.309140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 377/771] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:25:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2004%3A25%3A11 => generated 128 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:25:11.309299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.311601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:11.320218 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb52aaf4-1482-49c0-b367-887e14743479 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.150999 Aug 04 04:25:11.322054 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 395/772] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:11 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:11.330152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17ee230b-ecf7-48bc-9c99-c75b2435022a tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aad3310>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.345356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.346317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:11.357255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.358777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:11.360523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.361563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:11.475837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:11.624254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid b47b14c1-c8b1-4fdf-b601-48b469cda68e {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:11.646944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c09a6a5d-a7c8-47ea-99ee-cf4d96682d42 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 2051 microversion: 2.25 time: 0.322431 Aug 04 04:25:11.648268 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 396/773] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:11 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 2051 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:11.655535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.656401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: dc62ae1d-558b-47d6-8dea-d1f284aa6b79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:11.670330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:11.672244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.672711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:11.673594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.674615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:11.705203 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] HTTP exception thrown: Instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 could not be found. Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Request method failure captured: Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 HTTP/1.1 Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n1nuNK2neCVfEnBgCvxsWDh0CabZ-k2xoecT7TotY6cutkfdOAHdbGf_GlLf5o1LIeO8MbTO0FH6m2ELeGCzqNiieDqqoBeyQ9z1NG0MrsPU_8PV8VPBU5CzxoszALA32XsGgPNyuZyD-lkwuMPWILUJTtxdMaVp5nrzFJjwhKuxY Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 35738b32c46f438dbd72b3204cfcb474 Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-401164221 Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:25:11.708866 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/35738b32c46f438dbd72b3204cfcb474"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/35738b32c46f438dbd72b3204cfcb474"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/35738b32c46f438dbd72b3204cfcb474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_35738b32c46f438dbd72b3204cfcb474", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-401164221 Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 35738b32c46f438dbd72b3204cfcb474 Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-401164221 Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-401164221-project Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6ad16b7ab4cf4e008fe7c3f373140b8e Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-401164221-project Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 could not be found. Aug 04 04:25:11.710514 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'dc62ae1d-558b-47d6-8dea-d1f284aa6b79'} Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 could not be found. Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:11.711468 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 could not be found. Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 could not be found. Aug 04 04:25:11.712912 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:11.718427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Returning 404 to user: Instance dc62ae1d-558b-47d6-8dea-d1f284aa6b79 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:11.719582 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14bf4232-7ab8-4483-9a54-47012c683790 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79" status: 404 len: 111 microversion: 2.1 time: 0.069945 Aug 04 04:25:11.720520 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 397/774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:11 2022] GET /compute/v2.1/servers/dc62ae1d-558b-47d6-8dea-d1f284aa6b79 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:25:11.726240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:11.727086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:11.733618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.734134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:11.734935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:11.735440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.050564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid b47b14c1-c8b1-4fdf-b601-48b469cda68e {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:12.135997 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42abd53f-cdb5-4817-8e37-5e780cdfa8ae tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 2051 microversion: 2.25 time: 0.413302 Aug 04 04:25:12.137059 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 398/775] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:11 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 2051 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:12.143173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:12.144096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:12.176094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.177276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.179729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.181226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.264318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:25:12.470747 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-791aa7c5-795a-49fb-8754-9d6d6cea1047 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 204 len: 0 microversion: 2.1 time: 0.331693 Aug 04 04:25:12.471709 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 399/776] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:25:12 2022] DELETE /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:12.477779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:12.478472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:12.486257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.487174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.488770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.489213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.621362 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17ee230b-ecf7-48bc-9c99-c75b2435022a tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "DELETE /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 204 len: 0 microversion: 2.1 time: 1.300870 Aug 04 04:25:12.623221 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 378/777] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:11 2022] DELETE /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 0 bytes in 1312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:12.629894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-285817cf-91cc-4585-bb7d-d93259de6435 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:12.633728 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:12.633728 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:12.636338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285817cf-91cc-4585-bb7d-d93259de6435 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.636978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285817cf-91cc-4585-bb7d-d93259de6435 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.638253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285817cf-91cc-4585-bb7d-d93259de6435 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.646339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285817cf-91cc-4585-bb7d-d93259de6435 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.657192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=18 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:12.689844 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-285817cf-91cc-4585-bb7d-d93259de6435 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.064507 Aug 04 04:25:12.690451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:12.691451 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 379/778] 10.222.0.69 () {60 vars in 1217 bytes} [Thu Aug 4 04:25:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:25:12.697112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:12.698979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:12.707677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ed78436-6f31-4b1b-b78c-3c1e53500bb4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1462 microversion: 2.1 time: 0.234744 Aug 04 04:25:12.709015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 400/779] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:12 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1462 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:12.709551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.710418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.711520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.712098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.716144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:12.716761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:12.748833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.749280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.750080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.750513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.825740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:12.841236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:12.844441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:12.862278 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-833d5752-6831-4a65-acb2-f3ba506ae46d tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.169322 Aug 04 04:25:12.867247 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 380/780] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:12 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:12.874363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ea72b2b-8285-43e3-bcba-c9d8a1265929 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aad3ee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:12.913711 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-1ea72b2b-8285-43e3-bcba-c9d8a1265929 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] HTTP exception thrown: Image not found. Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ea72b2b-8285-43e3-bcba-c9d8a1265929 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Request method failure captured: Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 HTTP/1.1 Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60n3347_XsgkSKUFH9Z1kZb8aaMyajvhe1iNgmRjAovhv1IK1PTBY6quW2PHc1ifUkD79oZlmx9M1OdgPXxBRzex_kw7zp9nKqgt2Iv1U-1ZXlL720Noj7gQHxteQKTELMwo0RTDjo3SyX50SzS2xaj9tAQe9nCMyH2eeJX7rMEKIqo Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 57a51098088246149423af91de8d2167 Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:25:12.915966 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/57a51098088246149423af91de8d2167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/57a51098088246149423af91de8d2167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/57a51098088246149423af91de8d2167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_57a51098088246149423af91de8d2167", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 57a51098088246149423af91de8d2167 Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerTestJSON-726714051-project Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: aa8824426a46496aaaf6cc1640f18519 Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerTestJSON-726714051-project Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '15e5f790-ae0b-4c3d-80b4-f1b7e23d9024'} Aug 04 04:25:12.917587 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:25:12.918546 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:25:12.919740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 could not be found. Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:25:12.921122 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ea72b2b-8285-43e3-bcba-c9d8a1265929 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:12.922454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ea72b2b-8285-43e3-bcba-c9d8a1265929 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 404 len: 62 microversion: 2.1 time: 0.049342 Aug 04 04:25:12.926350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 381/781] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:12 2022] GET /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:25:12.930322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a3d5c323-c04b-4c50-ae85-2204ba758145 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:12.930856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a3d5c323-c04b-4c50-ae85-2204ba758145 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:12.943050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d5c323-c04b-4c50-ae85-2204ba758145 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.943729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d5c323-c04b-4c50-ae85-2204ba758145 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.944623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d5c323-c04b-4c50-ae85-2204ba758145 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:12.945049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d5c323-c04b-4c50-ae85-2204ba758145 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:12.973966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:12.987997 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8c0a7c9a-3ec7-4fd4-8567-fa134550f40c tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1477 microversion: 2.1 time: 0.274200 Aug 04 04:25:12.988628 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 401/782] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:12 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:13.004831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:13.005448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:13.018471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.018922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.019722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.020214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.115823 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a3d5c323-c04b-4c50-ae85-2204ba758145 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e/action" status: 202 len: 0 microversion: 2.25 time: 0.189982 Aug 04 04:25:13.116378 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 382/783] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:25:12 2022] POST /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:13.127927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62661968-4754-4e9c-9777-3d2e18fcef2d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-692820845"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:13.138001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62661968-4754-4e9c-9777-3d2e18fcef2d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:13.153517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62661968-4754-4e9c-9777-3d2e18fcef2d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.153973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62661968-4754-4e9c-9777-3d2e18fcef2d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.154752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62661968-4754-4e9c-9777-3d2e18fcef2d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.156287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62661968-4754-4e9c-9777-3d2e18fcef2d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.235576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:13.249643 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e60afb1-71df-4aa0-9e10-49842367b7ae tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1462 microversion: 2.1 time: 0.258886 Aug 04 04:25:13.263664 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 402/784] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:12 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1462 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:13.276736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e38c1d8d-da12-4266-9b89-6dd0195af4dc req-73ffc7e2-81cb-4a02-bd1b-5d907cc20ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead118c2-ebfb-4040-8a2a-7e89d2c504f2", "name": "network-vif-unplugged", "status": "completed", "tag": "e3085237-07be-47a5-adb5-78638b3d9288"}, {"server_uuid": "ce46d12e-0073-4f73-86fa-25bf2aac23f6", "name": "network-vif-plugged", "status": "completed", "tag": "03e5c638-30f6-4365-bbec-9c7499d43113"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:13.309654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e38c1d8d-da12-4266-9b89-6dd0195af4dc req-73ffc7e2-81cb-4a02-bd1b-5d907cc20ce4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.310281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e38c1d8d-da12-4266-9b89-6dd0195af4dc req-73ffc7e2-81cb-4a02-bd1b-5d907cc20ce4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.335278 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e38c1d8d-da12-4266-9b89-6dd0195af4dc req-73ffc7e2-81cb-4a02-bd1b-5d907cc20ce4 service nova] Creating event network-vif-unplugged:e3085237-07be-47a5-adb5-78638b3d9288 for instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 on n-h1-851337-5 Aug 04 04:25:13.336154 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e38c1d8d-da12-4266-9b89-6dd0195af4dc req-73ffc7e2-81cb-4a02-bd1b-5d907cc20ce4 service nova] Creating event network-vif-plugged:03e5c638-30f6-4365-bbec-9c7499d43113 for instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 on n-h2-851337-5 Aug 04 04:25:13.347315 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e38c1d8d-da12-4266-9b89-6dd0195af4dc req-73ffc7e2-81cb-4a02-bd1b-5d907cc20ce4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.081951 Aug 04 04:25:13.347957 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 403/785] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:13.353844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:13.355172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:13.362098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.362553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.363507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.363963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.460917 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62661968-4754-4e9c-9777-3d2e18fcef2d tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "POST /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2/action" status: 202 len: 0 microversion: 2.1 time: 0.338619 Aug 04 04:25:13.469140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 383/786] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:25:13 2022] POST /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:25:13.478982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-880a99d2-f82f-4253-bd4a-82f9a7d58e6c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'create', calling method: .version_select at 0x7f191a9b5f70>, body: {"keypair": {"name": "tempest-keypair-195827440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtDFe0pgBP8tGFfMKrWB6b7AadrQHv1NfubvkJYWEhYE8E8rjKgeL1EVg9CF+c/TZUtMlTRaf0tBCIStwPnIVK62PQfYSj8eEjSaeSVWNvrarqNUBhC7VnD8S/XkXiA4Q=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:13.498688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-880a99d2-f82f-4253-bd4a-82f9a7d58e6c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:25:13.503477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-880a99d2-f82f-4253-bd4a-82f9a7d58e6c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for user 80bef27d84824d25b096a8507009d824 and project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:25:13.534814 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-880a99d2-f82f-4253-bd4a-82f9a7d58e6c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061428 Aug 04 04:25:13.536509 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 384/787] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:25:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:13.542919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10aa7eaf-d8fa-4d37-a1ef-9c2810eb2772 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aad3d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:13.632861 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-10aa7eaf-d8fa-4d37-a1ef-9c2810eb2772 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.091579 Aug 04 04:25:13.634158 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 385/788] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:13 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:13.698752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid b47b14c1-c8b1-4fdf-b601-48b469cda68e {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:13.725855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-54b89b52-b362-42f4-bff9-2951a5de7161 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 2056 microversion: 2.25 time: 0.376656 Aug 04 04:25:13.741108 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 404/789] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:13 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 2056 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:13.894731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:13.895677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:13.904438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.905284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:13.906265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:13.907009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:14.012554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:14.013175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:14.023416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:14.024203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:14.025182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:14.025782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:14.367711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:14.383058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:14.386605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:14.398444 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a7dbcb6-91a5-4a2e-a62f-fe17e5645343 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.507622 Aug 04 04:25:14.400328 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 386/790] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:13 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:14.598073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:14.615481 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce3711d3-fb3a-4aa2-9886-62ea751c5fe1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1477 microversion: 2.1 time: 0.607604 Aug 04 04:25:14.616344 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 405/791] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:14 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1477 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:14.651714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a65f0ad4-f061-44ea-b3e4-710c95a567f4 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aad3790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:14.745213 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a65f0ad4-f061-44ea-b3e4-710c95a567f4 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.094435 Aug 04 04:25:14.754007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:14.754744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:14.762984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:14.766008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:14.766542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 387/792] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:14 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:14.769783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:14.771947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.194986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-078580f7-a34d-4978-ba1d-f3327085a9b2 req-5228fd48-c98a-4b12-811e-04fe9362a4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95e2bb4-37ce-4790-a791-d9fd173d7008", "name": "network-vif-deleted", "tag": "4ec4c4c0-7a37-4cf6-8d70-69044a2f9f8f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:15.209674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:15.219569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-078580f7-a34d-4978-ba1d-f3327085a9b2 req-5228fd48-c98a-4b12-811e-04fe9362a4f3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.220253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-078580f7-a34d-4978-ba1d-f3327085a9b2 req-5228fd48-c98a-4b12-811e-04fe9362a4f3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.235804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-078580f7-a34d-4978-ba1d-f3327085a9b2 req-5228fd48-c98a-4b12-811e-04fe9362a4f3 service nova] Creating event network-vif-deleted:4ec4c4c0-7a37-4cf6-8d70-69044a2f9f8f for instance b95e2bb4-37ce-4790-a791-d9fd173d7008 on n-h2-851337-5 Aug 04 04:25:15.243158 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-078580f7-a34d-4978-ba1d-f3327085a9b2 req-5228fd48-c98a-4b12-811e-04fe9362a4f3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056999 Aug 04 04:25:15.244405 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 388/793] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:15.244521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid b47b14c1-c8b1-4fdf-b601-48b469cda68e {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:15.287777 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-622e8687-715c-47a5-8f91-467175fb4fa9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 2036 microversion: 2.25 time: 0.539190 Aug 04 04:25:15.288367 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 406/794] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:14 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 2036 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:25:15.316999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851337-5", "block_migration": "auto"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:15.319807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:15.331332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.331790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.332723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.333266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.338871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:15.367973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'flavor' on Instance uuid b47b14c1-c8b1-4fdf-b601-48b469cda68e {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:15.386343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Going to try to live migrate instance to n-h1-851337-5 {{(pid=119343) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:25:15.426291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:15.427100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:15.439101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.439615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.440452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.440916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.555647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:15.571178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:15.573735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:15.592544 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20caef2a-bb79-43d1-a806-9e20d046cf46 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.172541 Aug 04 04:25:15.607467 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 407/795] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:15 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:15.642157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:15.643349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:15.661309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.662327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.663502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.666091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.807778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:15.809272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:15.810014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lazy-loading 'fault' on Instance uuid b95e2bb4-37ce-4790-a791-d9fd173d7008 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:15.955670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad16b7ab4cf4e008fe7c3f373140b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35738b32c46f438dbd72b3204cfcb474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:15.964317 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-51582e1a-f301-483a-9c95-a9b08dadaf82 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 200 len: 1311 microversion: 2.1 time: 0.327836 Aug 04 04:25:15.968065 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 408/796] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:15 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:15.983046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bce79e29-628c-4cf7-89f5-0edfeb838ac7 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a2ba0d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:16.061030 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bce79e29-628c-4cf7-89f5-0edfeb838ac7 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.088551 Aug 04 04:25:16.063111 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 409/797] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:15 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:16.072059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45aaeaf0-3a67-4b51-9abb-c9b02ed54385 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '.version_select at 0x7f191a23a1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:16.077576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45aaeaf0-3a67-4b51-9abb-c9b02ed54385 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:16.078456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45aaeaf0-3a67-4b51-9abb-c9b02ed54385 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:16.103602 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45aaeaf0-3a67-4b51-9abb-c9b02ed54385 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 1523 microversion: 2.1 time: 0.039177 Aug 04 04:25:16.105099 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 410/798] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:25:16 2022] GET /compute/v2.1/os-migrations => generated 1523 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:16.142297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57def146-46bd-4610-be02-b587c8037319 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:16.158457 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57def146-46bd-4610-be02-b587c8037319 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029029 Aug 04 04:25:16.164476 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 411/799] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:25:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:16.176560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45528e73-befd-4833-a93b-da7178559f5d tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1299350359", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:16.180651 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:16.180651 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:25:16.212207 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45528e73-befd-4833-a93b-da7178559f5d tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.037047 Aug 04 04:25:16.212838 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 412/800] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Aug 4 04:25:16 2022] POST /compute/v2.1/flavors => generated 499 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:25:16.224728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bf9b3872-b8f1-4373-926a-a9025605930f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:16.233741 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bf9b3872-b8f1-4373-926a-a9025605930f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012631 Aug 04 04:25:16.234612 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 413/801] 10.222.0.69 () {58 vars in 1182 bytes} [Thu Aug 4 04:25:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:25:16.415462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1207347565", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "c10aae03-88eb-4a05-a080-bc8a0e6bd35c"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:16.484016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:25:16.921856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:25:16.924087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:25:16.925182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:25:16.926564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:25:16.927228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:25:16.942447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:16.942904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:16.944275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:16.945077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:16.970072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:25:16.976594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for user 80bef27d84824d25b096a8507009d824 and project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:25:16.999767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:25:17.004641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:25:17.074129 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-75e730e4-095f-4111-80c7-1b202865105a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662936 Aug 04 04:25:17.080087 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 414/802] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:25:17.080351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:17.083205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:17.092562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:17.093259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:17.094453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:17.095098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:17.249621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:17.263680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:17.265199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:17.280450 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-976f7647-eab6-499c-9a28-73a376b4b6e4 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.203919 Aug 04 04:25:17.281797 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 415/803] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:17 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:17.291407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:17.293066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] [instance: b95e2bb4-37ce-4790-a791-d9fd173d7008] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:17.314014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:17.314446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:17.315278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:17.315715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:17.351643 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] HTTP exception thrown: Instance b95e2bb4-37ce-4790-a791-d9fd173d7008 could not be found. Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Request method failure captured: Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 HTTP/1.1 Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n1nuNK2neCVfEnBgCvxsWDh0CabZ-k2xoecT7TotY6cutkfdOAHdbGf_GlLf5o1LIeO8MbTO0FH6m2ELeGCzqNiieDqqoBeyQ9z1NG0MrsPU_8PV8VPBU5CzxoszALA32XsGgPNyuZyD-lkwuMPWILUJTtxdMaVp5nrzFJjwhKuxY Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 35738b32c46f438dbd72b3204cfcb474 Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-401164221 Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:25:17.361111 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/35738b32c46f438dbd72b3204cfcb474"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/35738b32c46f438dbd72b3204cfcb474"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/35738b32c46f438dbd72b3204cfcb474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_35738b32c46f438dbd72b3204cfcb474", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-401164221 Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 35738b32c46f438dbd72b3204cfcb474 Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-401164221 Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-401164221-project Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6ad16b7ab4cf4e008fe7c3f373140b8e Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-401164221-project Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance b95e2bb4-37ce-4790-a791-d9fd173d7008 could not be found. Aug 04 04:25:17.362797 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b95e2bb4-37ce-4790-a791-d9fd173d7008'} Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b95e2bb4-37ce-4790-a791-d9fd173d7008 could not be found. Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:17.363833 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b95e2bb4-37ce-4790-a791-d9fd173d7008 could not be found. Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b95e2bb4-37ce-4790-a791-d9fd173d7008 could not be found. Aug 04 04:25:17.365804 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:17.368514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] Returning 404 to user: Instance b95e2bb4-37ce-4790-a791-d9fd173d7008 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:17.368514 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1fc6f8e-6267-49ac-a282-ed52a440e8e1 tempest-ServersAdminNegativeTestJSON-401164221 tempest-ServersAdminNegativeTestJSON-401164221-project] 10.222.0.69 "GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008" status: 404 len: 111 microversion: 2.1 time: 0.082496 Aug 04 04:25:17.368514 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 416/804] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:17 2022] GET /compute/v2.1/servers/b95e2bb4-37ce-4790-a791-d9fd173d7008 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:25:17.378343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e9c2f0b-a332-48f0-9b8d-16c69b875cc7 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a355d30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:17.488904 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e9c2f0b-a332-48f0-9b8d-16c69b875cc7 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.119720 Aug 04 04:25:17.489499 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 417/805] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:17 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:17.500174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41be75ce-b630-4442-828e-6240ba7791d8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:17.500806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41be75ce-b630-4442-828e-6240ba7791d8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:17.619524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41be75ce-b630-4442-828e-6240ba7791d8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:17.630266 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41be75ce-b630-4442-828e-6240ba7791d8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1279 microversion: 2.1 time: 0.139675 Aug 04 04:25:17.631101 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 418/806] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:17 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:17.728089 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0dc8912e-e154-4e2a-800d-bc8a9eb98c38 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e/action" status: 202 len: 0 microversion: 2.25 time: 2.416900 Aug 04 04:25:17.728626 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 389/807] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:25:15 2022] POST /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e/action => generated 0 bytes in 2418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:25:17.738166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:17.739101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:17.754134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:17.755307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:17.756467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:17.758304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:18.138142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:18.148588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:18.155861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:18.158634 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-679e67f0-9d6b-455a-847f-65b098aafd4e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1568 microversion: 2.25 time: 0.425636 Aug 04 04:25:18.170987 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 419/808] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:17 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:18.310765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:18.311495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:18.322570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:18.323795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:18.324690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:18.325286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:18.418672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:18.434827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:18.438105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:18.447335 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35b3a9a1-0e24-4ad1-95dd-10a4d9a14049 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.141218 Aug 04 04:25:18.472476 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 390/809] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:18 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:18.506161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb72b1f5-4fa0-4217-945d-4a506988bf51 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a355820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:18.592492 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb72b1f5-4fa0-4217-945d-4a506988bf51 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.090871 Aug 04 04:25:18.602019 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 420/810] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:18 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:18.653483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:18.654600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:18.665457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:18.683492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:18.684420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:18.688988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:18.869102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:18.885947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46161ca0-db51-4f50-9f1b-f6aa67f4da15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1339 microversion: 2.1 time: 0.234762 Aug 04 04:25:18.901515 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 391/811] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:18 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:19.186736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:19.188887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:19.200320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:19.201067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:19.202086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:19.202811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:19.477639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:19.478294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:19.501720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:19.505694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:19.507930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:19.512018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:19.786170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:19.796260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:19.797791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:19.803398 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-454d5236-970d-4428-af82-edc9dd6fc2e9 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.330939 Aug 04 04:25:19.804740 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 392/812] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:19 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:19.833511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c4acb6a-f386-45da-a035-126e637ed541 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a8f99d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:19.899526 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c4acb6a-f386-45da-a035-126e637ed541 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.093264 Aug 04 04:25:19.900975 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 393/813] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:19 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:19.911716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:19.912678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:19.921839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:19.927995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:19.929223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:19.929922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:20.008579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:20.022895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:20.027782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:20.029368 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffd9ee5e-8c21-40ec-8b35-dda4dc06a76b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1568 microversion: 2.25 time: 0.848969 Aug 04 04:25:20.031242 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 421/814] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:19 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1568 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:20.188961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:20.201664 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37eab82c-5dd2-4122-a387-9970e9fe4b3b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1337 microversion: 2.1 time: 0.297154 Aug 04 04:25:20.242655 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 394/815] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:19 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1337 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:20.387567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-993473ea-3611-43fb-8ecb-9864a83d815e req-95f0fd3c-8a2a-497c-bf7a-709c0566ad1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47b14c1-c8b1-4fdf-b601-48b469cda68e", "name": "network-vif-unplugged", "status": "completed", "tag": "64e2eaf4-f301-4449-9ef9-f80bf581a3cf"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:20.418934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-993473ea-3611-43fb-8ecb-9864a83d815e req-95f0fd3c-8a2a-497c-bf7a-709c0566ad1c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:20.419699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-993473ea-3611-43fb-8ecb-9864a83d815e req-95f0fd3c-8a2a-497c-bf7a-709c0566ad1c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:20.439068 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-993473ea-3611-43fb-8ecb-9864a83d815e req-95f0fd3c-8a2a-497c-bf7a-709c0566ad1c service nova] Creating event network-vif-unplugged:64e2eaf4-f301-4449-9ef9-f80bf581a3cf for instance b47b14c1-c8b1-4fdf-b601-48b469cda68e on n-h2-851337-5 Aug 04 04:25:20.448631 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-993473ea-3611-43fb-8ecb-9864a83d815e req-95f0fd3c-8a2a-497c-bf7a-709c0566ad1c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069308 Aug 04 04:25:20.449996 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 422/816] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:20.813600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:20.814347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:20.825379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:20.825843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:20.831215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:20.831688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:20.835445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:20.836373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:20.852842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:20.854567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:20.855615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:20.856924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:20.895919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:25:21.091704 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61d86589-4cec-4532-95ce-b9994444ee85 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 204 len: 0 microversion: 2.1 time: 0.281868 Aug 04 04:25:21.094073 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 395/817] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:25:20 2022] DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:21.117640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ff7e292-ba92-4930-abfa-66940dfe4047 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a8e6310>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:21.139741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:21.163349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:21.170287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:21.183079 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8d3a8e5-c122-411b-8c62-1fe07c033304 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.356754 Aug 04 04:25:21.188921 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 423/818] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:20 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:21.209383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:21.214509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:21.218574 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6ff7e292-ba92-4930-abfa-66940dfe4047 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.122412 Aug 04 04:25:21.227502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 396/819] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:21 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:21.238193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:21.238793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:21.239913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:21.240488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:21.267056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:21.267989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:21.277120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:21.279692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:21.284947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:21.285678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:21.988529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:21.998995 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a650600-bd97-4ed7-92a4-1abe1ed70ea8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 0.736413 Aug 04 04:25:21.999615 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 397/820] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:21 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:22.010253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:22.027362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:22.029388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:22.035301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-700841185", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "2119286000", "adminPass": "***", "networks": [{"uuid": "12bdb45f-d8f5-4ab1-a4b8-8afe5c2a9499"}], "security_groups": [{"name": "tempest-securitygroup--1437432548"}], "key_name": "tempest-keypair-1257548634", "user_data": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:22.038838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-be544d46-0b45-470a-bfc7-1d24bbe83b23 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1568 microversion: 2.25 time: 0.848454 Aug 04 04:25:22.039469 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 424/821] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:21 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1568 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:22.056000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-cc37a1e0-d653-4a59-804f-4a191588aa98 req-2aa89d0a-1ea2-4794-b150-d68ad5e2310d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead118c2-ebfb-4040-8a2a-7e89d2c504f2", "name": "network-vif-plugged", "status": "completed", "tag": "e3085237-07be-47a5-adb5-78638b3d9288"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:22.072871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cc37a1e0-d653-4a59-804f-4a191588aa98 req-2aa89d0a-1ea2-4794-b150-d68ad5e2310d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:22.073973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cc37a1e0-d653-4a59-804f-4a191588aa98 req-2aa89d0a-1ea2-4794-b150-d68ad5e2310d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:22.091773 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-cc37a1e0-d653-4a59-804f-4a191588aa98 req-2aa89d0a-1ea2-4794-b150-d68ad5e2310d service nova] Creating event network-vif-plugged:e3085237-07be-47a5-adb5-78638b3d9288 for instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 on n-h1-851337-5 Aug 04 04:25:22.099195 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-cc37a1e0-d653-4a59-804f-4a191588aa98 req-2aa89d0a-1ea2-4794-b150-d68ad5e2310d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057761 Aug 04 04:25:22.100833 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 425/822] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:22.215959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:22.217602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:22.229991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] validate_networks() for [('12bdb45f-d8f5-4ab1-a4b8-8afe5c2a9499', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:25:22.242906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:22.243871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:22.246148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:22.249407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:22.591967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:22.611749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:22.616136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:22.638735 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6c1820a0-683f-40f5-8add-3158f4581ccb tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.428399 Aug 04 04:25:22.643164 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 426/823] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:22 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:25:22.658539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6735862f-fa4a-448d-891b-8e33ce61065c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a23a310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:22.676563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:22.738692 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6735862f-fa4a-448d-891b-8e33ce61065c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.093565 Aug 04 04:25:22.739701 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 427/824] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:22 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:22.752507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-abc32694-804b-44a8-9b0d-c28a953766cb req-96b8d807-43a6-49e5-9ac6-842a63ae593c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47b14c1-c8b1-4fdf-b601-48b469cda68e", "tag": "64e2eaf4-f301-4449-9ef9-f80bf581a3cf"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:22.782098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-abc32694-804b-44a8-9b0d-c28a953766cb req-96b8d807-43a6-49e5-9ac6-842a63ae593c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:22.783561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-abc32694-804b-44a8-9b0d-c28a953766cb req-96b8d807-43a6-49e5-9ac6-842a63ae593c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:22.812880 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-abc32694-804b-44a8-9b0d-c28a953766cb req-96b8d807-43a6-49e5-9ac6-842a63ae593c service nova] Creating event network-changed:64e2eaf4-f301-4449-9ef9-f80bf581a3cf for instance b47b14c1-c8b1-4fdf-b601-48b469cda68e on n-h2-851337-5 Aug 04 04:25:22.828527 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-abc32694-804b-44a8-9b0d-c28a953766cb req-96b8d807-43a6-49e5-9ac6-842a63ae593c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083359 Aug 04 04:25:22.829450 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 428/825] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:23.022450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:23.024452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:23.035907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:23.041072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:23.042384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:23.043050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:23.512376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:24.117376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:24.130491 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8177ae35-97a9-4ba6-bbca-e0f30a613df2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 1.113197 Aug 04 04:25:24.133271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 429/826] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:23 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:24.147174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:24.150372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:24.162770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:24.163273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:24.164074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:24.164541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:25.093695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:25.106316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:25.110760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:25.114224 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-722f0d9c-a06f-46bc-a144-331275cdf787 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1568 microversion: 2.25 time: 0.979094 Aug 04 04:25:25.117157 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 430/827] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:24 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1568 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:25.131645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:25.133916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:25.152333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:25.153039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:25.153999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:25.154595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:25.206869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:25:25.208133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:25:25.208968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:25:25.209498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:25:25.210069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:25:25.256103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:25.257739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:25.263687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:25.267275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:25.315956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Getting quotas for project 5eb654e083014c3a9accbed2d9717a62. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:25:25.334101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Getting quotas for user 3cb9b7217fa945ad8778fc4c29f80fb3 and project 5eb654e083014c3a9accbed2d9717a62. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:25:25.349107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:25:25.353169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:25:25.485291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:25.493392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46f5a5df-fad0-4de7-80e8-8ccde444402a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.492617 Aug 04 04:25:25.498304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:25.500271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:25.504090 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 398/828] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:25:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 3497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:25:25.509464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb7f7b60-8b5b-4c15-9556-6b91812a1bb9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aad34c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:25.517879 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a09c422-2728-4fa1-86c4-aa172b66562f tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.394042 Aug 04 04:25:25.520677 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 431/829] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:25 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:25.660599 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb7f7b60-8b5b-4c15-9556-6b91812a1bb9 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.140275 Aug 04 04:25:25.662387 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 399/830] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:25 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:25.672113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:25.673117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:25.680736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:25.681489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:25.682549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:25.683311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:26.075429 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c547ed1b-ad98-46fe-8438-91372dd44214 tempest-TenantUsagesNegativeTestJSON-1508441170 tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T04%3A25%3A24.530701&end=2022-08-05T04%3A25%3A24.530701" status: 404 len: 112 microversion: - time: 0.537118 Aug 04 04:25:26.075975 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 432/831] 10.222.0.69 () {58 vars in 1316 bytes} [Thu Aug 4 04:25:25 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T04%3A25%3A24.530701&end=2022-08-05T04%3A25%3A24.530701 => generated 112 bytes in 555 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 04:25:26.086411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9137d43e-e092-4db4-a79f-c8cde5b09957 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:26.087265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9137d43e-e092-4db4-a79f-c8cde5b09957 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:26.227972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9137d43e-e092-4db4-a79f-c8cde5b09957 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:26.249038 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9137d43e-e092-4db4-a79f-c8cde5b09957 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1264 microversion: 2.1 time: 0.167542 Aug 04 04:25:26.251062 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 433/832] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:26 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:26.292735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e183fa2c-e74d-45aa-b6ee-426945a1a409 tempest-TenantUsagesNegativeTestJSON-1508441170 tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin] Calling method '.version_select at 0x7f191a39b1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:26.323265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e183fa2c-e74d-45aa-b6ee-426945a1a409 tempest-TenantUsagesNegativeTestJSON-1508441170 tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 04 04:25:26.326226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e183fa2c-e74d-45aa-b6ee-426945a1a409 tempest-TenantUsagesNegativeTestJSON-1508441170 tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin] Request method failure captured: Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-simple-tenant-usage/100b1bac27b3433c8ea5b8a320bc0f42?start=2022-08-05T04%3A25%3A24.530701&end=2022-08-03T04%3A25%3A24.530701 HTTP/1.1 Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60o019y-MmpjLIFOCrehWEZSG89QFRUNspRhEpu07vdxVii4VDx4LsgKUNyqSuG2sHxMRDcvmYkcUxhnl949uXll-ft5INdxURbmhs2oByZ2xu-WtT_-EQzqYxIQzEHPcBlO9bBuXlKQ-l7jNBZVMwyJ0q-TfjgBOyuzDUL7reqLmYA Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 10352b0e2a10489eb225445386920893 Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1508441170 Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:25:26.334704 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/10352b0e2a10489eb225445386920893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/10352b0e2a10489eb225445386920893"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/10352b0e2a10489eb225445386920893"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_10352b0e2a10489eb225445386920893", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1508441170 Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 10352b0e2a10489eb225445386920893 Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1508441170 Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 32338cfa617f42a8a88de42ea347b30d Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid start time. The start time cannot occur after the end time. Aug 04 04:25:26.336098 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '100b1bac27b3433c8ea5b8a320bc0f42'} Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 04:25:26.336819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 04 04:25:26.338165 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:26.338806 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-105274d5-2d36-43bb-9a98-54a5eb89a82d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 0.671986 Aug 04 04:25:26.339995 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 400/833] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:25 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:26.345595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e183fa2c-e74d-45aa-b6ee-426945a1a409 tempest-TenantUsagesNegativeTestJSON-1508441170 tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:26.350269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:26.350931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:26.363946 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e183fa2c-e74d-45aa-b6ee-426945a1a409 tempest-TenantUsagesNegativeTestJSON-1508441170 tempest-TenantUsagesNegativeTestJSON-1508441170-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/100b1bac27b3433c8ea5b8a320bc0f42?start=2022-08-05T04%3A25%3A24.530701&end=2022-08-03T04%3A25%3A24.530701" status: 400 len: 111 microversion: 2.1 time: 0.097731 Aug 04 04:25:26.369309 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 434/834] 10.222.0.69 () {58 vars in 1412 bytes} [Thu Aug 4 04:25:26 2022] GET /compute/v2.1/os-simple-tenant-usage/100b1bac27b3433c8ea5b8a320bc0f42?start=2022-08-05T04%3A25%3A24.530701&end=2022-08-03T04%3A25%3A24.530701 => generated 111 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:25:26.385766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:26.387653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:26.409240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:26.409240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:26.748063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-61751100-89f8-4bdf-890d-e8fd76b7e0f7 tempest-TenantUsagesNegativeTestJSON-1328654993 tempest-TenantUsagesNegativeTestJSON-1328654993-project] Calling method '.version_select at 0x7f191a3fd670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:26.755401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-61751100-89f8-4bdf-890d-e8fd76b7e0f7 tempest-TenantUsagesNegativeTestJSON-1328654993 tempest-TenantUsagesNegativeTestJSON-1328654993-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '4af06ef41aec4f4c91939b2c09f872cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100b1bac27b3433c8ea5b8a320bc0f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-61751100-89f8-4bdf-890d-e8fd76b7e0f7 tempest-TenantUsagesNegativeTestJSON-1328654993 tempest-TenantUsagesNegativeTestJSON-1328654993-project] Request method failure captured: Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T04%3A25%3A24.530701&end=2022-08-05T04%3A25%3A24.530701&detailed=1 HTTP/1.1 Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60oyiVb-SOXn4VkT_spS8oWs75XaZEmDxNRLBiGXdGkzGBjPees5hHKOdEHB8RVL0xEufr1S-qfpJDyFR9znNlxjgeql_0TZPcbQkCPA6ZhBbVf2VNeoW1gJqMzxBlwu1MeMaOuharab726uwpHfi9NZMoLCYFyXxycm_cV9hJOj8EY Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 100b1bac27b3433c8ea5b8a320bc0f42 Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1328654993 Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:25:26.759016 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/100b1bac27b3433c8ea5b8a320bc0f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/100b1bac27b3433c8ea5b8a320bc0f42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/100b1bac27b3433c8ea5b8a320bc0f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_100b1bac27b3433c8ea5b8a320bc0f42", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1328654993 Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 100b1bac27b3433c8ea5b8a320bc0f42 Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1328654993 Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TenantUsagesNegativeTestJSON-1328654993-project Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4af06ef41aec4f4c91939b2c09f872cc Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1328654993-project Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: action_args: {} Aug 04 04:25:26.761229 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:25:26.762252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:25:26.763766 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:25:26.765157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 04:25:26.765157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:25:26.767974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-61751100-89f8-4bdf-890d-e8fd76b7e0f7 tempest-TenantUsagesNegativeTestJSON-1328654993 tempest-TenantUsagesNegativeTestJSON-1328654993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:26.770432 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-61751100-89f8-4bdf-890d-e8fd76b7e0f7 tempest-TenantUsagesNegativeTestJSON-1328654993 tempest-TenantUsagesNegativeTestJSON-1328654993-project] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T04%3A25%3A24.530701&end=2022-08-05T04%3A25%3A24.530701&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.393790 Aug 04 04:25:26.774220 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 435/835] 10.222.0.69 () {58 vars in 1335 bytes} [Thu Aug 4 04:25:26 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T04%3A25%3A24.530701&end=2022-08-05T04%3A25%3A24.530701&detailed=1 => generated 123 bytes in 398 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:25:26.809585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:26.812058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:26.824916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:26.851257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:26.852433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:26.858945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:26.862446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:26.973249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:27.177003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:27.190162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:27.195915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:27.208141 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c6641a1f-d242-4bbd-872f-87475637db01 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.426933 Aug 04 04:25:27.211734 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 436/836] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:26 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:27.221029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1dbc0b5d-dea9-4037-b6ca-091dcbeaeb43 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a355f70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:27.310940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1dbc0b5d-dea9-4037-b6ca-091dcbeaeb43 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.097767 Aug 04 04:25:27.313142 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 437/837] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:27 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:27.325999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:27.328566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:27.343437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:27.348084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:27.349312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:27.350189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:27.652791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:27.661430 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ce4b8da-5012-48c6-b2ca-907e0724a155 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1316 microversion: 2.1 time: 0.346943 Aug 04 04:25:27.683484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 438/838] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:27 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:27.697048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:27.702471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:27.708038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:27.709869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:27.714488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:27.723620 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-db78de9e-8db8-4c9d-8553-285fde916d48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1568 microversion: 2.25 time: 1.382671 Aug 04 04:25:27.727242 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 401/839] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:26 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1568 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:27.728224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:27.733739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:27.735692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:27.736400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:27.741333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-92f98820-ec61-407c-9043-d945d0f1aa67 req-ceea6206-231c-49d1-bb78-b1696f945dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b", "tag": "3fc792c7-febd-4eb9-bc27-aa4dbc529458"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:27.792395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-92f98820-ec61-407c-9043-d945d0f1aa67 req-ceea6206-231c-49d1-bb78-b1696f945dab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:27.793000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-92f98820-ec61-407c-9043-d945d0f1aa67 req-ceea6206-231c-49d1-bb78-b1696f945dab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:27.841847 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-92f98820-ec61-407c-9043-d945d0f1aa67 req-ceea6206-231c-49d1-bb78-b1696f945dab service nova] Creating event network-changed:3fc792c7-febd-4eb9-bc27-aa4dbc529458 for instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b on n-h2-851337-5 Aug 04 04:25:27.857472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-92f98820-ec61-407c-9043-d945d0f1aa67 req-ceea6206-231c-49d1-bb78-b1696f945dab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127859 Aug 04 04:25:27.860701 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 402/840] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:28.242529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:28.243415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:28.253543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:28.258484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:28.261218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:28.261977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:28.611459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:28.620872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:28.629005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:28.644301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:28.648817 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f1c3de2c-dc7e-4bee-9ac4-c2d3dac0b36a tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.411172 Aug 04 04:25:28.652378 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 403/841] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:28 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:28.672606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0307eb2b-d8db-465b-a401-0a830c8a41b8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a884b80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:28.765676 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0307eb2b-d8db-465b-a401-0a830c8a41b8 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.111607 Aug 04 04:25:28.771304 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 404/842] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:28 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:28.781456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ebe30f4f-87f0-491f-b892-7291974a91ef req-276bd61d-4713-4f5f-895a-18c9856d720b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a408a4e-9b6f-468f-9db8-155a85a0f96d", "name": "network-vif-deleted", "tag": "f96eb774-8631-49c6-b48b-69bd803736d9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:28.809468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ebe30f4f-87f0-491f-b892-7291974a91ef req-276bd61d-4713-4f5f-895a-18c9856d720b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:28.810326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ebe30f4f-87f0-491f-b892-7291974a91ef req-276bd61d-4713-4f5f-895a-18c9856d720b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:28.840256 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ebe30f4f-87f0-491f-b892-7291974a91ef req-276bd61d-4713-4f5f-895a-18c9856d720b service nova] Creating event network-vif-deleted:f96eb774-8631-49c6-b48b-69bd803736d9 for instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d on n-h1-851337-5 Aug 04 04:25:28.854780 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ebe30f4f-87f0-491f-b892-7291974a91ef req-276bd61d-4713-4f5f-895a-18c9856d720b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081587 Aug 04 04:25:28.856761 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 405/843] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:28.875528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:28.876611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:28.883594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:28.895771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:28.897016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:28.897659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:29.011180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:29.023957 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2908a02d-fab7-4be5-a4b5-5ea440917b8e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.165434 Aug 04 04:25:29.024682 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 406/844] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:28 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:29.029487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:29.035441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:29.045032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:29.057650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:29.062205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:29.065474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:29.180217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:29.187167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:29.193034 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-77b3b044-69be-41e3-bc4f-55b3497ae49a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 1.508203 Aug 04 04:25:29.204257 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 439/845] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:27 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:29.677201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:29.677982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:29.693321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:29.694004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:29.696563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:29.697420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:29.990268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:30.007328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:30.011636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:30.044087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cf1f969c-f995-40b2-b098-2c2ec3f7fb84 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.371040 Aug 04 04:25:30.046191 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 440/846] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:29 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:30.054215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b63433c-70e3-4346-96ce-5292f4190545 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a45d430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:30.148238 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b63433c-70e3-4346-96ce-5292f4190545 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.100699 Aug 04 04:25:30.162767 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 441/847] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:30 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:30.175944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:30.179649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:30.200496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:30.201594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:30.202577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:30.205015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:30.512135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:30.522885 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33092fdf-bb31-418e-92cd-0034f0c5ab34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.357710 Aug 04 04:25:30.531752 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 442/848] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:30 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:30.548956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:30.549721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:30.568748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:30.583702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:30.584749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:30.585340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:30.836188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:30.851701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:30.856476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:30.860154 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f294afdf-5458-46b1-863d-0905c3ca9a48 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1568 microversion: 2.25 time: 1.834418 Aug 04 04:25:30.864249 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 407/849] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:29 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1568 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:31.077932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:31.078644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:31.096626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:31.097199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:31.111282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:31.112497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:31.489122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:31.667168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:31.676910 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-97eeb696-51c8-4137-b52b-f089107b6943 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 1.143641 Aug 04 04:25:31.680193 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 443/850] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:30 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:31.696638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd7598bf-fa11-4a9e-a05f-6a0ae75cb883 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a45dc10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:31.770383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd7598bf-fa11-4a9e-a05f-6a0ae75cb883 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.088594 Aug 04 04:25:31.771344 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 444/851] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:31 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:31.787224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:31.789166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:31.810620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:31.812010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:31.814737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:31.815837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:32.752467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:32.757341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:32.768237 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc0acede-bd1b-4b2e-8469-f907f18d2919 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.995362 Aug 04 04:25:32.784818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:32.784818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:32.798118 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 445/852] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:31 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1322 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:32.831484 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92f434b2-0667-41f1-9ff1-9fdbf3ab4844 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 1.757225 Aug 04 04:25:32.835277 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 408/853] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:31 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:32.863882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:32.865885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:32.867083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:32.876723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:32.902143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:32.903951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:32.904571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:32.905156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:32.908620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:32.909870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:32.910376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:32.920104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:33.769665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:33.818780 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87164ca5-a2a0-4a6f-9920-e26f2fbd85d0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 0.981753 Aug 04 04:25:33.819871 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 409/854] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:32 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:33.838410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2c88979-d5fc-479d-84fb-19daa9ae2b0f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f192005aaf0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:33.854386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:33.870367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:33.875716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:33.879914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3df23482-5c39-49d2-af8a-9d54639e437f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1543 microversion: 2.25 time: 1.079255 Aug 04 04:25:33.895017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 446/855] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:32 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1543 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:33.917466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:33.922346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:33.938931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:33.942285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:33.944300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:33.945682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:33.960580 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2c88979-d5fc-479d-84fb-19daa9ae2b0f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.139346 Aug 04 04:25:33.974032 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 410/856] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:33 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:33.979219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:33.987949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:34.016788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:34.017439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:34.018414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:34.021154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:34.259889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:34.281093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:34.289173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:34.294357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:34.298036 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-263f9038-e156-4aba-af1c-02aae53199d5 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.396215 Aug 04 04:25:34.309569 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 447/857] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:33 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:34.325070 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d2cb797-0bb4-470c-aba7-b0357268269b tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1447 microversion: 2.75 time: 0.349659 Aug 04 04:25:34.326042 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 411/858] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:33 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1447 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:34.326844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8099b04-657e-4fa9-a11d-b16e77f5f26d tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '.version_select at 0x7f191a495670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:34.334977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8099b04-657e-4fa9-a11d-b16e77f5f26d tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:34.335861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8099b04-657e-4fa9-a11d-b16e77f5f26d tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:34.358783 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b8099b04-657e-4fa9-a11d-b16e77f5f26d tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 1701 microversion: 2.25 time: 0.047377 Aug 04 04:25:34.366380 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 448/859] 10.222.0.69 () {60 vars in 1184 bytes} [Thu Aug 4 04:25:34 2022] GET /compute/v2.1/os-migrations => generated 1701 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:34.384168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:34.385222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:34.399171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:34.403628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:34.405122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:34.405775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:34.840775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:34.841399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:34.859007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:34.859550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:34.860458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:34.860893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:35.035650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid b47b14c1-c8b1-4fdf-b601-48b469cda68e {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:35.090681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b213cc5-094d-4d3b-b7b5-dc79aaa7087c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 2036 microversion: 2.25 time: 0.711174 Aug 04 04:25:35.092326 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 412/860] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:34 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 2036 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:35.111635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c9b65b3-2e9d-43f8-9197-38282aa735a3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a8f4280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:35.202364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c9b65b3-2e9d-43f8-9197-38282aa735a3 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.106473 Aug 04 04:25:35.210015 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 413/861] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:35 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:35.287405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:35.343501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:35.477935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11d55b97-e281-44e8-b052-8d94c7b8c4ef tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Action: 'create', calling method: .version_select at 0x7f191a8e6ee0>, body: {"keypair": {"name": "tempest-keypair-82366615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMvR05xdmIxRBAcD5/1wZd/B6MQftqUxRm2xfEDd+J3OZiQpy/qNFLBtK+Xf0Ggw4RcuBaqGiMJIxmNtOaTPwGgPaQ2nWeNslBo0i15hQa6xRMsz9KrqUpG6ThLIqLRA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:35.519768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-11d55b97-e281-44e8-b052-8d94c7b8c4ef tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Getting quotas for project 828bda82de6f41c3959d1b81a24453a1. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:25:35.536468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-11d55b97-e281-44e8-b052-8d94c7b8c4ef tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Getting quotas for user fc44eab358f741bf8f619ef4bb079c73 and project 828bda82de6f41c3959d1b81a24453a1. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:25:35.572269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:35.592008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cce5b840-12f1-4b21-bd97-08c41f6b047c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 0.746697 Aug 04 04:25:35.593996 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 449/862] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:34 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:35.609542 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11d55b97-e281-44e8-b052-8d94c7b8c4ef tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.396597 Aug 04 04:25:35.611262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ae87a1c-8c35-4af2-be72-07e2c3cf73b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Action: 'create', calling method: .version_select at 0x7f191a3d9820>, body: {"keypair": {"name": "tempest-keypair-1025088252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoHPqBVzHFhH502isDt1gjw9Gat4jVjXt4Ec/2lDrsPqgcwIXTwTP3On9msgRvisVBDXKQ8ERQ/tDtqr7EIWjJxYEHG+OjkOhfseDNm6x/loVD+dCabWyDJpcIcgHHRXA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:35.613682 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 414/863] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:25:35 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:35.637796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:35.641702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:35.708299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:35.709183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:35.713672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:35.714348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:35.726352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3ae87a1c-8c35-4af2-be72-07e2c3cf73b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for project 300e53e93c2a4678b2b5695d002ac286. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:25:35.749241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3ae87a1c-8c35-4af2-be72-07e2c3cf73b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for user eaff90b8a434488f9d2731070edf30fe and project 300e53e93c2a4678b2b5695d002ac286. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:25:35.822627 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ae87a1c-8c35-4af2-be72-07e2c3cf73b4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.220032 Aug 04 04:25:35.825634 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 450/864] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:25:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 231 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 04:25:35.845608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:35.848626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:35.866391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:35.866391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:35.873423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:35.873888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:36.131816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:36.156033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:36.162579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:36.186489 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8298058-0906-4488-bed6-047b958867ec tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1453 microversion: 2.75 time: 0.357492 Aug 04 04:25:36.187732 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 451/865] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:35 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1453 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:36.226326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c64776ac-412b-4785-9249-919da5084ebe tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a28e940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:36.328190 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c64776ac-412b-4785-9249-919da5084ebe tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.106906 Aug 04 04:25:36.347133 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 452/866] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:36 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:36.617011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:36.617950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:36.642510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:36.644106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:36.653454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:36.653975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:37.431820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:37.450579 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab500812-2253-4ec3-adc0-b3f37b89c496 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 1.832451 Aug 04 04:25:37.451446 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 415/867] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:35 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:37.477132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:37.480550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:37.493716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:37.502475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:37.505731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:37.506417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:37.677139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:37.689293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:37.700789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:37.716321 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9a537d2-cf45-4533-913f-fb07978401f8 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1453 microversion: 2.75 time: 0.263590 Aug 04 04:25:37.724991 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 416/868] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:37 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1453 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:37.735849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7929e43-9faf-4a92-a616-bddee8864e01 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a9b5f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:37.848168 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7929e43-9faf-4a92-a616-bddee8864e01 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.119113 Aug 04 04:25:37.857961 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 417/869] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:37 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:37.863626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:37.875397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-23aec980-9820-42b4-bed8-ec0f083ae73f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 1.263103 Aug 04 04:25:37.876556 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 453/870] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:36 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:38.474985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:38.475750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:38.484099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:38.488601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:38.491896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:38.492605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:38.756144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:38.757103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:38.784089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:38.789480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:38.794675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:38.797133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:38.797865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:38.813583 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7264a001-40b9-4f2b-b8db-b9b8b4e66560 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.342323 Aug 04 04:25:38.814184 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 418/871] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:38 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:38.863334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-067e3c41-6d05-4fb5-835f-6894d8e655ed tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a941550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:38.958171 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-067e3c41-6d05-4fb5-835f-6894d8e655ed tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.087457 Aug 04 04:25:38.967284 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 419/872] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:38 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:38.972928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:38.973893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:38.988779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:38.989440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:38.999697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:39.000311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:39.121609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:39.137334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:39.138917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:39.161982 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81c2dc31-b8ec-40c9-a3ac-d4816fa4cc1e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1453 microversion: 2.75 time: 0.411468 Aug 04 04:25:39.166624 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 454/873] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:38 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1453 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:39.385941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:39.394071 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f40d43f-9d1b-4679-bb44-e51ed81b61f0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 0.425228 Aug 04 04:25:39.397332 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 420/874] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:38 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:39.839530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:39.840453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:39.853200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:39.859112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:39.860239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:39.860843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:39.979582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e6a5b8d-5d72-446b-9f2d-1157a49adb7f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a8f4280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:40.050504 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e6a5b8d-5d72-446b-9f2d-1157a49adb7f tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.076528 Aug 04 04:25:40.058314 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 421/875] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:39 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:40.200177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:40.200889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:40.223915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:40.224382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:40.225191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:40.225639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:40.519835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:40.529459 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a3628eff-fa14-4230-8e3d-9b8ee4898485 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.697616 Aug 04 04:25:40.530048 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 455/876] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:39 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:40.554455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:40.559860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:40.585432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:40.586144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:40.587240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:40.589735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:40.614598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:40.629967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:40.639602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:40.658067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-45000f4f-d246-4a9d-96f7-18f3596550b5 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1453 microversion: 2.75 time: 0.469935 Aug 04 04:25:40.682273 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 422/877] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:40 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1453 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:40.761671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3a7a557e-2798-4f9d-b0a0-9c567b50ea0e req-6ccccee6-43fc-425d-a0ad-53ca98ca348d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b", "name": "network-vif-plugged", "status": "completed", "tag": "3fc792c7-febd-4eb9-bc27-aa4dbc529458"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:40.840772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3a7a557e-2798-4f9d-b0a0-9c567b50ea0e req-6ccccee6-43fc-425d-a0ad-53ca98ca348d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:40.844176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3a7a557e-2798-4f9d-b0a0-9c567b50ea0e req-6ccccee6-43fc-425d-a0ad-53ca98ca348d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:40.886317 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3a7a557e-2798-4f9d-b0a0-9c567b50ea0e req-6ccccee6-43fc-425d-a0ad-53ca98ca348d service nova] Creating event network-vif-plugged:3fc792c7-febd-4eb9-bc27-aa4dbc529458 for instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b on n-h2-851337-5 Aug 04 04:25:40.898766 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3a7a557e-2798-4f9d-b0a0-9c567b50ea0e req-6ccccee6-43fc-425d-a0ad-53ca98ca348d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161927 Aug 04 04:25:40.910501 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 423/878] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:41.051513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-92a42aeb-a712-4be1-a1fa-ba66203dff65 req-3de843c2-0968-46e0-83ba-b501f5847e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0587a068-9eec-4e45-92a0-de71118a73d4", "tag": "dfddfe54-bf50-4e0f-a767-4eef195fa27b"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:41.063738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-92a42aeb-a712-4be1-a1fa-ba66203dff65 req-3de843c2-0968-46e0-83ba-b501f5847e1d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:41.064313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-92a42aeb-a712-4be1-a1fa-ba66203dff65 req-3de843c2-0968-46e0-83ba-b501f5847e1d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:41.082368 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-92a42aeb-a712-4be1-a1fa-ba66203dff65 req-3de843c2-0968-46e0-83ba-b501f5847e1d service nova] Creating event network-changed:dfddfe54-bf50-4e0f-a767-4eef195fa27b for instance 0587a068-9eec-4e45-92a0-de71118a73d4 on n-h1-851337-5 Aug 04 04:25:41.100656 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-92a42aeb-a712-4be1-a1fa-ba66203dff65 req-3de843c2-0968-46e0-83ba-b501f5847e1d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054510 Aug 04 04:25:41.103855 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 424/879] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:41.115690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6864086a-2aa8-4024-a175-8f42850bbf93 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a941280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:41.189883 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6864086a-2aa8-4024-a175-8f42850bbf93 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.084846 Aug 04 04:25:41.190895 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 425/880] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:41 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:41.337286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:41.352223 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cfd7d3bd-a57d-49e8-8a36-63cc4931f326 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 0.812477 Aug 04 04:25:41.354993 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 456/881] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:40 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:41.557258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:41.558387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:41.572420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:41.573258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:41.574353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:41.575793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:41.689132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:41.689756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:41.708747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:41.709827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:41.713517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:41.714180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:41.860799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:41.870770 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da396eed-3f16-4c83-9041-59654c231421 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.318684 Aug 04 04:25:41.876080 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 426/882] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:41 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:41.974270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:41.998821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:42.013186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:42.050087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab726880-a7ff-48ae-842b-31b05545d0b1 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1438 microversion: 2.75 time: 0.362224 Aug 04 04:25:42.056780 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 457/883] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:41 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1438 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:25:42.231443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-963306ab-5903-4150-a5c3-447ee6a5194c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a3ead30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:42.315339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:42.330211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:42.336263 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-963306ab-5903-4150-a5c3-447ee6a5194c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.125540 Aug 04 04:25:42.336971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 458/884] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:42 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:42.350263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.351284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:42.352347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.353053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:42.376948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:42.377904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:42.403023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.403885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:42.404960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.405652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:42.599851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:25:42.605909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:25:42.612830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:25:42.614601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:25:42.616933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:25:42.716238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:42.729939 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bea6ed84-72ca-47ef-bf32-bff8b9b29977 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1379 microversion: 2.1 time: 0.357689 Aug 04 04:25:42.731461 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 459/885] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:42 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1379 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:42.771626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:42.789191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.789559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:42.790405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.790850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:42.900602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:42.901226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:42.917667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.918124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:42.918916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:42.932909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:43.133034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:43.207364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38580239-0dc6-420e-bc33-ea2b2b5882dc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee/action" status: 202 len: 1942 microversion: 2.75 time: 1.133937 Aug 04 04:25:43.210843 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 427/886] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:25:42 2022] POST /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee/action => generated 1942 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 04:25:43.245958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:43.246606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:43.257108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:43.257565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:43.266870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:43.267728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:43.448859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:43.481523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:43.496344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52f3f549-268d-459c-86c6-012bae6c6a0a tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.600540 Aug 04 04:25:43.510782 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 460/887] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:42 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:43.510782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-80f2d5f3-7dd9-4fb7-a3af-a202576b6580 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a5ae550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:43.549670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2be4ca68-75b9-43f6-ab9a-5d6c25a06045 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.314227 Aug 04 04:25:43.555752 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 428/888] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:43 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:43.632022 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-80f2d5f3-7dd9-4fb7-a3af-a202576b6580 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.133105 Aug 04 04:25:43.633948 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 461/889] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:43 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:43.752454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:43.753374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:43.767794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:43.769777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:43.772075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:43.773059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.121842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:44.125590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:44.140123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9970d35-dd46-42a6-8a4e-7141896aa6f2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1528 microversion: 2.1 time: 0.392244 Aug 04 04:25:44.141285 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 429/890] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:43 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1528 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:44.165648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:44.167758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:44.197925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.198669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.199819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.200774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.443106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:44.453162 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a588e843-8ac7-403b-8359-2ddc4b8fae2b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1528 microversion: 2.1 time: 0.291757 Aug 04 04:25:44.462876 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 462/891] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:44 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1528 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:44.475335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1522082b-e8da-4166-a1ed-c492d86dbf28 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:44.476213 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:25:44.476213 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:25:44.517678 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1522082b-e8da-4166-a1ed-c492d86dbf28 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/c10aae03-88eb-4a05-a080-bc8a0e6bd35c" status: 202 len: 0 microversion: 2.1 time: 0.043040 Aug 04 04:25:44.519514 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 430/892] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:25:44 2022] DELETE /compute/v2.1/flavors/c10aae03-88eb-4a05-a080-bc8a0e6bd35c => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:44.521910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:44.523085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:44.533746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03f64915-c5b5-4f88-9642-d1a3fa9bc1ba tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:44.548971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.549528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.550369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.550808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.567722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:44.600909 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03f64915-c5b5-4f88-9642-d1a3fa9bc1ba tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.078223 Aug 04 04:25:44.614810 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 431/893] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:25:44 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:44.620606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:44.622311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:44.657355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.659230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.662029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.670581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.856428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:44.867551 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f75aef07-1098-4d34-adcb-a3a23a8fd385 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.353295 Aug 04 04:25:44.869890 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 463/894] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:44 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:44.875961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:44.881182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:44.909378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.910104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.912532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:44.913440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:44.916284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:44.978280 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65b2631b-6d0a-4c89-b71b-d8ea7a55307a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.361764 Aug 04 04:25:44.979573 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 432/895] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:44 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:44.994878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a884868f-e0d9-45d2-997d-7b2737408750 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a941790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:45.073438 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a884868f-e0d9-45d2-997d-7b2737408750 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.092543 Aug 04 04:25:45.074134 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 433/896] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:44 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:45.097069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:45.104619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Old instance type tempest-test_resize_flavor_-1299350359, new instance type m1.heat {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 04:25:45.113841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:25:45.114507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:25:45.115086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:25:45.116452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:25:45.116906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:25:45.351648 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96925c80-112d-441b-9bfa-dbc258fc3e6f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b/action" status: 202 len: 0 microversion: 2.1 time: 0.478570 Aug 04 04:25:45.355712 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 464/897] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:25:44 2022] POST /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:25:45.365524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:45.367613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:45.389617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:45.396504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:45.400248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:45.403710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:45.556344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:45.894913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:45.895871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:45.897633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=14 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:45.906227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:45.914699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:45.915752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:45.916282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:45.957862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:45.969082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-141b2e9a-14e6-489b-bca8-c2ec3a188d79 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1537 microversion: 2.1 time: 0.609941 Aug 04 04:25:45.970419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 434/898] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:45 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1537 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:46.018502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:46.019553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:46.047910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:46.055000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:46.057949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:46.058424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:46.518999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:46.590582 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c3a621a0-0c38-4893-bb76-8a6ff7d55082 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.583837 Aug 04 04:25:46.593841 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 435/899] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:46 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:46.632528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c4a1c4ee-1622-4164-9d0e-06fc938bfde1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a8e6c10>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:46.751281 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c4a1c4ee-1622-4164-9d0e-06fc938bfde1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1426 microversion: 2.1 time: 0.156084 Aug 04 04:25:46.752552 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 436/900] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:46 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:46.963834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:46.972286 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1c9d4e0-6e22-44fd-96f5-e997e47ede6c tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 1.081796 Aug 04 04:25:46.981486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 465/901] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:45 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:47.001258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:47.001881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:47.010491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:47.018769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:47.025177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:47.026200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:47.430473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:47.439286 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51880db0-d626-4b84-aa14-e2b443b6a114 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1537 microversion: 2.1 time: 0.446937 Aug 04 04:25:47.445328 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 437/902] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:46 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1537 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:47.622437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:47.623409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:47.648970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:47.650084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:47.653118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:47.655232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:47.767995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-abe23e95-17b6-4a2a-a00a-6a4d74865d6c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a8f9d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:48.004873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:48.041898 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99e053da-1389-4917-97de-0a9787127516 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.423831 Aug 04 04:25:48.043747 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 466/903] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:47 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:48.064311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:48.085111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:48.117287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:48.121394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:48.123093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:48.128224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:48.386302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:48.429631 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-138478c9-8688-4279-a150-0e4ae71caba6 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.384412 Aug 04 04:25:48.431153 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 467/904] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:48 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:48.447356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-192004068", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "50e30f39-3ea7-4335-a7da-5dfd49b29ac4"}], "security_groups": [{"name": "tempest-securitygroup--1915941828"}], "key_name": "tempest-keypair-1025088252", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:51.197847 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-abe23e95-17b6-4a2a-a00a-6a4d74865d6c tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1435 microversion: 2.1 time: 3.434003 Aug 04 04:25:51.201281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 438/905] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:47 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1435 bytes in 3436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:25:51.215370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:51.219042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:51.236899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:51.238018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:51.242831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:51.244105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:51.379979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] validate_networks() for [('50e30f39-3ea7-4335-a7da-5dfd49b29ac4', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:25:51.662535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:51.679454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-131e41e2-fb2f-49f1-9d84-5a34c87404d6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.476795 Aug 04 04:25:51.680091 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 439/906] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:51 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:51.689652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:51.692083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:51.721796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:51.722977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:51.724453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:51.725052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:51.889857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:51.948089 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1b9587c-6291-48e3-ba70-6ff1eacea829 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.264138 Aug 04 04:25:51.953213 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 440/907] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:51 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:52.117645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-190665704", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "6f5fc760-036b-4db9-9515-31d6fe212ea8"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:52.240056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] validate_networks() for [('6f5fc760-036b-4db9-9515-31d6fe212ea8', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:25:52.290905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:25:52.291366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:25:52.291848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:25:52.294260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:25:52.295205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:25:52.313752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:52.315685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:52.316579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:52.317014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:52.385421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:25:52.397172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for user eaff90b8a434488f9d2731070edf30fe and project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:25:52.421180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:25:52.425072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:25:52.593953 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-abfbc27a-2a9a-473f-8cd8-caf4a188529d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 4.161430 Aug 04 04:25:52.594612 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 468/908] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:25:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 4163 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:25:52.617200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:52.618945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:52.637644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:52.651538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:52.652598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:52.653753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.004234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:53.031810 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d169e78f-9232-464f-b57b-6176ebe96922 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.427841 Aug 04 04:25:53.047361 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 469/909] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:52 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:53.103180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-646a1db1-a105-472e-83e0-7914673410c0 req-fb3a623c-45aa-4a67-9cd6-502f6a3eecb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0587a068-9eec-4e45-92a0-de71118a73d4", "name": "network-vif-plugged", "status": "completed", "tag": "dfddfe54-bf50-4e0f-a767-4eef195fa27b"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:53.140702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-646a1db1-a105-472e-83e0-7914673410c0 req-fb3a623c-45aa-4a67-9cd6-502f6a3eecb5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.141393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-646a1db1-a105-472e-83e0-7914673410c0 req-fb3a623c-45aa-4a67-9cd6-502f6a3eecb5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.170351 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-646a1db1-a105-472e-83e0-7914673410c0 req-fb3a623c-45aa-4a67-9cd6-502f6a3eecb5 service nova] Creating event network-vif-plugged:dfddfe54-bf50-4e0f-a767-4eef195fa27b for instance 0587a068-9eec-4e45-92a0-de71118a73d4 on n-h1-851337-5 Aug 04 04:25:53.185115 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-646a1db1-a105-472e-83e0-7914673410c0 req-fb3a623c-45aa-4a67-9cd6-502f6a3eecb5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135111 Aug 04 04:25:53.190294 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 470/910] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:53.220934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-505ab8a5-2a8c-44d4-bb14-bf7c6569f4a4 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a3ea8b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:53.363923 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-505ab8a5-2a8c-44d4-bb14-bf7c6569f4a4 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 200 len: 1435 microversion: 2.1 time: 0.161013 Aug 04 04:25:53.365269 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 471/911] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:25:53 2022] GET /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 1435 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:53.371254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b916484c-1b2a-44a9-9a1b-7500e87373f4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:53.372455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b916484c-1b2a-44a9-9a1b-7500e87373f4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:53.388595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:53.430466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:25:53.431603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:25:53.432073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:25:53.432489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:25:53.433554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:25:53.469227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.469732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.470626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.471139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.521836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:25:53.533733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for user 53377b39d2804967aa0d5b71ee57e9a8 and project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:25:53.547836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:53.563894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:25:53.566379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:25:53.600239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b916484c-1b2a-44a9-9a1b-7500e87373f4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:53.609252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b916484c-1b2a-44a9-9a1b-7500e87373f4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:53.611329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b916484c-1b2a-44a9-9a1b-7500e87373f4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:53.621607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b916484c-1b2a-44a9-9a1b-7500e87373f4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1285 microversion: 2.25 time: 0.254866 Aug 04 04:25:53.622333 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 472/912] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:53 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:53.631428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:53.652469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:53.674284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.684936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.686174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.699586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.733274 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b2e597c-2296-450a-bcbd-60a9a39b2cbf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773928 Aug 04 04:25:53.734998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 441/913] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:25:53.747496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:53.749162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:53.799587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.810332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.812015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.815931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.948414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:53.960024 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb1a559e-d743-4ef5-a7ac-7881c3cad49b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.336395 Aug 04 04:25:53.961176 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 473/914] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:53 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:53.966534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:53.967239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:53.989793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.990263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:53.991100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:53.991766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:54.040463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:54.125353 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-72394d8e-bdff-41aa-8734-493af90c9cb5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.377556 Aug 04 04:25:54.126448 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 442/915] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:53 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:54.134438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2036c25b-c233-4d2d-827c-22e71aba36ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:54.135985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2036c25b-c233-4d2d-827c-22e71aba36ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:54.272425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2036c25b-c233-4d2d-827c-22e71aba36ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:54.284400 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2036c25b-c233-4d2d-827c-22e71aba36ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1210 microversion: 2.1 time: 0.156645 Aug 04 04:25:54.285514 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 443/916] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:54 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:54.290328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:54.294273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:54.310409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:54.310847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:54.311659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:54.315344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:54.346875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:54.357828 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ba079cb-362e-48eb-8990-fce84fe60eaa tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1466 microversion: 2.1 time: 0.395152 Aug 04 04:25:54.358449 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 474/917] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:53 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1466 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:54.518362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34b1e236-9868-4eec-8fe8-980cea584f8e tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Action: 'create', calling method: .version_select at 0x7f191a65f1f0>, body: {"pool": null} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:54.611713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:54.626488 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e471ba77-8ba8-4a44-be6a-f95dc8d46b49 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1390 microversion: 2.1 time: 0.339735 Aug 04 04:25:54.627335 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 444/918] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:54 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1390 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:54.633064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ff8feaf-5a3c-46bf-a43f-ebe5875dccde tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191aa64550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:55.792947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ff8feaf-5a3c-46bf-a43f-ebe5875dccde tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "DELETE /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8" status: 204 len: 0 microversion: 2.1 time: 1.164162 Aug 04 04:25:55.793797 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 445/919] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:54 2022] DELETE /compute/v2.1/images/8db81659-8983-4bac-a86a-e223941ca1b8 => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:55.800160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:55.801046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:55.813398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:55.820596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:55.823342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:55.824022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:55.971381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:55.985051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:55.986833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:55.988202 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46282048-5b2d-41ec-82a4-0542f827fba7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1343 microversion: 2.25 time: 0.192989 Aug 04 04:25:56.003090 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 446/920] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:55 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:56.007744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:56.008151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:56.054177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:56.054636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:56.058535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:56.059236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:56.474974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:56.486330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a545387b-a4cc-409a-88b4-8de84891ff7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.483983 Aug 04 04:25:56.487005 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 447/921] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:56 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:56.491397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:56.492013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:56.515975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:56.516438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:56.519754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:56.520577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:56.707250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:56.752595 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6cb32fa2-b74a-4098-a77a-b951106a97fc tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.264616 Aug 04 04:25:56.753686 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 448/922] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:56 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:56.759692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2cd7ea84-c18a-4f7c-8889-a125141111b9 req-aa49398c-f51c-4a01-9b02-6f6ae04ca543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead118c2-ebfb-4040-8a2a-7e89d2c504f2", "name": "network-vif-unplugged", "status": "completed", "tag": "e3085237-07be-47a5-adb5-78638b3d9288"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:56.778137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2cd7ea84-c18a-4f7c-8889-a125141111b9 req-aa49398c-f51c-4a01-9b02-6f6ae04ca543 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:56.778743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2cd7ea84-c18a-4f7c-8889-a125141111b9 req-aa49398c-f51c-4a01-9b02-6f6ae04ca543 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:56.792109 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2cd7ea84-c18a-4f7c-8889-a125141111b9 req-aa49398c-f51c-4a01-9b02-6f6ae04ca543 service nova] Creating event network-vif-unplugged:e3085237-07be-47a5-adb5-78638b3d9288 for instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 on n-h1-851337-5 Aug 04 04:25:56.798414 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2cd7ea84-c18a-4f7c-8889-a125141111b9 req-aa49398c-f51c-4a01-9b02-6f6ae04ca543 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043148 Aug 04 04:25:56.799428 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 449/923] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:56.806009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:56.807133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:56.814387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:56.815119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:56.816225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:56.816951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:57.011917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:57.023287 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-106765bc-fcef-45b0-ac4c-795a28a6e5bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1268 microversion: 2.1 time: 0.222547 Aug 04 04:25:57.024859 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 450/924] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:56 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:57.037959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:57.038504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:57.048836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:57.049280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:57.060152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:57.060857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:57.347447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:57.356575 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a023f906-75ac-4c09-a7a0-ce96ede46e1d tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1589 microversion: 2.1 time: 0.330470 Aug 04 04:25:57.357167 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 451/925] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:57 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1589 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:57.371763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2153e02b-7831-4caf-9e78-9117e7596177 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '.version_select at 0x7f191a9b5280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:57.428487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2153e02b-7831-4caf-9e78-9117e7596177 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] HTTP exception thrown: Image not found. Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2153e02b-7831-4caf-9e78-9117e7596177 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Request method failure captured: Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 HTTP/1.1 Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60n3347_XsgkSKUFH9Z1kZb8aaMyajvhe1iNgmRjAovhv1IK1PTBY6quW2PHc1ifUkD79oZlmx9M1OdgPXxBRzex_kw7zp9nKqgt2Iv1U-1ZXlL720Noj7gQHxteQKTELMwo0RTDjo3SyX50SzS2xaj9tAQe9nCMyH2eeJX7rMEKIqo Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 57a51098088246149423af91de8d2167 Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:25:57.430510 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/57a51098088246149423af91de8d2167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/57a51098088246149423af91de8d2167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/57a51098088246149423af91de8d2167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_57a51098088246149423af91de8d2167", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 57a51098088246149423af91de8d2167 Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerTestJSON-726714051-project Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: aa8824426a46496aaaf6cc1640f18519 Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerTestJSON-726714051-project Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '15e5f790-ae0b-4c3d-80b4-f1b7e23d9024'} Aug 04 04:25:57.431961 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 to delete Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:57.432764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 could not be found. Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:25:57.437460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2153e02b-7831-4caf-9e78-9117e7596177 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:25:57.439247 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2153e02b-7831-4caf-9e78-9117e7596177 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "DELETE /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024" status: 404 len: 62 microversion: 2.1 time: 0.071648 Aug 04 04:25:57.440578 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 452/926] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:57 2022] DELETE /compute/v2.1/images/15e5f790-ae0b-4c3d-80b4-f1b7e23d9024 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:25:57.449457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:57.454775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:57.472070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:57.472687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:57.473595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:57.476103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:57.898245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:57.927692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:57.929741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:57.932370 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-12986413-c144-4110-bdfe-61826124a5a1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1411 microversion: 2.25 time: 0.493821 Aug 04 04:25:57.933262 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 453/927] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:57 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1411 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:57.942594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee8d89aa-a7fb-4ff4-a531-b8f300f23170 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:57.943376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee8d89aa-a7fb-4ff4-a531-b8f300f23170 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:57.966944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee8d89aa-a7fb-4ff4-a531-b8f300f23170 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:57.968545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee8d89aa-a7fb-4ff4-a531-b8f300f23170 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:57.969645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee8d89aa-a7fb-4ff4-a531-b8f300f23170 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:57.970225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee8d89aa-a7fb-4ff4-a531-b8f300f23170 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.069489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:25:58.333949 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee8d89aa-a7fb-4ff4-a531-b8f300f23170 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.399174 Aug 04 04:25:58.334541 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 454/928] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:25:57 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4/os-interface => generated 285 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:58.339407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:58.340293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:58.355490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.355948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.356732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.359660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.442494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:25:58.517303 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34b1e236-9868-4eec-8fe8-980cea584f8e tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.142370 Aug 04 04:25:58.519596 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 475/929] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:25:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:58.524904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1ab0f0f7-a0eb-4bbb-bdf2-e40a64552e46 req-5489a95d-4a63-441b-8bdd-72ba00e10657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1543d282-7d4f-4c87-b761-049a3c1ab46a", "tag": "20d3f61f-c31d-4334-aab1-aebea15b1651"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:25:58.548633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1ab0f0f7-a0eb-4bbb-bdf2-e40a64552e46 req-5489a95d-4a63-441b-8bdd-72ba00e10657 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.549488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1ab0f0f7-a0eb-4bbb-bdf2-e40a64552e46 req-5489a95d-4a63-441b-8bdd-72ba00e10657 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.567883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1ab0f0f7-a0eb-4bbb-bdf2-e40a64552e46 req-5489a95d-4a63-441b-8bdd-72ba00e10657 service nova] Creating event network-changed:20d3f61f-c31d-4334-aab1-aebea15b1651 for instance 1543d282-7d4f-4c87-b761-049a3c1ab46a on n-h2-851337-5 Aug 04 04:25:58.576557 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1ab0f0f7-a0eb-4bbb-bdf2-e40a64552e46 req-5489a95d-4a63-441b-8bdd-72ba00e10657 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055550 Aug 04 04:25:58.577995 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 476/930] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:25:58.590760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:58.604998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:58.667909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.668722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.669680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.670875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.677688 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-16ebc0f7-1812-44d2-8747-685855d700cd tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 204 len: 0 microversion: 2.1 time: 0.341680 Aug 04 04:25:58.679352 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 455/931] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:25:58 2022] DELETE /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:25:58.685227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:58.687805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:58.699664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.700463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.701440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.702042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.953718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:25:58.979181 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9a4f5ff1-4cb5-497d-831a-6ce1cd324b0e tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.298216 Aug 04 04:25:58.980051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 456/932] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:25:58 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:25:58.985597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:58.986430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:58.992579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.993057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:58.993866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:58.994469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:59.249508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:59.257948 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8402c92d-4313-45b0-85a8-8e7a521a3d78 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.676761 Aug 04 04:25:59.260011 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 477/933] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:58 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:59.266750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aacaa983-6afc-4f05-9963-4be6ad977d08 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Calling method '.version_select at 0x7f191a6d0430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:59.428386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:25:59.440869 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0910585d-69f8-4d3c-8300-d11b26da0ac0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1310 microversion: 2.1 time: 0.459543 Aug 04 04:25:59.453721 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 457/934] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:58 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1310 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:25:59.453721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:25:59.453721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:25:59.466931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:59.467433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:25:59.469107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:25:59.469549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.027516 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aacaa983-6afc-4f05-9963-4be6ad977d08 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/8bd4f8cf-f07a-4db0-9b57-543b9a90ec59" status: 200 len: 141 microversion: 2.1 time: 0.765397 Aug 04 04:26:00.029242 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 478/935] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:25:59 2022] GET /compute/v2.1/os-floating-ips/8bd4f8cf-f07a-4db0-9b57-543b9a90ec59 => generated 141 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:00.037244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:00.038005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:00.038610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:00.047006 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dc43f2d2-b329-4089-9d4b-a9372d1d7861 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1472 microversion: 2.1 time: 0.603926 Aug 04 04:26:00.058682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.060835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.062084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.062457 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 458/936] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:25:59 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1472 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:00.065469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.073689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:00.074313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:00.096539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.097356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.099551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.100216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.227965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:00.271312 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-09a29042-1cdf-4b53-b91f-a6ed11aa44d5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.203293 Aug 04 04:26:00.275238 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 459/937] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:00 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:00.307837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7700079-9098-4d77-8584-a04802b55fd0 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Calling method '.version_select at 0x7f191a9b5f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:00.490187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:00.499331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:00.501316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:00.503126 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7482506e-70b7-448c-b6f8-fc19a1c8032c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1411 microversion: 2.25 time: 0.471043 Aug 04 04:26:00.504212 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 479/938] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:00 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1411 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:00.513450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:00.514414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:00.523199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.524012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.524888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.525502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.849214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b7700079-9098-4d77-8584-a04802b55fd0 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.568118 Aug 04 04:26:00.850769 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 460/939] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:26:00 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:00.858901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:00.859906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:00.869105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.870795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.871916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.872684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:00.924578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:00.936745 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35cd2fbd-97f3-474f-9861-fb07e6fcc963 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.431204 Aug 04 04:26:00.937346 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 480/940] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:00 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:00.953406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-560bb170-6da9-4571-8de9-72f28d411e20 req-b967beb7-646c-408f-9394-e742039dac4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46a93f8-4b98-41ba-bfcc-1c01a0d05309", "tag": "a7a9350d-0ca3-41d0-b540-5018858da4aa"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:00.986705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-560bb170-6da9-4571-8de9-72f28d411e20 req-b967beb7-646c-408f-9394-e742039dac4a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:00.988265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-560bb170-6da9-4571-8de9-72f28d411e20 req-b967beb7-646c-408f-9394-e742039dac4a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:01.004367 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-560bb170-6da9-4571-8de9-72f28d411e20 req-b967beb7-646c-408f-9394-e742039dac4a service nova] Creating event network-changed:a7a9350d-0ca3-41d0-b540-5018858da4aa for instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 on n-h2-851337-5 Aug 04 04:26:01.010971 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-560bb170-6da9-4571-8de9-72f28d411e20 req-b967beb7-646c-408f-9394-e742039dac4a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072084 Aug 04 04:26:01.011838 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 481/941] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:01.016881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:01.017653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:01.024775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:01.025303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:01.026472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:01.027033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:01.353321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:01.363633 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4473ec38-e2f5-4ddc-8d2b-30d2ecf609b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1310 microversion: 2.1 time: 0.511502 Aug 04 04:26:01.371361 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 461/942] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:00 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1310 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:01.376201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b8857f38-17d5-4507-9036-62f98bad1d0c req-fe7106df-d112-48bf-9dcb-fb87b7f73047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0587a068-9eec-4e45-92a0-de71118a73d4", "tag": "dfddfe54-bf50-4e0f-a767-4eef195fa27b"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:01.408424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b8857f38-17d5-4507-9036-62f98bad1d0c req-fe7106df-d112-48bf-9dcb-fb87b7f73047 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:01.408871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b8857f38-17d5-4507-9036-62f98bad1d0c req-fe7106df-d112-48bf-9dcb-fb87b7f73047 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:01.438489 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b8857f38-17d5-4507-9036-62f98bad1d0c req-fe7106df-d112-48bf-9dcb-fb87b7f73047 service nova] Creating event network-changed:dfddfe54-bf50-4e0f-a767-4eef195fa27b for instance 0587a068-9eec-4e45-92a0-de71118a73d4 on n-h1-851337-5 Aug 04 04:26:01.450097 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b8857f38-17d5-4507-9036-62f98bad1d0c req-fe7106df-d112-48bf-9dcb-fb87b7f73047 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077374 Aug 04 04:26:01.454654 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 462/943] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:01.468618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e856da05-75bb-4a00-af6b-4bad8a03cbd7 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Calling method '.version_select at 0x7f191a9b5a60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:01.509713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:01.522422 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7b0e3fba-67be-420a-bf46-c38972069665 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1589 microversion: 2.1 time: 0.508941 Aug 04 04:26:01.524798 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 482/944] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:01 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1589 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:01.549229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:01.551820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:01.564088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:01.564696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:01.565711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:01.576178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:01.991221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8824426a46496aaaf6cc1640f18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a51098088246149423af91de8d2167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:02.010767 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c064d459-9902-4be4-87f7-277821bb6e2b tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 200 len: 1472 microversion: 2.1 time: 0.483618 Aug 04 04:26:02.012200 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 483/945] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:01 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:02.018543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:02.035307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:02.047817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:02.048473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:02.049716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:02.050302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:02.275842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:02.296395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:02.327929 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba38bd6c-d723-4ab2-ae62-065969af6e73 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.314646 Aug 04 04:26:02.346429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 484/946] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:02 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:02.352469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:02.353339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:02.359717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:02.362997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:02.363785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:02.364765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:02.365372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:02.727095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:02.736428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:02.744463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:02.745902 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-05454d10-c379-47b6-bb9b-a5a87097ea9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1411 microversion: 2.25 time: 0.397826 Aug 04 04:26:02.747272 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 485/947] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:02 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1411 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:02.753376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:02.754605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:02.762236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:02.762783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:02.763772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:02.764503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.105907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:03.135250 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67544a4b-e2d4-43b3-863a-92d89540376b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.384719 Aug 04 04:26:03.136977 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 486/948] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:02 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:03.143351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:03.144145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:03.168414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.168890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.169947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.173234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.498486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:03.605067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:03.797949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:03.859108 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-052498ec-76b5-435f-b412-07bc805f656d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1310 microversion: 2.1 time: 0.721639 Aug 04 04:26:03.860533 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 487/949] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:03 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1310 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:03.871367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e856da05-75bb-4a00-af6b-4bad8a03cbd7 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/8bd4f8cf-f07a-4db0-9b57-543b9a90ec59" status: 202 len: 0 microversion: 2.1 time: 2.415343 Aug 04 04:26:03.871969 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 463/950] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:26:01 2022] DELETE /compute/v2.1/os-floating-ips/8bd4f8cf-f07a-4db0-9b57-543b9a90ec59 => generated 0 bytes in 2417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:26:03.875321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:03.876298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] [instance: ead118c2-ebfb-4040-8a2a-7e89d2c504f2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:03.877264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9d4636dd-2b2d-4bc3-a8e7-a0e6d28f7637 req-38772746-8ce9-43da-b761-c1b932d8030b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead118c2-ebfb-4040-8a2a-7e89d2c504f2", "name": "network-vif-deleted", "tag": "e3085237-07be-47a5-adb5-78638b3d9288"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:03.888463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.889187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.890319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.891193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.904040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9d4636dd-2b2d-4bc3-a8e7-a0e6d28f7637 req-38772746-8ce9-43da-b761-c1b932d8030b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.906160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9d4636dd-2b2d-4bc3-a8e7-a0e6d28f7637 req-38772746-8ce9-43da-b761-c1b932d8030b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.910405 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] HTTP exception thrown: Instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 could not be found. Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Request method failure captured: Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 HTTP/1.1 Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60n3347_XsgkSKUFH9Z1kZb8aaMyajvhe1iNgmRjAovhv1IK1PTBY6quW2PHc1ifUkD79oZlmx9M1OdgPXxBRzex_kw7zp9nKqgt2Iv1U-1ZXlL720Noj7gQHxteQKTELMwo0RTDjo3SyX50SzS2xaj9tAQe9nCMyH2eeJX7rMEKIqo Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 57a51098088246149423af91de8d2167 Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:03.912199 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/57a51098088246149423af91de8d2167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/57a51098088246149423af91de8d2167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/57a51098088246149423af91de8d2167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_57a51098088246149423af91de8d2167", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 57a51098088246149423af91de8d2167 Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-726714051 Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerTestJSON-726714051-project Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: aa8824426a46496aaaf6cc1640f18519 Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerTestJSON-726714051-project Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 could not be found. Aug 04 04:26:03.913601 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'ead118c2-ebfb-4040-8a2a-7e89d2c504f2'} Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 could not be found. Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:03.914448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 could not be found. Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 could not be found. Aug 04 04:26:03.915876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:03.917261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] Returning 404 to user: Instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:03.917261 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e8579de-6655-4a55-a09f-0e27cf99dae1 tempest-ImagesOneServerTestJSON-726714051 tempest-ImagesOneServerTestJSON-726714051-project] 10.222.0.69 "GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2" status: 404 len: 111 microversion: 2.1 time: 0.052291 Aug 04 04:26:03.917261 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 488/951] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:03 2022] GET /compute/v2.1/servers/ead118c2-ebfb-4040-8a2a-7e89d2c504f2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:26:03.925626 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9d4636dd-2b2d-4bc3-a8e7-a0e6d28f7637 req-38772746-8ce9-43da-b761-c1b932d8030b service nova] Creating event network-vif-deleted:e3085237-07be-47a5-adb5-78638b3d9288 for instance ead118c2-ebfb-4040-8a2a-7e89d2c504f2 on n-h1-851337-5 Aug 04 04:26:03.933507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9d4636dd-2b2d-4bc3-a8e7-a0e6d28f7637 req-38772746-8ce9-43da-b761-c1b932d8030b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060298 Aug 04 04:26:03.935156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:03.935860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:03.938070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 464/952] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:03.943054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.943612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.944471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.944985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.948990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:03.949706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:03.960429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.961933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:03.962816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:03.963424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:04.097553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:04.121694 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-703cf0d3-9727-441d-b8ff-061a1f5828c5 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.204404 Aug 04 04:26:04.122692 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 489/953] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:03 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:04.127457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38bb4e1a-1057-415b-ab5b-2a14ffcb6eaf tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Action: 'create', calling method: .version_select at 0x7f191a69bdc0>, body: {"pool": null} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:04.235472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:04.252098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:04.254022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:04.258179 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-25dc988a-df5e-42ee-9171-e8f9b2820159 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1411 microversion: 2.25 time: 0.318679 Aug 04 04:26:04.259547 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 465/954] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:03 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1411 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:04.280702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:04.281672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:04.287581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:04.289421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:04.290446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:04.291264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:04.291976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:04.535297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:04.544588 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6779c9f7-f9d6-40db-ac26-dfdeeb057cb8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.271691 Aug 04 04:26:04.545370 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 466/955] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:04 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:04.560421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ba57d847-a416-4f9c-b324-0361e2f9eb03 req-3f8b8ae2-242e-437d-a040-4e3fa7719027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1543d282-7d4f-4c87-b761-049a3c1ab46a", "name": "network-vif-plugged", "status": "completed", "tag": "20d3f61f-c31d-4334-aab1-aebea15b1651"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:04.579280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ba57d847-a416-4f9c-b324-0361e2f9eb03 req-3f8b8ae2-242e-437d-a040-4e3fa7719027 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:04.579982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ba57d847-a416-4f9c-b324-0361e2f9eb03 req-3f8b8ae2-242e-437d-a040-4e3fa7719027 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:04.595756 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ba57d847-a416-4f9c-b324-0361e2f9eb03 req-3f8b8ae2-242e-437d-a040-4e3fa7719027 service nova] Creating event network-vif-plugged:20d3f61f-c31d-4334-aab1-aebea15b1651 for instance 1543d282-7d4f-4c87-b761-049a3c1ab46a on n-h2-851337-5 Aug 04 04:26:04.601774 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ba57d847-a416-4f9c-b324-0361e2f9eb03 req-3f8b8ae2-242e-437d-a040-4e3fa7719027 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045211 Aug 04 04:26:04.603149 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 467/956] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:04.892706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:04.893611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:04.900692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:04.901326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:04.902545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:04.902999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:05.145651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:05.158855 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38b358d1-bd76-47f1-aef4-dc963c84925c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1310 microversion: 2.1 time: 0.275828 Aug 04 04:26:05.164826 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 468/957] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:04 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1310 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:05.176046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:05.176781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:05.186116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:05.186563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:05.187419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:05.188059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:05.319642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:05.351365 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f51d4f8f-fe58-492e-b461-cf6539a0625a tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.183147 Aug 04 04:26:05.359619 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 469/958] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:05 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:05.365492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:05.366308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:05.387241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:05.387694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:05.388504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:05.389445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:05.745846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:05.754694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:05.756471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:05.757703 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-abd5c523-3548-4ed0-966d-80b3d8082510 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1411 microversion: 2.25 time: 0.397085 Aug 04 04:26:05.759281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 470/959] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:05 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:05.772290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:05.773292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:05.779929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:05.780473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:05.781278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:05.781695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:06.188168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:06.199292 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b0d015f-58ca-41ac-8c35-1901bbe2248b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.434149 Aug 04 04:26:06.202383 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 471/960] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:05 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:06.209665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:06.211011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:06.223337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:06.224177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:06.225401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:06.226092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:06.256849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:06.326164 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38bb4e1a-1057-415b-ab5b-2a14ffcb6eaf tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.201442 Aug 04 04:26:06.327987 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 490/961] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:26:04 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:06.341219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-079d7f0b-5e42-44c2-bf73-4bdf40f15d51 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Calling method '.version_select at 0x7f191a4d8b80>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:06.772437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:06.782376 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31bc8b70-a738-4015-9fc3-f3a5738fc1fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1310 microversion: 2.1 time: 0.577907 Aug 04 04:26:06.783331 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 472/962] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:06 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1310 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:06.791241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:06.792189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:06.815205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:06.816001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:06.817373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:06.817899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:06.949044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:06.969311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78551398-a8dd-4ab4-9c9d-7cd61831f8b9 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.184687 Aug 04 04:26:06.970148 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 473/963] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:06 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:06.975454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:06.976366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:06.986823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:06.987567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:06.988679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:06.989350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:07.292763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:07.331706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:07.340083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:07.344786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e907ae1d-e2fc-48c3-880c-7e06b23ae922 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1607 microversion: 2.25 time: 0.373432 Aug 04 04:26:07.351109 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 474/964] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:06 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1607 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:07.373036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:07.373718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:07.391361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:07.394238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:07.394238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:07.394238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:07.967050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:07.977406 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5bafc5bd-546c-4147-ad27-b9ba3460c906 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.624366 Aug 04 04:26:07.979128 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 475/965] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:07 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:07.986516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5adf1f2-c3d4-45dd-b581-0f493abdc429 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:07.987356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e5adf1f2-c3d4-45dd-b581-0f493abdc429 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:08.008516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5adf1f2-c3d4-45dd-b581-0f493abdc429 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:08.009604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5adf1f2-c3d4-45dd-b581-0f493abdc429 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:08.011827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5adf1f2-c3d4-45dd-b581-0f493abdc429 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:08.019424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5adf1f2-c3d4-45dd-b581-0f493abdc429 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:08.231459 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5adf1f2-c3d4-45dd-b581-0f493abdc429 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.250085 Aug 04 04:26:08.232093 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 476/966] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:26:07 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:26:08.239417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:08.240387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:08.250071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:08.250525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:08.251623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:08.252278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:08.332621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-079d7f0b-5e42-44c2-bf73-4bdf40f15d51 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac" status: 202 len: 0 microversion: 2.1 time: 1.996630 Aug 04 04:26:08.337135 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 491/967] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:26:06 2022] DELETE /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac => generated 0 bytes in 2002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:26:08.342298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:08.343142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:08.349893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:08.351247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:08.352748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:08.353351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:08.496897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:08.557685 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1e635223-fd1f-48c3-80dd-e0b389080328 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.219237 Aug 04 04:26:08.562888 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 492/968] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:08 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:08.565925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:08.571690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95fc9111-53c5-4712-aa3e-1caa33a2ea2d tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Calling method '.version_select at 0x7f191aa209d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:08.579035 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9f43a1ff-5883-4c9e-bc2f-50b5a8648cdf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1310 microversion: 2.1 time: 0.344890 Aug 04 04:26:08.579666 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 477/969] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:08 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1310 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:08.591284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b7f9d696-216d-4c58-9984-20490613b686 req-091c5a65-7ad9-476a-9bde-edb8763da6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46a93f8-4b98-41ba-bfcc-1c01a0d05309", "name": "network-vif-plugged", "status": "completed", "tag": "a7a9350d-0ca3-41d0-b540-5018858da4aa"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:08.624540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b7f9d696-216d-4c58-9984-20490613b686 req-091c5a65-7ad9-476a-9bde-edb8763da6d4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:08.625432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b7f9d696-216d-4c58-9984-20490613b686 req-091c5a65-7ad9-476a-9bde-edb8763da6d4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:08.655565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-95fc9111-53c5-4712-aa3e-1caa33a2ea2d tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 306f7c8e-5c99-4568-a042-e3823fbb55ac could not be found", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:26:08.656267 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-95fc9111-53c5-4712-aa3e-1caa33a2ea2d tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] HTTP exception thrown: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95fc9111-53c5-4712-aa3e-1caa33a2ea2d tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Request method failure captured: Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac HTTP/1.1 Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60pSlQghwlfFGL7NHBB0OFUh17PySfAPoQbRbfWgJo5z-wh6aCUNhhaTy8gMkIgL95s10X5s5SE8HSFLocJ_wKCy_tY4B_eW5oX5Ey7oUgxjOdXjenvianOZFBtg19EHC4NWoPLMLiwtLhFpFyEXlAUHAz5CHEJ7EBoOxwwJ1GDOIkc Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ada5207e293b478ebf51ec98890947d4 Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsTestJSON-1267537274 Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:08.664048 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ada5207e293b478ebf51ec98890947d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ada5207e293b478ebf51ec98890947d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ada5207e293b478ebf51ec98890947d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ada5207e293b478ebf51ec98890947d4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsTestJSON-1267537274 Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ada5207e293b478ebf51ec98890947d4 Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1267537274 Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsTestJSON-1267537274-project Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 3a47ccd1d67e43829ca3cc4a6cf83f3b Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsTestJSON-1267537274-project Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: exception: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '306f7c8e-5c99-4568-a042-e3823fbb55ac'} Aug 04 04:26:08.665907 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:26:08.667183 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 306f7c8e-5c99-4568-a042-e3823fbb55ac could not be found Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dfea1ef-4c47-4c25-a4e0-8fe39b92dbb3'] Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac. Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:08.668783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:08.669993 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:08.671197 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.671197 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.672470 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b7f9d696-216d-4c58-9984-20490613b686 req-091c5a65-7ad9-476a-9bde-edb8763da6d4 service nova] Creating event network-vif-plugged:a7a9350d-0ca3-41d0-b540-5018858da4aa for instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 on n-h2-851337-5 Aug 04 04:26:08.672641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95fc9111-53c5-4712-aa3e-1caa33a2ea2d tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Returning 404 to user: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:08.673114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-95fc9111-53c5-4712-aa3e-1caa33a2ea2d tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac" status: 404 len: 111 microversion: 2.1 time: 0.108682 Aug 04 04:26:08.675064 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 493/970] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:26:08 2022] GET /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:26:08.689150 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b7f9d696-216d-4c58-9984-20490613b686 req-091c5a65-7ad9-476a-9bde-edb8763da6d4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104045 Aug 04 04:26:08.690076 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 478/971] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:08.703611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-731c2282-ef15-40ef-998d-79ceeec853f6 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Calling method '.version_select at 0x7f191a65f1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:08.832763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-731c2282-ef15-40ef-998d-79ceeec853f6 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 306f7c8e-5c99-4568-a042-e3823fbb55ac could not be found", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:26:08.833466 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-731c2282-ef15-40ef-998d-79ceeec853f6 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] HTTP exception thrown: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-731c2282-ef15-40ef-998d-79ceeec853f6 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Request method failure captured: Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac HTTP/1.1 Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60pSlQghwlfFGL7NHBB0OFUh17PySfAPoQbRbfWgJo5z-wh6aCUNhhaTy8gMkIgL95s10X5s5SE8HSFLocJ_wKCy_tY4B_eW5oX5Ey7oUgxjOdXjenvianOZFBtg19EHC4NWoPLMLiwtLhFpFyEXlAUHAz5CHEJ7EBoOxwwJ1GDOIkc Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ada5207e293b478ebf51ec98890947d4 Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsTestJSON-1267537274 Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:08.835541 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ada5207e293b478ebf51ec98890947d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ada5207e293b478ebf51ec98890947d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ada5207e293b478ebf51ec98890947d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ada5207e293b478ebf51ec98890947d4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsTestJSON-1267537274 Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ada5207e293b478ebf51ec98890947d4 Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1267537274 Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsTestJSON-1267537274-project Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 3a47ccd1d67e43829ca3cc4a6cf83f3b Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsTestJSON-1267537274-project Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: exception: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '306f7c8e-5c99-4568-a042-e3823fbb55ac'} Aug 04 04:26:08.836930 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:26:08.840002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 306f7c8e-5c99-4568-a042-e3823fbb55ac could not be found Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5816a75c-2edc-4fb4-bd51-a255d5ef1c5f'] Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac. Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:08.841097 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:08.842270 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:08.844115 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac Aug 04 04:26:08.844115 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:08.846407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-731c2282-ef15-40ef-998d-79ceeec853f6 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] Returning 404 to user: Floating IP not found for ID 306f7c8e-5c99-4568-a042-e3823fbb55ac {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:08.847752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-731c2282-ef15-40ef-998d-79ceeec853f6 tempest-FloatingIPsTestJSON-1267537274 tempest-FloatingIPsTestJSON-1267537274-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac" status: 404 len: 111 microversion: 2.1 time: 0.155080 Aug 04 04:26:08.848548 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 494/972] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:26:08 2022] DELETE /compute/v2.1/os-floating-ips/306f7c8e-5c99-4568-a042-e3823fbb55ac => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:26:09.028103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:09.031831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:09.048110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:09.055247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:09.056489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:09.057106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:09.296252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:09.308016 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-81795ee5-ad36-4e28-82a4-55a92501bec8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.310630 Aug 04 04:26:09.309594 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 479/973] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:08 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:09.606162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:09.607461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:09.608079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:09.608954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:09.621043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:09.621700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:09.623925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:09.625672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:09.627069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:09.629201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:09.630202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:09.630817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:09.879340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:09.922844 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5fe3f317-17b5-4a03-877c-cf21e46de01d tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.322398 Aug 04 04:26:09.927720 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 495/974] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:09 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:10.081778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:10.095039 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c4668020-52f2-44d1-a7ad-bc2fb1b877c3 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1310 microversion: 2.1 time: 0.492988 Aug 04 04:26:10.097952 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 480/975] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:09 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1310 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:10.330374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:10.331195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:10.354797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:10.355490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:10.357444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:10.367492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:10.676954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:10.697618 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-25a11b44-fe77-4c8b-9d30-242060916c29 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 0.369445 Aug 04 04:26:10.721363 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 496/976] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:10 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:10.963740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:10.965234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:10.978501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:10.981405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:10.982666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:10.985779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:11.118199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:11.118827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:11.138608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:11.139342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:11.140730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:11.141504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:11.333900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:11.395810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:11.404034 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ef03c9a-1ded-42c3-b969-9f3667ab4a88 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1929 microversion: 2.75 time: 0.445027 Aug 04 04:26:11.404717 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 481/977] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:10 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1929 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:11.417234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1b9d52a4-f168-4eba-9c70-7cc4306bfb64 req-608adc1a-49d7-4b29-8b02-0e253eb381a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1543d282-7d4f-4c87-b761-049a3c1ab46a", "tag": "20d3f61f-c31d-4334-aab1-aebea15b1651"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:11.431693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:11.441033 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a3b910fd-0529-4fe2-a15c-22e153d7779e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1494 microversion: 2.1 time: 0.326859 Aug 04 04:26:11.456087 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 497/978] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:11 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1494 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:11.468110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b9d52a4-f168-4eba-9c70-7cc4306bfb64 req-608adc1a-49d7-4b29-8b02-0e253eb381a0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:11.471418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b9d52a4-f168-4eba-9c70-7cc4306bfb64 req-608adc1a-49d7-4b29-8b02-0e253eb381a0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:11.506500 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1b9d52a4-f168-4eba-9c70-7cc4306bfb64 req-608adc1a-49d7-4b29-8b02-0e253eb381a0 service nova] Creating event network-changed:20d3f61f-c31d-4334-aab1-aebea15b1651 for instance 1543d282-7d4f-4c87-b761-049a3c1ab46a on n-h2-851337-5 Aug 04 04:26:11.522710 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1b9d52a4-f168-4eba-9c70-7cc4306bfb64 req-608adc1a-49d7-4b29-8b02-0e253eb381a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114034 Aug 04 04:26:11.528427 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 482/979] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:11.725428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:11.726133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:11.741170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:11.741660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:11.743030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:11.743470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:11.746110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12122cf4-9638-443d-bce2-873754906bc4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:11.747374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12122cf4-9638-443d-bce2-873754906bc4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:11.762188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12122cf4-9638-443d-bce2-873754906bc4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:11.762924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12122cf4-9638-443d-bce2-873754906bc4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:11.768867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12122cf4-9638-443d-bce2-873754906bc4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:11.769395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12122cf4-9638-443d-bce2-873754906bc4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:12.907436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:12.951433 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41cacc66-c5ad-49e9-b555-e152d71b2261 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1542 microversion: 2.1 time: 1.229814 Aug 04 04:26:12.960664 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 483/980] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:11 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1542 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:12.961879 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12122cf4-9638-443d-bce2-873754906bc4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1645 microversion: 2.1 time: 1.493461 Aug 04 04:26:12.965608 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 498/981] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:11 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1645 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:12.974686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:12.998510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:13.010692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a92f3522-024c-42e6-a465-ed3085a9fd1c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:13.011660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a92f3522-024c-42e6-a465-ed3085a9fd1c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:13.045465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a92f3522-024c-42e6-a465-ed3085a9fd1c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.047802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.048765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a92f3522-024c-42e6-a465-ed3085a9fd1c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.050409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.052052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.052918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a92f3522-024c-42e6-a465-ed3085a9fd1c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.055893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.056365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a92f3522-024c-42e6-a465-ed3085a9fd1c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.423964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:13.474552 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37d55887-06b1-42c8-8e1f-f2f9a54f1fd1 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1935 microversion: 2.75 time: 0.507838 Aug 04 04:26:13.491876 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 484/982] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:12 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1935 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:13.760134 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a92f3522-024c-42e6-a465-ed3085a9fd1c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1645 microversion: 2.1 time: 0.757231 Aug 04 04:26:13.761319 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 499/983] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:13 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1645 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:13.792023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcefb45b-c565-49e7-853a-2742255bb584 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:13.800539 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:13.800539 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:26:13.810817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcefb45b-c565-49e7-853a-2742255bb584 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.812160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcefb45b-c565-49e7-853a-2742255bb584 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.816185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcefb45b-c565-49e7-853a-2742255bb584 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.818868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcefb45b-c565-49e7-853a-2742255bb584 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.875974 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcefb45b-c565-49e7-853a-2742255bb584 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095000 Aug 04 04:26:13.885393 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 485/984] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:26:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:13.890974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851337-5", "block_migration": true, "disk_over_commit": false}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:13.893594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:13.913441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.913939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.914758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:13.923478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:13.996659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lazy-loading 'flavor' on Instance uuid c46a93f8-4b98-41ba-bfcc-1c01a0d05309 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:14.000533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:14.002072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:14.019264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:14.019264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:14.021977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:14.024982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:14.087011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Going to try to live migrate instance to n-h1-851337-5 {{(pid=119342) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:26:14.889936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:14.907973 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c7001116-020e-4186-b8e1-2e4b227c6697 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1541 microversion: 2.1 time: 0.912347 Aug 04 04:26:14.924323 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 486/985] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:13 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1541 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:14.949003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:14.954702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:14.963949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:14.965386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:14.966879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:14.967542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:15.241560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:15.282477 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1bcdaada-1a6a-4f60-b173-e8f2c8d85fc7 tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1935 microversion: 2.75 time: 0.352784 Aug 04 04:26:15.286154 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 487/986] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:14 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1935 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:15.578742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-924624212", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f30461e9-3c81-462f-be25-58cf671d319f"}], "security_groups": [{"name": "tempest-securitygroup--724537"}], "key_name": "tempest-keypair-82366615", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e72ad498-7c79-4621-a2bb-3deb0f16166a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:15.941552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] validate_networks() for [('f30461e9-3c81-462f-be25-58cf671d319f', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:26:16.619781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Getting quotas for project 828bda82de6f41c3959d1b81a24453a1. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:16.626446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Getting quotas for user fc44eab358f741bf8f619ef4bb079c73 and project 828bda82de6f41c3959d1b81a24453a1. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:16.651916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:26:16.652659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:26:16.653366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:26:16.653965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:26:16.654535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:26:16.685825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:16.689058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:16.690145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:16.690774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:16.714562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Getting quotas for project 828bda82de6f41c3959d1b81a24453a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:16.724169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Getting quotas for user fc44eab358f741bf8f619ef4bb079c73 and project 828bda82de6f41c3959d1b81a24453a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:16.885990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:26:16.888272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e72ad498-7c79-4621-a2bb-3deb0f16166a',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:26:17.194123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9bd578ab-96a5-4a5c-9eb8-52bf4d0f61b3 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.619899 Aug 04 04:26:17.205389 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 488/987] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:26:15 2022] POST /compute/v2.1/servers => generated 403 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:26:17.216437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:17.227393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:17.255319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:17.258119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:17.261048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:17.262471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:17.600655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:17.611934 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd5712e7-3446-4d2b-a1cf-1f29f46e1b68 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1470 microversion: 2.1 time: 0.405394 Aug 04 04:26:17.628452 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 489/988] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:17 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1470 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:17.634683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:17.635649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:17.642094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:17.642842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:17.643895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:17.644514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:17.780844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:17.792446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] Lazy-loading 'services' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:17.835834 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b10a0b3-8af1-4c0e-a83a-866dbf5c461c tempest-ServersAdmin275Test-1951206507 tempest-ServersAdmin275Test-1951206507-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1920 microversion: 2.75 time: 0.205197 Aug 04 04:26:17.839780 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 490/989] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:17 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1920 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:17.848393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-53062f01-5984-4f3d-b0e3-0566ace10c40 req-6e02f2db-77b3-4f64-b90d-f5d601358ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b", "name": "network-vif-unplugged", "status": "completed", "tag": "3fc792c7-febd-4eb9-bc27-aa4dbc529458"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:17.862691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-53062f01-5984-4f3d-b0e3-0566ace10c40 req-6e02f2db-77b3-4f64-b90d-f5d601358ca8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:17.863359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-53062f01-5984-4f3d-b0e3-0566ace10c40 req-6e02f2db-77b3-4f64-b90d-f5d601358ca8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:17.885559 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-53062f01-5984-4f3d-b0e3-0566ace10c40 req-6e02f2db-77b3-4f64-b90d-f5d601358ca8 service nova] Creating event network-vif-unplugged:3fc792c7-febd-4eb9-bc27-aa4dbc529458 for instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b on n-h2-851337-5 Aug 04 04:26:17.898280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-53062f01-5984-4f3d-b0e3-0566ace10c40 req-6e02f2db-77b3-4f64-b90d-f5d601358ca8 service nova] Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:26:17.908991 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-53062f01-5984-4f3d-b0e3-0566ace10c40 req-6e02f2db-77b3-4f64-b90d-f5d601358ca8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067619 Aug 04 04:26:17.910059 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 491/990] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:17.930302 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b650b738-5dd6-43c1-a2a2-679376bc2174 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309/action" status: 202 len: 0 microversion: 2.1 time: 4.043985 Aug 04 04:26:17.931031 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 500/991] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:26:13 2022] POST /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309/action => generated 0 bytes in 4046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:26:17.936315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-132bd6bd-d513-44d9-a4e3-4b1ecac796d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:17.937021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-132bd6bd-d513-44d9-a4e3-4b1ecac796d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:18.007721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-132bd6bd-d513-44d9-a4e3-4b1ecac796d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:18.016621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-132bd6bd-d513-44d9-a4e3-4b1ecac796d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1119 microversion: 2.1 time: 0.084402 Aug 04 04:26:18.017947 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 501/992] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:17 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1119 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:18.023412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:18.024200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:18.031411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.032075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.059382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.063776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.218142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.218603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.219443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.219882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.288801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:18.291773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:18.300718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for user 80bef27d84824d25b096a8507009d824 and project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:18.415368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c36783a5-bc82-436e-b721-b5300c4431fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'create', calling method: .version_select at 0x7f191a7d99d0>, body: {"keypair": {"name": "tempest-keypair-1848170105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrGrSM0J4b+PSRjKobHeYGrNMbqneqorFYmd1YbsOhns6OsARoMKuYmL/6b8YE0zV5vI9ySTPnq5KPgfgpu0FaIMffrtzPZDLJ86tIewj2hLWQrBlZNHOWg60l8iTONAg=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:18.459550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c36783a5-bc82-436e-b721-b5300c4431fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for project 85353a54064c4117bfedd41efcde07db. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:18.470554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c36783a5-bc82-436e-b721-b5300c4431fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for user d51068c4cce544e38ad1b23996efdec3 and project 85353a54064c4117bfedd41efcde07db. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:18.530708 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c36783a5-bc82-436e-b721-b5300c4431fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.614054 Aug 04 04:26:18.531394 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 492/993] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:26:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:18.550068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:18.552935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:18.557309 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f386bf1-b7ac-45e8-8709-0d8ec770ee91 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b/action" status: 202 len: 0 microversion: 2.1 time: 0.537495 Aug 04 04:26:18.564171 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 502/994] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:26:18 2022] POST /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:26:18.566223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.566683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.571043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:18.572034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:18.575931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.576402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.589542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.591553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.592595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.593249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.632990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:26:18.802833 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c167f756-1c0f-4860-9133-7c8d9c6af7a6 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 204 len: 0 microversion: 2.75 time: 0.262531 Aug 04 04:26:18.803478 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 493/995] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:26:18 2022] DELETE /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:26:18.816764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:18.817932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:18.826573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.827334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:18.828325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:18.829680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:19.128834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:19.140835 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e5c3635-7960-4e6c-8eb8-6e8953080046 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.575093 Aug 04 04:26:19.141682 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 503/996] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:18 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:19.150048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:19.151113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:19.158352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:19.159422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:19.160570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:19.161268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:19.275854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:19.288624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:19.293176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:19.303862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-617affc6-239d-44f8-83c5-37421ce5d76e tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1444 microversion: 2.75 time: 0.160829 Aug 04 04:26:19.306117 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 504/997] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:19 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:19.313109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:19.313941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:19.321967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:19.322766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:19.325702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:19.327340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:19.496716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:19.506437 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-209ae661-a18e-4d69-87d9-69ed2146a873 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1225 microversion: 2.1 time: 0.198603 Aug 04 04:26:19.508427 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 505/998] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:19 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1225 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:19.521912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:19.532438 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a98c1a1d-53eb-47a1-8162-81304ebc498e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1469 microversion: 2.1 time: 0.727499 Aug 04 04:26:19.533696 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 494/999] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:18 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1469 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:20.164171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:20.169921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:20.185793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.187618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.189427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.192166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.329972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:20.330710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:20.341940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.344208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.346668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.348354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.612084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:20.628112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:20.629742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:20.635951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56565236-e17a-4baf-ba74-e3fc6d9c0953 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1444 microversion: 2.75 time: 0.310521 Aug 04 04:26:20.637154 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 495/1000] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:20 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1444 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:20.681330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-230e72eb-3d4d-4e15-92ad-bfa6de0c23bc req-e490d24b-7d2e-462c-bd4d-359470ef0b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b", "name": "network-vif-plugged", "status": "completed", "tag": "3fc792c7-febd-4eb9-bc27-aa4dbc529458"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:20.710510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-230e72eb-3d4d-4e15-92ad-bfa6de0c23bc req-e490d24b-7d2e-462c-bd4d-359470ef0b7a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.713292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-230e72eb-3d4d-4e15-92ad-bfa6de0c23bc req-e490d24b-7d2e-462c-bd4d-359470ef0b7a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.737642 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-230e72eb-3d4d-4e15-92ad-bfa6de0c23bc req-e490d24b-7d2e-462c-bd4d-359470ef0b7a service nova] Creating event network-vif-plugged:3fc792c7-febd-4eb9-bc27-aa4dbc529458 for instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b on n-h2-851337-5 Aug 04 04:26:20.753088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-230e72eb-3d4d-4e15-92ad-bfa6de0c23bc req-e490d24b-7d2e-462c-bd4d-359470ef0b7a service nova] Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:26:20.777314 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-230e72eb-3d4d-4e15-92ad-bfa6de0c23bc req-e490d24b-7d2e-462c-bd4d-359470ef0b7a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137889 Aug 04 04:26:20.777938 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 496/1001] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:20.786500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:20.794415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:20.807810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.808467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.809654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.813141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.928800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:20.939642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6a86447-d2b6-406c-b16c-bbc55a5de644 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.780167 Aug 04 04:26:20.942490 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 506/1002] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:20 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:20.954648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:20.964035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:20.973636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.974214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.978210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:20.983876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:20.995951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:21.012404 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a562be89-a9d3-4841-8c01-050309e3d954 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1235 microversion: 2.1 time: 0.229779 Aug 04 04:26:21.017074 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 497/1003] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:20 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1235 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:21.166907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:21.196367 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a2c559a7-9ea0-4248-aea7-b059521c1e58 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1469 microversion: 2.1 time: 0.250983 Aug 04 04:26:21.200378 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 507/1004] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:20 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:21.661034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:21.661638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:21.676968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:21.677710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:21.680420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:21.684970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:21.736899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:21.737909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:21.738375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lazy-loading 'fault' on Instance uuid 1e85b025-f6dd-476a-819b-dc48b1c798ee {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:21.789401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:21.800072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:21.806366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d1f299e211e4211916e6e2ddedcf407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ee2d0ed95e4d41bca3aa809aee19fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:21.831322 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3b150edc-d79e-4e65-a964-7372b4a57439 tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 200 len: 1449 microversion: 2.75 time: 0.173495 Aug 04 04:26:21.834349 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 498/1005] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:21 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 1449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:21.965843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:21.966641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:21.980185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:21.980653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:21.981455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:21.981896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:22.039403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:22.041700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:22.051226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:22.052158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:22.053376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:22.054035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:22.173702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:22.198343 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bd67dddf-4013-42e4-9f25-cb501ef8160a tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1235 microversion: 2.1 time: 0.157459 Aug 04 04:26:22.199417 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 499/1006] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:22 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1235 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:22.228983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:22.231894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:22.250967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:22.252803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:22.256102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:22.260840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:22.743344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:22.761175 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-407d8565-b4db-445e-b18a-148556dcbccc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.800421 Aug 04 04:26:22.776414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 508/1007] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:21 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:22.776414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2101382624", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcf37719-691e-4ce4-8b13-247de9c8f621"}], "security_groups": [{"name": "tempest-securitygroup--680386617"}], "key_name": "tempest-keypair-1848170105", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:23.028389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:23.039204 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad81dbcd-cfda-49da-8dfe-28223cad12b7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1469 microversion: 2.1 time: 0.821701 Aug 04 04:26:23.041994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 500/1008] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:22 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1469 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:23.059436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e93ff3f2-b9f9-4923-8be9-977dbd15b09e req-517ffd8b-4555-4c11-921f-f72213095d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46a93f8-4b98-41ba-bfcc-1c01a0d05309", "name": "network-vif-unplugged", "status": "completed", "tag": "a7a9350d-0ca3-41d0-b540-5018858da4aa"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:23.088432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e93ff3f2-b9f9-4923-8be9-977dbd15b09e req-517ffd8b-4555-4c11-921f-f72213095d99 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:23.089142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e93ff3f2-b9f9-4923-8be9-977dbd15b09e req-517ffd8b-4555-4c11-921f-f72213095d99 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:23.119097 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e93ff3f2-b9f9-4923-8be9-977dbd15b09e req-517ffd8b-4555-4c11-921f-f72213095d99 service nova] Creating event network-vif-unplugged:a7a9350d-0ca3-41d0-b540-5018858da4aa for instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 on n-h2-851337-5 Aug 04 04:26:23.120645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] validate_networks() for [('fcf37719-691e-4ce4-8b13-247de9c8f621', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:26:23.138430 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e93ff3f2-b9f9-4923-8be9-977dbd15b09e req-517ffd8b-4555-4c11-921f-f72213095d99 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084105 Aug 04 04:26:23.139191 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 501/1009] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:23.153086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:23.171342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] [instance: 1e85b025-f6dd-476a-819b-dc48b1c798ee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:23.198338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:23.198894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:23.203159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:23.203660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:23.263639 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] HTTP exception thrown: Instance 1e85b025-f6dd-476a-819b-dc48b1c798ee could not be found. Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Request method failure captured: Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee HTTP/1.1 Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60oU5Au8p24eY-SKvOpFZkJGOgAAnHyZzfngxsi0Kv7VHemP2hQHTSLpNDzqQvibL4Q7TWlAvjaDqJao2xmGtFv8j7edWH9FJX0M31ggPwVUQDJEWtMFF87iC0-5CL_WI221AWgLzb8XgCWKjho6-ADZgZbOlZl6KNZzPf4b-nKCrtI Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.75 Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 68ee2d0ed95e4d41bca3aa809aee19fe Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersAdmin275Test-239174252 Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:23.270273 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/68ee2d0ed95e4d41bca3aa809aee19fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/68ee2d0ed95e4d41bca3aa809aee19fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/68ee2d0ed95e4d41bca3aa809aee19fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_68ee2d0ed95e4d41bca3aa809aee19fe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersAdmin275Test-239174252 Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 68ee2d0ed95e4d41bca3aa809aee19fe Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersAdmin275Test-239174252 Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersAdmin275Test-239174252-project Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 5d1f299e211e4211916e6e2ddedcf407 Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersAdmin275Test-239174252-project Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 1e85b025-f6dd-476a-819b-dc48b1c798ee could not be found. Aug 04 04:26:23.272089 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1e85b025-f6dd-476a-819b-dc48b1c798ee'} Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e85b025-f6dd-476a-819b-dc48b1c798ee could not be found. Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:23.273073 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e85b025-f6dd-476a-819b-dc48b1c798ee could not be found. Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e85b025-f6dd-476a-819b-dc48b1c798ee could not be found. Aug 04 04:26:23.275021 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:23.276420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] Returning 404 to user: Instance 1e85b025-f6dd-476a-819b-dc48b1c798ee could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:23.276420 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0a1f361-5e2f-4b78-b4a8-50de25aa55ee tempest-ServersAdmin275Test-239174252 tempest-ServersAdmin275Test-239174252-project] 10.222.0.69 "GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee" status: 404 len: 111 microversion: 2.75 time: 0.132699 Aug 04 04:26:23.276420 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 502/1010] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:23 2022] GET /compute/v2.1/servers/1e85b025-f6dd-476a-819b-dc48b1c798ee => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:26:23.294650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:23.294650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:23.316887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:23.317484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:23.320658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:23.321103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:23.603765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:23.779662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:23.788712 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b7c5a05d-cde9-4c2b-8550-00f6138b7562 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1299 microversion: 2.1 time: 0.513357 Aug 04 04:26:23.791950 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 503/1011] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:23 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1299 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:23.805634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:23.806672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:23.816892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:23.821902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:23.834591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:23.835755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:23.836352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:24.134540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:24.147472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bd981306-4ef3-4790-a550-07390ab69b09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.354125 Aug 04 04:26:24.148829 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 504/1012] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:23 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:24.158304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:24.167830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:24.182122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:24.184445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:24.187240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:24.188302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:24.706941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:24.727304 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-47f2c5a8-c9ca-43f6-b7f5-d8b8e3c916e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1535 microversion: 2.1 time: 0.577211 Aug 04 04:26:24.728029 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 505/1013] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:24 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1535 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:24.813330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:24.814209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:24.827139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:24.827978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:24.829050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:24.829703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:24.846618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:26:24.847705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:26:24.848247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:26:24.848725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:26:24.849145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:26:24.860915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:24.861784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:24.864693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:24.865377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:24.905518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:24.911010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for user d51068c4cce544e38ad1b23996efdec3 and project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:24.927064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:26:24.929855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:26:25.012540 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b98e4065-7d92-4aa0-85a2-1ed12587ff6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.248769 Aug 04 04:26:25.013965 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 509/1014] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:26:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:26:25.028832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d69dc3d-9d6d-4007-ba37-7ced7c122be3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:25.033280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d69dc3d-9d6d-4007-ba37-7ced7c122be3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:25.577209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d69dc3d-9d6d-4007-ba37-7ced7c122be3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:25.585945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d69dc3d-9d6d-4007-ba37-7ced7c122be3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1239 microversion: 2.1 time: 0.564293 Aug 04 04:26:25.591314 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 510/1015] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:25 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1239 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:25.598492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:25.603732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:25.633483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:25.633926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:25.634716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:25.635178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:25.730045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:25.744473 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5af9272-b688-4b97-bbf5-664065341312 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1299 microversion: 2.1 time: 0.935366 Aug 04 04:26:25.745069 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 506/1016] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:24 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1299 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:25.750824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-bf0f37c8-31d0-4f96-8104-8b177bc566ea req-1aa5ebf8-a7e2-482b-9c8a-85d1f3814de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46a93f8-4b98-41ba-bfcc-1c01a0d05309", "tag": "a7a9350d-0ca3-41d0-b540-5018858da4aa"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:25.782696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-bf0f37c8-31d0-4f96-8104-8b177bc566ea req-1aa5ebf8-a7e2-482b-9c8a-85d1f3814de6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:25.783383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-bf0f37c8-31d0-4f96-8104-8b177bc566ea req-1aa5ebf8-a7e2-482b-9c8a-85d1f3814de6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:25.808978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-bf0f37c8-31d0-4f96-8104-8b177bc566ea req-1aa5ebf8-a7e2-482b-9c8a-85d1f3814de6 service nova] Creating event network-changed:a7a9350d-0ca3-41d0-b540-5018858da4aa for instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 on n-h2-851337-5 Aug 04 04:26:25.819126 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-bf0f37c8-31d0-4f96-8104-8b177bc566ea req-1aa5ebf8-a7e2-482b-9c8a-85d1f3814de6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071904 Aug 04 04:26:25.832374 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 507/1017] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:25.839585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:25.840627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:25.852964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:25.853419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:25.854321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:25.854649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:26.374198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:26.383161 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fbe87bc1-95b5-43ed-a542-db2d2471fec8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.790226 Aug 04 04:26:26.389537 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 511/1018] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:25 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:26.405746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5802156c-5515-457b-95d0-b8853827bc16 req-48d443d3-d049-4914-960e-7f227df7509b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b", "name": "network-vif-unplugged", "status": "completed", "tag": "3fc792c7-febd-4eb9-bc27-aa4dbc529458"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:26.427325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5802156c-5515-457b-95d0-b8853827bc16 req-48d443d3-d049-4914-960e-7f227df7509b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:26.427989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5802156c-5515-457b-95d0-b8853827bc16 req-48d443d3-d049-4914-960e-7f227df7509b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:26.456025 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5802156c-5515-457b-95d0-b8853827bc16 req-48d443d3-d049-4914-960e-7f227df7509b service nova] Creating event network-vif-unplugged:3fc792c7-febd-4eb9-bc27-aa4dbc529458 for instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b on n-h2-851337-5 Aug 04 04:26:26.456227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:26.458695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:26.474348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9700172c-0085-4bdb-903a-e58191274617 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1535 microversion: 2.1 time: 0.638154 Aug 04 04:26:26.475321 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 508/1019] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:25 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1535 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:26.478588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-5802156c-5515-457b-95d0-b8853827bc16 req-48d443d3-d049-4914-960e-7f227df7509b service nova] Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:26:26.491604 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5802156c-5515-457b-95d0-b8853827bc16 req-48d443d3-d049-4914-960e-7f227df7509b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089575 Aug 04 04:26:26.492684 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 512/1020] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:26.614861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:26.615927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:26.626576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:26.629211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:26.630052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:26.630507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:26.711577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:26.754731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:26.766068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:26.767127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:26.773509 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff2c3c26-4e02-4033-a7da-0171f8b4a1c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1291 microversion: 2.1 time: 0.162596 Aug 04 04:26:26.777896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:26.778342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:26.779295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:26.779582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:26.789451 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 509/1021] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:26 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1291 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:27.041535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:27.056244 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f425986c-05ce-4afc-8046-9c10a07a7f01 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1299 microversion: 2.1 time: 0.291895 Aug 04 04:26:27.057942 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 513/1022] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:26 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:27.415768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:27.416627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:27.429499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:27.430225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:27.431240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:27.431729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:27.499667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:27.501557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:27.522487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:27.526445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:27.527908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:27.528533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:27.751745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:27.761878 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-09de3b8c-7e68-45b1-aebd-341120fbe12d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.350209 Aug 04 04:26:27.762647 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 510/1023] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:27 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:27.799737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:27.800360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:27.816580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:27.818408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:27.820788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:27.821235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:27.853627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:27.864057 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6032c18f-ec01-4dc1-ae0c-7558d5fb976a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1535 microversion: 2.1 time: 0.370955 Aug 04 04:26:27.865262 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 514/1024] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:27 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1535 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:27.933690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-66d4483d-2ef5-4996-a7ee-34678e9bc22e req-3911169d-fe88-4831-9566-ab574f993fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3dd801-1ae9-4f2f-8a2a-752aac37784b", "tag": "06710828-acf1-4b9f-9661-cb72538bbc4e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:27.959013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-66d4483d-2ef5-4996-a7ee-34678e9bc22e req-3911169d-fe88-4831-9566-ab574f993fab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:27.959544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-66d4483d-2ef5-4996-a7ee-34678e9bc22e req-3911169d-fe88-4831-9566-ab574f993fab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:27.976219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:27.978821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-66d4483d-2ef5-4996-a7ee-34678e9bc22e req-3911169d-fe88-4831-9566-ab574f993fab service nova] Creating event network-changed:06710828-acf1-4b9f-9661-cb72538bbc4e for instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b on n-h1-851337-5 Aug 04 04:26:27.984994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e4dad784-63e4-40bc-8826-b9462d902b80 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1297 microversion: 2.1 time: 0.192596 Aug 04 04:26:27.985506 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 511/1025] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:27 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1297 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:27.987080 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-66d4483d-2ef5-4996-a7ee-34678e9bc22e req-3911169d-fe88-4831-9566-ab574f993fab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058092 Aug 04 04:26:27.988149 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 515/1026] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:28.083254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:28.084207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:28.096674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:28.098392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:28.102023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:28.102714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:28.418903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:28.428327 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ecf8c31-66fa-42fa-a016-f3e931d0fa0d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1299 microversion: 2.1 time: 0.349949 Aug 04 04:26:28.446751 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 516/1027] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:28 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1299 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:28.792863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:28.793483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:28.804301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:28.811109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:28.811886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:28.815658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:28.816373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:28.885550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:28.886787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:28.896501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:28.904700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:28.907397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:28.909221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.266418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:29.277822 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff08842b-f661-4de4-a5a3-a6575e5e86ba tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1528 microversion: 2.1 time: 0.396974 Aug 04 04:26:29.279451 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 517/1028] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:28 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:29.292420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:29.295500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:29.306600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.307405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.308543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.309205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.323315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:29.336704 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-af69ed40-0b8d-479b-9a3e-88618d95056b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.547696 Aug 04 04:26:29.342553 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 512/1029] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:28 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:29.354779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:29.355449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:29.376969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.377634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.379316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.380185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.539104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:29.551008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad130f70-1694-46ec-88d0-f5ce16e1d0e6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1297 microversion: 2.1 time: 0.269792 Aug 04 04:26:29.552199 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 518/1030] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:29 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1297 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:29.560128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:29.564466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:29.583428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.593902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.608183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.608874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.691371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:29.705397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-21549a86-0da7-45a7-9c36-78b9060c923a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1528 microversion: 2.1 time: 0.361565 Aug 04 04:26:29.711657 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 513/1031] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:29 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1528 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:29.805261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:29.813896 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c1abd33-3b5f-4bee-b0e0-51ccde3c1a17 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.260448 Aug 04 04:26:29.814994 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 519/1032] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:29 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:29.820143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d1996d6-e1eb-4535-979c-6a046ea17497 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:29.821200 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:29.821200 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:26:29.827159 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8d1996d6-e1eb-4535-979c-6a046ea17497 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] HTTP exception thrown: Flavor c10aae03-88eb-4a05-a080-bc8a0e6bd35c could not be found. Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d1996d6-e1eb-4535-979c-6a046ea17497 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Request method failure captured: Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/flavors/c10aae03-88eb-4a05-a080-bc8a0e6bd35c HTTP/1.1 Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mdvYdHmS9Lem5wM-3jxqWHyJ9W30Al0cJBYH8s3eDNHtzTsgYQPiq5U5vKI0Z5RWGQRrdIihV9uN5UH_gEML11uCRHUUIFZlKrOamwC47I4EhSsARYUtBffxXyShwQVe7r1iAOwWJqb-hBWrNbLf4cbGl_d4e5g9SOnwOuSBcrNn8 Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 22215bcace514a4b8d41c1c0872460a9 Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MigrationsAdminTest-1590843740 Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:26:29.829292 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22215bcace514a4b8d41c1c0872460a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22215bcace514a4b8d41c1c0872460a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22215bcace514a4b8d41c1c0872460a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22215bcace514a4b8d41c1c0872460a9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MigrationsAdminTest-1590843740 Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 22215bcace514a4b8d41c1c0872460a9 Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MigrationsAdminTest-1590843740 Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MigrationsAdminTest-1590843740-project-admin Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ddb47c0d58fb47eba4cc08933ba292c0 Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MigrationsAdminTest-1590843740-project-admin Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: exception: Flavor c10aae03-88eb-4a05-a080-bc8a0e6bd35c could not be found. Aug 04 04:26:29.830611 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'c10aae03-88eb-4a05-a080-bc8a0e6bd35c'} Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor c10aae03-88eb-4a05-a080-bc8a0e6bd35c could not be found. Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:29.831531 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor c10aae03-88eb-4a05-a080-bc8a0e6bd35c could not be found. Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor c10aae03-88eb-4a05-a080-bc8a0e6bd35c could not be found. Aug 04 04:26:29.832806 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:29.833905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d1996d6-e1eb-4535-979c-6a046ea17497 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Returning 404 to user: Flavor c10aae03-88eb-4a05-a080-bc8a0e6bd35c could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:29.834817 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d1996d6-e1eb-4535-979c-6a046ea17497 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/c10aae03-88eb-4a05-a080-bc8a0e6bd35c" status: 404 len: 109 microversion: 2.1 time: 0.018731 Aug 04 04:26:29.836780 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 520/1033] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:26:29 2022] DELETE /compute/v2.1/flavors/c10aae03-88eb-4a05-a080-bc8a0e6bd35c => generated 109 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:26:29.953896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4af5f169-1d0b-459c-97d0-3c4bfac172df tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:29.958024 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:29.958024 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:26:29.960470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4af5f169-1d0b-459c-97d0-3c4bfac172df tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.961559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4af5f169-1d0b-459c-97d0-3c4bfac172df tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.962704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4af5f169-1d0b-459c-97d0-3c4bfac172df tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:29.963180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4af5f169-1d0b-459c-97d0-3c4bfac172df tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:29.982551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1293558109", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:30.016075 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4af5f169-1d0b-459c-97d0-3c4bfac172df tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.302909 Aug 04 04:26:30.016666 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 514/1034] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:26:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:30.029248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9814d5b8-1471-4ab1-94c5-270169d2ca01 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:30.032130 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:30.032130 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:26:30.033788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9814d5b8-1471-4ab1-94c5-270169d2ca01 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.034448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9814d5b8-1471-4ab1-94c5-270169d2ca01 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.035511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9814d5b8-1471-4ab1-94c5-270169d2ca01 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.036140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9814d5b8-1471-4ab1-94c5-270169d2ca01 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.062838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:26:30.066195 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9814d5b8-1471-4ab1-94c5-270169d2ca01 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=n-d-851337-5" status: 200 len: 578 microversion: 2.1 time: 0.040638 Aug 04 04:26:30.074163 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 515/1035] 10.222.0.69 () {58 vars in 1172 bytes} [Thu Aug 4 04:26:30 2022] GET /compute/v2.1/os-services?host=n-d-851337-5 => generated 578 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:26:30.096709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff0311f3-fae9-4e5f-8e86-808a94f1de43 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:30.100348 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:30.100348 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:26:30.103011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff0311f3-fae9-4e5f-8e86-808a94f1de43 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.103532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff0311f3-fae9-4e5f-8e86-808a94f1de43 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.105991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff0311f3-fae9-4e5f-8e86-808a94f1de43 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.106704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff0311f3-fae9-4e5f-8e86-808a94f1de43 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.168367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff0311f3-fae9-4e5f-8e86-808a94f1de43 tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082826 Aug 04 04:26:30.181077 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 516/1036] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:26:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:30.201976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3b71cf59-42d1-4731-848f-8ed11ca68fff tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:30.205891 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:30.205891 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:26:30.218296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b71cf59-42d1-4731-848f-8ed11ca68fff tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.219290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b71cf59-42d1-4731-848f-8ed11ca68fff tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.220688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b71cf59-42d1-4731-848f-8ed11ca68fff tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.222881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b71cf59-42d1-4731-848f-8ed11ca68fff tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.265306 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3b71cf59-42d1-4731-848f-8ed11ca68fff tempest-ServicesAdminTestJSON-2136227432 tempest-ServicesAdminTestJSON-2136227432-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075313 Aug 04 04:26:30.268456 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 517/1037] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:26:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:26:30.359976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:30.361015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:30.369866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.372138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.373172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.373800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.434796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:26:30.435525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:26:30.436409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:26:30.437047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:26:30.438195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:26:30.455265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.459857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.462693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.463557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.483017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:30.517343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:30.524340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Getting quotas for user 80bef27d84824d25b096a8507009d824 and project 9e7531c85f5a4fbc8705fb94e4182c92. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:30.537646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:26:30.542111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:26:30.607651 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a36189e9-ebda-4d1e-8e3b-ae7990f7792b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629587 Aug 04 04:26:30.609608 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 521/1038] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:26:30.615273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:30.617076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:30.627715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.628708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.630233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.630904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.675896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:30.686748 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c5fb1e5-c6f9-446b-8867-7f6dd3d9f07e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.331084 Aug 04 04:26:30.700556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 518/1039] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:30 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:30.700556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c9a2bb4-d7ee-4533-be1b-4beba0611832 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:30.700556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c9a2bb4-d7ee-4533-be1b-4beba0611832 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:30.780034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c9a2bb4-d7ee-4533-be1b-4beba0611832 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:30.796292 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c9a2bb4-d7ee-4533-be1b-4beba0611832 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1213 microversion: 2.1 time: 0.105538 Aug 04 04:26:30.797409 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 519/1040] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:30 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:30.844507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:30.845411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:30.868998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.871634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.874059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:30.875558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:30.921882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:30.937609 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c3b494d-cbb0-4a3f-ad92-89cbc348fa56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.326578 Aug 04 04:26:30.939348 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 522/1041] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:30 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:31.091463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:31.103188 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcecc1d2-2c66-4a4d-a521-bac598c146cf tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.268229 Aug 04 04:26:31.104436 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 520/1042] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:30 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:31.708338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:31.708980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:31.717052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:31.717505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:31.718489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:31.718931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:31.828397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:31.829142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:31.837378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:31.843187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:31.844695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:31.845370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:31.928508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:31.953230 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3e5cf1e8-2d04-4e8f-9ae7-9e81bc6710a4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.248045 Aug 04 04:26:31.967611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:31.967875 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 523/1043] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:31 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:31.981816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:31.982869 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e83df44b-6357-44ca-9c86-c5e5f8e93db8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1265 microversion: 2.1 time: 0.167400 Aug 04 04:26:31.983907 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 521/1044] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:31 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:31.986001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:32.001729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:32.002284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:32.003251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:32.003789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:32.128780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:32.129682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:32.153796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:32.156246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:32.157124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:32.160807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:32.509336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:32.522078 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5408d3e7-3c26-4eb1-9bd0-b44da7860da7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.560772 Aug 04 04:26:32.524106 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 524/1045] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:31 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:32.595750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:32.595998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-74d3b09e-c640-4b53-9522-303406b8c96d req-7797ed2b-49bf-48e2-a1f4-c5199a1e40bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b", "name": "network-vif-plugged", "status": "completed", "tag": "3fc792c7-febd-4eb9-bc27-aa4dbc529458"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:32.605920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-74d3b09e-c640-4b53-9522-303406b8c96d req-7797ed2b-49bf-48e2-a1f4-c5199a1e40bb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:32.606819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-74d3b09e-c640-4b53-9522-303406b8c96d req-7797ed2b-49bf-48e2-a1f4-c5199a1e40bb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:32.607474 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-490ec5bc-58c1-4038-a0d1-c774b78cc9d6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.484167 Aug 04 04:26:32.626720 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 522/1046] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:32 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:32.648587 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-74d3b09e-c640-4b53-9522-303406b8c96d req-7797ed2b-49bf-48e2-a1f4-c5199a1e40bb service nova] Creating event network-vif-plugged:3fc792c7-febd-4eb9-bc27-aa4dbc529458 for instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b on n-h2-851337-5 Aug 04 04:26:32.676838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-74d3b09e-c640-4b53-9522-303406b8c96d req-7797ed2b-49bf-48e2-a1f4-c5199a1e40bb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084331 Aug 04 04:26:32.677861 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 525/1047] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:32.978004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:32.978629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:32.987297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:32.987783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:32.988725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:32.988982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:33.005586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:33.007507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:33.020597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:33.025160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:33.026256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:33.027500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:33.217338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:33.234470 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7b9d917-2194-49da-80af-a49cc97407b9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1271 microversion: 2.1 time: 0.230904 Aug 04 04:26:33.235136 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 526/1048] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:32 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:33.306943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:33.317582 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd358200-f60e-4201-84fd-40f6faa056fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1504 microversion: 2.1 time: 0.343442 Aug 04 04:26:33.331133 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 523/1049] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:32 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1504 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:33.546615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:33.547688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:33.560307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:33.562432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:33.563446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:33.564810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:33.606104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1816712445", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "1ce5a8a2-4eeb-4b49-9721-ea09562fbc92"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:33.729065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] validate_networks() for [('1ce5a8a2-4eeb-4b49-9721-ea09562fbc92', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:26:33.978885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:33.992083 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6031a26b-a9fc-4f4b-bfd4-0143b3c8ce23 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.450509 Aug 04 04:26:34.005120 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 524/1050] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:33 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:34.010169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7f897b1d-6ab9-46e7-aa17-995b68c1b08e req-08c2175b-8441-49ac-b873-7917292abfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:34.029220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f897b1d-6ab9-46e7-aa17-995b68c1b08e req-08c2175b-8441-49ac-b873-7917292abfe5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:34.029446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f897b1d-6ab9-46e7-aa17-995b68c1b08e req-08c2175b-8441-49ac-b873-7917292abfe5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:34.054721 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7f897b1d-6ab9-46e7-aa17-995b68c1b08e req-08c2175b-8441-49ac-b873-7917292abfe5 service nova] Creating event network-changed:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:26:34.064601 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7f897b1d-6ab9-46e7-aa17-995b68c1b08e req-08c2175b-8441-49ac-b873-7917292abfe5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068959 Aug 04 04:26:34.065114 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 525/1051] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:34.076975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:34.077683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:34.096916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:34.097372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:34.098229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:34.098586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:34.638939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:34.657338 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8e60e66-954d-473f-a7fc-635c4cf050b7 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.588872 Aug 04 04:26:34.670206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 526/1052] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:34 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:34.675548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:34.676162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:34.682991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:34.683448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:34.684224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:34.684723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.029015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:35.038190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1876b6f-0be9-4939-b7c0-5bd05c5380b1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.366502 Aug 04 04:26:35.038704 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 527/1053] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:34 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:35.039071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:26:35.039568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:26:35.039974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:26:35.040389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:26:35.040818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:26:35.045281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:35.045922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:35.056390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.056842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.057637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.058060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.058642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.059140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.059949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.060391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.106009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for project ff11bae71d3142f9aa402463be123222. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:35.112174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for user 0a2006e35cc04887b80733ca3c736b9c and project ff11bae71d3142f9aa402463be123222. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:35.126199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:26:35.129377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:26:35.197748 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cdab4a22-9d63-4951-ac03-4d78f18ae1ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889118 Aug 04 04:26:35.198928 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 527/1054] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:26:35.204146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:35.205624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:35.214700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.215476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.216483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.217238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.842532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:35.855646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-deecdb06-9467-4620-961e-13923cb06918 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1494 microversion: 2.1 time: 0.815228 Aug 04 04:26:35.857643 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 528/1055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:35 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1494 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:35.878084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:35.878997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:35.889929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.890572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.891695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.892441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.939582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:35.951438 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83df3b8b-2fb1-4070-8de4-35c0e9f91529 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.751090 Aug 04 04:26:35.952497 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 528/1056] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:35 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:35.958497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:35.959500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:35.968639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.969463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:35.970472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:35.971472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.032649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:36.035095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:36.046657 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d6bb4971-b2da-41b9-90b2-45f996f0f837 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1229 microversion: 2.1 time: 0.187575 Aug 04 04:26:36.047537 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 529/1057] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:35 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1229 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:36.088837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee3f5c90-1ea3-454f-a205-3c5855b3852e tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '.version_select at 0x7f191acbfc10>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:36.100823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee3f5c90-1ea3-454f-a205-3c5855b3852e tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.101482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee3f5c90-1ea3-454f-a205-3c5855b3852e tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.113752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee3f5c90-1ea3-454f-a205-3c5855b3852e tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 2344 microversion: 2.1 time: 0.037088 Aug 04 04:26:36.114590 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 530/1058] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:26:36 2022] GET /compute/v2.1/os-migrations => generated 2344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:36.129102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:36.130013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:36.153587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.154230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.156229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.156680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.422664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:36.434063 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c5136b2-fd57-40b9-9a60-c7ff1b2027ec tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.480223 Aug 04 04:26:36.440017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 529/1059] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:35 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:36.451234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:36.452807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8c191c7-4e53-4fec-88d7-b1cd7acdaa83 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:36.453562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d8c191c7-4e53-4fec-88d7-b1cd7acdaa83 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:36.459337 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-30ae44e2-28d3-4dd6-8413-953ab1122e35 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.343390 Aug 04 04:26:36.461031 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 531/1060] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:36 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:36.479066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e27d531d-36ad-4635-8aab-095de1aa6bb2 req-9ef82175-9798-4e42-937c-453857ad0ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:36.479230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8c191c7-4e53-4fec-88d7-b1cd7acdaa83 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.479706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8c191c7-4e53-4fec-88d7-b1cd7acdaa83 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.480595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8c191c7-4e53-4fec-88d7-b1cd7acdaa83 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.481361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8c191c7-4e53-4fec-88d7-b1cd7acdaa83 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.490182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e27d531d-36ad-4635-8aab-095de1aa6bb2 req-9ef82175-9798-4e42-937c-453857ad0ee6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.490809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e27d531d-36ad-4635-8aab-095de1aa6bb2 req-9ef82175-9798-4e42-937c-453857ad0ee6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.506597 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e27d531d-36ad-4635-8aab-095de1aa6bb2 req-9ef82175-9798-4e42-937c-453857ad0ee6 service nova] Creating event network-changed:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h1-851337-5 Aug 04 04:26:36.515344 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e27d531d-36ad-4635-8aab-095de1aa6bb2 req-9ef82175-9798-4e42-937c-453857ad0ee6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040376 Aug 04 04:26:36.516083 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 532/1061] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:36.751298 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8c191c7-4e53-4fec-88d7-b1cd7acdaa83 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1645 microversion: 2.1 time: 0.309825 Aug 04 04:26:36.752486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 530/1062] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:36 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1645 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:36.974505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:36.975823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:36.977522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-80681864", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "6f5fc760-036b-4db9-9515-31d6fe212ea8"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:36.983105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.984053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:36.985330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:36.985994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:37.049545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] validate_networks() for [('6f5fc760-036b-4db9-9515-31d6fe212ea8', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:26:37.366767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:37.378793 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98a1aa7c-b11a-44c6-828a-41c8812f0878 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.407960 Aug 04 04:26:37.382668 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 533/1063] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:36 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:37.402249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:37.404062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:37.413584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:37.414317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:37.416475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:37.417088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:37.976472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:37.984995 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c5012f9-1ebb-4c5a-8ec3-1ee745d799ca tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.600739 Aug 04 04:26:37.985894 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 534/1064] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:37 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:37.990671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:37.991883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:37.998728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:37.999546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.000370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.000867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.095292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:26:38.096499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:26:38.097786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:26:38.098540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:26:38.099392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:26:38.112781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.113475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.114522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.115203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.143118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:38.153078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for user 53377b39d2804967aa0d5b71ee57e9a8 and project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:38.168400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:26:38.172197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:26:38.184256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:38.234240 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2621368e-0d35-43d6-b598-d3165e550c88 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261902 Aug 04 04:26:38.241821 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 531/1065] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:26:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:26:38.251331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:38.251942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:38.265711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.266427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.267328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.267784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.304142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:38.315651 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d65e8e7-e27a-4ad4-93e0-5e97fefef169 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.328453 Aug 04 04:26:38.317119 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 535/1066] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:37 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:38.338357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b5cce8d8-97cf-4886-b118-0e5f7a3d64a6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:38.340755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b5cce8d8-97cf-4886-b118-0e5f7a3d64a6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:38.504421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b5cce8d8-97cf-4886-b118-0e5f7a3d64a6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:38.512424 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b5cce8d8-97cf-4886-b118-0e5f7a3d64a6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1209 microversion: 2.1 time: 0.193996 Aug 04 04:26:38.539037 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 536/1067] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:38 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1209 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:38.544880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:38.545752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:38.552498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.553169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.554180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.554836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:38.903586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:38.913138 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b39d7a2-1b5e-4303-953b-bf451d699510 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.676043 Aug 04 04:26:38.913742 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 532/1068] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:38 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:38.933098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b4328f8c-1503-4919-aed8-f3715655610e req-4f5dc671-4a82-4cc8-97f4-2e21417695bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb8d55b-d5f1-41da-8a55-de6a6770fe34", "tag": "6eb84cde-0131-4c9c-ae10-1830ec03d098"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:38.981813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b4328f8c-1503-4919-aed8-f3715655610e req-4f5dc671-4a82-4cc8-97f4-2e21417695bd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:38.983377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b4328f8c-1503-4919-aed8-f3715655610e req-4f5dc671-4a82-4cc8-97f4-2e21417695bd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.015933 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b4328f8c-1503-4919-aed8-f3715655610e req-4f5dc671-4a82-4cc8-97f4-2e21417695bd service nova] Creating event network-changed:6eb84cde-0131-4c9c-ae10-1830ec03d098 for instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 on n-h2-851337-5 Aug 04 04:26:39.023170 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b4328f8c-1503-4919-aed8-f3715655610e req-4f5dc671-4a82-4cc8-97f4-2e21417695bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103745 Aug 04 04:26:39.024169 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 533/1069] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:39.031578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:39.033423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:39.044112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.044574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.045693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.046283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.048110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:39.060341 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a7680af-fba6-4395-be7d-bbb54b1e3aea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.519898 Aug 04 04:26:39.061629 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 537/1070] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:38 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:39.338300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:39.344809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:39.345857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:39.356379 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42c51c32-971a-4b50-84e2-24875bde6aa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.330879 Aug 04 04:26:39.357559 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 534/1071] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:39 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:39.374497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.376642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.383669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.384916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.547786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:39.548723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:39.557277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.558003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.559366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.560166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.933741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:39.941318 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53be7475-e713-468a-aa17-12dceec1f07b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1205 microversion: 2.1 time: 0.398496 Aug 04 04:26:39.941986 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 535/1072] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:39 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1205 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:39.947057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:39.947683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:39.955251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.955709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:39.956495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:39.956933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:40.069952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:40.086610 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ceab6ec-c777-42cb-8bfb-67e60ecda676 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.746328 Aug 04 04:26:40.105437 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 538/1073] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:39 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:40.106656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:40.110032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:40.125919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:40.128831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:40.130007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:40.130818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:40.236361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:40.327293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:40.348731 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9c40c758-a1c6-43e3-8521-8b82cbf2a087 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.403351 Aug 04 04:26:40.364071 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 536/1074] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:39 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:40.378346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:40.378980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:40.396839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:40.401393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:40.401393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:40.401393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:40.542532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:40.556870 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3e4178a-1ee5-4591-8ce7-b71961c353a1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.462192 Aug 04 04:26:40.557488 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 539/1075] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:40 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:40.868174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:40.876710 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0f922a02-b549-402b-93f1-97caada34da4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.502588 Aug 04 04:26:40.891123 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 537/1076] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:40 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:40.963992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:40.964624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:40.980205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:40.981432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:40.983016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:40.983622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.093773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:41.102671 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c729b54-170f-47fc-bfb5-acb0c4fec92c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1267 microversion: 2.1 time: 0.143097 Aug 04 04:26:41.123227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:41.124890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:41.129357 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 540/1077] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:40 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:41.134427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.135229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.136238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.136902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.375931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:41.376686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:41.384412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.384876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.386299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.386753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.413241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:41.429258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0f5fd424-d9fc-4192-ba28-853af980c853 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.307873 Aug 04 04:26:41.431150 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 538/1078] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:41 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:41.584059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:41.585417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:41.592683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.593625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.595973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.596595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.681749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:41.696121 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ee64ce6-1ab0-4077-843c-5a1ebeb597d9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.324691 Aug 04 04:26:41.697227 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 541/1079] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:41 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:41.853309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:41.870391 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20a828e4-96bb-4f08-aeba-d66368a1b082 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.294309 Aug 04 04:26:41.871460 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 539/1080] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:41 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:41.901799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:41.902657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:41.917411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.918973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:41.921438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:41.922070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.124987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:42.125956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:42.149130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.149733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.150579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.151041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.235963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:42.246877 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c61acc3b-704e-433d-9df6-effb420aed6c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.350821 Aug 04 04:26:42.259720 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 542/1081] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:41 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:42.278807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d209a02e-875a-4bee-99ee-178ea6ba6ce7 req-000f0f2a-b121-4d28-b98a-c092e023e93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-plugged", "status": "completed", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:42.299940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d209a02e-875a-4bee-99ee-178ea6ba6ce7 req-000f0f2a-b121-4d28-b98a-c092e023e93c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.300389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d209a02e-875a-4bee-99ee-178ea6ba6ce7 req-000f0f2a-b121-4d28-b98a-c092e023e93c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.318528 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d209a02e-875a-4bee-99ee-178ea6ba6ce7 req-000f0f2a-b121-4d28-b98a-c092e023e93c service nova] Creating event network-vif-plugged:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:26:42.327867 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d209a02e-875a-4bee-99ee-178ea6ba6ce7 req-000f0f2a-b121-4d28-b98a-c092e023e93c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053228 Aug 04 04:26:42.329148 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 543/1082] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:26:42.453004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:42.453717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:42.469301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.469695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.470503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.470947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.535346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:42.557364 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc28f0aa-1112-457c-a8f2-3ea78bbc58ee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.436485 Aug 04 04:26:42.572596 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 540/1083] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:42 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:42.716991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:42.717834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:42.724669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:42.727727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.728634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.730045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.730986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.736770 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7efdc3a8-32ac-4ae6-9fe6-91fc28cc5579 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.287866 Aug 04 04:26:42.737729 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 544/1084] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:42 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:42.739520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:42.893662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:42.894511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:42.901525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.902207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:42.903249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:42.903830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:43.021489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:43.050399 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e8234ae-0a38-4e32-9853-763b65c7687b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.337106 Aug 04 04:26:43.051943 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 541/1085] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:42 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:43.167202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:43.176304 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc083b08-cde7-4b16-af15-0a97bc673c3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.286468 Aug 04 04:26:43.177138 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 545/1086] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:42 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:43.284060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:43.284683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:43.299203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:43.299683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:43.300484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:43.300927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:43.549730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:43.557360 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c11df04a-1811-4bbf-8825-e81e28d2adb4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.277156 Aug 04 04:26:43.557931 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 542/1087] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:43 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:43.578991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:43.579663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:43.587791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:43.587996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:43.588834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:43.589338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:43.732440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:43.741308 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e470b35f-228e-4e6e-aab0-d351b06e19e0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.165267 Aug 04 04:26:43.741519 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 546/1088] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:43 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:43.758996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:43.759684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:43.773495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:43.774010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:43.774914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:43.775458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:43.844640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b93bb5e-a863-4805-b050-09aa275bf1aa tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Calling method '.version_select at 0x7f191a5ae430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:43.896130 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b93bb5e-a863-4805-b050-09aa275bf1aa tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.196247 Aug 04 04:26:43.897433 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 543/1089] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:26:43 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:26:43.914373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01e761d9-ac60-41bd-8ba1-eab8267a99e9 tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Action: 'create', calling method: .version_select at 0x7f19208718b0>, body: {"pool": "non_exist_pool"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:43.960784 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-01e761d9-ac60-41bd-8ba1-eab8267a99e9 tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] HTTP exception thrown: Floating IP pool not found. Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01e761d9-ac60-41bd-8ba1-eab8267a99e9 tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Request method failure captured: Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 26 Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qDW2LJqZ89w-ElKlxsjNYE1VzhCCzS74obm70Mv_MAXDvcsre16zvsmSaATMmXKbfZqNTKCOL4A4JbkMllGGEEXxKzSU2-4jXsGfaAwsgZb97SfmxOtkRKKsR9yJUBAWvuLi3us38xwRUnEpJIyneU_tYnzN07FX4c_2e88OXP5K4 Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d8dd702ab81c4a69a2b5800600b268f8 Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1777969723 Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:43.962874 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8dd702ab81c4a69a2b5800600b268f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d8dd702ab81c4a69a2b5800600b268f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8dd702ab81c4a69a2b5800600b268f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d8dd702ab81c4a69a2b5800600b268f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1777969723 Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d8dd702ab81c4a69a2b5800600b268f8 Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1777969723 Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsNegativeTestJSON-1777969723-project Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: efed3d57eff34bd4a481dd34248fa530 Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1777969723-project Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: {"pool": "non_exist_pool"} Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: exception: Floating IP pool not found. Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 04 04:26:43.964463 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:43.965622 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 04 04:26:43.967004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:43.968852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01e761d9-ac60-41bd-8ba1-eab8267a99e9 tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Returning 404 to user: Floating IP pool not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:43.969285 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-01e761d9-ac60-41bd-8ba1-eab8267a99e9 tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.062742 Aug 04 04:26:43.970294 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 544/1090] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:26:43 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 04:26:43.983252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7fdd3f0d-1602-4c6b-b2b2-ccefd52263fd tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Calling method '.version_select at 0x7f1919ffb3a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:44.007259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:44.016532 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11eae1fa-ce2a-4d3e-b801-21caa28a7a33 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.261921 Aug 04 04:26:44.017108 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 547/1091] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:43 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:44.038520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-7fdd3f0d-1602-4c6b-b2b2-ccefd52263fd tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 650bbfe5-6803-4eef-8919-2611c7dc4764 could not be found", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:26:44.039282 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7fdd3f0d-1602-4c6b-b2b2-ccefd52263fd tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] HTTP exception thrown: Floating IP not found for ID 650bbfe5-6803-4eef-8919-2611c7dc4764 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7fdd3f0d-1602-4c6b-b2b2-ccefd52263fd tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Request method failure captured: Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-floating-ips/650bbfe5-6803-4eef-8919-2611c7dc4764 HTTP/1.1 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qDW2LJqZ89w-ElKlxsjNYE1VzhCCzS74obm70Mv_MAXDvcsre16zvsmSaATMmXKbfZqNTKCOL4A4JbkMllGGEEXxKzSU2-4jXsGfaAwsgZb97SfmxOtkRKKsR9yJUBAWvuLi3us38xwRUnEpJIyneU_tYnzN07FX4c_2e88OXP5K4 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d8dd702ab81c4a69a2b5800600b268f8 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1777969723 Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:44.041791 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8dd702ab81c4a69a2b5800600b268f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d8dd702ab81c4a69a2b5800600b268f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8dd702ab81c4a69a2b5800600b268f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d8dd702ab81c4a69a2b5800600b268f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1777969723 Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d8dd702ab81c4a69a2b5800600b268f8 Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1777969723 Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsNegativeTestJSON-1777969723-project Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: efed3d57eff34bd4a481dd34248fa530 Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1777969723-project Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: exception: Floating IP not found for ID 650bbfe5-6803-4eef-8919-2611c7dc4764 Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '650bbfe5-6803-4eef-8919-2611c7dc4764'} Aug 04 04:26:44.043361 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:26:44.044188 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 650bbfe5-6803-4eef-8919-2611c7dc4764 could not be found Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a412bcb0-1c8e-482f-b681-be3c95e1803a'] Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 650bbfe5-6803-4eef-8919-2611c7dc4764. Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:44.045582 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 650bbfe5-6803-4eef-8919-2611c7dc4764 Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:44.047213 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:44.048652 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 650bbfe5-6803-4eef-8919-2611c7dc4764 Aug 04 04:26:44.048652 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:44.048652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7fdd3f0d-1602-4c6b-b2b2-ccefd52263fd tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] Returning 404 to user: Floating IP not found for ID 650bbfe5-6803-4eef-8919-2611c7dc4764 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:44.048652 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7fdd3f0d-1602-4c6b-b2b2-ccefd52263fd tempest-FloatingIPsNegativeTestJSON-1777969723 tempest-FloatingIPsNegativeTestJSON-1777969723-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/650bbfe5-6803-4eef-8919-2611c7dc4764" status: 404 len: 111 microversion: 2.1 time: 0.066926 Aug 04 04:26:44.048652 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 545/1092] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:26:43 2022] DELETE /compute/v2.1/os-floating-ips/650bbfe5-6803-4eef-8919-2611c7dc4764 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:26:44.073030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:44.073871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:44.096374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.096825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.097642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.098079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.196806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:44.197483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:44.204434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.205085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.206092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.208061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.806899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:44.818240 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd8872b1-3e2f-4f81-bde0-1f343f010a7d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1364 microversion: 2.1 time: 0.625825 Aug 04 04:26:44.820032 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 546/1093] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:44 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1364 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:44.832747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3a37c50c-1a3b-4b01-a6b7-b9751a2e6357 req-71a611d0-5053-416d-bdb1-11d7a925035b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3dd801-1ae9-4f2f-8a2a-752aac37784b", "name": "network-vif-plugged", "status": "completed", "tag": "06710828-acf1-4b9f-9661-cb72538bbc4e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:44.843863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3a37c50c-1a3b-4b01-a6b7-b9751a2e6357 req-71a611d0-5053-416d-bdb1-11d7a925035b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.844653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3a37c50c-1a3b-4b01-a6b7-b9751a2e6357 req-71a611d0-5053-416d-bdb1-11d7a925035b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.860696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3a37c50c-1a3b-4b01-a6b7-b9751a2e6357 req-71a611d0-5053-416d-bdb1-11d7a925035b service nova] Creating event network-vif-plugged:06710828-acf1-4b9f-9661-cb72538bbc4e for instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b on n-h1-851337-5 Aug 04 04:26:44.866173 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3a37c50c-1a3b-4b01-a6b7-b9751a2e6357 req-71a611d0-5053-416d-bdb1-11d7a925035b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044565 Aug 04 04:26:44.867103 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 547/1094] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:44.874054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:44.875113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:44.884061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.884836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.885869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.886377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.889561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:44.903307 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8739edc-4c97-4d1a-82ff-b716ec524de3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.833979 Aug 04 04:26:44.916967 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 548/1095] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:44 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:44.922603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d4e5e27c-ad0b-4504-81e6-fb390295087e req-be980a52-335f-4625-86b7-424f5c013ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa29d0be-bfe0-495b-b3dc-94a18e813093", "tag": "a5a98ca7-52ff-4c04-a9c8-a94414acbef7"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:44.928197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:44.934428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d4e5e27c-ad0b-4504-81e6-fb390295087e req-be980a52-335f-4625-86b7-424f5c013ce8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.934978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d4e5e27c-ad0b-4504-81e6-fb390295087e req-be980a52-335f-4625-86b7-424f5c013ce8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.947992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d4e5e27c-ad0b-4504-81e6-fb390295087e req-be980a52-335f-4625-86b7-424f5c013ce8 service nova] Creating event network-changed:a5a98ca7-52ff-4c04-a9c8-a94414acbef7 for instance fa29d0be-bfe0-495b-b3dc-94a18e813093 on n-h1-851337-5 Aug 04 04:26:44.953051 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d4e5e27c-ad0b-4504-81e6-fb390295087e req-be980a52-335f-4625-86b7-424f5c013ce8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034905 Aug 04 04:26:44.953741 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 549/1096] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:44.963525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:44.964150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:44.970574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.971072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.971850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:44.972282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:44.977262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:45.189842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:45.200410 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2e348ae8-6875-4ba6-8e49-9a118d8ffbc8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.331722 Aug 04 04:26:45.201378 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 548/1097] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:44 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:45.219907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:45.220635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:45.227931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:45.228511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:45.229408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:45.230080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:45.308341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:45.316156 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9540e089-97e1-418e-9fa1-678980f4144a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.358763 Aug 04 04:26:45.317016 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 550/1098] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:44 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:45.506297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:45.515096 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e7137f5-298b-4049-b74e-b29acc3d723e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.312094 Aug 04 04:26:45.523718 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 549/1099] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:45 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:45.842860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:45.843804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:45.851613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:45.852797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:45.853750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:45.856004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:45.924122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:45.925569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:45.934212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:45.935070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:45.936123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:45.936749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.255756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:46.272850 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-de17060d-a090-42e2-b750-d52b817fe9fc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1551 microversion: 2.1 time: 0.434686 Aug 04 04:26:46.273650 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 551/1100] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:45 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1551 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:46.278793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:46.279959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:46.288220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.288928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.290171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.290770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.367835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:46.378798 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b0282707-1308-4e83-8e74-a1e9661581c4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.458691 Aug 04 04:26:46.392264 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 550/1101] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:45 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:46.405738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-89ddc01e-63bc-4428-9fe9-e61f6b934f62 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:46.407598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-89ddc01e-63bc-4428-9fe9-e61f6b934f62 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:46.422423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89ddc01e-63bc-4428-9fe9-e61f6b934f62 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.423358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89ddc01e-63bc-4428-9fe9-e61f6b934f62 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.424539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89ddc01e-63bc-4428-9fe9-e61f6b934f62 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.425157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89ddc01e-63bc-4428-9fe9-e61f6b934f62 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.617255 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-89ddc01e-63bc-4428-9fe9-e61f6b934f62 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223104 Aug 04 04:26:46.617837 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 551/1102] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:26:46 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:46.623859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:46.624669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:46.656802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.657522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.677869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.678573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.714481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:46.723105 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c00e4573-e969-43b9-af6f-0ef81c9e5141 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.448038 Aug 04 04:26:46.723697 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 552/1103] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:46 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:46.744744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:46.746921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:46.758633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.759391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:46.760357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:46.761142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.044663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:47.053439 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b6cbe33-10df-49a0-a51c-ef20b843ab52 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.433202 Aug 04 04:26:47.054049 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 552/1104] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:46 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:47.059005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:47.064162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:47.072013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.072718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.073669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.074267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.101448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 1543d282-7d4f-4c87-b761-049a3c1ab46a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:47.134218 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d974a64-032c-452e-9c44-7e011cccc0bc tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 2343 microversion: 2.25 time: 0.394477 Aug 04 04:26:47.137556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 553/1105] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:26:46 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 2343 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:26:47.143269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-19431d40-9c66-477b-8a67-5e908e58d8fd req-513afd3b-50bc-4d96-abae-61f87f8937d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb8d55b-d5f1-41da-8a55-de6a6770fe34", "name": "network-vif-plugged", "status": "completed", "tag": "6eb84cde-0131-4c9c-ae10-1830ec03d098"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:47.161804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-19431d40-9c66-477b-8a67-5e908e58d8fd req-513afd3b-50bc-4d96-abae-61f87f8937d7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.162552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-19431d40-9c66-477b-8a67-5e908e58d8fd req-513afd3b-50bc-4d96-abae-61f87f8937d7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.176147 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-19431d40-9c66-477b-8a67-5e908e58d8fd req-513afd3b-50bc-4d96-abae-61f87f8937d7 service nova] Creating event network-vif-plugged:6eb84cde-0131-4c9c-ae10-1830ec03d098 for instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 on n-h2-851337-5 Aug 04 04:26:47.183346 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-19431d40-9c66-477b-8a67-5e908e58d8fd req-513afd3b-50bc-4d96-abae-61f87f8937d7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043355 Aug 04 04:26:47.184183 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 554/1106] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:47.192525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9bf51137-b044-4047-9cf4-a44df763818b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:47.196180 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:47.196180 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:26:47.197772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bf51137-b044-4047-9cf4-a44df763818b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.198396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bf51137-b044-4047-9cf4-a44df763818b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.199430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bf51137-b044-4047-9cf4-a44df763818b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.200550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bf51137-b044-4047-9cf4-a44df763818b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.249564 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9bf51137-b044-4047-9cf4-a44df763818b tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.063908 Aug 04 04:26:47.250217 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 555/1107] 10.222.0.69 () {60 vars in 1217 bytes} [Thu Aug 4 04:26:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:26:47.407121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:47.408641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:47.429526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.430055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.436701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.438000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.517052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:47.536476 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38b80cc3-5847-46f8-b516-adf3a54064f0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1287 microversion: 2.1 time: 0.480543 Aug 04 04:26:47.538768 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 553/1108] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:47 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1287 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:47.745331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:47.746251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:47.753247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.754058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.755158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:47.755831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:47.898071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:47.911541 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a2228794-6f55-40c2-8fb8-1c406acd78e2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.509447 Aug 04 04:26:47.913332 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 556/1109] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:47 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:48.016991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:48.027313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed191037-f5ae-42ed-9ea5-c8b1ec2379b1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1325 microversion: 2.1 time: 0.286874 Aug 04 04:26:48.027900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 554/1110] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:47 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1325 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:48.075220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:48.076455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:48.087931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:48.089551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:48.091948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:48.094944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:48.384950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:48.393348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e3a81a48-bf72-4a23-8a79-9a7a4dd07f66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.322666 Aug 04 04:26:48.397473 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 557/1111] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:48 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:48.560439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:48.561161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:48.570351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=11 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:48.571621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=28 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:48.577327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:48.582222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:48.583517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:48.584286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:48.890674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4a97d08f-29d9-4144-a3e3-a346fe27a5ad req-e1c506c5-2a1f-4e0b-af98-e66262b0218b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:48.901836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:48.909612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4a97d08f-29d9-4144-a3e3-a346fe27a5ad req-e1c506c5-2a1f-4e0b-af98-e66262b0218b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:48.910353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4a97d08f-29d9-4144-a3e3-a346fe27a5ad req-e1c506c5-2a1f-4e0b-af98-e66262b0218b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:48.935353 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4a97d08f-29d9-4144-a3e3-a346fe27a5ad req-e1c506c5-2a1f-4e0b-af98-e66262b0218b service nova] Creating event network-changed:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:26:48.945448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4a97d08f-29d9-4144-a3e3-a346fe27a5ad req-e1c506c5-2a1f-4e0b-af98-e66262b0218b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084273 Aug 04 04:26:48.950929 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 558/1112] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:48.956920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:48.971493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:48.980705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:48.981581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:48.983037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:48.983792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.365136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:49.376963 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d7fe3a9-b5af-4e35-8431-9e9639ab9a1c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.424241 Aug 04 04:26:49.392209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:49.393505 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 559/1113] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:48 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:49.401560 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dda0a707-29f4-4fd1-abb4-7e36aed41e54 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1478 microversion: 2.1 time: 0.845134 Aug 04 04:26:49.403540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:49.404672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:49.415945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.416867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.417670 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 555/1114] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:48 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1478 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:49.418215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.418863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.423993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-7e7f455b-3478-49fb-a5cd-64b6115967d9 req-6b976070-5039-4e1a-b4ed-5858eb27ea51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "name": "network-vif-plugged", "status": "completed", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:49.435264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7e7f455b-3478-49fb-a5cd-64b6115967d9 req-6b976070-5039-4e1a-b4ed-5858eb27ea51 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.436023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7e7f455b-3478-49fb-a5cd-64b6115967d9 req-6b976070-5039-4e1a-b4ed-5858eb27ea51 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.448811 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-7e7f455b-3478-49fb-a5cd-64b6115967d9 req-6b976070-5039-4e1a-b4ed-5858eb27ea51 service nova] Creating event network-vif-plugged:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h1-851337-5 Aug 04 04:26:49.454178 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-7e7f455b-3478-49fb-a5cd-64b6115967d9 req-6b976070-5039-4e1a-b4ed-5858eb27ea51 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Aug 04 04:26:49.455337 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 556/1115] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:49.463182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:49.464151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:49.471502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.472152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.473964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.474581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.862451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:49.871862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c6c2a635-6fff-43b4-8a3a-a20e5909f7af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.475391 Aug 04 04:26:49.872714 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 560/1116] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:49 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:49.896481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4578baa1-4834-44f2-bff4-fc40f180415e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:49.896481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4578baa1-4834-44f2-bff4-fc40f180415e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:49.900702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4578baa1-4834-44f2-bff4-fc40f180415e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.901049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4578baa1-4834-44f2-bff4-fc40f180415e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.901843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4578baa1-4834-44f2-bff4-fc40f180415e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.902282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4578baa1-4834-44f2-bff4-fc40f180415e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.938190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:49.950162 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2361f741-ab3e-45c7-9dbe-43e5a024a239 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.493384 Aug 04 04:26:49.951065 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 557/1117] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:49 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:49.956815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:49.957638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:49.965128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.966049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:49.967094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:49.967533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:50.013781 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4578baa1-4834-44f2-bff4-fc40f180415e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125544 Aug 04 04:26:50.022673 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 561/1118] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:26:49 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:50.022673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8f23645-0ebe-4fd5-b469-df9728e2ec39 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9819622-b8a3-4307-a5a4-851dece67fda", "device": "/dev/xvdb"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:50.024886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8f23645-0ebe-4fd5-b469-df9728e2ec39 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:50.031719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8f23645-0ebe-4fd5-b469-df9728e2ec39 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:50.032171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8f23645-0ebe-4fd5-b469-df9728e2ec39 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:50.032964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8f23645-0ebe-4fd5-b469-df9728e2ec39 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:50.033401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8f23645-0ebe-4fd5-b469-df9728e2ec39 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:50.283670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:50.291907 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f1b33a2-7a59-41bd-990e-d9a869e26d06 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.339577 Aug 04 04:26:50.292513 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 558/1119] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:49 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:50.314075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01411675-cdea-451d-8a59-3f38e69e6b46 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2146411038", "metadata": {"": ""}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01411675-cdea-451d-8a59-3f38e69e6b46 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action HTTP/1.1 Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 107 Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:50.319683 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2146411038", "metadata": {"": ""}}} Aug 04 04:26:50.321416 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'beb8d55b-d5f1-41da-8a55-de6a6770fe34', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2146411038', 'metadata': {'': ''}}}} Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'': ''} Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:50.322377 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:50.324030 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:50.325517 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:50.325517 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:50.325517 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:26:50.325517 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:26:50.325517 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:50.325517 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:50.327058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01411675-cdea-451d-8a59-3f38e69e6b46 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:50.328276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-01411675-cdea-451d-8a59-3f38e69e6b46 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action" status: 400 len: 170 microversion: 2.1 time: 0.018374 Aug 04 04:26:50.332790 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 559/1120] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Aug 4 04:26:50 2022] POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:26:50.339662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:50.352658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:50.366870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:50.367726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:50.368791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:50.369457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:50.561066 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8f23645-0ebe-4fd5-b469-df9728e2ec39 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "POST /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.543338 Aug 04 04:26:50.565690 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 562/1121] 10.222.0.69 () {62 vars in 1364 bytes} [Thu Aug 4 04:26:50 2022] POST /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:26:50.589137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:50.589917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:50.613560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:50.614145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:50.615032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:50.615988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:51.207751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:51.228046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ba2b9a8-b2ee-4f3a-ac15-b510144ae7d1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.890965 Aug 04 04:26:51.228664 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 560/1122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:50 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:51.238586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:51.239239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:51.258120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:51.259648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:51.260674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:51.261129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:51.308297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:51.314575 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19969c33-5397-4306-be06-8046b265391e tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.746853 Aug 04 04:26:51.315192 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 563/1123] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:50 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:51.332135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:51.332774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:51.345080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:51.345540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:51.346481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:51.346921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:51.735363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:51.750928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9c54cc93-437e-43a4-b9c1-d899ca452826 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.520477 Aug 04 04:26:51.752066 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 561/1124] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:51 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:51.753338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:51.769051 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9ff6929-2bb5-4a95-9993-d064496ad37e tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.449723 Aug 04 04:26:51.769998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 564/1125] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:51 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:51.795004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a364176d-c250-4288-9079-9cd385ab9002 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-135196370", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a364176d-c250-4288-9079-9cd385ab9002 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action HTTP/1.1 Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 618 Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:51.800191 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:51.801779 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:26:51.802778 n-d-851337-5 devstack@n-api.service[119342]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-135196370", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 04 04:26:51.802778 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:26:51.802778 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'beb8d55b-d5f1-41da-8a55-de6a6770fe34', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-135196370', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 04:26:51.803073 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:51.803794 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:51.804932 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:51.805740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:51.805740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:51.805740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:26:51.805740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:26:51.805740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:26:51.805740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:51.807891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a364176d-c250-4288-9079-9cd385ab9002 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:51.809034 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a364176d-c250-4288-9079-9cd385ab9002 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action" status: 400 len: 938 microversion: 2.1 time: 0.019330 Aug 04 04:26:51.811149 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 562/1126] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Aug 4 04:26:51 2022] POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:26:51.821669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:51.822666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:51.835493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:51.836437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:51.837536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:51.838325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.072065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:52.083851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b47e5e72-cc2c-4036-b800-20e736305ca4 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.268386 Aug 04 04:26:52.085749 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 565/1127] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:51 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:52.113788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:52.116390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:52.151175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.154764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.157195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.157895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.315945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:52.316764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:52.330142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.330885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.333188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.335341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.476617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:52.486461 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4b6b162-42ab-42a7-bcf6-ea6fe7296b73 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.379846 Aug 04 04:26:52.493050 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 563/1128] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:52 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:52.502820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:52.503642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:52.510702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.511481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.512680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.513385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.535962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:52.579981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:52.594409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b8d64b1c-016f-4ac3-bb6e-0db8568833a1 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1478 microversion: 2.1 time: 0.280746 Aug 04 04:26:52.596138 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 566/1129] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:52 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1478 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:52.612579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f0b32fde-28f4-4256-910a-33139a0dd560 req-2ac6124e-bb2e-49ad-9ec4-57e40f1eb900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3dd801-1ae9-4f2f-8a2a-752aac37784b", "tag": "06710828-acf1-4b9f-9661-cb72538bbc4e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:52.628282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f0b32fde-28f4-4256-910a-33139a0dd560 req-2ac6124e-bb2e-49ad-9ec4-57e40f1eb900 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.629012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f0b32fde-28f4-4256-910a-33139a0dd560 req-2ac6124e-bb2e-49ad-9ec4-57e40f1eb900 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.651419 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f0b32fde-28f4-4256-910a-33139a0dd560 req-2ac6124e-bb2e-49ad-9ec4-57e40f1eb900 service nova] Creating event network-changed:06710828-acf1-4b9f-9661-cb72538bbc4e for instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b on n-h1-851337-5 Aug 04 04:26:52.664225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f0b32fde-28f4-4256-910a-33139a0dd560 req-2ac6124e-bb2e-49ad-9ec4-57e40f1eb900 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060754 Aug 04 04:26:52.667682 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 567/1130] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:52.676303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-59582b69-43e0-41c9-9673-f9c55eb997f7 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-59582b69-43e0-41c9-9673-f9c55eb997f7 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action HTTP/1.1 Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 285 Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:52.680917 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:26:52.682296 n-d-851337-5 devstack@n-api.service[119343]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'beb8d55b-d5f1-41da-8a55-de6a6770fe34', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:26:52.682970 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:26:52.683628 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:26:52.684855 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:26:52.685658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:26:52.685658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:52.688134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-59582b69-43e0-41c9-9673-f9c55eb997f7 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:52.689788 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-59582b69-43e0-41c9-9673-f9c55eb997f7 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action" status: 400 len: 619 microversion: 2.1 time: 0.020449 Aug 04 04:26:52.690597 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 568/1131] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Aug 4 04:26:52 2022] POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:26:52.702148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:52.704419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:52.714493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.715500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.716543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.717835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.724346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:52.836477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:52.847007 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14b26ca0-ece2-4374-9550-39f354e04c15 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1313 microversion: 2.1 time: 0.350821 Aug 04 04:26:52.847612 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 564/1132] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:52 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:52.854655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:52.855304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:52.879289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.881287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:52.884298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:52.894270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.086183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:53.100711 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11832d30-2cde-47f5-809d-66068467885c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.402901 Aug 04 04:26:53.102542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 569/1133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:52 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:53.124582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:53.125432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:53.134895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.135744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.136707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.138497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.353866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:53.372841 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f72cb5c0-fe67-4449-a524-59c2973fa581 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.522977 Aug 04 04:26:53.373441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 565/1134] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:52 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:53.421428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:53.439499 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08293143-4acf-4631-b207-e25bd9ec8e99 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.316586 Aug 04 04:26:53.441493 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 570/1135] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:53 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:53.467886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99fb9bb4-0777-46db-9e1c-72cb5edcfcfe tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1191086107"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:53.471052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99fb9bb4-0777-46db-9e1c-72cb5edcfcfe tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:53.490581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99fb9bb4-0777-46db-9e1c-72cb5edcfcfe tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.495017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99fb9bb4-0777-46db-9e1c-72cb5edcfcfe tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.495950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99fb9bb4-0777-46db-9e1c-72cb5edcfcfe tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.496404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99fb9bb4-0777-46db-9e1c-72cb5edcfcfe tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.787896 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb205e29-696e-46e2-a7c7-2dff59ae1b99 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] 10.222.0.69 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.261934 Aug 04 04:26:53.788826 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 571/1136] 10.222.0.69 () {58 vars in 1128 bytes} [Thu Aug 4 04:26:53 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 04 04:26:53.802197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6dd62d93-b3ef-4b4d-be42-516379e633f2 req-a65806b1-bdc7-405b-819b-cce989acc310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29d0be-bfe0-495b-b3dc-94a18e813093", "name": "network-vif-plugged", "status": "completed", "tag": "a5a98ca7-52ff-4c04-a9c8-a94414acbef7"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:53.821696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6dd62d93-b3ef-4b4d-be42-516379e633f2 req-a65806b1-bdc7-405b-819b-cce989acc310 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.824087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6dd62d93-b3ef-4b4d-be42-516379e633f2 req-a65806b1-bdc7-405b-819b-cce989acc310 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.841508 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6dd62d93-b3ef-4b4d-be42-516379e633f2 req-a65806b1-bdc7-405b-819b-cce989acc310 service nova] Creating event network-vif-plugged:a5a98ca7-52ff-4c04-a9c8-a94414acbef7 for instance fa29d0be-bfe0-495b-b3dc-94a18e813093 on n-h1-851337-5 Aug 04 04:26:53.847628 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6dd62d93-b3ef-4b4d-be42-516379e633f2 req-a65806b1-bdc7-405b-819b-cce989acc310 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052959 Aug 04 04:26:53.850444 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 572/1137] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:53.858097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-834a7647-67a2-44cc-898d-10cc32989c0a tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Calling method '.version_select at 0x7f191a835670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:53.874319 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99fb9bb4-0777-46db-9e1c-72cb5edcfcfe tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action" status: 202 len: 0 microversion: 2.1 time: 0.410873 Aug 04 04:26:53.875281 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 566/1138] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:26:53 2022] POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:26:53.898445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:53.899511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:53.908191 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-834a7647-67a2-44cc-898d-10cc32989c0a tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] HTTP exception thrown: Image not found. Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-834a7647-67a2-44cc-898d-10cc32989c0a tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Request method failure captured: Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qNRGn4zSSh4zDPVvZxWGnu-Us8Zxtg8ZvNUkoXJkt6DoURRRsokFKJKUmFbK7YT4RAPEW-FuLmp841J1TfAK6Pp7yeQx5Y0aQMnlq60G7wdKP3eTKiQSHUPUz53C-Xg_iC2nAHUwtbKlPY9pkYBHkNM-7dHZsDmDnSNl2idWxPaSs Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:53.910221 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1b7b4489157748b59f467a817172f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1b7b4489157748b59f467a817172f03c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 362cc14af106453eae3721dab3c6829f Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '-1'} Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:53.911851 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:53.913448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:53.914912 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:53.916437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-834a7647-67a2-44cc-898d-10cc32989c0a tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:53.918121 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-834a7647-67a2-44cc-898d-10cc32989c0a tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] 10.222.0.69 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.066154 Aug 04 04:26:53.923165 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 573/1139] 10.222.0.69 () {58 vars in 1134 bytes} [Thu Aug 4 04:26:53 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:26:53.931358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1362869961"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:53.932668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.933300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.935278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.935898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.938542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:53.953583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.955891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:53.957184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:53.957742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.024782 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Cannot 'createImage' instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 while it is in task_state image_snapshot_pending Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action HTTP/1.1 Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 85 Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:54.027129 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1362869961"}} Aug 04 04:26:54.028726 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'createImage' instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 while it is in task_state image_snapshot_pending Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'beb8d55b-d5f1-41da-8a55-de6a6770fe34', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1362869961'}}} Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:54.029610 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 while it is in task_state image_snapshot_pending Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 while it is in task_state image_snapshot_pending Aug 04 04:26:54.031093 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.032482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 409 to user: Cannot 'createImage' instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 while it is in task_state image_snapshot_pending {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:54.035254 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3103731b-8c8d-4ccc-b43d-394ab1f6a541 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action" status: 409 len: 167 microversion: 2.1 time: 0.110852 Aug 04 04:26:54.039387 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 574/1140] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:26:53 2022] POST /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34/action => generated 167 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:26:54.041915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ba62cfb-4d8c-402e-984d-44831bf23ee3 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Calling method '.version_select at 0x7f191a75e8b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.067995 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-9ba62cfb-4d8c-402e-984d-44831bf23ee3 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] HTTP exception thrown: Image not found. Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ba62cfb-4d8c-402e-984d-44831bf23ee3 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Request method failure captured: Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/images/94260eae-1912-4ec0-afa5-3890eb5cd9bj HTTP/1.1 Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qNRGn4zSSh4zDPVvZxWGnu-Us8Zxtg8ZvNUkoXJkt6DoURRRsokFKJKUmFbK7YT4RAPEW-FuLmp841J1TfAK6Pp7yeQx5Y0aQMnlq60G7wdKP3eTKiQSHUPUz53C-Xg_iC2nAHUwtbKlPY9pkYBHkNM-7dHZsDmDnSNl2idWxPaSs Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:54.081043 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1b7b4489157748b59f467a817172f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1b7b4489157748b59f467a817172f03c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 362cc14af106453eae3721dab3c6829f Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '94260eae-1912-4ec0-afa5-3890eb5cd9bj'} Aug 04 04:26:54.082446 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 94260eae-1912-4ec0-afa5-3890eb5cd9bj to delete Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.083394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94260eae-1912-4ec0-afa5-3890eb5cd9bj could not be found. Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:54.084602 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ba62cfb-4d8c-402e-984d-44831bf23ee3 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:54.085766 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ba62cfb-4d8c-402e-984d-44831bf23ee3 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] 10.222.0.69 "DELETE /compute/v2.1/images/94260eae-1912-4ec0-afa5-3890eb5cd9bj" status: 404 len: 62 microversion: 2.1 time: 0.046292 Aug 04 04:26:54.086767 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 575/1141] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:54 2022] DELETE /compute/v2.1/images/94260eae-1912-4ec0-afa5-3890eb5cd9bj => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:26:54.112763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f3ec234d-b12f-4d6b-9806-a369bcafdf51 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '.version_select at 0x7f191a835700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.119754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:54.129942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-10f6aa7c-1e9a-4a4b-935f-7baa0c981dd8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1462 microversion: 2.1 time: 0.247579 Aug 04 04:26:54.131494 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 567/1142] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:53 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1462 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:54.137236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10bfa0d4-e806-4bd3-97ad-8ede6cbbda72 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Calling method '.version_select at 0x7f1919fd4310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.160868 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-10bfa0d4-e806-4bd3-97ad-8ede6cbbda72 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] HTTP exception thrown: Image not found. Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10bfa0d4-e806-4bd3-97ad-8ede6cbbda72 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Request method failure captured: Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/images/33e712bf-bf8a-4efa-8f76-5ffe312bfbf21 HTTP/1.1 Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qNRGn4zSSh4zDPVvZxWGnu-Us8Zxtg8ZvNUkoXJkt6DoURRRsokFKJKUmFbK7YT4RAPEW-FuLmp841J1TfAK6Pp7yeQx5Y0aQMnlq60G7wdKP3eTKiQSHUPUz53C-Xg_iC2nAHUwtbKlPY9pkYBHkNM-7dHZsDmDnSNl2idWxPaSs Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:54.168356 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1b7b4489157748b59f467a817172f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1b7b4489157748b59f467a817172f03c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 362cc14af106453eae3721dab3c6829f Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '33e712bf-bf8a-4efa-8f76-5ffe312bfbf21'} Aug 04 04:26:54.169874 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 33e712bf-bf8a-4efa-8f76-5ffe312bfbf21 to delete Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.170684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33e712bf-bf8a-4efa-8f76-5ffe312bfbf21 could not be found. Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:54.172002 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10bfa0d4-e806-4bd3-97ad-8ede6cbbda72 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:54.173196 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-10bfa0d4-e806-4bd3-97ad-8ede6cbbda72 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] 10.222.0.69 "DELETE /compute/v2.1/images/33e712bf-bf8a-4efa-8f76-5ffe312bfbf21" status: 404 len: 62 microversion: 2.1 time: 0.037279 Aug 04 04:26:54.183017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 568/1143] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:26:54 2022] DELETE /compute/v2.1/images/33e712bf-bf8a-4efa-8f76-5ffe312bfbf21 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:26:54.188802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33198630-99c0-4f0b-8ba7-0a8c7a471abc tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.189686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33198630-99c0-4f0b-8ba7-0a8c7a471abc tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:54.211142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33198630-99c0-4f0b-8ba7-0a8c7a471abc tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.211880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33198630-99c0-4f0b-8ba7-0a8c7a471abc tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.214024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33198630-99c0-4f0b-8ba7-0a8c7a471abc tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.218474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33198630-99c0-4f0b-8ba7-0a8c7a471abc tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.352814 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f3ec234d-b12f-4d6b-9806-a369bcafdf51 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/images/931b39cf-5825-4249-ac63-917daa0078fe" status: 204 len: 0 microversion: 2.1 time: 0.255160 Aug 04 04:26:54.354079 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 576/1144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:54 2022] DELETE /compute/v2.1/images/931b39cf-5825-4249-ac63-917daa0078fe => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:54.360755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04555923-877e-48ba-8134-427b45be3ca1 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Calling method '.version_select at 0x7f191a7ea700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.391795 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33198630-99c0-4f0b-8ba7-0a8c7a471abc tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1613 microversion: 2.1 time: 0.207338 Aug 04 04:26:54.394474 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-04555923-877e-48ba-8134-427b45be3ca1 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] HTTP exception thrown: Image not found. Aug 04 04:26:54.395151 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 569/1145] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:54 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1613 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04555923-877e-48ba-8134-427b45be3ca1 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Request method failure captured: Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/images/tempest-invalid-917508855 HTTP/1.1 Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qNRGn4zSSh4zDPVvZxWGnu-Us8Zxtg8ZvNUkoXJkt6DoURRRsokFKJKUmFbK7YT4RAPEW-FuLmp841J1TfAK6Pp7yeQx5Y0aQMnlq60G7wdKP3eTKiQSHUPUz53C-Xg_iC2nAHUwtbKlPY9pkYBHkNM-7dHZsDmDnSNl2idWxPaSs Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:54.398889 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1b7b4489157748b59f467a817172f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1b7b4489157748b59f467a817172f03c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 362cc14af106453eae3721dab3c6829f Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'tempest-invalid-917508855'} Aug 04 04:26:54.400457 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-917508855 to delete Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.401249 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-917508855 could not be found. Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:54.402372 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:26:54.403619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.405511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.405511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:54.407812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04555923-877e-48ba-8134-427b45be3ca1 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:54.408925 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-04555923-877e-48ba-8134-427b45be3ca1 tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] 10.222.0.69 "DELETE /compute/v2.1/images/tempest-invalid-917508855" status: 404 len: 62 microversion: 2.1 time: 0.053642 Aug 04 04:26:54.410000 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 577/1146] 10.222.0.69 () {58 vars in 1203 bytes} [Thu Aug 4 04:26:54 2022] DELETE /compute/v2.1/images/tempest-invalid-917508855 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:26:54.413783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.414270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.415250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.415713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.415941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.416564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:54.424199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.424905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.425366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.426031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.621925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:54.626174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:54.630201 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d2d3d04-c387-4cb3-8415-57c0c74b3e42 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1533 microversion: 2.1 time: 0.232502 Aug 04 04:26:54.641735 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 570/1147] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:54 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1533 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:54.641735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:54.641735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:54.642778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.643266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.644045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.644493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.646210 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2cb9491-409b-4465-acf1-9b96cf991183 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.234936 Aug 04 04:26:54.650576 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 578/1148] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:54 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:54.655507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9970890-8712-4bc9-8705-62a07a7ed72b tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Calling method '.version_select at 0x7f191a797ee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.675079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ddb47c0d58fb47eba4cc08933ba292c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22215bcace514a4b8d41c1c0872460a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:54.675671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] flavor_id is None. Assuming migration. {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 04:26:54.676325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 04:26:54.679661 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-a9970890-8712-4bc9-8705-62a07a7ed72b tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] HTTP exception thrown: Image not found. Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9970890-8712-4bc9-8705-62a07a7ed72b tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Request method failure captured: Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/images/adfffa80-de4c-4d86-83e1-7bdec8f25796 HTTP/1.1 Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qNRGn4zSSh4zDPVvZxWGnu-Us8Zxtg8ZvNUkoXJkt6DoURRRsokFKJKUmFbK7YT4RAPEW-FuLmp841J1TfAK6Pp7yeQx5Y0aQMnlq60G7wdKP3eTKiQSHUPUz53C-Xg_iC2nAHUwtbKlPY9pkYBHkNM-7dHZsDmDnSNl2idWxPaSs Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:54.681417 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1b7b4489157748b59f467a817172f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1b7b4489157748b59f467a817172f03c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1b7b4489157748b59f467a817172f03c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 1b7b4489157748b59f467a817172f03c Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-788038682 Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 362cc14af106453eae3721dab3c6829f Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-788038682-project Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'adfffa80-de4c-4d86-83e1-7bdec8f25796'} Aug 04 04:26:54.682919 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image adfffa80-de4c-4d86-83e1-7bdec8f25796 to delete Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.684326 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image adfffa80-de4c-4d86-83e1-7bdec8f25796 could not be found. Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:54.685440 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9970890-8712-4bc9-8705-62a07a7ed72b tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:54.689046 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9970890-8712-4bc9-8705-62a07a7ed72b tempest-ImagesDeleteNegativeTestJSON-788038682 tempest-ImagesDeleteNegativeTestJSON-788038682-project] 10.222.0.69 "DELETE /compute/v2.1/images/adfffa80-de4c-4d86-83e1-7bdec8f25796" status: 404 len: 62 microversion: 2.1 time: 0.034331 Aug 04 04:26:54.691292 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 579/1149] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:54 2022] DELETE /compute/v2.1/images/adfffa80-de4c-4d86-83e1-7bdec8f25796 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:26:54.806828 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b00a637b-21d7-49bf-9560-21104905623f tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178/action" status: 202 len: 0 microversion: 2.1 time: 0.173949 Aug 04 04:26:54.808032 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 571/1150] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:26:54 2022] POST /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:26:54.819526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:54.821648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:54.831146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.831956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:54.833384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:54.834890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:55.026412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:55.035550 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cbb89549-8506-4720-b431-41c1968ca796 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1471 microversion: 2.1 time: 0.222579 Aug 04 04:26:55.037977 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 580/1151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:54 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:55.657390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:55.659302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:55.670602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:55.671252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:55.679504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:55.679998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:55.680845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:55.681165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:55.681314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:55.682053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:55.685342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:55.686894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:55.978408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:55.988371 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f86bb188-2bf8-4372-a0a6-2db9e43c5128 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1309 microversion: 2.1 time: 0.322251 Aug 04 04:26:55.988962 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 581/1152] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:55 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:56.017039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:56.026564 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-befcc228-126f-48ae-a967-448823b5a804 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1539 microversion: 2.1 time: 0.378000 Aug 04 04:26:56.027941 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 572/1153] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:55 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1539 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:56.060685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:56.061367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:56.068651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:56.068928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:56.070290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:56.070910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:56.277637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:56.291828 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ef636db-cc78-434e-82fb-a3dd15521f38 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1471 microversion: 2.1 time: 0.236898 Aug 04 04:26:56.292726 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 582/1154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:56 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:56.918662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fda813df-e672-4069-b368-7d10a38de047 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f1919ff4040>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPDmsfhuIPtCrYKZkUI1QLADE3fm782m3CEoTcv3CccRD4DUcIUbALb771dfCq21tYyFfukEKGxzVAENrsjVsARdKrXIjYPzrYqqVJnIU9Gc3YIfTkrPm8Ib50L8R2DMA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fda813df-e672-4069-b368-7d10a38de047 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 257 Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:56.922831 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:26:56.924315 n-d-851337-5 devstack@n-api.service[119342]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPDmsfhuIPtCrYKZkUI1QLADE3fm782m3CEoTcv3CccRD4DUcIUbALb771dfCq21tYyFfukEKGxzVAENrsjVsARdKrXIjYPzrYqqVJnIU9Gc3YIfTkrPm8Ib50L8R2DMA=="}} Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPDmsfhuIPtCrYKZkUI1QLADE3fm782m3CEoTcv3CccRD4DUcIUbALb771dfCq21tYyFfukEKGxzVAENrsjVsARdKrXIjYPzrYqqVJnIU9Gc3YIfTkrPm8Ib50L8R2DMA=='}}} Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.925081 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:56.926265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:26:56.931876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:26:56.935070 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 04:26:56.935070 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.935070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fda813df-e672-4069-b368-7d10a38de047 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:56.935070 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fda813df-e672-4069-b368-7d10a38de047 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.143330 Aug 04 04:26:56.935070 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 573/1155] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:26:56 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:26:56.935866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01dd41ea-fdc9-45c6-a84b-b9eed61c0fdb tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f191a751b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-944556035", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:56.951237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-01dd41ea-fdc9-45c6-a84b-b9eed61c0fdb tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:56.955218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-01dd41ea-fdc9-45c6-a84b-b9eed61c0fdb tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for user db5a66d04f2a4853bfa6b9518e066636 and project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:56.972734 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-01dd41ea-fdc9-45c6-a84b-b9eed61c0fdb tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01dd41ea-fdc9-45c6-a84b-b9eed61c0fdb tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 2166 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-944556035", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:56.983020 n-d-851337-5 devstack@n-api.service[119343]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-944556035', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:56.985282 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01dd41ea-fdc9-45c6-a84b-b9eed61c0fdb tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01dd41ea-fdc9-45c6-a84b-b9eed61c0fdb tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.054287 Aug 04 04:26:56.987888 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 583/1156] 10.222.0.69 () {60 vars in 1160 bytes} [Thu Aug 4 04:26:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:26:56.997706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91533b94-7b6f-4cd5-9969-f9f9c2c0bf78 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f1919f9d5e0>, body: {"keypair": {"name": "tempest-keypair-1678152443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0eADYI+uavGmEJolG3GoDpi7HhbhYrdWqTv3zXdncKWOrQPKWLN1bCKvlfutqx/wpWNiR3Pe/DkYZ1QxZjOMD3/zxb6TGcLyJF2oUG7LYy8rI1nKmlgbOaajEk0UYiuQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:57.012758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.013410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.020400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.020881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.022593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.023083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.027113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-91533b94-7b6f-4cd5-9969-f9f9c2c0bf78 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:57.037450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-91533b94-7b6f-4cd5-9969-f9f9c2c0bf78 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for user db5a66d04f2a4853bfa6b9518e066636 and project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:57.079446 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91533b94-7b6f-4cd5-9969-f9f9c2c0bf78 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085462 Aug 04 04:26:57.080234 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 574/1157] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:26:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:57.086923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.087577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.097934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.098403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.100225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.100689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.213447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.254887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:57.265746 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e357ba5-33dc-44b3-830b-f4dd7cc52521 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1492 microversion: 2.1 time: 0.257746 Aug 04 04:26:57.266920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 584/1158] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1492 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:57.272058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd7c6d76-9296-469c-b9cd-a12b8904d2b1 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f191a751c10>, body: {"keypair": {"name": "tempest-keypair-1678152443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxyBc6C9kqo7Kgz8h3hP4exKOQ2EQEo0cqC99lPBHa0iu+1++izcKOgmkhNWq5SDx3FlInfQ2c8QHOQvJkpFZ1w9l1E2gXwxW/TvemMtY+s1AH8Yv8/irPdHQ152ScdIQ=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:57.289664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-fd7c6d76-9296-469c-b9cd-a12b8904d2b1 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:57.293666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-fd7c6d76-9296-469c-b9cd-a12b8904d2b1 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for user db5a66d04f2a4853bfa6b9518e066636 and project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:57.316165 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-fd7c6d76-9296-469c-b9cd-a12b8904d2b1 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] HTTP exception thrown: Key pair 'tempest-keypair-1678152443' already exists. Aug 04 04:26:57.317405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd7c6d76-9296-469c-b9cd-a12b8904d2b1 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 273 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: {"keypair": {"name": "tempest-keypair-1678152443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxyBc6C9kqo7Kgz8h3hP4exKOQ2EQEo0cqC99lPBHa0iu+1++izcKOgmkhNWq5SDx3FlInfQ2c8QHOQvJkpFZ1w9l1E2gXwxW/TvemMtY+s1AH8Yv8/irPdHQ152ScdIQ=="}} Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: exception: Key pair 'tempest-keypair-1678152443' already exists. Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1678152443', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxyBc6C9kqo7Kgz8h3hP4exKOQ2EQEo0cqC99lPBHa0iu+1++izcKOgmkhNWq5SDx3FlInfQ2c8QHOQvJkpFZ1w9l1E2gXwxW/TvemMtY+s1AH8Yv8/irPdHQ152ScdIQ=='}}} Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result.read() Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'db5a66d04f2a4853bfa6b9518e066636-tempest-keypair-1678152443' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 04:26:57.320188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result.read() Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 04:26:57.324364 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'db5a66d04f2a4853bfa6b9518e066636-tempest-keypair-1678152443' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 4, 26, 57, 309604), 'updated_at': None, 'name': 'tempest-keypair-1678152443', 'user_id': 'db5a66d04f2a4853bfa6b9518e066636', 'fingerprint': '20:93:e3:06:4f:aa:a2:13:0a:95:2b:2b:d7:5a:9c:58', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxyBc6C9kqo7Kgz8h3hP4exKOQ2EQEo0cqC99lPBHa0iu+1++izcKOgmkhNWq5SDx3FlInfQ2c8QHOQvJkpFZ1w9l1E2gXwxW/TvemMtY+s1AH8Yv8/irPdHQ152ScdIQ==', 'type': 'ssh'}] Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi keypair.create() Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._create() Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1678152443' already exists. Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 04 04:26:57.330938 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1678152443' already exists. Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1678152443' already exists. Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd7c6d76-9296-469c-b9cd-a12b8904d2b1 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 409 to user: Key pair 'tempest-keypair-1678152443' already exists. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd7c6d76-9296-469c-b9cd-a12b8904d2b1 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.053709 Aug 04 04:26:57.339413 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 585/1159] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:26:57 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:26:57.341015 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d7373372-1a14-4be1-9e16-437f81ce6721 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1521 microversion: 2.1 time: 0.246035 Aug 04 04:26:57.341015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 575/1160] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.341279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e696890f-4d36-4716-b8ed-b08914cc9b45 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.341279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e696890f-4d36-4716-b8ed-b08914cc9b45 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.343254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e696890f-4d36-4716-b8ed-b08914cc9b45 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.343772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e696890f-4d36-4716-b8ed-b08914cc9b45 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.344611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e696890f-4d36-4716-b8ed-b08914cc9b45 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.345125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e696890f-4d36-4716-b8ed-b08914cc9b45 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.348749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.351268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.356532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.357235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.358106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.358542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.565951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e696890f-4d36-4716-b8ed-b08914cc9b45 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1643 microversion: 2.1 time: 0.242396 Aug 04 04:26:57.566527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 586/1161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1643 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.569369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:57.572117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03f94079-3090-4ffe-a5cd-2afd8281feae tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Calling method '.version_select at 0x7f191a779670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.578183 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26b92af5-d525-462b-ae82-4b1781ae75c0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1471 microversion: 2.1 time: 0.233929 Aug 04 04:26:57.578993 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 576/1162] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.590898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.592195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.592584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03f94079-3090-4ffe-a5cd-2afd8281feae tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678152443" status: 202 len: 0 microversion: 2.1 time: 0.025029 Aug 04 04:26:57.593159 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 587/1163] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678152443 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:26:57.597734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98b3696d-4724-4615-ad17-3c5b003106a4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.598348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98b3696d-4724-4615-ad17-3c5b003106a4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.599034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.600038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.600816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.601251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.605407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98b3696d-4724-4615-ad17-3c5b003106a4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.605925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98b3696d-4724-4615-ad17-3c5b003106a4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.606945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98b3696d-4724-4615-ad17-3c5b003106a4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.607451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98b3696d-4724-4615-ad17-3c5b003106a4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.628102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:26:57.707427 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e2444537-ff40-4b06-8403-01590d06ed9c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 204 len: 0 microversion: 2.1 time: 0.120400 Aug 04 04:26:57.711449 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 577/1164] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:26:57 2022] DELETE /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:57.716845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-946c65a4-54d2-46a3-8dea-5a99aca49a98 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f191a0643a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKfVb7JdHlgsqMkzSOKTq69+cKA3Gh7j2TB7hSFg0juUeX8haiOm7tF4qN5HanyCzjWWwgWjaYqn3sz9FN2QyHjSFdx5+hzM6alGsMrTReH0aXbbZlSNRjHO7GDJDzpug=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-946c65a4-54d2-46a3-8dea-5a99aca49a98 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 247 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKfVb7JdHlgsqMkzSOKTq69+cKA3Gh7j2TB7hSFg0juUeX8haiOm7tF4qN5HanyCzjWWwgWjaYqn3sz9FN2QyHjSFdx5+hzM6alGsMrTReH0aXbbZlSNRjHO7GDJDzpug=="}} Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKfVb7JdHlgsqMkzSOKTq69+cKA3Gh7j2TB7hSFg0juUeX8haiOm7tF4qN5HanyCzjWWwgWjaYqn3sz9FN2QyHjSFdx5+hzM6alGsMrTReH0aXbbZlSNRjHO7GDJDzpug=='}}} Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi '' Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:26:57.720597 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-946c65a4-54d2-46a3-8dea-5a99aca49a98 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-946c65a4-54d2-46a3-8dea-5a99aca49a98 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009308 Aug 04 04:26:57.725563 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 578/1165] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:26:57 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:26:57.732154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.732870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.734827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.741893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.742350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.743175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.743617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.755445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98b3696d-4724-4615-ad17-3c5b003106a4 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1643 microversion: 2.1 time: 0.161213 Aug 04 04:26:57.756158 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 588/1166] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1643 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.760849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d94033b5-d9b7-4ab1-8d92-cfeb6a421443 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f191a779d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-210434107", "public_key": " "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:57.776517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d94033b5-d9b7-4ab1-8d92-cfeb6a421443 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:57.780601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d94033b5-d9b7-4ab1-8d92-cfeb6a421443 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for user db5a66d04f2a4853bfa6b9518e066636 and project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:57.796113 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-d94033b5-d9b7-4ab1-8d92-cfeb6a421443 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d94033b5-d9b7-4ab1-8d92-cfeb6a421443 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 94 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-210434107", "public_key": " "}} Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-210434107', 'public_key': ' '}}} Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.798016 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d94033b5-d9b7-4ab1-8d92-cfeb6a421443 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d94033b5-d9b7-4ab1-8d92-cfeb6a421443 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.042294 Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 589/1167] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Aug 4 04:26:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea02b45e-4842-4caa-90d3-a845822ea2ed tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:26:57.809948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea02b45e-4842-4caa-90d3-a845822ea2ed tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.812919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea02b45e-4842-4caa-90d3-a845822ea2ed tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.812919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea02b45e-4842-4caa-90d3-a845822ea2ed tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.812919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea02b45e-4842-4caa-90d3-a845822ea2ed tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.824910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.839516 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea02b45e-4842-4caa-90d3-a845822ea2ed tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038025 Aug 04 04:26:57.840541 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 590/1168] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:26:57.846102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-788cbcb4-3498-48ff-92f9-98c35adf5796 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f191a7518b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPboa9btDuOyXV+8jThHMc+xAsg9HEaQ+TQMXRNoAtEsgCfzsBEQ/wQlL0nspUK8aWGjopfzEGOBxnhWCNoBTuYmEXv02GuTRRPp2UGj+MXkvbWli47hqRCey0KBIbpeA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-788cbcb4-3498-48ff-92f9-98c35adf5796 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 507 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPboa9btDuOyXV+8jThHMc+xAsg9HEaQ+TQMXRNoAtEsgCfzsBEQ/wQlL0nspUK8aWGjopfzEGOBxnhWCNoBTuYmEXv02GuTRRPp2UGj+MXkvbWli47hqRCey0KBIbpeA=="}} Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPboa9btDuOyXV+8jThHMc+xAsg9HEaQ+TQMXRNoAtEsgCfzsBEQ/wQlL0nspUK8aWGjopfzEGOBxnhWCNoBTuYmEXv02GuTRRPp2UGj+MXkvbWli47hqRCey0KBIbpeA=='}}} Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 04:26:57.850658 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-788cbcb4-3498-48ff-92f9-98c35adf5796 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-788cbcb4-3498-48ff-92f9-98c35adf5796 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010418 Aug 04 04:26:57.853677 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 591/1169] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:26:57 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:26:57.857621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f10b4e98-6e98-4ac4-bc12-e3df4b7b4ebb tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:57.858158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f10b4e98-6e98-4ac4-bc12-e3df4b7b4ebb tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.865072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f10b4e98-6e98-4ac4-bc12-e3df4b7b4ebb tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.866032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f10b4e98-6e98-4ac4-bc12-e3df4b7b4ebb tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.866817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f10b4e98-6e98-4ac4-bc12-e3df4b7b4ebb tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.867291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f10b4e98-6e98-4ac4-bc12-e3df4b7b4ebb tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.909755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:57.921412 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3072cd80-8687-4a32-a98d-27531cec9acd tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1527 microversion: 2.1 time: 0.192563 Aug 04 04:26:57.922394 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 579/1170] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1527 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.929217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-587084c5-9720-4b1f-83a1-45a68c3b790d tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Action: 'create', calling method: .version_select at 0x7f1919fffca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-914267081", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:57.939496 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f10b4e98-6e98-4ac4-bc12-e3df4b7b4ebb tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093/action" status: 202 len: 0 microversion: 2.1 time: 0.085305 Aug 04 04:26:57.940113 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 592/1171] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:26:57 2022] POST /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:26:57.949898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-34e65a88-ea3a-43a5-bd0e-a420ab22a116 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.950605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-587084c5-9720-4b1f-83a1-45a68c3b790d tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:26:57.950773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-34e65a88-ea3a-43a5-bd0e-a420ab22a116 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:57.955996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-587084c5-9720-4b1f-83a1-45a68c3b790d tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Getting quotas for user db5a66d04f2a4853bfa6b9518e066636 and project 7d72eb9220da4b2c8d19e1ff825f2ae6. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:26:57.957803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e65a88-ea3a-43a5-bd0e-a420ab22a116 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.958581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e65a88-ea3a-43a5-bd0e-a420ab22a116 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.959879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e65a88-ea3a-43a5-bd0e-a420ab22a116 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:57.960387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e65a88-ea3a-43a5-bd0e-a420ab22a116 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:57.972545 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-587084c5-9720-4b1f-83a1-45a68c3b790d tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-587084c5-9720-4b1f-83a1-45a68c3b790d tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 117 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-914267081", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-914267081', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 04:26:57.974616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-587084c5-9720-4b1f-83a1-45a68c3b790d tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-587084c5-9720-4b1f-83a1-45a68c3b790d tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.051925 Aug 04 04:26:57.978742 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 580/1172] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:26:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:26:57.985760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3a306f69-abfc-4a80-8705-4437e874f9d5 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Calling method '.version_select at 0x7f1919ff4310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:57.998856 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3a306f69-abfc-4a80-8705-4437e874f9d5 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-679368758 not found for user db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3a306f69-abfc-4a80-8705-4437e874f9d5 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Request method failure captured: Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-679368758 HTTP/1.1 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qQfjZ7WJLdJS5O7KvU8XWYfykc4d-OxgL29QVB-SEcDsFZbpFPcMXFiEH5oUdivYEnZfsOwLaIDE3pEUY3_9br3CWDGLGDoNsQ3s1KAi04k1AS2InBdbBm0YWF0Mi2CWi7O5MH-BIhIL3b6NDVKpjvXeaxf4MFKEHxNxrYlbqadV8 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7d72eb9220da4b2c8d19e1ff825f2ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7d72eb9220da4b2c8d19e1ff825f2ae6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7d72eb9220da4b2c8d19e1ff825f2ae6 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-756419061 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-KeyPairsNegativeTestJSON-756419061-project Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: exception: Keypair tempest-keypair-non-existent-679368758 not found for user db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'tempest-keypair-non-existent-679368758'} Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-679368758 not found for user db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:58.000909 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-679368758 not found for user db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-679368758 not found for user db5a66d04f2a4853bfa6b9518e066636 Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3a306f69-abfc-4a80-8705-4437e874f9d5 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] Returning 404 to user: Keypair tempest-keypair-non-existent-679368758 not found for user db5a66d04f2a4853bfa6b9518e066636 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:26:58.007572 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3a306f69-abfc-4a80-8705-4437e874f9d5 tempest-KeyPairsNegativeTestJSON-756419061 tempest-KeyPairsNegativeTestJSON-756419061-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-679368758" status: 404 len: 144 microversion: 2.1 time: 0.020635 Aug 04 04:26:58.010141 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 581/1173] 10.222.0.69 () {58 vars in 1257 bytes} [Thu Aug 4 04:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-679368758 => generated 144 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:26:58.098350 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-34e65a88-ea3a-43a5-bd0e-a420ab22a116 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1648 microversion: 2.1 time: 0.153062 Aug 04 04:26:58.099035 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 593/1174] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:57 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1648 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:58.601221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:58.601852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:58.611811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:58.612271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:58.613071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:58.613517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:58.637652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:58.778114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:58.786048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca67c42b-1c03-45a7-a5d6-101361ee1fa3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.190655 Aug 04 04:26:58.786648 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 582/1175] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:58 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:58.948296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:58.948909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:58.955741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:58.956183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:58.956973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:58.957397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:59.101513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:26:59.109580 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a3037c6-789f-49d5-a604-1173b9b72695 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1527 microversion: 2.1 time: 0.165991 Aug 04 04:26:59.110389 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 594/1176] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:58 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1527 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:59.120495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1e79614-8fa1-4dcb-84d9-4b5a94acdcd0 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:59.121494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d1e79614-8fa1-4dcb-84d9-4b5a94acdcd0 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:59.128661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1e79614-8fa1-4dcb-84d9-4b5a94acdcd0 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:59.129113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1e79614-8fa1-4dcb-84d9-4b5a94acdcd0 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:59.129924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1e79614-8fa1-4dcb-84d9-4b5a94acdcd0 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:59.130370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1e79614-8fa1-4dcb-84d9-4b5a94acdcd0 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:59.289421 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1e79614-8fa1-4dcb-84d9-4b5a94acdcd0 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1628 microversion: 2.1 time: 0.174069 Aug 04 04:26:59.289997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 583/1177] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:59 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1628 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:59.311856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-5", "block_migration": true, "disk_over_commit": false}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:26:59.314588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:59.323217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:59.323217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:59.323217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:59.323217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:59.352852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lazy-loading 'flavor' on Instance uuid fa29d0be-bfe0-495b-b3dc-94a18e813093 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:26:59.367496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Going to try to live migrate instance to n-h2-851337-5 {{(pid=119343) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:26:59.424089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:59.808050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:26:59.809714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:26:59.817019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:59.819653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:59.820579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:26:59.821640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:26:59.992233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:00.003597 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa297019-21e7-4a36-91ac-c392bab4f9c9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.199549 Aug 04 04:27:00.016186 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 584/1178] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:26:59 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:00.133614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:00.134988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:00.144077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:00.144583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:00.145501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:00.146842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:00.244507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:00.273171 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3618de0-437b-4445-8190-56fcad59ed0a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 200 len: 1485 microversion: 2.1 time: 0.144417 Aug 04 04:27:00.281594 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 585/1179] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:00 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 1485 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:00.296386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8d23e7e3-7798-418b-8523-6f54a383af8b req-863eafea-a38d-41fa-9446-2300e92907e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb8d55b-d5f1-41da-8a55-de6a6770fe34", "name": "network-vif-deleted", "tag": "6eb84cde-0131-4c9c-ae10-1830ec03d098"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:00.311425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8d23e7e3-7798-418b-8523-6f54a383af8b req-863eafea-a38d-41fa-9446-2300e92907e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:00.312006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8d23e7e3-7798-418b-8523-6f54a383af8b req-863eafea-a38d-41fa-9446-2300e92907e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:00.335730 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8d23e7e3-7798-418b-8523-6f54a383af8b req-863eafea-a38d-41fa-9446-2300e92907e1 service nova] Creating event network-vif-deleted:6eb84cde-0131-4c9c-ae10-1830ec03d098 for instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 on n-h2-851337-5 Aug 04 04:27:00.342808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8d23e7e3-7798-418b-8523-6f54a383af8b req-863eafea-a38d-41fa-9446-2300e92907e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059692 Aug 04 04:27:00.343806 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 586/1180] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:01.030612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:01.032318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:01.042359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:01.043245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:01.044170 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8bf87e18-4ed5-4cd7-98bf-7db7178c401c tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093/action" status: 202 len: 0 microversion: 2.1 time: 1.737162 Aug 04 04:27:01.045161 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 595/1181] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:26:59 2022] POST /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093/action => generated 0 bytes in 1739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:27:01.045765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:01.046419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:01.070100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:01.072311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:01.086676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:01.087333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:01.088490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:01.089239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:01.438584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:01.446412 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc2e21f9-3bed-4477-930a-ad327f13da6b tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.423082 Aug 04 04:27:01.459563 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 587/1182] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:01 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:01.466617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:01.467660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:01.467852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:01.474892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:01.475698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:01.476709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:01.477364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:01.482511 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-740c7129-70aa-4e82-b39c-d75fb61bd396 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.431224 Aug 04 04:27:01.483171 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 596/1183] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:01 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:01.501795 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 HTTP/1.1 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'beb8d55b-d5f1-41da-8a55-de6a6770fe34'} Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:01.504046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:01.508685 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:01.512470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:01.513629 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38d2b1ac-8b26-435e-8ff0-1c10dfbdb80a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 404 len: 111 microversion: 2.1 time: 0.052567 Aug 04 04:27:01.514786 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 588/1184] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:01 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:01.528913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-275844f0-4487-4922-9c5e-78e6ac9a7463 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'create', calling method: .version_select at 0x7f191a729940>, body: {"keypair": {"name": "tempest-keypair-1704040612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaRGddvcj/N/ZhaHVDtbtNgSRAqJYFYCCcXa6cDkfovhqH/Me0PREpkKHHjvgfBseaf3inQ2eZgxg/Fr7A7VkTIrvEpcBfQLI5Xz5JTPOSHPjBeC5ZwCYeFOCJpwezBQw=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:01.554102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-275844f0-4487-4922-9c5e-78e6ac9a7463 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for project ff11bae71d3142f9aa402463be123222. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:27:01.559387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-275844f0-4487-4922-9c5e-78e6ac9a7463 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for user 0a2006e35cc04887b80733ca3c736b9c and project ff11bae71d3142f9aa402463be123222. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:27:01.589843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-275844f0-4487-4922-9c5e-78e6ac9a7463 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066193 Aug 04 04:27:01.590668 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 597/1185] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:27:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:27:02.472153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:02.473524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:02.490749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:02.491471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:02.492358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:02.492872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:02.507689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:02.508598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:02.516899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:02.517675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:02.518754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:02.519483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:02.863803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:02.877487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:02.895496 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a6c12b7-3678-4858-85e5-0dc6de1c9977 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.393139 Aug 04 04:27:02.898155 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 598/1186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:02 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:02.898766 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a63f08a-3239-402d-98a9-16e1345a1ce1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.431966 Aug 04 04:27:02.914905 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 589/1187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:02 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:03.919471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:03.920836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:03.925931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:03.927321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:03.933494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:03.934149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:03.935261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:03.935624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:03.946797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:03.947544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:03.949168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:03.950037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:04.187627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:04.199451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:04.202725 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c41f8c1-ac3c-4932-8ff4-7f4af5031bcc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.284840 Aug 04 04:27:04.203593 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 599/1188] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:03 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:04.220899 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76f2e39e-f6c1-4d59-adfc-b7d6f6947088 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.302959 Aug 04 04:27:04.221504 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 590/1189] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:03 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:04.479585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-450269118", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:04.551459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] validate_networks() for [('1ce5a8a2-4eeb-4b49-9721-ea09562fbc92', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:27:04.963846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:04.964767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:04.973179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:04.973862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:04.975616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:04.976200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.408721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 1543d282-7d4f-4c87-b761-049a3c1ab46a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:27:05.442479 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7b78acb-11e3-46d8-a2ac-68091f1026e5 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 2421 microversion: 2.25 time: 0.483727 Aug 04 04:27:05.444050 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 591/1190] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:04 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 2421 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:05.451633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6820cee3-cdcb-43eb-a50a-e30796506b6e req-589ede0a-16da-49da-86dd-a647b60f69d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29d0be-bfe0-495b-b3dc-94a18e813093", "name": "network-vif-unplugged", "status": "completed", "tag": "a5a98ca7-52ff-4c04-a9c8-a94414acbef7"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:05.467476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6820cee3-cdcb-43eb-a50a-e30796506b6e req-589ede0a-16da-49da-86dd-a647b60f69d4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.468199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6820cee3-cdcb-43eb-a50a-e30796506b6e req-589ede0a-16da-49da-86dd-a647b60f69d4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.486895 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6820cee3-cdcb-43eb-a50a-e30796506b6e req-589ede0a-16da-49da-86dd-a647b60f69d4 service nova] Creating event network-vif-unplugged:a5a98ca7-52ff-4c04-a9c8-a94414acbef7 for instance fa29d0be-bfe0-495b-b3dc-94a18e813093 on n-h1-851337-5 Aug 04 04:27:05.493608 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6820cee3-cdcb-43eb-a50a-e30796506b6e req-589ede0a-16da-49da-86dd-a647b60f69d4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047951 Aug 04 04:27:05.495174 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 592/1191] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:05.502109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:05.503210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:05.510469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.511340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.512497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.513157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.538398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:27:05.538398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:27:05.539203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:27:05.539663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:27:05.540277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:27:05.551916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.552634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.553606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.554208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.590549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for project ff11bae71d3142f9aa402463be123222. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:27:05.600622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for user 0a2006e35cc04887b80733ca3c736b9c and project ff11bae71d3142f9aa402463be123222. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:27:05.616140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:27:05.618417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:27:05.691988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:05.695540 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-491339ed-9d6c-48dd-bea3-5931b0edd996 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.225954 Aug 04 04:27:05.698644 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 600/1192] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:27:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:27:05.702633 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7c9c47a-86d2-4f07-a0ac-78ffc25f59df tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.205825 Aug 04 04:27:05.703312 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 593/1193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:05 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:05.704963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:05.705848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:05.713597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.714268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.715313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.715914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.718059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851337-5", "block_migration": "auto"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:05.721272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:05.748154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.749599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.752282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:05.753750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:05.805455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'flavor' on Instance uuid 1543d282-7d4f-4c87-b761-049a3c1ab46a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:27:05.841786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Going to try to live migrate instance to n-h1-851337-5 {{(pid=119342) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:27:05.930864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:05.947730 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9cfebd9-455b-4d42-940b-218c046458d2 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.246760 Aug 04 04:27:05.961862 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 601/1194] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:05 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:05.971130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41ddd685-6160-47af-88a9-60a4e7aa0cfa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:05.972355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41ddd685-6160-47af-88a9-60a4e7aa0cfa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:06.078564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41ddd685-6160-47af-88a9-60a4e7aa0cfa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:06.092536 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41ddd685-6160-47af-88a9-60a4e7aa0cfa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1224 microversion: 2.1 time: 0.141676 Aug 04 04:27:06.107800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 602/1195] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:05 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:06.726651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:06.727392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:06.738351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:06.740621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:06.741969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:06.742738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:06.929811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:06.937798 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9f80be32-7381-499e-9488-d766541008ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.216733 Aug 04 04:27:06.939086 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 603/1196] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:06 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:06.969666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:06.970603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:06.991969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:06.992650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:06.993675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:06.994341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:07.173327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:07.183610 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91a5c602-e5ab-4213-99f4-a6b130043f0f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.217974 Aug 04 04:27:07.184194 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 604/1197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:06 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:07.363931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1056226777", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "b19d837b-c2f4-473a-ab4a-aff415815cea"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:07.450035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] validate_networks() for [('b19d837b-c2f4-473a-ab4a-aff415815cea', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:27:07.907211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:27:07.907772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:27:07.908212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:27:07.908625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:27:07.909367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:27:07.921001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:07.921685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:07.922734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:07.923352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:07.945190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Getting quotas for project fb1296f1aab44166866e503dd79225c5. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:27:07.950997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Getting quotas for user 16ace659cbb84a0aa6541a7c4d805451 and project fb1296f1aab44166866e503dd79225c5. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:27:07.964999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:07.965509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:27:07.969329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:27:08.008320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e82cbe9-7bbd-4cfa-b88e-029d6be4fac9 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/action" status: 202 len: 0 microversion: 2.25 time: 2.299692 Aug 04 04:27:08.010568 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 594/1198] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:27:05 2022] POST /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/action => generated 0 bytes in 2307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:08.035084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1262c6a9-6d47-4494-acb4-e4528cf94aba tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 0.842656 Aug 04 04:27:08.037094 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 605/1199] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:27:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:27:08.038115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:08.039007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:08.049870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.050746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.051875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.052629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.064286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9a8170bb-33b2-4ee0-a6bc-0b67c5f367c0 req-b82c36ad-3dc1-4398-8084-03edd938c49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa29d0be-bfe0-495b-b3dc-94a18e813093", "tag": "a5a98ca7-52ff-4c04-a9c8-a94414acbef7"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:08.096048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9a8170bb-33b2-4ee0-a6bc-0b67c5f367c0 req-b82c36ad-3dc1-4398-8084-03edd938c49a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.097479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9a8170bb-33b2-4ee0-a6bc-0b67c5f367c0 req-b82c36ad-3dc1-4398-8084-03edd938c49a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.112967 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9a8170bb-33b2-4ee0-a6bc-0b67c5f367c0 req-b82c36ad-3dc1-4398-8084-03edd938c49a service nova] Creating event network-changed:a5a98ca7-52ff-4c04-a9c8-a94414acbef7 for instance fa29d0be-bfe0-495b-b3dc-94a18e813093 on n-h1-851337-5 Aug 04 04:27:08.118849 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9a8170bb-33b2-4ee0-a6bc-0b67c5f367c0 req-b82c36ad-3dc1-4398-8084-03edd938c49a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079782 Aug 04 04:27:08.119713 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 606/1200] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:08.125796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:08.126714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:08.135006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.135818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.137847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.138651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.168663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.176853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92e6e0b0-1584-4192-acdd-3cb825909084 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1282 microversion: 2.1 time: 0.164741 Aug 04 04:27:08.180014 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 595/1201] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:08 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:08.194263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:08.194905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:08.210350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.215680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.216535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.216982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.527593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.542205 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-353894a5-e0f7-40b9-bbe2-a96d85f08c81 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.417708 Aug 04 04:27:08.556379 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 607/1202] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:08 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:08.568475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c788bc2f-18cf-48c7-8a3f-bef888c0a6cb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:08.569132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c788bc2f-18cf-48c7-8a3f-bef888c0a6cb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:08.587101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.603682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.609919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.612061 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-770ff379-5d7f-4a1d-b235-283c1c0a1ec4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.427425 Aug 04 04:27:08.615048 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 596/1203] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:08 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:08.625006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:08.628559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:08.640148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.640826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.641871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:08.642568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:08.687671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c788bc2f-18cf-48c7-8a3f-bef888c0a6cb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.698017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c788bc2f-18cf-48c7-8a3f-bef888c0a6cb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.700709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c788bc2f-18cf-48c7-8a3f-bef888c0a6cb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.702176 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c788bc2f-18cf-48c7-8a3f-bef888c0a6cb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1259 microversion: 2.21 time: 0.143968 Aug 04 04:27:08.703078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 608/1204] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:08 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:08.841458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:08.850568 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cd513be-6742-4623-b6ca-8ad56bedb722 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.232973 Aug 04 04:27:08.851189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 597/1205] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:08 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:09.203384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:09.203987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:09.216192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:09.217344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:09.218421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:09.219407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:09.384908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:09.400089 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ca320edb-238c-45a2-9036-06577d102cba tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1324 microversion: 2.1 time: 0.205487 Aug 04 04:27:09.401003 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 609/1206] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:09 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:09.573755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:09.574673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:09.588996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:09.590433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:09.592099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:09.592705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:09.643668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:09.644673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:09.660400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:09.661809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:09.665846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:09.670886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.026608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.036132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.042181 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7caf7d74-4f0f-4634-a358-4c6998b802b2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.481200 Aug 04 04:27:10.044160 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 598/1207] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:09 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:10.050736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:10.051748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:10.071449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:10.071863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.073441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:10.075418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.098027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.126366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.128437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.133706 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-15ef2005-355b-40b6-b518-ad15b0b20352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.495926 Aug 04 04:27:10.135920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 610/1208] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:09 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:27:10.149010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:10.149942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:10.168883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:10.175606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.176462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:10.177671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.238569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.250004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.251556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.263443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a44d4f8-0f12-4739-a927-3404539274fb tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1317 microversion: 2.21 time: 0.206826 Aug 04 04:27:10.275139 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 599/1209] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:10 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:10.424285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:10.425703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:10.450660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:10.451694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.453008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:10.453796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.693694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.705325 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e601096c-3566-4624-a744-287a4f6cabdc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.567618 Aug 04 04:27:10.706689 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 611/1210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:10 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:10.748820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8b5e8b0c-cfa1-487a-9d69-ccda4508123f req-9b877fa5-72c9-450d-8d27-679a02cec5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f94cc3f-daa3-4561-9c16-1cfc491300ba", "tag": "f684c2e9-4be3-452c-911e-182187587f50"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:10.760491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:10.782275 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2bddd72e-3cfe-4051-a716-39dfa622e11c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1324 microversion: 2.1 time: 0.363996 Aug 04 04:27:10.784181 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 600/1211] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:10 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:10.794742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8b5e8b0c-cfa1-487a-9d69-ccda4508123f req-9b877fa5-72c9-450d-8d27-679a02cec5ff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:10.795563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8b5e8b0c-cfa1-487a-9d69-ccda4508123f req-9b877fa5-72c9-450d-8d27-679a02cec5ff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:10.811231 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8b5e8b0c-cfa1-487a-9d69-ccda4508123f req-9b877fa5-72c9-450d-8d27-679a02cec5ff service nova] Creating event network-changed:f684c2e9-4be3-452c-911e-182187587f50 for instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba on n-h2-851337-5 Aug 04 04:27:10.818971 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8b5e8b0c-cfa1-487a-9d69-ccda4508123f req-9b877fa5-72c9-450d-8d27-679a02cec5ff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074674 Aug 04 04:27:10.820423 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 612/1212] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:27:11.066279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:11.067496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:11.080942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.081807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.086002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.086501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.162229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:11.163125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:11.169515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.170000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.170864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.171373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.501171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.510308 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-66750f5d-9dd0-4eb6-bff5-4c80d3102505 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.448481 Aug 04 04:27:11.515979 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 601/1213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:11 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:11.523318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:11.524285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:11.532534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.533078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.534003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.534527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.592883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.604366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.605870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.607332 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf216c8d-bb41-4187-bb02-41cc2aafe058 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.449376 Aug 04 04:27:11.611419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 613/1214] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:11 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:11.727957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:11.728604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:11.738096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.751482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.752071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.752894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.753066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.753400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.754793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.756586 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16324b06-8ffa-4f85-9a73-9631cb24d902 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.239335 Aug 04 04:27:11.757156 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 602/1215] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:11 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:11.806752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:11.808139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:11.818079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.818533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.819478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:11.819927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:11.967436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:11.975608 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13ff7baf-46b9-444d-bd48-c3662acf9f7d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.251965 Aug 04 04:27:11.976571 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 614/1216] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:11 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:11.999378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:12.007591 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81c81bd8-5b1e-4cdb-aa45-07e23b5d01e6 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1324 microversion: 2.1 time: 0.205773 Aug 04 04:27:12.008188 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 603/1217] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:11 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:12.537708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:12.538791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:12.547017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:12.547807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:12.548929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:12.549443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:12.633669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:12.634784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:12.645334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:12.646615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:12.647498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:12.651418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:12.965039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:12.972571 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c0a100bb-5d94-4707-b16a-5c0ebcb692dd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.439400 Aug 04 04:27:12.973762 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 615/1218] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:12 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:12.978564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:12.979613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:12.988213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:12.989024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:12.991166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:12.991821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:13.087283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:13.098848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:13.100715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:13.102284 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a9f7246f-0eea-4742-8233-2b4f58d44c9a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.474114 Aug 04 04:27:13.109800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 604/1219] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:12 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:13.119639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:13.120769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:13.128518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:13.129303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:13.129904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:13.130967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:13.739602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:13.751360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:13.753627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:13.755369 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02f818db-17d8-4d33-9869-91d6032617d5 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.780081 Aug 04 04:27:13.757573 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 616/1220] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:12 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:13.766611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:13.767508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:13.777926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:13.778386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:13.779212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:13.779684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:13.797357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:13.853328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:13.866685 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d3b452b8-6071-4b84-8059-0c5b009dfac9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.757919 Aug 04 04:27:13.868038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 605/1221] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:13 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:13.998314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:13.998927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:14.005394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.005931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.006970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.007475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.131388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:14.141783 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b8c1131c-87d3-45a2-b39b-0a016b5af1eb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1324 microversion: 2.1 time: 0.382486 Aug 04 04:27:14.155502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 617/1222] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:13 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1324 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:14.168187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:14.168805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:14.175473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.176275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.177378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.178114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.354643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:14.366011 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db0cdd84-1471-4b61-82de-ee78ca993170 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1502 microversion: 2.1 time: 0.371037 Aug 04 04:27:14.376926 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 606/1223] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:13 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:14.390248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-332c7212-22b8-4081-9023-c6090174c9ae req-d5aa11ca-c2aa-45a8-a0dc-7bce70e1cc3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f8a1a9-9689-4003-9e93-0a06f6bbf26a", "tag": "3e915957-7293-47b8-9c14-3ed5be444022"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:14.401897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-332c7212-22b8-4081-9023-c6090174c9ae req-d5aa11ca-c2aa-45a8-a0dc-7bce70e1cc3f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.402340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-332c7212-22b8-4081-9023-c6090174c9ae req-d5aa11ca-c2aa-45a8-a0dc-7bce70e1cc3f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.422005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-332c7212-22b8-4081-9023-c6090174c9ae req-d5aa11ca-c2aa-45a8-a0dc-7bce70e1cc3f service nova] Creating event network-changed:3e915957-7293-47b8-9c14-3ed5be444022 for instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a on n-h2-851337-5 Aug 04 04:27:14.428320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-332c7212-22b8-4081-9023-c6090174c9ae req-d5aa11ca-c2aa-45a8-a0dc-7bce70e1cc3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047400 Aug 04 04:27:14.428922 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 607/1224] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:14.631342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:14.654862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:14.668153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:14.669629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9697d18-9cbd-482a-b044-fc0e280d2fd0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.508789 Aug 04 04:27:14.670708 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 618/1225] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:14 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:14.784964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:14.786739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:14.800147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.800844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.802026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.802613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.891757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:14.892405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:14.903813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:14.906323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.906976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:14.907944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:14.908565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.163108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.172385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.175173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.176396 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8017a000-cd9e-41dc-b1ca-e572b5f9ab7f tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.397357 Aug 04 04:27:15.177248 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 608/1226] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:14 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:15.181501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:15.182118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:15.188282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.188820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.191092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.191092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.242502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.254761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dfcd21ed-a10f-41a0-a0c0-5c06b02a0eb1 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.366674 Aug 04 04:27:15.276990 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 619/1227] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:14 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:15.387733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:15.388586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:15.396841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.397522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.398661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.399516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.403833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.414371 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a4acc203-f089-43ef-8ba2-0817ee80b3aa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1324 microversion: 2.1 time: 0.236172 Aug 04 04:27:15.415254 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 609/1228] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:15 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:15.571627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.579839 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b95cb354-b7bd-4c67-bf9b-4f2faccf06a8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1477 microversion: 2.1 time: 0.196403 Aug 04 04:27:15.580675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 620/1229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:15 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1477 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:15.601525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1301a12d-d468-482a-9b9f-dd440920ec7a tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '.version_select at 0x7f1919f87c10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:15.605396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1301a12d-d468-482a-9b9f-dd440920ec7a tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.605823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1301a12d-d468-482a-9b9f-dd440920ec7a tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.620696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1301a12d-d468-482a-9b9f-dd440920ec7a tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 3505 microversion: 2.1 time: 0.023928 Aug 04 04:27:15.621307 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 610/1230] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:27:15 2022] GET /compute/v2.1/os-migrations => generated 3505 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:15.636819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9c912b9-9dcc-4878-ba8d-11a52fcaad92 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:15.637438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9c912b9-9dcc-4878-ba8d-11a52fcaad92 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:15.653469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c912b9-9dcc-4878-ba8d-11a52fcaad92 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.653919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c912b9-9dcc-4878-ba8d-11a52fcaad92 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.654840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c912b9-9dcc-4878-ba8d-11a52fcaad92 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.655315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c912b9-9dcc-4878-ba8d-11a52fcaad92 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.702055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:15.705167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:15.716843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.718923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.720662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:15.721389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:15.884000 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9c912b9-9dcc-4878-ba8d-11a52fcaad92 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1628 microversion: 2.1 time: 0.250186 Aug 04 04:27:15.885438 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 621/1231] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:15 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1628 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:15.907359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.912129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.913634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:15.913859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ebbd4101-686a-4d6b-bbb9-3f77a0b80f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Action: 'create', calling method: .version_select at 0x7f191a6f95e0>, body: {"keypair": {"name": "tempest-keypair-473709371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF26UGHL12Z6qmIXkC+cdQJgAdu3DNR8IntwXtfQOELTuricp0K6Qf+s0PgmzDJZABDpOHLIkyc004M7r6jsR0JTwmeumqX4asM6Zd13+d2Xegd/cUlPsfzVg3TG3sRKKQ=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:15.915678 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c6c28187-1b0c-4c86-ba70-7167e01dabbb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.223205 Aug 04 04:27:15.916423 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 611/1232] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:15 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:15.931522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ebbd4101-686a-4d6b-bbb9-3f77a0b80f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:27:15.935665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ebbd4101-686a-4d6b-bbb9-3f77a0b80f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for user 53377b39d2804967aa0d5b71ee57e9a8 and project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:27:15.961636 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ebbd4101-686a-4d6b-bbb9-3f77a0b80f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051627 Aug 04 04:27:15.963261 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 622/1233] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:27:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:16.206184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:16.207348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:16.214427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.215097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.216286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.216859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.288128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:16.289365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:16.298863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.300847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.302642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.303275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.623499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:16.633988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:16.636299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:16.637726 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff59c6da-bf9e-4362-bd74-7148ec8b3829 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.437447 Aug 04 04:27:16.652356 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 612/1234] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:16 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:16.660576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:16.661672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:16.669400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.670005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.671572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.672636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.709245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:16.721635 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4bac2f8a-da62-4795-9f5e-9587ce37019c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.438106 Aug 04 04:27:16.731055 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 623/1235] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:16 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:16.737879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a154854a-875e-4a04-a743-644a4a67875d req-e932f038-3734-40db-812c-6627a7000da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f94cc3f-daa3-4561-9c16-1cfc491300ba", "name": "network-vif-plugged", "status": "completed", "tag": "f684c2e9-4be3-452c-911e-182187587f50"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:16.751186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a154854a-875e-4a04-a743-644a4a67875d req-e932f038-3734-40db-812c-6627a7000da8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.751639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a154854a-875e-4a04-a743-644a4a67875d req-e932f038-3734-40db-812c-6627a7000da8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.765032 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a154854a-875e-4a04-a743-644a4a67875d req-e932f038-3734-40db-812c-6627a7000da8 service nova] Creating event network-vif-plugged:f684c2e9-4be3-452c-911e-182187587f50 for instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba on n-h2-851337-5 Aug 04 04:27:16.770684 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a154854a-875e-4a04-a743-644a4a67875d req-e932f038-3734-40db-812c-6627a7000da8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037963 Aug 04 04:27:16.771420 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 624/1236] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:16.946881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:16.947897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:16.954151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.954980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:16.956142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:16.956824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:17.021702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:17.034621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f97b6c4-9811-46b3-9e60-351d2a1bcaf8 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1324 microversion: 2.1 time: 0.380438 Aug 04 04:27:17.049141 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 613/1237] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:16 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:17.240328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:17.249219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:17.250770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:17.252060 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e2be12c9-f9ef-4996-a33e-4502b9c9dd21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.309897 Aug 04 04:27:17.252611 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 625/1238] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:16 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:27:17.621337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-778158429", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "6f5fc760-036b-4db9-9515-31d6fe212ea8"}], "security_groups": [{"name": "tempest-securitygroup--2019478966"}], "key_name": "tempest-keypair-473709371", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:17.665901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:17.669828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:17.677155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:17.677606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:17.678387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:17.678856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:17.769103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] validate_networks() for [('6f5fc760-036b-4db9-9515-31d6fe212ea8', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:27:17.896738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:17.905396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:17.906885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:17.908090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22b9c113-8e7f-4a36-810c-9e084aefe647 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.247138 Aug 04 04:27:17.908652 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 626/1239] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:17 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:27:17.913127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:17.913669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:17.919968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:17.920408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:17.921177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:17.921604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:17.936990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.158292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:18.167516 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ac0f8365-d90c-4580-aeb1-09bb0b48150f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.257660 Aug 04 04:27:18.168592 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 627/1240] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:17 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:18.173651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:18.173853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:18.181970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.182556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:18.183521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.184073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:18.351270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:27:18.352299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:27:18.353708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:27:18.354234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:27:18.355584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:27:18.367913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.368416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:18.369347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.369924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:18.383223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:18.389781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:27:18.392398 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa70553b-a700-43ab-be17-2a179cea2f01 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1324 microversion: 2.1 time: 0.222352 Aug 04 04:27:18.393561 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 628/1241] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:18 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:18.398891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:18.399585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:18.404510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for user 53377b39d2804967aa0d5b71ee57e9a8 and project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:27:18.406015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.406724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:18.407763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.408196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:18.420225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:27:18.422944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:27:18.480703 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2de8af7-1871-420d-a41f-cbb155244b4f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.865785 Aug 04 04:27:18.481791 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 614/1242] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:27:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:27:18.495965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b41ec040-153c-43ab-a10d-a57edd9a6671 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:18.496754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b41ec040-153c-43ab-a10d-a57edd9a6671 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:18.577670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b41ec040-153c-43ab-a10d-a57edd9a6671 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:18.587145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b41ec040-153c-43ab-a10d-a57edd9a6671 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1233 microversion: 2.1 time: 0.097950 Aug 04 04:27:18.587702 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 615/1243] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:18 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:18.635177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:18.654290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:18.656611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:18.666888 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-86b08447-6f9c-4dfe-9cab-210dbe712d93 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.263684 Aug 04 04:27:18.671145 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 629/1244] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:18 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:18.931196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:18.932407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:18.938656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.940843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.941508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:18.943035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:18.943632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.087131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:19.096216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:19.097712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:19.099014 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-10ab9803-3ce7-436f-8b15-abf23a3f61dd tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.172370 Aug 04 04:27:19.099607 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 616/1245] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:18 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:19.189517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:19.190106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:19.198101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.198552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.199375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.199815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.344215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:19.352227 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-453d8e8e-6a85-41dc-bea1-67bb6ff64d70 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.166671 Aug 04 04:27:19.352809 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 630/1246] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:19 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:19.414776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:19.415530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:19.422909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.423457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.424489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.425007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.563605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:19.571674 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d30f66aa-f65c-4f86-8128-9941e922a126 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1520 microversion: 2.1 time: 0.161533 Aug 04 04:27:19.572352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 617/1247] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:19 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:19.595776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:19.596476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:19.603141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.603589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.604410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.605172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.610943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:19.611553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:19.618182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.618634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.619512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.619953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.635565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:19.757395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:19.765706 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4fb36b97-acdc-47c9-bb19-4f73b3af0526 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1293 microversion: 2.1 time: 0.158964 Aug 04 04:27:19.766643 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 618/1248] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:19 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:19.784816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:19.785433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:19.792167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.792614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.793392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.793829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.895579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:19.903084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-222cccca-a0a5-4825-8fa5-81c00d9a818d tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1520 microversion: 2.1 time: 0.311170 Aug 04 04:27:19.903662 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 631/1249] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:19 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:19.929702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a19425db-d0ec-45f2-9f91-e3392f1afa5b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1107169642"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:19.932253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a19425db-d0ec-45f2-9f91-e3392f1afa5b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:19.938130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a19425db-d0ec-45f2-9f91-e3392f1afa5b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.938587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a19425db-d0ec-45f2-9f91-e3392f1afa5b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:19.939397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a19425db-d0ec-45f2-9f91-e3392f1afa5b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:19.939839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a19425db-d0ec-45f2-9f91-e3392f1afa5b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.003210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.013112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.015234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.016585 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a0dc28d-3b6c-4dba-b8be-f8c8741df3ec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.237145 Aug 04 04:27:20.017358 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 619/1250] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:19 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:20.122858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:20.123603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:20.131128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.131860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.132649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.133088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.135108 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a19425db-d0ec-45f2-9f91-e3392f1afa5b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba/action" status: 202 len: 0 microversion: 2.1 time: 0.209494 Aug 04 04:27:20.136015 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 632/1251] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:27:19 2022] POST /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 04 04:27:20.147644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-db72c466-35df-4d40-964d-b9c56119d340 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '.version_select at 0x7f191a688f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:20.275688 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-db72c466-35df-4d40-964d-b9c56119d340 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9" status: 204 len: 0 microversion: 2.1 time: 0.132401 Aug 04 04:27:20.276257 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 633/1252] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:20 2022] DELETE /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:20.284555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-163f259e-e364-42da-8d5c-0e1b97a34aa5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '.version_select at 0x7f191a751a60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:20.306063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-163f259e-e364-42da-8d5c-0e1b97a34aa5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Image not found. Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-163f259e-e364-42da-8d5c-0e1b97a34aa5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9 HTTP/1.1 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '32acf52d-4401-458d-a3fa-389caa2042a9'} Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 32acf52d-4401-458d-a3fa-389caa2042a9 Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:27:20.308500 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 32acf52d-4401-458d-a3fa-389caa2042a9 could not be found. Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-163f259e-e364-42da-8d5c-0e1b97a34aa5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-163f259e-e364-42da-8d5c-0e1b97a34aa5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9" status: 404 len: 62 microversion: 2.1 time: 0.031453 Aug 04 04:27:20.314665 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 634/1253] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:27:20 2022] GET /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 04:27:20.324148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:20.325032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:20.331538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.332102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.333017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.333530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.362453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.399560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.401778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.403120 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6545843-954d-4ba4-af45-badf5d5c3160 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.285259 Aug 04 04:27:20.403690 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 620/1254] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:20 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:20.423876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:20.424755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:20.433072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.433637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.434494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.435032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.639656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.651782 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2c6f912-8110-45b7-8bcb-20cab9e3ff7a tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1532 microversion: 2.1 time: 0.332628 Aug 04 04:27:20.652363 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 635/1255] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:20 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1532 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:20.660468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-00b3c434-3d8f-4904-9fa2-a48512baf3b8 req-a074dac1-a0c0-4f18-9e34-68af64b8be15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f8a1a9-9689-4003-9e93-0a06f6bbf26a", "name": "network-vif-plugged", "status": "completed", "tag": "3e915957-7293-47b8-9c14-3ed5be444022"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:20.672086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-00b3c434-3d8f-4904-9fa2-a48512baf3b8 req-a074dac1-a0c0-4f18-9e34-68af64b8be15 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.672529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-00b3c434-3d8f-4904-9fa2-a48512baf3b8 req-a074dac1-a0c0-4f18-9e34-68af64b8be15 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.685138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:20.685975 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-00b3c434-3d8f-4904-9fa2-a48512baf3b8 req-a074dac1-a0c0-4f18-9e34-68af64b8be15 service nova] Creating event network-vif-plugged:3e915957-7293-47b8-9c14-3ed5be444022 for instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a on n-h2-851337-5 Aug 04 04:27:20.691526 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-00b3c434-3d8f-4904-9fa2-a48512baf3b8 req-a074dac1-a0c0-4f18-9e34-68af64b8be15 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037730 Aug 04 04:27:20.692716 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 636/1256] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:20.694612 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c01119f-fd67-45ac-8080-1bbcf971dab4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.278051 Aug 04 04:27:20.695336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 621/1257] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:20 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:20.792812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:20.793435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:20.800109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.800563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.801804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:20.802763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:20.807053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:21.040631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:21.041474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:21.051264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:21.054712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:21.055841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:21.056290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:21.120056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:21.127667 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e61bea89-75c0-451f-b285-276ce0349ad8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.339649 Aug 04 04:27:21.128246 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 637/1258] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:20 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:21.352117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:21.363163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:21.365908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:21.367336 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c93d66b7-e907-4d73-91b3-edb31f668910 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.330683 Aug 04 04:27:21.367903 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 622/1259] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:21 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:27:21.428769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:21.429397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:21.436771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:21.437213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:21.438004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:21.438452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:21.674319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:21.675607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:21.683189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:21.683653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:21.684446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:21.685067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.058853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.068222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.070014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.071245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad90d6d2-6f06-4011-8089-fc1cf893d765 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1359 microversion: 2.21 time: 0.646867 Aug 04 04:27:22.071811 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 638/1260] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:21 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1359 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:27:22.076404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:22.077021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:22.084248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:22.084631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.086053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:22.086671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.100157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.112843 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b73e02e-dfa4-41b5-afb2-a7702d763415 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1538 microversion: 2.1 time: 0.442791 Aug 04 04:27:22.114343 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 623/1261] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:21 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1538 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:22.150687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:22.151651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:22.158265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:22.158715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.159513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:22.160108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.366068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.376168 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b446920a-024c-41d9-a5c7-f1b8bfb4a664 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.303223 Aug 04 04:27:22.377480 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 639/1262] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:22 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:22.383124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-67e9ee48-b1eb-44b6-8313-5e139816bac4 req-d608a712-3c60-4c3f-8933-19aab6952199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3", "tag": "d71b6231-503c-4161-8202-4ace91baf877"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:22.394003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-67e9ee48-b1eb-44b6-8313-5e139816bac4 req-d608a712-3c60-4c3f-8933-19aab6952199 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:22.394574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-67e9ee48-b1eb-44b6-8313-5e139816bac4 req-d608a712-3c60-4c3f-8933-19aab6952199 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.407464 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-67e9ee48-b1eb-44b6-8313-5e139816bac4 req-d608a712-3c60-4c3f-8933-19aab6952199 service nova] Creating event network-changed:d71b6231-503c-4161-8202-4ace91baf877 for instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 on n-h1-851337-5 Aug 04 04:27:22.413710 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-67e9ee48-b1eb-44b6-8313-5e139816bac4 req-d608a712-3c60-4c3f-8933-19aab6952199 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034632 Aug 04 04:27:22.414360 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 640/1263] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:22.415973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.419971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:22.421038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:22.429146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:22.429828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.430817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:22.431449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:22.434637 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0d1d841-f3fb-4a53-8325-49472ee138fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.288527 Aug 04 04:27:22.439100 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 624/1264] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:22 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:22.581422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.591665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.593331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:22.594660 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d147a4f-64a7-4abf-8c04-4371759cccb2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.179159 Aug 04 04:27:22.595252 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 641/1265] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:22 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:23.099098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:23.099713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:23.107291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.107982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.108506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.108986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.136240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:23.136893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:23.143721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.144167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.145072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.146646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.418675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.427217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.428748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.429995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.430496 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ebfeed58-72f9-4121-bba2-3d1a88ab708c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1552 microversion: 2.21 time: 0.335992 Aug 04 04:27:23.430926 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 625/1266] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:23 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1552 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:23.435683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:23.436517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:23.439534 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57e4b8a5-d061-4205-bae1-d1d43460a82c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1533 microversion: 2.1 time: 0.307924 Aug 04 04:27:23.444528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.445187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.446134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.446722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.451289 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 642/1267] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:23 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1533 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:23.462463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:23.464121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:23.471355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.472245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.473779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.475424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.511344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:27:23.610777 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22f43e2c-84bc-4071-af3f-f875f2ba44e3 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 204 len: 0 microversion: 2.21 time: 0.157769 Aug 04 04:27:23.611615 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 643/1268] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:27:23 2022] DELETE /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:27:23.618614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:23.619656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:23.626718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.627198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.628084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.628605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.687354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.695570 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1228a3e7-1713-4c93-98cf-3d94cf1fb991 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.263419 Aug 04 04:27:23.696159 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 626/1269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:23 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:23.701168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:23.702649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:23.711274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.711734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.712522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.713028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.835119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.843794 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-863a9e5c-09ec-43b6-ab68-2f98e19bc802 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.230744 Aug 04 04:27:23.844346 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 644/1270] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:23 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:23.849981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:23.850184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:23.856917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.857380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.858208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:23.858618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:23.874242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.883506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.885025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:23.886247 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-425d3bff-13cc-447f-96cc-811845d71693 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.189169 Aug 04 04:27:23.886836 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 627/1271] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:23 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:24.070667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:24.078975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:24.080556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:24.081736 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e471bddc-3442-4aef-b4e3-09643ebe85f2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1558 microversion: 2.21 time: 0.236418 Aug 04 04:27:24.082512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 645/1272] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:23 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:24.269770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2a53898f-041a-4736-ae18-fdc25ca23663 req-04398c82-9b7b-4395-b41c-ba8b390f88a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1543d282-7d4f-4c87-b761-049a3c1ab46a", "name": "network-vif-unplugged", "status": "completed", "tag": "20d3f61f-c31d-4334-aab1-aebea15b1651"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:24.283810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2a53898f-041a-4736-ae18-fdc25ca23663 req-04398c82-9b7b-4395-b41c-ba8b390f88a9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.284628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2a53898f-041a-4736-ae18-fdc25ca23663 req-04398c82-9b7b-4395-b41c-ba8b390f88a9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.298415 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2a53898f-041a-4736-ae18-fdc25ca23663 req-04398c82-9b7b-4395-b41c-ba8b390f88a9 service nova] Creating event network-vif-unplugged:20d3f61f-c31d-4334-aab1-aebea15b1651 for instance 1543d282-7d4f-4c87-b761-049a3c1ab46a on n-h2-851337-5 Aug 04 04:27:24.303986 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2a53898f-041a-4736-ae18-fdc25ca23663 req-04398c82-9b7b-4395-b41c-ba8b390f88a9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038697 Aug 04 04:27:24.304601 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 628/1273] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:24.466770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:24.468144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:24.475045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.475925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.476790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.477282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.648697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:24.659806 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-381dd914-ddfa-4449-87ca-84a63dfe7407 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1520 microversion: 2.1 time: 0.196358 Aug 04 04:27:24.663468 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 646/1274] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:24 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:24.683631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:24.684468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:24.692777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.693235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.694083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.694525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.722816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:24.724341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:24.725865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:27:24.733259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.733988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.735031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.735617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.814827 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c3df03c9-ec81-44ae-8767-44535add7477 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 204 len: 0 microversion: 2.1 time: 0.135704 Aug 04 04:27:24.816273 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 629/1275] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:24 2022] DELETE /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:24.828283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:24.829272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:24.836571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.836929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.837723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.838167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.939274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:24.949572 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d012977-62f5-49f0-8ea0-8b6fdfdf6c59 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.235235 Aug 04 04:27:24.955447 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 647/1276] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:24 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:24.962553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:24.963994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:24.975253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.975807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:24.977469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:24.977469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:25.031172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.042352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55b59df6-2357-4e09-a799-2af09d9df0af tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1526 microversion: 2.1 time: 0.220762 Aug 04 04:27:25.043441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 630/1277] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:24 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:25.048575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:25.049475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:25.061867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:25.062328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:25.063172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:25.064101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:25.150553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.158048 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c50690a5-3711-4ecd-9ce0-d04c167418ab tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.201061 Aug 04 04:27:25.158635 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 648/1278] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:24 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:25.163936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:25.164562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:25.170790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:25.171346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:25.172143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:25.172585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:25.229303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.238977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.240991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.242059 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-903a5a81-3bda-4715-a9ef-c4bdbcb255ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.197291 Aug 04 04:27:25.242842 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 631/1279] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:25 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:25.319785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.327653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.329211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:25.330348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36ae8d98-8e8d-4655-98da-1ab868bc7820 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1558 microversion: 2.21 time: 0.170769 Aug 04 04:27:25.330899 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 649/1280] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:25 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:25.979010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:25.979580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:25.986752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:25.987303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:25.988060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:25.988488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.037731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:26.038453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:26.042072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=36 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:26.048967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.049416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.050309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.050812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.079633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:27:26.140876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:26.149639 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd5403c1-6d68-4a1f-8127-9778afd1ad0a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.174567 Aug 04 04:27:26.150229 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 632/1281] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:25 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:26.155173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:26.155742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:26.163044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.163516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.164289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.164726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.164871 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f2c6c80-3106-4295-93bc-a5dc42763aee tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 204 len: 0 microversion: 2.1 time: 0.131158 Aug 04 04:27:26.165456 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 650/1282] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:26 2022] DELETE /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:26.173876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:26.174660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:26.181406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.181849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.182639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.183086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.185817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:26.401425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:26.409034 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1bb3ad02-40bb-4a57-92f6-878341a05180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1526 microversion: 2.1 time: 0.257746 Aug 04 04:27:26.422875 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 633/1283] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:26 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1526 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:26.422875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:26.422875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:26.423312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.423809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.424927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.425589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.429708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:26.467572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:26.479284 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62021f50-4103-41d4-bc10-cfbe2bfc49cd tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1714 microversion: 2.1 time: 0.308614 Aug 04 04:27:26.483326 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 651/1284] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:26 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1714 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:26.492117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:26.493017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:26.500024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.500607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.501275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.502264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.809396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:26.817380 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-afe2692f-428f-4adc-b2c0-08f5bce02e61 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.406086 Aug 04 04:27:26.817960 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 634/1285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:26 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:26.823362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-7a453cde-7652-49cf-828d-6941ce160b82 req-9b1fa91c-a610-4304-8641-1bc45c8df9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1543d282-7d4f-4c87-b761-049a3c1ab46a", "tag": "20d3f61f-c31d-4334-aab1-aebea15b1651"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:26.833084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7a453cde-7652-49cf-828d-6941ce160b82 req-9b1fa91c-a610-4304-8641-1bc45c8df9cd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.833506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7a453cde-7652-49cf-828d-6941ce160b82 req-9b1fa91c-a610-4304-8641-1bc45c8df9cd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.844444 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-7a453cde-7652-49cf-828d-6941ce160b82 req-9b1fa91c-a610-4304-8641-1bc45c8df9cd service nova] Creating event network-changed:20d3f61f-c31d-4334-aab1-aebea15b1651 for instance 1543d282-7d4f-4c87-b761-049a3c1ab46a on n-h2-851337-5 Aug 04 04:27:26.849746 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-7a453cde-7652-49cf-828d-6941ce160b82 req-9b1fa91c-a610-4304-8641-1bc45c8df9cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030670 Aug 04 04:27:26.850336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 635/1286] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:26.855455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:26.856170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:26.863457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.864557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.865400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:26.865865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:26.908107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:26.918983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:26.920602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:26.922047 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61d2fcd0-81a9-4c64-bdb1-a3413c018b94 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.436938 Aug 04 04:27:26.938731 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 652/1287] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:26 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:27.174814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:27.175602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:27.183091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.183651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.184520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.185031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.229545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:27.240589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:27.242680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16ace659cbb84a0aa6541a7c4d805451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1296f1aab44166866e503dd79225c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:27.244727 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-61bdfce8-7c62-4eea-a9be-5546cf2bb44c tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 200 len: 1558 microversion: 2.21 time: 0.393140 Aug 04 04:27:27.245656 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 636/1288] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:26 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 1558 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:27.433478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:27.434420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:27.442348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.443372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.446718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.447712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.524833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:27.539842 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-238a870e-7769-415a-93bb-94092db57bec tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.369881 Aug 04 04:27:27.540577 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 653/1289] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:27 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:27.562500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9a1a2dcd-cdc9-46dc-bbb2-98bf376e19a1 req-130b0dc7-3417-4dda-a156-aa616d28bbbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f8a1a9-9689-4003-9e93-0a06f6bbf26a", "name": "network-vif-deleted", "tag": "3e915957-7293-47b8-9c14-3ed5be444022"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:27.577334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9a1a2dcd-cdc9-46dc-bbb2-98bf376e19a1 req-130b0dc7-3417-4dda-a156-aa616d28bbbf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.578319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9a1a2dcd-cdc9-46dc-bbb2-98bf376e19a1 req-130b0dc7-3417-4dda-a156-aa616d28bbbf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.601599 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9a1a2dcd-cdc9-46dc-bbb2-98bf376e19a1 req-130b0dc7-3417-4dda-a156-aa616d28bbbf service nova] Creating event network-vif-deleted:3e915957-7293-47b8-9c14-3ed5be444022 for instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a on n-h2-851337-5 Aug 04 04:27:27.607367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9a1a2dcd-cdc9-46dc-bbb2-98bf376e19a1 req-130b0dc7-3417-4dda-a156-aa616d28bbbf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063228 Aug 04 04:27:27.608370 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 654/1290] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:27.615131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:27.622079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:27.636296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.637183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.638911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.639466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.776121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:27.784846 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b63d3606-e5bd-476c-9015-3605f10d62c5 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 200 len: 1526 microversion: 2.1 time: 0.356305 Aug 04 04:27:27.786120 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 637/1291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:27 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 1526 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:27.837756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:27.838812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:27.845205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.845653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.846427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.847284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.864967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:27.882227 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5240463-b73c-486b-bffa-49edb255f4e2 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1714 microversion: 2.1 time: 0.272299 Aug 04 04:27:27.884587 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 655/1292] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:27 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1714 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:27.947211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:27.948014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:27.955259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.956148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:27.957214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:27.958492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.073387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:28.081712 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-18e37931-71da-4062-aadf-ec1146a93529 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.247801 Aug 04 04:27:28.083072 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 638/1293] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:27 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:28.142409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:28.154773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:28.157217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:28.159124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4cf4b70f-2f8f-4f95-bbec-fa315f851d2f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.217253 Aug 04 04:27:28.159915 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 656/1294] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:27 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:28.271262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:28.271881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:28.279034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.279602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.280269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.280913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.297023 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] HTTP exception thrown: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Request method failure captured: Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a HTTP/1.1 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qavGlTvU54xQMdbSYQoud_W1AMcH9rvpXNAMwdny8mW5HM774oeddaeOj6YK3as99HwUdqy0utslv7Ch4kGYUjbaKjrRuJHHRVkWHQmabgqMZ-Y21nhKNutdzMJhiL6MZL17hVLOqaqkf1l7vFwj9cHVG7ULxTc_70ExEEwCh7QMc Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fb1296f1aab44166866e503dd79225c5 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fb1296f1aab44166866e503dd79225c5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fb1296f1aab44166866e503dd79225c5 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-InstanceActionsV221TestJSON-278037744-project Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 16ace659cbb84a0aa6541a7c4d805451 Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-InstanceActionsV221TestJSON-278037744-project Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a5f8a1a9-9689-4003-9e93-0a06f6bbf26a'} Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.298680 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Returning 404 to user: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b9b5bd24-3796-4a1c-b9f9-ab126c605957 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 404 len: 111 microversion: 2.21 time: 0.035687 Aug 04 04:27:28.303149 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 639/1295] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:28 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:27:28.311823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a341e1f8-1c2c-475a-b470-aa85fe207830 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '.version_select at 0x7f191a751280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:28.312467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a341e1f8-1c2c-475a-b470-aa85fe207830 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:28.319267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a341e1f8-1c2c-475a-b470-aa85fe207830 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.319712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a341e1f8-1c2c-475a-b470-aa85fe207830 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.320487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a341e1f8-1c2c-475a-b470-aa85fe207830 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.320922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a341e1f8-1c2c-475a-b470-aa85fe207830 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.398409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a341e1f8-1c2c-475a-b470-aa85fe207830 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.090410 Aug 04 04:27:28.398890 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 657/1296] 10.222.0.69 () {60 vars in 1337 bytes} [Thu Aug 4 04:27:28 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a/os-instance-actions => generated 611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:28.411334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:28.411826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:28.413766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.419509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.419955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.420721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.421152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.434969 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] HTTP exception thrown: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Request method failure captured: Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a HTTP/1.1 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60qavGlTvU54xQMdbSYQoud_W1AMcH9rvpXNAMwdny8mW5HM774oeddaeOj6YK3as99HwUdqy0utslv7Ch4kGYUjbaKjrRuJHHRVkWHQmabgqMZ-Y21nhKNutdzMJhiL6MZL17hVLOqaqkf1l7vFwj9cHVG7ULxTc_70ExEEwCh7QMc Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fb1296f1aab44166866e503dd79225c5 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fb1296f1aab44166866e503dd79225c5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fb1296f1aab44166866e503dd79225c5 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-InstanceActionsV221TestJSON-278037744-project Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 16ace659cbb84a0aa6541a7c4d805451 Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-InstanceActionsV221TestJSON-278037744-project Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a5f8a1a9-9689-4003-9e93-0a06f6bbf26a'} Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:28.436512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Returning 404 to user: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24c2f2eb-6b1f-4e03-b5cb-ef2efaeef9c2 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 404 len: 111 microversion: 2.21 time: 0.030523 Aug 04 04:27:28.441120 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 640/1297] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:27:28 2022] DELETE /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:27:28.447178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:28.447817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] [instance: a5f8a1a9-9689-4003-9e93-0a06f6bbf26a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:28.453866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.454318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.455122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.455565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.469722 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] HTTP exception thrown: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Request method failure captured: Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a HTTP/1.1 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60qavGlTvU54xQMdbSYQoud_W1AMcH9rvpXNAMwdny8mW5HM774oeddaeOj6YK3as99HwUdqy0utslv7Ch4kGYUjbaKjrRuJHHRVkWHQmabgqMZ-Y21nhKNutdzMJhiL6MZL17hVLOqaqkf1l7vFwj9cHVG7ULxTc_70ExEEwCh7QMc Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fb1296f1aab44166866e503dd79225c5 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb1296f1aab44166866e503dd79225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fb1296f1aab44166866e503dd79225c5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fb1296f1aab44166866e503dd79225c5 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-278037744 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-InstanceActionsV221TestJSON-278037744-project Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 16ace659cbb84a0aa6541a7c4d805451 Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-InstanceActionsV221TestJSON-278037744-project Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'a5f8a1a9-9689-4003-9e93-0a06f6bbf26a'} Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.471405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] Returning 404 to user: Instance a5f8a1a9-9689-4003-9e93-0a06f6bbf26a could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ff0ecd2-2487-4bca-a751-396abff50919 tempest-InstanceActionsV221TestJSON-278037744 tempest-InstanceActionsV221TestJSON-278037744-project] 10.222.0.69 "GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a" status: 404 len: 111 microversion: 2.21 time: 0.029555 Aug 04 04:27:28.475960 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 658/1298] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:28 2022] GET /compute/v2.1/servers/a5f8a1a9-9689-4003-9e93-0a06f6bbf26a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:27:28.564064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:28.564685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:28.571517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.571965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.572742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.573180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.588898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.712778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:28.720918 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27202edf-966e-40a7-93e2-754154f1650a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.160672 Aug 04 04:27:28.721562 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 641/1299] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:28 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:28.807077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:28.807901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:28.813988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.814447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.815259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.815699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.830067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba HTTP/1.1 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '7f94cc3f-daa3-4561-9c16-1cfc491300ba'} Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.831608 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a67551bc-1b1b-4f6c-a72e-7b2353d64687 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 404 len: 111 microversion: 2.1 time: 0.029960 Aug 04 04:27:28.836052 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 659/1300] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:28 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:28.883429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-255631324", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:28.907551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:28.909117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:28.911073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.917088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.917530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.918585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:28.919077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:28.949984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] validate_networks() for [('1ce5a8a2-4eeb-4b49-9721-ea09562fbc92', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:27:29.467398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:29.478867 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7db0fd6-0333-479c-9180-a4e40bc1f1a7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1714 microversion: 2.1 time: 0.575827 Aug 04 04:27:29.480337 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 660/1301] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:28 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1714 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:29.487688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:29.488365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:29.497341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:29.500731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:29.503270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:29.503825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:29.783677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:29.793422 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bac6a123-976c-4e61-a22c-7029de463250 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.311658 Aug 04 04:27:29.794464 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 661/1302] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:29 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:29.800533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:29.801984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:29.809495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:29.810209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:29.811303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:29.811944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:29.848397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:27:29.848906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:27:29.849302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:27:29.849713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:27:29.850296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:27:29.870231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:29.870984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:29.871989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:29.872606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:29.900348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for project ff11bae71d3142f9aa402463be123222. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:27:29.905653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Getting quotas for user 0a2006e35cc04887b80733ca3c736b9c and project ff11bae71d3142f9aa402463be123222. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:27:29.920532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:27:29.924024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:27:29.986973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:29.988902 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ccc085e8-9742-4776-820f-53100b20e674 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.110350 Aug 04 04:27:29.991794 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 642/1303] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:27:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:27:29.997157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4a868d82-93b6-4cdf-a01f-2d7e040046c9 req-b754ea8e-3450-453f-8ff1-ca92f2fa704b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f94cc3f-daa3-4561-9c16-1cfc491300ba", "name": "network-vif-deleted", "tag": "f684c2e9-4be3-452c-911e-182187587f50"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:30.000614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:30.003393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:30.008583 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67b4f459-ce54-4624-a25c-f5a6deceaa5b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.212161 Aug 04 04:27:30.010709 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 662/1304] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:29 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:30.011257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4a868d82-93b6-4cdf-a01f-2d7e040046c9 req-b754ea8e-3450-453f-8ff1-ca92f2fa704b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.012843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4a868d82-93b6-4cdf-a01f-2d7e040046c9 req-b754ea8e-3450-453f-8ff1-ca92f2fa704b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:30.016557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:30.017526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:30.025504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.026192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:30.027257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.027945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:30.036192 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4a868d82-93b6-4cdf-a01f-2d7e040046c9 req-b754ea8e-3450-453f-8ff1-ca92f2fa704b service nova] Creating event network-vif-deleted:f684c2e9-4be3-452c-911e-182187587f50 for instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba on n-h2-851337-5 Aug 04 04:27:30.042231 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4a868d82-93b6-4cdf-a01f-2d7e040046c9 req-b754ea8e-3450-453f-8ff1-ca92f2fa704b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048954 Aug 04 04:27:30.043946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 643/1305] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:30.053855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b5b46f7-5054-495c-ab85-e669596bddaa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:30.055575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b5b46f7-5054-495c-ab85-e669596bddaa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:30.265346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b5b46f7-5054-495c-ab85-e669596bddaa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:30.280369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b5b46f7-5054-495c-ab85-e669596bddaa tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1224 microversion: 2.1 time: 0.234256 Aug 04 04:27:30.281188 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 644/1306] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:30 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1224 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:30.298248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d2502627-0393-4ab7-8e4f-d3305a7063c4 req-45443301-e103-4510-9b91-2e7ba87eb3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3", "name": "network-vif-plugged", "status": "completed", "tag": "d71b6231-503c-4161-8202-4ace91baf877"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:30.310419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d2502627-0393-4ab7-8e4f-d3305a7063c4 req-45443301-e103-4510-9b91-2e7ba87eb3b2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.310864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d2502627-0393-4ab7-8e4f-d3305a7063c4 req-45443301-e103-4510-9b91-2e7ba87eb3b2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:30.333005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d2502627-0393-4ab7-8e4f-d3305a7063c4 req-45443301-e103-4510-9b91-2e7ba87eb3b2 service nova] Creating event network-vif-plugged:d71b6231-503c-4161-8202-4ace91baf877 for instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 on n-h1-851337-5 Aug 04 04:27:30.339869 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d2502627-0393-4ab7-8e4f-d3305a7063c4 req-45443301-e103-4510-9b91-2e7ba87eb3b2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046326 Aug 04 04:27:30.340683 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 645/1307] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:30.439408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:30.450813 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-45f35d75-fb6e-44f5-9ccf-e31f285defa4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1476 microversion: 2.1 time: 0.438609 Aug 04 04:27:30.451945 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 663/1308] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:30 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1476 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:30.510885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:30.512184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:30.521904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.522520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:30.523520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.524189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:30.789600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:30.802030 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dcaa8b1d-f9c2-40ad-ac54-f2131fdca704 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1714 microversion: 2.1 time: 0.298234 Aug 04 04:27:30.803347 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 646/1309] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:30 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1714 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:30.818915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:30.820409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:30.827947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.828675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:30.829496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:30.829930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.037464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:31.038808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:31.047100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.047942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.049106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.049693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.092823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:31.109351 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57bebbc5-6fe9-4c00-8856-8777fc0941f6 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.295497 Aug 04 04:27:31.110687 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 664/1310] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:30 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:31.311326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:31.312707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:31.339388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.340968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.342105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.343555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.526171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:31.536177 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c7520ef3-0099-4181-a86f-7cef5a98faac tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1294 microversion: 2.1 time: 0.237472 Aug 04 04:27:31.537665 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 665/1311] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:31 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1294 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:31.544591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:31.544982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:31.552077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.552653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.553515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.554046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.558135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:31.572749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:31.574291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:31.579276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-74eb9656-037e-4c98-bdb0-f5becbba674a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.549220 Aug 04 04:27:31.580439 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 647/1312] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:31 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:31.825547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:31.826688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:31.833479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.833926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.834909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:31.835377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:31.952639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:31.963691 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5b6c802-5fbc-4c6a-84f8-377b179b320c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1475 microversion: 2.1 time: 0.424515 Aug 04 04:27:31.964299 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 666/1313] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:31 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:32.003396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:32.012816 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a45ce214-2afe-4113-9613-7158ddc99fde tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1646 microversion: 2.1 time: 0.191034 Aug 04 04:27:32.013473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 648/1314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:31 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1646 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:32.131124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:32.131844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:32.140688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.141500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.142592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.143210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.311395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0ae6db34-5d42-4579-8aa4-774f7351ec69 req-593aa7e6-4ac4-49dd-bf4b-659d18166615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0587a068-9eec-4e45-92a0-de71118a73d4", "name": "network-vif-deleted", "tag": "dfddfe54-bf50-4e0f-a767-4eef195fa27b"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:32.326846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0ae6db34-5d42-4579-8aa4-774f7351ec69 req-593aa7e6-4ac4-49dd-bf4b-659d18166615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.326846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0ae6db34-5d42-4579-8aa4-774f7351ec69 req-593aa7e6-4ac4-49dd-bf4b-659d18166615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.348298 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0ae6db34-5d42-4579-8aa4-774f7351ec69 req-593aa7e6-4ac4-49dd-bf4b-659d18166615 service nova] Creating event network-vif-deleted:dfddfe54-bf50-4e0f-a767-4eef195fa27b for instance 0587a068-9eec-4e45-92a0-de71118a73d4 on n-h1-851337-5 Aug 04 04:27:32.354051 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0ae6db34-5d42-4579-8aa4-774f7351ec69 req-593aa7e6-4ac4-49dd-bf4b-659d18166615 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049989 Aug 04 04:27:32.355520 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 649/1315] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:32.564615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:32.565426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:32.572225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.572988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.575083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.575699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.753343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:32.762623 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b7d2be50-18f7-464a-8f73-17c3cc79ed71 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1359 microversion: 2.1 time: 0.636345 Aug 04 04:27:32.769070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:32.769575 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 667/1316] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:32 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1359 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:32.774464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:32.780483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:32.780982 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35e49605-d264-4a48-8ea0-819a8296910b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1282 microversion: 2.1 time: 0.222369 Aug 04 04:27:32.788952 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 650/1317] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:32 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:32.792810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.803814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.804665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.805108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.985695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:32.986310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:32.993198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.994004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:32.995223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:32.995976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.235645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:33.284205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:33.298925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:33.300710 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9da86979-efe9-4ac3-b51e-20e35cb872a2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.529934 Aug 04 04:27:33.333675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 668/1318] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:32 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:33.348612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:33.349444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:33.357111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.357566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.358362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.358807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.400857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.401317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.401839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lazy-loading 'fault' on Instance uuid 0587a068-9eec-4e45-92a0-de71118a73d4 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:27:33.403845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.489719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:33.501025 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-649783a4-efe3-465f-8379-abbe54b4dc45 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1475 microversion: 2.1 time: 0.519548 Aug 04 04:27:33.505739 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 651/1319] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:32 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1475 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:33.511371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-defdfaf4-8da6-475d-bfc5-551187013686 req-9788a531-8be0-487b-8a04-1a6fd1cc830e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "name": "network-vif-unplugged", "status": "completed", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:33.521970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb9b7217fa945ad8778fc4c29f80fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb654e083014c3a9accbed2d9717a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:33.540012 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b0bd7c7-22c3-4509-a419-65339f158063 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 200 len: 1354 microversion: 2.1 time: 0.204073 Aug 04 04:27:33.541456 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 669/1320] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:33 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 1354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:33.557739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-defdfaf4-8da6-475d-bfc5-551187013686 req-9788a531-8be0-487b-8a04-1a6fd1cc830e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.558196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-defdfaf4-8da6-475d-bfc5-551187013686 req-9788a531-8be0-487b-8a04-1a6fd1cc830e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.581839 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-defdfaf4-8da6-475d-bfc5-551187013686 req-9788a531-8be0-487b-8a04-1a6fd1cc830e service nova] Creating event network-vif-unplugged:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h2-851337-5 Aug 04 04:27:33.596074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-defdfaf4-8da6-475d-bfc5-551187013686 req-9788a531-8be0-487b-8a04-1a6fd1cc830e service nova] Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:27:33.613232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-defdfaf4-8da6-475d-bfc5-551187013686 req-9788a531-8be0-487b-8a04-1a6fd1cc830e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105816 Aug 04 04:27:33.613846 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 652/1321] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:33.793181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:33.794661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:33.803181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.804548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.807308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.810338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.815131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:33.818360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:33.831562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.832870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:33.833857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:33.834451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:34.628349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:34.635887 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-538e6398-95f9-4edf-82c9-d28019bf00ab tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.828329 Aug 04 04:27:34.649093 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 653/1322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:33 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:34.651549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:34.654816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:34.655448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:34.662300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:34.663076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:34.663820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:34.664412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:34.671739 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8dd78aae-195b-4a18-b1d0-abde7ec893bb tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1542 microversion: 2.1 time: 0.888057 Aug 04 04:27:34.672761 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 670/1323] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:33 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1542 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:34.679894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:34.680680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:34.687319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:34.688214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:34.689701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:34.690387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.103698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:35.118212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:35.119145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:35.125056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:35.128027 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ff91bc3-b462-48e0-b786-82e163267d61 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.476793 Aug 04 04:27:35.129657 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 654/1324] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:34 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:35.133119 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8bb423a9-9d27-442a-8bfa-4a68a5e621de tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1475 microversion: 2.1 time: 0.458416 Aug 04 04:27:35.137612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:35.138774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:35.147783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.148712 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 671/1325] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:34 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1475 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:35.151285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.152076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.153462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.154132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.155711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f66d277-c52b-487a-b4ac-cf1cd3410a22 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:35.156219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0f66d277-c52b-487a-b4ac-cf1cd3410a22 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:35.165491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f66d277-c52b-487a-b4ac-cf1cd3410a22 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.166037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f66d277-c52b-487a-b4ac-cf1cd3410a22 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.166900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f66d277-c52b-487a-b4ac-cf1cd3410a22 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.167386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f66d277-c52b-487a-b4ac-cf1cd3410a22 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.179886 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] HTTP exception thrown: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Request method failure captured: Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 HTTP/1.1 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60muwKtXHoDnnM1-FPTVEfE-gB8UBDrl44bVPMgTOTGLwV8SRJtgovSCcM22SA5GUwQNKq2GdWfpqkggR_MDJay6Z2_MAj0N5n4_hv3PeAMIb1xwRZcnXbfi_36flVk59J7ly5KxZ4ah99Ff7oueItPYGjmIXULc0-8PmylKiibFFtQ Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb654e083014c3a9accbed2d9717a62", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 3cb9b7217fa945ad8778fc4c29f80fb3 Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0587a068-9eec-4e45-92a0-de71118a73d4'} Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.182330 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:35.188739 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.189916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Returning 404 to user: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:35.192006 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-822f60a7-03aa-4bb8-a663-f2f3610f8b2e tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 404 len: 111 microversion: 2.1 time: 0.059899 Aug 04 04:27:35.192682 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 655/1326] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:35 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:35.201810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:35.202731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:35.209715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.210167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.211056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.211489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.227818 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] HTTP exception thrown: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Request method failure captured: Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d HTTP/1.1 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60muwKtXHoDnnM1-FPTVEfE-gB8UBDrl44bVPMgTOTGLwV8SRJtgovSCcM22SA5GUwQNKq2GdWfpqkggR_MDJay6Z2_MAj0N5n4_hv3PeAMIb1xwRZcnXbfi_36flVk59J7ly5KxZ4ah99Ff7oueItPYGjmIXULc0-8PmylKiibFFtQ Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb654e083014c3a9accbed2d9717a62", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 3cb9b7217fa945ad8778fc4c29f80fb3 Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '9a408a4e-9b6f-468f-9db8-155a85a0f96d'} Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:35.229602 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Returning 404 to user: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:35.234599 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07159d74-1344-4e6b-a15d-7a9598a080f9 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 404 len: 111 microversion: 2.1 time: 0.034061 Aug 04 04:27:35.236727 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 656/1327] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:35 2022] DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:27:35.246924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:35.247805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:35.254547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.255022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.255793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.256224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.271091 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] HTTP exception thrown: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Request method failure captured: Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d HTTP/1.1 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60muwKtXHoDnnM1-FPTVEfE-gB8UBDrl44bVPMgTOTGLwV8SRJtgovSCcM22SA5GUwQNKq2GdWfpqkggR_MDJay6Z2_MAj0N5n4_hv3PeAMIb1xwRZcnXbfi_36flVk59J7ly5KxZ4ah99Ff7oueItPYGjmIXULc0-8PmylKiibFFtQ Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb654e083014c3a9accbed2d9717a62", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 3cb9b7217fa945ad8778fc4c29f80fb3 Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '9a408a4e-9b6f-468f-9db8-155a85a0f96d'} Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.272621 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Returning 404 to user: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-28c80b02-20c0-44d7-945c-2e11f3a4be34 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 404 len: 111 microversion: 2.1 time: 0.037331 Aug 04 04:27:35.276526 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 657/1328] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:35 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:35.282661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d69d28ef-b7ca-4eae-bdd8-6d52d7b716b1 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '.version_select at 0x7f191a6109d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:35.305433 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d69d28ef-b7ca-4eae-bdd8-6d52d7b716b1 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257548634" status: 202 len: 0 microversion: 2.1 time: 0.025650 Aug 04 04:27:35.306021 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 658/1329] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:27:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257548634 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:27:35.343871 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0f66d277-c52b-487a-b4ac-cf1cd3410a22 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193889 Aug 04 04:27:35.344680 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 672/1330] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:27:35 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:35.644090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0001e5ea-5694-4e9d-957b-a4571bb4bafe req-7196e8d6-6bc5-41a5-b263-e831c7455e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:35.659663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:35.666057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0001e5ea-5694-4e9d-957b-a4571bb4bafe req-7196e8d6-6bc5-41a5-b263-e831c7455e23 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.667107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0001e5ea-5694-4e9d-957b-a4571bb4bafe req-7196e8d6-6bc5-41a5-b263-e831c7455e23 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.675819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:35.690184 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0001e5ea-5694-4e9d-957b-a4571bb4bafe req-7196e8d6-6bc5-41a5-b263-e831c7455e23 service nova] Creating event network-changed:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h2-851337-5 Aug 04 04:27:35.697059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-0001e5ea-5694-4e9d-957b-a4571bb4bafe req-7196e8d6-6bc5-41a5-b263-e831c7455e23 service nova] Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:27:35.708064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.709021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.709965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:35.710618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:35.711017 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0001e5ea-5694-4e9d-957b-a4571bb4bafe req-7196e8d6-6bc5-41a5-b263-e831c7455e23 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071253 Aug 04 04:27:35.712353 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 659/1331] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:36.096902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:36.108932 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-15182540-57b8-4696-b424-6ffec73498f1 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.453483 Aug 04 04:27:36.123958 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 673/1332] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:35 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:36.156863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:36.157601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:36.178934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:36.185062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:36.187731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:36.188360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:36.189209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:36.189722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:36.200972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:36.201960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:36.202900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:36.205872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:36.206611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:36.634140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:36.651037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:36.653738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:36.655265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39f1db1e-888a-4a6b-88e2-2c2f98f7ea86 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.504837 Aug 04 04:27:36.655665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:36.656293 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 660/1333] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:36 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:36.686380 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc3ecc82-a107-47eb-a4ba-3c68bbfab13c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1473 microversion: 2.1 time: 0.513903 Aug 04 04:27:36.688086 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 674/1334] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:36 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1473 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:37.132338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.132952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:37.143606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.156368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.157369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.157992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.278637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ee38279-9602-44d2-a79b-5be107edf20c tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.279829 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:27:37.279829 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:27:37.308150 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ee38279-9602-44d2-a79b-5be107edf20c tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/321708186" status: 202 len: 0 microversion: 2.1 time: 0.033737 Aug 04 04:27:37.309987 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 675/1335] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:27:37 2022] DELETE /compute/v2.1/flavors/321708186 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:27:37.319578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e03c4a8b-91a1-491e-aec8-5e2cc69f4966 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.364257 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e03c4a8b-91a1-491e-aec8-5e2cc69f4966 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.049156 Aug 04 04:27:37.367538 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 676/1336] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:27:37 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:37.392692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b085bd9-ba24-4bc2-a2e5-457108f11ab4 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.439517 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b085bd9-ba24-4bc2-a2e5-457108f11ab4 tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/2119286000" status: 202 len: 0 microversion: 2.1 time: 0.054935 Aug 04 04:27:37.440802 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 677/1337] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:27:37 2022] DELETE /compute/v2.1/flavors/2119286000 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:27:37.454803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1c0ae45-380c-41c2-ab4b-86e5a6f03a0b tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.490055 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1c0ae45-380c-41c2-ab4b-86e5a6f03a0b tempest-ServersWithSpecificFlavorTestJSON-1812470408 tempest-ServersWithSpecificFlavorTestJSON-1812470408-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044109 Aug 04 04:27:37.491375 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 678/1338] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:27:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:37.537118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.538271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:37.548846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.550096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.551920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.552874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.579104 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] HTTP exception thrown: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Request method failure captured: Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 HTTP/1.1 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60muwKtXHoDnnM1-FPTVEfE-gB8UBDrl44bVPMgTOTGLwV8SRJtgovSCcM22SA5GUwQNKq2GdWfpqkggR_MDJay6Z2_MAj0N5n4_hv3PeAMIb1xwRZcnXbfi_36flVk59J7ly5KxZ4ah99Ff7oueItPYGjmIXULc0-8PmylKiibFFtQ Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb654e083014c3a9accbed2d9717a62", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 3cb9b7217fa945ad8778fc4c29f80fb3 Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0587a068-9eec-4e45-92a0-de71118a73d4'} Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:37.581263 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.587729 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.589643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Returning 404 to user: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:37.590946 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7453f96b-a40f-4a3d-a6f3-5ab0fe9936cf tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 404 len: 111 microversion: 2.1 time: 0.062209 Aug 04 04:27:37.595149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:37.595297 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 679/1339] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:37 2022] DELETE /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:37.601098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.601701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 0587a068-9eec-4e45-92a0-de71118a73d4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:37.604465 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c2c65ab-34ff-4155-838e-faa03b69e949 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.476617 Aug 04 04:27:37.609853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.610645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.611953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.612460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.622267 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 661/1340] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:37 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:37.639831 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] HTTP exception thrown: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Request method failure captured: Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 HTTP/1.1 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60muwKtXHoDnnM1-FPTVEfE-gB8UBDrl44bVPMgTOTGLwV8SRJtgovSCcM22SA5GUwQNKq2GdWfpqkggR_MDJay6Z2_MAj0N5n4_hv3PeAMIb1xwRZcnXbfi_36flVk59J7ly5KxZ4ah99Ff7oueItPYGjmIXULc0-8PmylKiibFFtQ Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb654e083014c3a9accbed2d9717a62", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 3cb9b7217fa945ad8778fc4c29f80fb3 Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0587a068-9eec-4e45-92a0-de71118a73d4'} Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.654899 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.666491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Returning 404 to user: Instance 0587a068-9eec-4e45-92a0-de71118a73d4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:37.669995 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f1717dc7-8ffe-47e9-990a-afa53359cc95 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4" status: 404 len: 111 microversion: 2.1 time: 0.073160 Aug 04 04:27:37.672335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.672903 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 680/1341] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:37 2022] GET /compute/v2.1/servers/0587a068-9eec-4e45-92a0-de71118a73d4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:37.683022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:37.688199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Searching by: {'deleted': False, 'project_id': '828bda82de6f41c3959d1b81a24453a1'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:27:37.697480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.698265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:37.711251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.711742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.712655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.713455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.723387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.723864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.730250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.733050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.740230 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] HTTP exception thrown: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Request method failure captured: Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d HTTP/1.1 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60muwKtXHoDnnM1-FPTVEfE-gB8UBDrl44bVPMgTOTGLwV8SRJtgovSCcM22SA5GUwQNKq2GdWfpqkggR_MDJay6Z2_MAj0N5n4_hv3PeAMIb1xwRZcnXbfi_36flVk59J7ly5KxZ4ah99Ff7oueItPYGjmIXULc0-8PmylKiibFFtQ Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb654e083014c3a9accbed2d9717a62", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 3cb9b7217fa945ad8778fc4c29f80fb3 Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '9a408a4e-9b6f-468f-9db8-155a85a0f96d'} Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:37.745153 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Returning 404 to user: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc00669e-9cc5-4b4c-87e2-33b234a03cd7 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 404 len: 111 microversion: 2.1 time: 0.064920 Aug 04 04:27:37.751592 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 681/1342] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:37 2022] DELETE /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:37.758197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:37.758967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:37.768855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.769616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.770542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:37.771083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:37.953075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:27:38.130102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7f17bab-bc25-41f3-a38c-1b8467aedbb9 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.461812 Aug 04 04:27:38.131106 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 662/1343] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:27:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:38.148691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:38.149512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:38.156203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.156929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:38.157867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.158461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:38.684419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:38.696574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:38.701450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:38.703312 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1fc06060-17c5-445c-92c0-2f9539aae942 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.950606 Aug 04 04:27:38.727457 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 682/1344] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:37 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:38.732835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:38.734863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] [instance: 9a408a4e-9b6f-468f-9db8-155a85a0f96d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:38.745534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.747815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:38.748876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.749482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:38.766840 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] HTTP exception thrown: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Request method failure captured: Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d HTTP/1.1 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60muwKtXHoDnnM1-FPTVEfE-gB8UBDrl44bVPMgTOTGLwV8SRJtgovSCcM22SA5GUwQNKq2GdWfpqkggR_MDJay6Z2_MAj0N5n4_hv3PeAMIb1xwRZcnXbfi_36flVk59J7ly5KxZ4ah99Ff7oueItPYGjmIXULc0-8PmylKiibFFtQ Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb654e083014c3a9accbed2d9717a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb654e083014c3a9accbed2d9717a62", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5eb654e083014c3a9accbed2d9717a62 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 3cb9b7217fa945ad8778fc4c29f80fb3 Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-742909765-project Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '9a408a4e-9b6f-468f-9db8-155a85a0f96d'} Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:38.768791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. Aug 04 04:27:38.773675 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:38.775174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] Returning 404 to user: Instance 9a408a4e-9b6f-468f-9db8-155a85a0f96d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:38.776408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56424077-dafc-4323-9603-b5dcc4134e12 tempest-ServersWithSpecificFlavorTestJSON-742909765 tempest-ServersWithSpecificFlavorTestJSON-742909765-project] 10.222.0.69 "GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d" status: 404 len: 111 microversion: 2.1 time: 0.047454 Aug 04 04:27:38.779851 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 683/1345] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:38 2022] GET /compute/v2.1/servers/9a408a4e-9b6f-468f-9db8-155a85a0f96d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:38.793979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-066b47af-317e-44ce-9104-cabe9f0df51f req-fdc3cd60-ccf7-4f56-bee8-929bc72e380c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "364b9ebf-7671-455e-a44e-a974f95c9b52", "tag": "826f144f-9337-47ea-a43c-baf6f934e072"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:38.823791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-066b47af-317e-44ce-9104-cabe9f0df51f req-fdc3cd60-ccf7-4f56-bee8-929bc72e380c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.824613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-066b47af-317e-44ce-9104-cabe9f0df51f req-fdc3cd60-ccf7-4f56-bee8-929bc72e380c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:38.850762 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-066b47af-317e-44ce-9104-cabe9f0df51f req-fdc3cd60-ccf7-4f56-bee8-929bc72e380c service nova] Creating event network-changed:826f144f-9337-47ea-a43c-baf6f934e072 for instance 364b9ebf-7671-455e-a44e-a974f95c9b52 on n-h2-851337-5 Aug 04 04:27:38.866048 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-066b47af-317e-44ce-9104-cabe9f0df51f req-fdc3cd60-ccf7-4f56-bee8-929bc72e380c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084153 Aug 04 04:27:38.866700 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 684/1346] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:38.873622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4be56754-0a0d-458f-833e-d8cf577c0650 req-a44797e3-54ed-4523-adbf-0152af6ca9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3", "tag": "d71b6231-503c-4161-8202-4ace91baf877"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:38.886620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4be56754-0a0d-458f-833e-d8cf577c0650 req-a44797e3-54ed-4523-adbf-0152af6ca9f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.887603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4be56754-0a0d-458f-833e-d8cf577c0650 req-a44797e3-54ed-4523-adbf-0152af6ca9f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:38.907899 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4be56754-0a0d-458f-833e-d8cf577c0650 req-a44797e3-54ed-4523-adbf-0152af6ca9f0 service nova] Creating event network-changed:d71b6231-503c-4161-8202-4ace91baf877 for instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 on n-h1-851337-5 Aug 04 04:27:38.916235 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4be56754-0a0d-458f-833e-d8cf577c0650 req-a44797e3-54ed-4523-adbf-0152af6ca9f0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047223 Aug 04 04:27:38.917658 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 685/1347] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:38.925051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:38.932274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:38.933783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Searching by: {'deleted': False, 'project_id': '828bda82de6f41c3959d1b81a24453a1'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:27:38.945580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.946860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:38.948281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:38.948939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:39.185541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:27:39.205855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:39.221059 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd924c12-59cd-4c02-88cd-0ecd4e61da7c tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1470 microversion: 2.1 time: 1.084470 Aug 04 04:27:39.224991 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 663/1348] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:38 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1470 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:39.246134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:39.246805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:39.270791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:39.271561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:39.275281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:39.275906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:39.385317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:39.400279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:39.400734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:39.906420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:39.914084 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b5b56949-c289-49e3-ba3d-739931ccd6b3 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.683767 Aug 04 04:27:39.916926 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 664/1349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:39 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:39.931403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-223d7f0c-cbbe-4526-a32a-a60b9dc84940 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:39.932106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-223d7f0c-cbbe-4526-a32a-a60b9dc84940 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:39.939981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-223d7f0c-cbbe-4526-a32a-a60b9dc84940 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:39.940782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-223d7f0c-cbbe-4526-a32a-a60b9dc84940 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:39.942401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-223d7f0c-cbbe-4526-a32a-a60b9dc84940 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:39.943018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-223d7f0c-cbbe-4526-a32a-a60b9dc84940 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.013304 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-954a9dfa-fa4a-4e36-9cdb-8ad8816f8021 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 1599 microversion: 2.1 time: 1.093523 Aug 04 04:27:40.027021 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 686/1350] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:27:38 2022] GET /compute/v2.1/servers/detail => generated 1599 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:40.039134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:40.040154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:40.057296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.058212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.060208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.067234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.150541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-223d7f0c-cbbe-4526-a32a-a60b9dc84940 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "POST /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178/action" status: 202 len: 0 microversion: 2.1 time: 0.232170 Aug 04 04:27:40.151493 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 665/1351] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:27:39 2022] POST /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:27:40.165213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35bd3d6a-91f7-41b3-960d-ac1a83aada3e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:40.180326 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35bd3d6a-91f7-41b3-960d-ac1a83aada3e tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026499 Aug 04 04:27:40.186702 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 666/1352] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:27:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:40.205008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:40.205963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:40.217672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.218119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.218907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.219366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.293995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:40.370471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:40.380649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:40.382172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:40.383392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40eba01f-5959-4a71-9c33-f2e22d25e4b1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.355018 Aug 04 04:27:40.383962 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 687/1353] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:40 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:40.500433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:40.500941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:40.512270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.512617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.513413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.513856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.564355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:27:40.575718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:40.586238 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d64e756-3759-48ed-8452-471933ad26b4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.390647 Aug 04 04:27:40.586828 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 667/1354] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:40 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:40.700030 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-593fc54e-a775-4f62-9742-80f1ca2711bc tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 204 len: 0 microversion: 2.1 time: 0.203123 Aug 04 04:27:40.701183 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 688/1355] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:40 2022] DELETE /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:40.711690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:40.712586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:40.719709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.720511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.721542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.722374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.941567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:40.942292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:40.955119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.958058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.959133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:40.960076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:40.994888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:41.004832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dfa947ba-c847-4082-bfcb-2a79f65d8f04 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1602 microversion: 2.1 time: 0.298213 Aug 04 04:27:41.007128 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 668/1356] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:40 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1602 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:41.403938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:41.410034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:41.410656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:41.413343 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f394d955-204f-4fac-a460-fddf8b20d180 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.476825 Aug 04 04:27:41.414138 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 689/1357] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:40 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:41.428916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:41.429810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:41.431001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:41.431597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:41.613814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:41.614629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:41.626605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:41.627393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:41.628337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:41.629207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:41.780321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:41.797668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:41.799585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:41.800948 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff18080a-adad-4e87-a2b4-329e8b577cff tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.394816 Aug 04 04:27:41.816708 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 669/1358] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:41 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:42.030918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:42.031647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:42.040532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:42.044381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:42.045172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:42.046188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:42.047699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:42.089954 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9f08252-e2e9-49e0-b191-44b6ea60b61d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.483320 Aug 04 04:27:42.092748 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 690/1359] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:41 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:42.420775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:42.430928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a2bc577b-a8cf-45a1-886f-6fdcc09a17cb tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1602 microversion: 2.1 time: 0.403741 Aug 04 04:27:42.431621 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 670/1360] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:42 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1602 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:42.435381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:42.436509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:42.449688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:42.450138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:42.450932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:42.451399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:42.829589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:42.830489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:42.849443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:42.849902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:42.850698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:42.851209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:42.917370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:42.929538 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48a6ddc7-b6ec-432d-a567-b56fba882786 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.495389 Aug 04 04:27:42.931506 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 691/1361] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:42 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:43.113054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:43.113789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:43.126863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:43.134914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:43.136123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:43.136800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:43.151505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.353039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:43.364815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:43.380580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:43.382194 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f2361766-ee66-43ff-971f-d3b00a00c8e3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.558889 Aug 04 04:27:43.383049 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 671/1362] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:42 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:43.452725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:43.453549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:43.474755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:43.475391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:43.476374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:43.476921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:44.027026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:44.036077 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8738904a-67cf-49cf-8283-c543a7e5d344 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.927099 Aug 04 04:27:44.050442 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 692/1363] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:43 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:44.055515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9b9b63cd-d3d9-4d26-83ad-772af201edc4 req-ddbc3ca6-0bfb-4537-9ae9-8ed1bd96ff8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "name": "network-vif-plugged", "status": "completed", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:44.066912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b9b63cd-d3d9-4d26-83ad-772af201edc4 req-ddbc3ca6-0bfb-4537-9ae9-8ed1bd96ff8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:44.067873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b9b63cd-d3d9-4d26-83ad-772af201edc4 req-ddbc3ca6-0bfb-4537-9ae9-8ed1bd96ff8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:44.097914 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9b9b63cd-d3d9-4d26-83ad-772af201edc4 req-ddbc3ca6-0bfb-4537-9ae9-8ed1bd96ff8a service nova] Creating event network-vif-plugged:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h2-851337-5 Aug 04 04:27:44.113151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-9b9b63cd-d3d9-4d26-83ad-772af201edc4 req-ddbc3ca6-0bfb-4537-9ae9-8ed1bd96ff8a service nova] Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:27:44.135878 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9b9b63cd-d3d9-4d26-83ad-772af201edc4 req-ddbc3ca6-0bfb-4537-9ae9-8ed1bd96ff8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083801 Aug 04 04:27:44.136850 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 693/1364] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:44.148968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:44.149954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:44.170429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:44.171158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:44.172197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:44.172799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:44.293469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:44.310755 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e2844f4-a914-4423-aeee-a4985933f750 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1602 microversion: 2.1 time: 0.862003 Aug 04 04:27:44.311384 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 672/1365] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:43 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1602 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:44.425848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:44.427581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:44.441855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:44.442498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:44.443577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:44.444251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:44.620406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:44.636090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fed0b024-e618-4f9f-9e51-0c52e987c231 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.497831 Aug 04 04:27:44.638930 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 694/1366] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:44 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:44.740233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:44.749670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:44.759955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:44.762619 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3196dc9c-e2b7-4a4b-9f48-2704e366be9e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1813 microversion: 2.25 time: 0.354590 Aug 04 04:27:44.786095 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 673/1367] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:44 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1813 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:45.067703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:45.070334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:45.093285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.094462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.095423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.098633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.260665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:45.275621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6fa63093-9330-406c-a3c5-253bed2f4dd9 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.222363 Aug 04 04:27:45.276603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 695/1368] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:45 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:45.333000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:45.333539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:45.340457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.340913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.341739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.342179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.430764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:45.439285 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f792217-e32d-4192-8964-ddd5be4a2701 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1538 microversion: 2.1 time: 0.110854 Aug 04 04:27:45.440097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 674/1369] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:45 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1538 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:45.667681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:45.669174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:45.684760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.686418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.688390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.688970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.772902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3d4d9c45-a933-42f9-84c2-7c839adfb9c7 req-4cd90ae9-49e8-4517-9b34-d189a88230a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3dd801-1ae9-4f2f-8a2a-752aac37784b", "name": "network-vif-deleted", "tag": "06710828-acf1-4b9f-9661-cb72538bbc4e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:45.804772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3d4d9c45-a933-42f9-84c2-7c839adfb9c7 req-4cd90ae9-49e8-4517-9b34-d189a88230a5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.805584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3d4d9c45-a933-42f9-84c2-7c839adfb9c7 req-4cd90ae9-49e8-4517-9b34-d189a88230a5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.831893 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3d4d9c45-a933-42f9-84c2-7c839adfb9c7 req-4cd90ae9-49e8-4517-9b34-d189a88230a5 service nova] Creating event network-vif-deleted:06710828-acf1-4b9f-9661-cb72538bbc4e for instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b on n-h1-851337-5 Aug 04 04:27:45.841178 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3d4d9c45-a933-42f9-84c2-7c839adfb9c7 req-4cd90ae9-49e8-4517-9b34-d189a88230a5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077120 Aug 04 04:27:45.868321 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 675/1370] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:45.886838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:45.888410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:45.903545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.905764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.906804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:45.907560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:45.913980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:46.058507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:46.079853 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ef09e647-d762-4c6e-8cb3-326c418610f2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.425692 Aug 04 04:27:46.081975 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 696/1371] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:45 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:46.186637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:46.196945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:46.201422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:46.202899 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6606bc0a-20a2-4285-95ae-6a379d40c998 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1803 microversion: 2.25 time: 0.331544 Aug 04 04:27:46.203662 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 676/1372] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:45 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1803 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:46.225432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3db37b47-1bcc-4e4b-a377-928c4f88cfdf req-c326710c-844d-4a3a-9996-7745ac67a4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364b9ebf-7671-455e-a44e-a974f95c9b52", "name": "network-vif-plugged", "status": "completed", "tag": "826f144f-9337-47ea-a43c-baf6f934e072"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:46.228057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec10545e-a346-414f-a1da-a017aaa5ddbf tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '.version_select at 0x7f1919dde3a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:46.232122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec10545e-a346-414f-a1da-a017aaa5ddbf tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.232581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec10545e-a346-414f-a1da-a017aaa5ddbf tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.238015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3db37b47-1bcc-4e4b-a377-928c4f88cfdf req-c326710c-844d-4a3a-9996-7745ac67a4ac service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.240254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3db37b47-1bcc-4e4b-a377-928c4f88cfdf req-c326710c-844d-4a3a-9996-7745ac67a4ac service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.263613 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec10545e-a346-414f-a1da-a017aaa5ddbf tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 4048 microversion: 2.25 time: 0.038870 Aug 04 04:27:46.264494 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 677/1373] 10.222.0.69 () {60 vars in 1184 bytes} [Thu Aug 4 04:27:46 2022] GET /compute/v2.1/os-migrations => generated 4048 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:46.280036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:46.280903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:46.287841 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3db37b47-1bcc-4e4b-a377-928c4f88cfdf req-c326710c-844d-4a3a-9996-7745ac67a4ac service nova] Creating event network-vif-plugged:826f144f-9337-47ea-a43c-baf6f934e072 for instance 364b9ebf-7671-455e-a44e-a974f95c9b52 on n-h2-851337-5 Aug 04 04:27:46.293513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.296988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.298142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.298756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.306051 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3db37b47-1bcc-4e4b-a377-928c4f88cfdf req-c326710c-844d-4a3a-9996-7745ac67a4ac service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089414 Aug 04 04:27:46.306990 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 697/1374] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:46.320392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:46.323812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:46.341488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.342217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.360881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.363025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.777719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 1543d282-7d4f-4c87-b761-049a3c1ab46a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:27:46.808922 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab14d6f4-4af8-4f95-9e53-e03fb555265c tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 2421 microversion: 2.25 time: 0.532696 Aug 04 04:27:46.810728 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 678/1375] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:46 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 2421 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:27:46.841795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:46.844108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:46.858627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.860007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.862372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.865434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.883210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:46.892832 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22f0b9d2-4988-4a5d-a5da-a9ac40a76abf tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.584544 Aug 04 04:27:46.895430 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 698/1376] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:46 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:46.901631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:46.902503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:46.913192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.913970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.914928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:46.915664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:46.997079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:47.011463 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8db30610-eb75-497e-8fec-0a8bb9c7a0a6 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1250 microversion: 2.1 time: 0.180220 Aug 04 04:27:47.012225 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 679/1377] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:46 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1250 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:47.102676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:47.109697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:47.121042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:47.122511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 1543d282-7d4f-4c87-b761-049a3c1ab46a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:27:47.123491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:47.132049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:47.133667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:47.141446 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc67d7c2-8e2f-4c66-a69d-43c0c8170506 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 2421 microversion: 2.25 time: 0.244375 Aug 04 04:27:47.142690 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 699/1378] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:27:46 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 2421 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:27:47.238815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:47.239353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:47.243227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.258837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:47.259481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:47.260033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:47.260482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:47.460114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:47.473308 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3313e9d1-2b2b-4a50-a0d0-8d1885663c61 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1324 microversion: 2.1 time: 0.374897 Aug 04 04:27:47.475595 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 680/1379] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:47 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:47.596124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lazy-loading 'services' on Instance uuid 1543d282-7d4f-4c87-b761-049a3c1ab46a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:27:47.819181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1254568611", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a7caa1d7-5ebf-4ff0-8dd5-b5e59187099d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:47.842236 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8156f520-2146-430c-9cb4-ee0761ad5a21 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments/a9819622-b8a3-4307-a5a4-851dece67fda" status: 202 len: 0 microversion: 2.25 time: 0.605031 Aug 04 04:27:47.866557 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 700/1380] 10.222.0.69 () {60 vars in 1457 bytes} [Thu Aug 4 04:27:47 2022] DELETE /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments/a9819622-b8a3-4307-a5a4-851dece67fda => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:47.881580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.882746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-385fc6b5-862a-4d6a-b027-b11c0c1f9eee tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:47.889831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-385fc6b5-862a-4d6a-b027-b11c0c1f9eee tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:47.903359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-385fc6b5-862a-4d6a-b027-b11c0c1f9eee tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:47.904235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-385fc6b5-862a-4d6a-b027-b11c0c1f9eee tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:47.906608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-385fc6b5-862a-4d6a-b027-b11c0c1f9eee tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:47.907833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-385fc6b5-862a-4d6a-b027-b11c0c1f9eee tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:47.929375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] validate_networks() for [('a7caa1d7-5ebf-4ff0-8dd5-b5e59187099d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:27:48.059282 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-385fc6b5-862a-4d6a-b027-b11c0c1f9eee tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.187903 Aug 04 04:27:48.060576 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 701/1381] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:47 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:48.078973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:48.079612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:48.100811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:48.101350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:48.102209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:48.102714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:48.882072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:48.898050 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00d97834-4a71-43b0-9fb2-bb489046b834 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.827347 Aug 04 04:27:48.902657 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 702/1382] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:48 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:48.924980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:48.926031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:48.940320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:48.945907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:48.948743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:48.951453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.000132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:49.095311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:49.114220 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d04965eb-dd28-428a-9a32-b6d1b0b1154b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1250 microversion: 2.1 time: 0.206510 Aug 04 04:27:49.119750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 703/1383] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:48 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1250 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:49.133405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-712e014d-7c6d-4272-b24e-291a79ec87f4 req-251996f6-329c-439f-8471-b8253891a264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "name": "network-vif-unplugged", "status": "completed", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:49.149425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-712e014d-7c6d-4272-b24e-291a79ec87f4 req-251996f6-329c-439f-8471-b8253891a264 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.150070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-712e014d-7c6d-4272-b24e-291a79ec87f4 req-251996f6-329c-439f-8471-b8253891a264 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.168536 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-712e014d-7c6d-4272-b24e-291a79ec87f4 req-251996f6-329c-439f-8471-b8253891a264 service nova] Creating event network-vif-unplugged:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h1-851337-5 Aug 04 04:27:49.178931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-712e014d-7c6d-4272-b24e-291a79ec87f4 req-251996f6-329c-439f-8471-b8253891a264 service nova] Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:27:49.212023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-712e014d-7c6d-4272-b24e-291a79ec87f4 req-251996f6-329c-439f-8471-b8253891a264 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090704 Aug 04 04:27:49.212639 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 704/1384] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:49.217742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:49.218443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:49.238193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.238650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.239467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.239912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.384288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:49.395614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:27:49.396345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:27:49.397229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:27:49.397824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:27:49.398413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:27:49.413206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.413921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.414907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.415557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.442583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Getting quotas for project 0baf2263b88a4de598e09ebe247d47d8. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:27:49.447993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Getting quotas for user 9a45d57b2a194fbaa90a2dd9f91189a8 and project 0baf2263b88a4de598e09ebe247d47d8. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:27:49.462532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Going to run 2 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:27:49.465650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 9dfd1372-7d16-4a1e-8bd8-954a7f884a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:27:49.512385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=9dfd1372-7d16-4a1e-8bd8-954a7f884a9d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:27:49.600946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:49.605992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b7e4bf3-c410-4b8c-829e-845f2aaa360f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.105870 Aug 04 04:27:49.608038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 681/1385] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:27:49.612131 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55e22b25-1f4b-4387-98fa-c9f45e1a92b2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1521 microversion: 2.1 time: 0.398252 Aug 04 04:27:49.615035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dae16388-0164-4bac-8c0b-ef7c7c74a9fa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:49.617622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dae16388-0164-4bac-8c0b-ef7c7c74a9fa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:49.624770 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 705/1386] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:49 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:49.625083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dae16388-0164-4bac-8c0b-ef7c7c74a9fa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.625783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dae16388-0164-4bac-8c0b-ef7c7c74a9fa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.626896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dae16388-0164-4bac-8c0b-ef7c7c74a9fa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.627644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dae16388-0164-4bac-8c0b-ef7c7c74a9fa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.654147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:49.667891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:49.668741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Searching by: {'deleted': False, 'project_id': '0baf2263b88a4de598e09ebe247d47d8'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:27:49.689243 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dae16388-0164-4bac-8c0b-ef7c7c74a9fa tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079103 Aug 04 04:27:49.694743 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 682/1387] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:49 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:49.694912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.694912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.695243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.696006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.697666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:49.698285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:49.705533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.706113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.707610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.708155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.735642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:27:49.815275 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-adce5ead-a5b4-4414-adce-9fc6da42c207 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.188409 Aug 04 04:27:49.816475 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 706/1388] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:27:49 2022] GET /compute/v2.1/servers => generated 677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:49.831674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c22b5aa5-c5fc-4339-9fc6-f2e4d78e6fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:49.835970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c22b5aa5-c5fc-4339-9fc6-f2e4d78e6fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:49.875865 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fc0d2c69-f74d-4f78-b462-318a517570ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 204 len: 0 microversion: 2.1 time: 0.182950 Aug 04 04:27:49.878829 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 683/1389] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:49 2022] DELETE /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:49.893550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:49.898515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:49.918867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.919519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.920610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:49.923744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:49.951521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c22b5aa5-c5fc-4339-9fc6-f2e4d78e6fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:49.965124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c22b5aa5-c5fc-4339-9fc6-f2e4d78e6fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1220 microversion: 2.1 time: 0.138796 Aug 04 04:27:49.968319 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 707/1390] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:49 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:49.989614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:49.990429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:50.003031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:50.003949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:50.004920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:50.005358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:50.290821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:50.307189 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35adcb68-3114-4930-93a7-861ad2ddaadb tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1527 microversion: 2.1 time: 0.415614 Aug 04 04:27:50.310490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:50.321449 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 684/1391] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:49 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1527 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:50.325316 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d947e35a-20b1-4b44-be62-bdc0ce5bebd4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.354148 Aug 04 04:27:50.327389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:50.328547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:50.331765 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 708/1392] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:49 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:50.350087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:50.350749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:50.351682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:50.352385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:50.509177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:50.518205 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d28af3f1-ea48-43b9-9cf1-e1b6a87edf6d tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1250 microversion: 2.1 time: 0.194804 Aug 04 04:27:50.519365 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 685/1393] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:50 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1250 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:50.703195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-52232808-ea20-4e47-bb61-0c7fc03f947a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:50.705349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-52232808-ea20-4e47-bb61-0c7fc03f947a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:50.717936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52232808-ea20-4e47-bb61-0c7fc03f947a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:50.721118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52232808-ea20-4e47-bb61-0c7fc03f947a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:50.722751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52232808-ea20-4e47-bb61-0c7fc03f947a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:50.726027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52232808-ea20-4e47-bb61-0c7fc03f947a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:50.809916 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-52232808-ea20-4e47-bb61-0c7fc03f947a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111316 Aug 04 04:27:50.821086 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 709/1394] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:50 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:50.989439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:50.990770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:51.007585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.008406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.009439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.010122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.109115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:51.128424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b81fb1a7-afb2-43f8-b716-c1bbd7e259bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1224 microversion: 2.1 time: 0.143070 Aug 04 04:27:51.129523 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 686/1395] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:50 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:51.257444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-626d5ddd-cdd0-4ed9-b587-097ce88c97ce req-a2c1954e-dcde-48ee-b417-8c91d0212d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:51.280292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-626d5ddd-cdd0-4ed9-b587-097ce88c97ce req-a2c1954e-dcde-48ee-b417-8c91d0212d9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.280735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-626d5ddd-cdd0-4ed9-b587-097ce88c97ce req-a2c1954e-dcde-48ee-b417-8c91d0212d9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.304069 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-626d5ddd-cdd0-4ed9-b587-097ce88c97ce req-a2c1954e-dcde-48ee-b417-8c91d0212d9d service nova] Creating event network-changed:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h1-851337-5 Aug 04 04:27:51.335434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:51.337174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:51.337425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-626d5ddd-cdd0-4ed9-b587-097ce88c97ce req-a2c1954e-dcde-48ee-b417-8c91d0212d9d service nova] Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:27:51.360400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.361147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.362102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.363241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.367193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-626d5ddd-cdd0-4ed9-b587-097ce88c97ce req-a2c1954e-dcde-48ee-b417-8c91d0212d9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114073 Aug 04 04:27:51.368013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 710/1396] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:51.387665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:51.388682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:51.395583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.396254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.398630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.399305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.407499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.702713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:51.714348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:51.725342 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32bfd92d-7ebd-4991-a4a6-334cfae9f7ae tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1527 microversion: 2.1 time: 0.400592 Aug 04 04:27:51.727793 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5506db2b-2272-49ab-8ae1-e7c730fe67cd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.355473 Aug 04 04:27:51.728606 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 711/1397] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:51 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:51.734575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:51.735286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:51.735545 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 687/1398] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:51 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1527 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:51.742691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.743516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.744628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.745251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.828290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a839af1-cb36-476e-ba01-177168951fc1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:51.830882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a839af1-cb36-476e-ba01-177168951fc1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:51.855118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a839af1-cb36-476e-ba01-177168951fc1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.855904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a839af1-cb36-476e-ba01-177168951fc1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.857189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a839af1-cb36-476e-ba01-177168951fc1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:51.857869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a839af1-cb36-476e-ba01-177168951fc1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:51.876812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:51.894535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c3561c7-a437-4702-88d7-460298f814a2 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1250 microversion: 2.1 time: 0.163795 Aug 04 04:27:51.896391 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 712/1399] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:51 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1250 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:51.948972 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a839af1-cb36-476e-ba01-177168951fc1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125105 Aug 04 04:27:51.953885 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 688/1400] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:51 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:27:52.150592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:52.151396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:52.174040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:52.174866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:52.185733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:52.186334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:52.368044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:52.381590 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-18182064-3693-48c5-baf8-8253536ae759 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1278 microversion: 2.1 time: 0.232654 Aug 04 04:27:52.382219 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 713/1401] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:52 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:52.750930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:52.751900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:52.752425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:52.753661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:52.760095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:52.760547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:52.761345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:52.761790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:52.765057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:52.769699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:52.770689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:52.771285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.161741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:53.172108 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4c96be19-68e3-46b9-85b2-329e48413570 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.423072 Aug 04 04:27:53.189169 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 714/1402] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:52 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:53.196221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:53.200731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:53.216402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:53.217220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.219831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:53.220461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.346628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:53.359844 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64808878-e9ec-42dc-97b3-660a6f0b1052 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1250 microversion: 2.1 time: 0.168767 Aug 04 04:27:53.360437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2006e35cc04887b80733ca3c736b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff11bae71d3142f9aa402463be123222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:53.382258 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 715/1403] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:53 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1250 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:53.387919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a5abec3-1ebe-4f9c-8c45-4da031fbd140 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:53.390238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4a5abec3-1ebe-4f9c-8c45-4da031fbd140 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:53.391385 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-94e7d91a-2bea-48cc-89e4-ae93c0ade13b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 200 len: 1527 microversion: 2.1 time: 0.645822 Aug 04 04:27:53.393257 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 689/1404] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:52 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 1527 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:53.407574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a5abec3-1ebe-4f9c-8c45-4da031fbd140 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:53.408035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a5abec3-1ebe-4f9c-8c45-4da031fbd140 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.409030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a5abec3-1ebe-4f9c-8c45-4da031fbd140 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:53.410146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:53.411044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a5abec3-1ebe-4f9c-8c45-4da031fbd140 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.411798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:53.474986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:53.480394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.482876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:53.489959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.491649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a5abec3-1ebe-4f9c-8c45-4da031fbd140 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106546 Aug 04 04:27:53.492269 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 716/1405] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:53 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:53.654421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:53.672617 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f57292d1-3f0f-4515-a883-080b97e82669 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1278 microversion: 2.1 time: 0.274068 Aug 04 04:27:53.691456 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 690/1406] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:53 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1278 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:53.745800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-971bffb9-f015-4590-b76f-4e6aa82d74c6 req-ea491a17-fbba-483c-979f-07025a97d07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364b9ebf-7671-455e-a44e-a974f95c9b52", "name": "network-vif-deleted", "tag": "826f144f-9337-47ea-a43c-baf6f934e072"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:53.772870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-971bffb9-f015-4590-b76f-4e6aa82d74c6 req-ea491a17-fbba-483c-979f-07025a97d07d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:53.787122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-971bffb9-f015-4590-b76f-4e6aa82d74c6 req-ea491a17-fbba-483c-979f-07025a97d07d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:53.812541 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-971bffb9-f015-4590-b76f-4e6aa82d74c6 req-ea491a17-fbba-483c-979f-07025a97d07d service nova] Creating event network-vif-deleted:826f144f-9337-47ea-a43c-baf6f934e072 for instance 364b9ebf-7671-455e-a44e-a974f95c9b52 on n-h2-851337-5 Aug 04 04:27:53.824704 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-971bffb9-f015-4590-b76f-4e6aa82d74c6 req-ea491a17-fbba-483c-979f-07025a97d07d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088359 Aug 04 04:27:53.827941 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 717/1407] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:54.384692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:54.386564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:54.402063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.402786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.403779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.407593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.419049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:54.420872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:54.423946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.485779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.485779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.487799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.489599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.630183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.632047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.635355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lazy-loading 'fault' on Instance uuid 6d3dd801-1ae9-4f2f-8a2a-752aac37784b {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:27:54.807000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc44eab358f741bf8f619ef4bb079c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828bda82de6f41c3959d1b81a24453a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:54.823560 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ac7d7e1f-ed24-4aad-b5c2-6c84355aadd0 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 200 len: 1209 microversion: 2.1 time: 0.444173 Aug 04 04:27:54.846379 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 718/1408] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:54 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 1209 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:54.853482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:54.866496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 364b9ebf-7671-455e-a44e-a974f95c9b52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:54.885894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.887906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.891028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.891689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.928358 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Instance 364b9ebf-7671-455e-a44e-a974f95c9b52 could not be found. Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 HTTP/1.1 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 364b9ebf-7671-455e-a44e-a974f95c9b52 could not be found. Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '364b9ebf-7671-455e-a44e-a974f95c9b52'} Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364b9ebf-7671-455e-a44e-a974f95c9b52 could not be found. Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364b9ebf-7671-455e-a44e-a974f95c9b52 could not be found. Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:54.934431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364b9ebf-7671-455e-a44e-a974f95c9b52 could not be found. Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:54.939623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Instance 364b9ebf-7671-455e-a44e-a974f95c9b52 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:54.941910 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2e87f90d-ba7b-4034-bd41-94426260726b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52" status: 404 len: 111 microversion: 2.1 time: 0.092375 Aug 04 04:27:54.944402 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 719/1409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:54 2022] GET /compute/v2.1/servers/364b9ebf-7671-455e-a44e-a974f95c9b52 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:54.955867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ae5509f-7d8f-439e-bd06-395b5c4aba12 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:54.969095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6ae5509f-7d8f-439e-bd06-395b5c4aba12 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:54.980691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ae5509f-7d8f-439e-bd06-395b5c4aba12 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.981754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ae5509f-7d8f-439e-bd06-395b5c4aba12 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:54.986117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ae5509f-7d8f-439e-bd06-395b5c4aba12 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:54.986820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ae5509f-7d8f-439e-bd06-395b5c4aba12 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.038382 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6ae5509f-7d8f-439e-bd06-395b5c4aba12 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090263 Aug 04 04:27:55.044628 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 720/1410] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:54 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:55.057240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:55.060218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:55.073072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.073937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.080611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.082851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.123366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:55.135525 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c2e5c6e-d0c6-45c1-b029-076b245e2257 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1469 microversion: 2.1 time: 0.945299 Aug 04 04:27:55.151653 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 691/1411] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:54 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1469 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:55.157502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d9392ef-f33b-43f5-9ed2-7cf708f29993 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '.version_select at 0x7f1919f7b550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:55.204027 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3d9392ef-f33b-43f5-9ed2-7cf708f29993 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Image not found. Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d9392ef-f33b-43f5-9ed2-7cf708f29993 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9 HTTP/1.1 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '32acf52d-4401-458d-a3fa-389caa2042a9'} Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 32acf52d-4401-458d-a3fa-389caa2042a9 to delete Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 32acf52d-4401-458d-a3fa-389caa2042a9 could not be found. Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.207216 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:27:55.212006 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.213559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d9392ef-f33b-43f5-9ed2-7cf708f29993 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:55.215216 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d9392ef-f33b-43f5-9ed2-7cf708f29993 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9" status: 404 len: 62 microversion: 2.1 time: 0.075604 Aug 04 04:27:55.216097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 692/1412] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:55 2022] DELETE /compute/v2.1/images/32acf52d-4401-458d-a3fa-389caa2042a9 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:27:55.227938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:55.236073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:55.251974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.252865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.253998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.254578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.264252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:55.276832 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d77d8647-6166-441e-be62-89b0eb50bd70 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1278 microversion: 2.1 time: 0.228836 Aug 04 04:27:55.277457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:55.279334 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 721/1413] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:55 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:55.292327 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba HTTP/1.1 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '7f94cc3f-daa3-4561-9c16-1cfc491300ba'} Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:55.294302 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.299140 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.301765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:55.302810 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fdda2d1f-9717-4739-a69e-3ca502625155 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 404 len: 111 microversion: 2.1 time: 0.082778 Aug 04 04:27:55.303620 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 693/1414] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:55 2022] DELETE /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:27:55.313779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:55.314710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: 7f94cc3f-daa3-4561-9c16-1cfc491300ba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:55.322532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.323285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.324288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.324894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.341105 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba HTTP/1.1 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '7f94cc3f-daa3-4561-9c16-1cfc491300ba'} Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.343485 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. Aug 04 04:27:55.348885 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.350369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Instance 7f94cc3f-daa3-4561-9c16-1cfc491300ba could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:55.352069 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-85da47de-4235-42db-9c5e-0255d91e4c09 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba" status: 404 len: 111 microversion: 2.1 time: 0.043700 Aug 04 04:27:55.365003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f3990f2-8972-4cfa-a8c3-a45a0a27baa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '.version_select at 0x7f1919f3b280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:55.368247 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 722/1415] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:55 2022] GET /compute/v2.1/servers/7f94cc3f-daa3-4561-9c16-1cfc491300ba => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:55.395626 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f3990f2-8972-4cfa-a8c3-a45a0a27baa2 tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704040612" status: 202 len: 0 microversion: 2.1 time: 0.037303 Aug 04 04:27:55.399583 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 694/1416] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:27:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704040612 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:27:55.845179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:55.846400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] [instance: 6d3dd801-1ae9-4f2f-8a2a-752aac37784b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:55.854128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.854855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.855868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:55.856729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:55.891761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] HTTP exception thrown: Instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b could not be found. Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Request method failure captured: Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b HTTP/1.1 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60o-djhu3dxH_o-91mYgM0HlOn_JT6qDikgK-DaJqG7dHzyVA1fc_EZqhA-B5uFv90wWaqjNll3GuB-439EWADNAe18uzBgzTN7uoHBDWkVDH8QyHG1YdrLVLiDkghj_KhDIuZ6FOr40lRxSUyrUwlJywri1ahzWphch2JPPlw0_2zk Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 828bda82de6f41c3959d1b81a24453a1 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestBootFromVolume-1807884470 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/828bda82de6f41c3959d1b81a24453a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/828bda82de6f41c3959d1b81a24453a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/828bda82de6f41c3959d1b81a24453a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_828bda82de6f41c3959d1b81a24453a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestBootFromVolume-1807884470 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 828bda82de6f41c3959d1b81a24453a1 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1807884470 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestBootFromVolume-1807884470-project Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: fc44eab358f741bf8f619ef4bb079c73 Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestBootFromVolume-1807884470-project Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b could not be found. Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6d3dd801-1ae9-4f2f-8a2a-752aac37784b'} Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b could not be found. Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b could not be found. Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:55.894849 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.899534 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:55.899534 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:55.899534 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:55.899534 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:55.899534 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:55.899534 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b could not be found. Aug 04 04:27:55.899534 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:27:55.903143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Returning 404 to user: Instance 6d3dd801-1ae9-4f2f-8a2a-752aac37784b could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:55.906225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e450a1cb-ed6a-49fd-abba-d254937af061 tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b" status: 404 len: 111 microversion: 2.1 time: 0.064741 Aug 04 04:27:55.911583 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 723/1417] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:55 2022] GET /compute/v2.1/servers/6d3dd801-1ae9-4f2f-8a2a-752aac37784b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:27:55.926257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-abced440-e47f-4b40-9974-15497e1ecc6b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] Calling method '.version_select at 0x7f1919deca60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:55.964088 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-abced440-e47f-4b40-9974-15497e1ecc6b tempest-ServersTestBootFromVolume-1807884470 tempest-ServersTestBootFromVolume-1807884470-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82366615" status: 202 len: 0 microversion: 2.1 time: 0.046740 Aug 04 04:27:55.965244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 695/1418] 10.222.0.69 () {58 vars in 1215 bytes} [Thu Aug 4 04:27:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82366615 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:27:56.053402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60cbb048-2952-43e4-83b0-968092805785 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:56.057724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-60cbb048-2952-43e4-83b0-968092805785 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:56.073927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60cbb048-2952-43e4-83b0-968092805785 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.076148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60cbb048-2952-43e4-83b0-968092805785 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.081808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60cbb048-2952-43e4-83b0-968092805785 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.082569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60cbb048-2952-43e4-83b0-968092805785 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.153374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60cbb048-2952-43e4-83b0-968092805785 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104974 Aug 04 04:27:56.160282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:56.161310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:56.171245 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 724/1419] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:56 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:56.179519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.180321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.181351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.182321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.301787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:56.302574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:56.312123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.323635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.324674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.325398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.713123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:56.738837 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-017eb23f-9859-4843-908c-5ffb68b970ea tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1462 microversion: 2.1 time: 0.583155 Aug 04 04:27:56.740087 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 696/1420] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:56 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1462 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:56.745218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-782b0c9f-ec34-4f6d-a3d5-fc7d342b3ba3 req-e64b8f25-1a87-4255-85d5-943fa016c139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "name": "network-vif-plugged", "status": "completed", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:56.777374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-782b0c9f-ec34-4f6d-a3d5-fc7d342b3ba3 req-e64b8f25-1a87-4255-85d5-943fa016c139 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.785954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-782b0c9f-ec34-4f6d-a3d5-fc7d342b3ba3 req-e64b8f25-1a87-4255-85d5-943fa016c139 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.798173 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-782b0c9f-ec34-4f6d-a3d5-fc7d342b3ba3 req-e64b8f25-1a87-4255-85d5-943fa016c139 service nova] Creating event network-vif-plugged:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h1-851337-5 Aug 04 04:27:56.805541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-782b0c9f-ec34-4f6d-a3d5-fc7d342b3ba3 req-e64b8f25-1a87-4255-85d5-943fa016c139 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063588 Aug 04 04:27:56.810781 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 697/1421] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:56.817816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-74d0f4c3-00bf-4587-9e1f-761195b86fa4 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:56.818909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-74d0f4c3-00bf-4587-9e1f-761195b86fa4 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:56.826672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c3-00bf-4587-9e1f-761195b86fa4 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.827636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c3-00bf-4587-9e1f-761195b86fa4 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:56.828814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c3-00bf-4587-9e1f-761195b86fa4 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:56.829507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c3-00bf-4587-9e1f-761195b86fa4 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.024355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:57.034846 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-054a578b-b446-4acf-a8bc-291816620ea6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.738018 Aug 04 04:27:57.036348 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 725/1422] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:56 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:57.181847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e0d3204f-acea-4f09-beaa-e79b192cbadb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:57.184131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e0d3204f-acea-4f09-beaa-e79b192cbadb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:57.197133 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-74d0f4c3-00bf-4587-9e1f-761195b86fa4 tempest-MigrationsAdminTest-1590843740 tempest-MigrationsAdminTest-1590843740-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1613 microversion: 2.1 time: 0.384007 Aug 04 04:27:57.201409 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 698/1423] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:56 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1613 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:57.202680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0d3204f-acea-4f09-beaa-e79b192cbadb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.203156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0d3204f-acea-4f09-beaa-e79b192cbadb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.204390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0d3204f-acea-4f09-beaa-e79b192cbadb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.205057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0d3204f-acea-4f09-beaa-e79b192cbadb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.247016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:57.247969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:57.270875 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e0d3204f-acea-4f09-beaa-e79b192cbadb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092873 Aug 04 04:27:57.275767 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 726/1424] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:57 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:27:57.286461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.287826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.289328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.289544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.334360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:27:57.527293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ad6f5ba-c5bf-4773-85c0-384bc82983a4 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 204 len: 0 microversion: 2.1 time: 0.287661 Aug 04 04:27:57.529662 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 699/1425] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:57 2022] DELETE /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:57.538798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:57.539455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:57.547745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.550924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.553465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.554819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.556972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07cf989b-80c4-4a7b-ad64-bc7263cf6dde tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '.version_select at 0x7f1919e1cc10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:57.611468 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-07cf989b-80c4-4a7b-ad64-bc7263cf6dde tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Image not found. Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07cf989b-80c4-4a7b-ad64-bc7263cf6dde tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/images/931b39cf-5825-4249-ac63-917daa0078fe HTTP/1.1 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '931b39cf-5825-4249-ac63-917daa0078fe'} Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 931b39cf-5825-4249-ac63-917daa0078fe to delete Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 931b39cf-5825-4249-ac63-917daa0078fe could not be found. Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:57.615616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:27:57.620114 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.623056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07cf989b-80c4-4a7b-ad64-bc7263cf6dde tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:57.624283 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07cf989b-80c4-4a7b-ad64-bc7263cf6dde tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/images/931b39cf-5825-4249-ac63-917daa0078fe" status: 404 len: 62 microversion: 2.1 time: 0.078640 Aug 04 04:27:57.625360 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 700/1426] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:57 2022] DELETE /compute/v2.1/images/931b39cf-5825-4249-ac63-917daa0078fe => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:27:57.645305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:57.646335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:57.658061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.658827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.659840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.660442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.715344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 HTTP/1.1 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'beb8d55b-d5f1-41da-8a55-de6a6770fe34'} Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:57.721133 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-071a12fd-8cc3-405f-a4a9-d4ea526a6c5c tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "DELETE /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 404 len: 111 microversion: 2.1 time: 0.092960 Aug 04 04:27:57.725721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 701/1427] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:27:57 2022] DELETE /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:57.747341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:57.748006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] [instance: beb8d55b-d5f1-41da-8a55-de6a6770fe34] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:57.768175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.770363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.771249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.772840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.775029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:57.786634 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fbc1cd28-2118-45f9-8e8a-2d3d1e26160d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1468 microversion: 2.1 time: 0.252555 Aug 04 04:27:57.788873 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] HTTP exception thrown: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Request method failure captured: Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 HTTP/1.1 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60p4EKe5SuxJUOt4KNIXVP5Q_5rANMa12oP1Paj9mRNfXJ9YKgsXoSgP0VQQQQYM1oBhZ0r3fbg8CbWk2L6c2fqRLI4UkrsAXzeGG1GBVlpR4MOJWJ1rpqXsFcYVpP9dDMw2LuCJaFkFrtScO5P7C08tgxmHBilp9bbWhiVakYVAUkM Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ff11bae71d3142f9aa402463be123222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ff11bae71d3142f9aa402463be123222"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ff11bae71d3142f9aa402463be123222", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ff11bae71d3142f9aa402463be123222 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-341965222 Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0a2006e35cc04887b80733ca3c736b9c Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-341965222-project Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'beb8d55b-d5f1-41da-8a55-de6a6770fe34'} Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.791662 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] Returning 404 to user: Instance beb8d55b-d5f1-41da-8a55-de6a6770fe34 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:27:57.795554 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9938de03-3a72-49ce-bb1a-ae49defb092b tempest-ImagesOneServerNegativeTestJSON-341965222 tempest-ImagesOneServerNegativeTestJSON-341965222-project] 10.222.0.69 "GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34" status: 404 len: 111 microversion: 2.1 time: 0.060857 Aug 04 04:27:57.796535 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 702/1428] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:57 2022] GET /compute/v2.1/servers/beb8d55b-d5f1-41da-8a55-de6a6770fe34 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:27:57.803382 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 727/1429] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:57 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1468 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:57.859433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-379c8d84-706b-4b12-becb-3946cabf2f84 req-50e009e5-31b4-422c-b3cb-2e4470003fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfd1372-7d16-4a1e-8bd8-954a7f884a9d", "tag": "0ba4d6f2-a10d-49fc-8775-68fe1e21d570"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:57.897031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-379c8d84-706b-4b12-becb-3946cabf2f84 req-50e009e5-31b4-422c-b3cb-2e4470003fe0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:57.897648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-379c8d84-706b-4b12-becb-3946cabf2f84 req-50e009e5-31b4-422c-b3cb-2e4470003fe0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:57.932771 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-379c8d84-706b-4b12-becb-3946cabf2f84 req-50e009e5-31b4-422c-b3cb-2e4470003fe0 service nova] Creating event network-changed:0ba4d6f2-a10d-49fc-8775-68fe1e21d570 for instance 9dfd1372-7d16-4a1e-8bd8-954a7f884a9d on n-h2-851337-5 Aug 04 04:27:57.942132 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-379c8d84-706b-4b12-becb-3946cabf2f84 req-50e009e5-31b4-422c-b3cb-2e4470003fe0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085937 Aug 04 04:27:57.943339 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 703/1430] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:27:58.058344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:58.058914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:58.090479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:58.091084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:58.091946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:58.093225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:58.204673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c82dbab0-d2ec-44c9-b704-e09205b389f8 req-04b0a25d-bb38-4873-b241-01193a06151b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88db0ff0-bf7e-4b14-a90c-71b17c790a4a", "tag": "0d1ac246-e50f-4f80-a2aa-c83273a849fd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:27:58.240384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c82dbab0-d2ec-44c9-b704-e09205b389f8 req-04b0a25d-bb38-4873-b241-01193a06151b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:58.240837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c82dbab0-d2ec-44c9-b704-e09205b389f8 req-04b0a25d-bb38-4873-b241-01193a06151b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:58.266504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c82dbab0-d2ec-44c9-b704-e09205b389f8 req-04b0a25d-bb38-4873-b241-01193a06151b service nova] Creating event network-changed:0d1ac246-e50f-4f80-a2aa-c83273a849fd for instance 88db0ff0-bf7e-4b14-a90c-71b17c790a4a on n-h2-851337-5 Aug 04 04:27:58.275205 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c82dbab0-d2ec-44c9-b704-e09205b389f8 req-04b0a25d-bb38-4873-b241-01193a06151b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075975 Aug 04 04:27:58.276180 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 704/1431] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:27:58.290375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db13908f-ffde-4033-8865-2d3ba86acf29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:58.292984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db13908f-ffde-4033-8865-2d3ba86acf29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:58.311985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db13908f-ffde-4033-8865-2d3ba86acf29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:58.313565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db13908f-ffde-4033-8865-2d3ba86acf29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:58.328107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db13908f-ffde-4033-8865-2d3ba86acf29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:58.328812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db13908f-ffde-4033-8865-2d3ba86acf29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:58.388146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db13908f-ffde-4033-8865-2d3ba86acf29 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104545 Aug 04 04:27:58.389938 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 705/1432] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:58 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:27:58.644548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:58.652486 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b839f2d2-7575-4fd2-987b-488b2717c4c3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.600100 Aug 04 04:27:58.663422 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 728/1433] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:58 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:58.813281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:58.814670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:58.823127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:58.823578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:58.824522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:58.825075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:59.146067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:27:59.156708 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16016997-46f5-4c52-a599-7a4d0a73da17 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1468 microversion: 2.1 time: 0.350337 Aug 04 04:27:59.157432 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 706/1434] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:58 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1468 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:59.405404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84c99688-f880-4115-a542-16e39187ae1e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:59.407605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-84c99688-f880-4115-a542-16e39187ae1e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:59.416653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84c99688-f880-4115-a542-16e39187ae1e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:59.417754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84c99688-f880-4115-a542-16e39187ae1e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:59.419558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84c99688-f880-4115-a542-16e39187ae1e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:59.420654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84c99688-f880-4115-a542-16e39187ae1e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:59.515936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84c99688-f880-4115-a542-16e39187ae1e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.118004 Aug 04 04:27:59.522525 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 729/1435] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:27:59 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:59.675123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:27:59.680316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:27:59.691941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.694329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.714341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:59.719541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:27:59.721239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:27:59.721932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:00.183297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:00.184924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:00.189981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.195056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.205716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:00.211121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:00.212429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:00.213114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:00.228431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.806688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:00.818553 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57774f2f-ca53-4746-8b45-cffd6f7f8dd8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 1.148372 Aug 04 04:28:00.819892 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 707/1436] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:27:59 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:01.141950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:01.154654 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91845c95-c8ef-4d79-a4a2-d3ec2ad520f6 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 200 len: 1468 microversion: 2.1 time: 0.980951 Aug 04 04:28:01.158453 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 730/1437] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:00 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 1468 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:01.370474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-cd8d4982-4292-4530-9f16-0afcfd8cedce req-4c031864-4936-409e-bb38-036f92f6f74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c108a-da7e-4bab-b871-5e34b9e0d178", "name": "network-vif-deleted", "tag": "78a979e4-2220-4b1c-b6bf-e9b54015a730"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:01.407490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cd8d4982-4292-4530-9f16-0afcfd8cedce req-4c031864-4936-409e-bb38-036f92f6f74d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:01.408314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cd8d4982-4292-4530-9f16-0afcfd8cedce req-4c031864-4936-409e-bb38-036f92f6f74d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:01.436471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-cd8d4982-4292-4530-9f16-0afcfd8cedce req-4c031864-4936-409e-bb38-036f92f6f74d service nova] Creating event network-vif-deleted:78a979e4-2220-4b1c-b6bf-e9b54015a730 for instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 on n-h1-851337-5 Aug 04 04:28:01.443542 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-cd8d4982-4292-4530-9f16-0afcfd8cedce req-4c031864-4936-409e-bb38-036f92f6f74d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106558 Aug 04 04:28:01.444951 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 708/1438] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:01.840881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:01.841506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:01.865465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:01.866079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:01.866987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:01.867420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:02.182066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:02.183320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 2b6c108a-da7e-4bab-b871-5e34b9e0d178] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:02.224555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:02.228767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:02.233252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:02.235164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:02.282920 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] HTTP exception thrown: Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 could not be found. Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Request method failure captured: Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 HTTP/1.1 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mbGNqXpKdf8UxhS-qymP9KjfLriqfquH9FT_uOUh0K3xgfm7-nbNzb8HZwFW66MKRg3rgPoI5zlHUHpp5vSwP1vsVK2GDCKpAAAdaVQC9rt1T4TMh1qJ8eFzTopthpVo7en097BokWyw5qcyc97pDvO7xXfRkFEY_Bxul9OzdlgaQ Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e7531c85f5a4fbc8705fb94e4182c92", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 80bef27d84824d25b096a8507009d824 Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 could not be found. Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '2b6c108a-da7e-4bab-b871-5e34b9e0d178'} Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 could not be found. Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 could not be found. Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:02.286104 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:02.291376 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:02.291376 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:02.291376 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:02.291376 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:02.291376 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:02.291376 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 could not be found. Aug 04 04:28:02.291376 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:02.296472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Returning 404 to user: Instance 2b6c108a-da7e-4bab-b871-5e34b9e0d178 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:02.297618 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5cf36ed8-882c-4424-a3cc-9662fb5b28f7 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178" status: 404 len: 111 microversion: 2.1 time: 0.121319 Aug 04 04:28:02.301161 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 709/1439] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:02 2022] GET /compute/v2.1/servers/2b6c108a-da7e-4bab-b871-5e34b9e0d178 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:02.316683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:02.317358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:02.326006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:02.327340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:02.329821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:02.331330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:02.385565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:28:02.587226 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8295c25f-5a3d-4950-8c7c-cab3e7c86bbd tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "DELETE /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 204 len: 0 microversion: 2.1 time: 0.276964 Aug 04 04:28:02.589521 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 710/1440] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:28:02 2022] DELETE /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:02.599101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:02.600054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:02.609289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:02.610210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:02.611485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:02.612600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:02.689479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:02.699351 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c876fda-dde5-43f5-90e3-2ce6399cbccc tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.862612 Aug 04 04:28:02.704023 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 731/1441] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:01 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:02.954265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:02.968487 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-84fb7d1f-d17c-4b17-9b39-7ebc5e2d62e3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1534 microversion: 2.1 time: 0.375926 Aug 04 04:28:02.971922 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 711/1442] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:02 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1534 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:03.721470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:03.722098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:03.738516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:03.748131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:03.749101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:03.753514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:03.996907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:03.998250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:04.007661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:04.008339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:04.009398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:04.010066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:04.636899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:04.668840 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d60b01e-70cc-4d81-9508-4c9d5a0fe081 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1534 microversion: 2.1 time: 0.680248 Aug 04 04:28:04.686089 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 712/1443] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:03 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1534 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:04.691023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:04.700844 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51723e5d-f750-4e1e-ad39-7e52a16eadd7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.983254 Aug 04 04:28:04.711179 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 732/1444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:03 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:05.498931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-35b61bfa-0b6c-44df-a4f0-31f3165c406e req-e7bc9431-91cf-4794-934b-53fbfa36c82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfd1372-7d16-4a1e-8bd8-954a7f884a9d", "name": "network-vif-plugged", "status": "completed", "tag": "0ba4d6f2-a10d-49fc-8775-68fe1e21d570"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:05.530000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-35b61bfa-0b6c-44df-a4f0-31f3165c406e req-e7bc9431-91cf-4794-934b-53fbfa36c82d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:05.531856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-35b61bfa-0b6c-44df-a4f0-31f3165c406e req-e7bc9431-91cf-4794-934b-53fbfa36c82d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:05.548331 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-35b61bfa-0b6c-44df-a4f0-31f3165c406e req-e7bc9431-91cf-4794-934b-53fbfa36c82d service nova] Creating event network-vif-plugged:0ba4d6f2-a10d-49fc-8775-68fe1e21d570 for instance 9dfd1372-7d16-4a1e-8bd8-954a7f884a9d on n-h2-851337-5 Aug 04 04:28:05.555269 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-35b61bfa-0b6c-44df-a4f0-31f3165c406e req-e7bc9431-91cf-4794-934b-53fbfa36c82d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064751 Aug 04 04:28:05.555907 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 713/1445] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:05.694421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:05.696116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:05.705915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:05.710368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:05.711566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:05.712240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:05.735092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:05.736004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:05.753467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:05.753958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:05.754811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:05.756458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:05.976999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:05.993992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c4fc495a-57f5-4009-9815-8f54e3d75172 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1492 microversion: 2.1 time: 0.305294 Aug 04 04:28:05.998990 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 733/1446] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:05 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1492 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:06.347976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:06.360488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-519d9cf1-e2d9-4365-aa53-39ed9a2dfb01 req-f2de5c51-9f9e-40bf-8db4-8899c0eeb2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b", "name": "network-vif-deleted", "tag": "3fc792c7-febd-4eb9-bc27-aa4dbc529458"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:06.360918 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1c6d104-6194-4e40-ad6c-e80178885277 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.629426 Aug 04 04:28:06.363020 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 714/1447] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:05 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:06.400061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-519d9cf1-e2d9-4365-aa53-39ed9a2dfb01 req-f2de5c51-9f9e-40bf-8db4-8899c0eeb2a0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:06.400519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-519d9cf1-e2d9-4365-aa53-39ed9a2dfb01 req-f2de5c51-9f9e-40bf-8db4-8899c0eeb2a0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:06.426752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-519d9cf1-e2d9-4365-aa53-39ed9a2dfb01 req-f2de5c51-9f9e-40bf-8db4-8899c0eeb2a0 service nova] Creating event network-vif-deleted:3fc792c7-febd-4eb9-bc27-aa4dbc529458 for instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b on n-h2-851337-5 Aug 04 04:28:06.439146 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-519d9cf1-e2d9-4365-aa53-39ed9a2dfb01 req-f2de5c51-9f9e-40bf-8db4-8899c0eeb2a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082617 Aug 04 04:28:06.444320 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 734/1448] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:06.936001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Calling method '.version_select at 0x7f1919da93a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:06.936999 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:06.936999 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:28:06.938294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:06.941196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.021118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:07.021950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:07.038052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.038794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.042842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.043659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.126376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.127131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.127790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lazy-loading 'fault' on Instance uuid 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:28:07.282292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.283437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.289563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.303959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.304888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.312894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:07.323289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f04081c6-b9cf-4b67-9d17-267cdb2d1196 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 200 len: 1369 microversion: 2.1 time: 0.308400 Aug 04 04:28:07.328323 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 735/1449] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:07 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 1369 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:07.331090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9d8567c1-8c07-48cc-883b-0484c6539247 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.708214 Aug 04 04:28:07.332119 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 715/1450] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:28:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:07.343836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Calling method '.version_select at 0x7f191a696a60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:07.349383 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:07.349383 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:28:07.354481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.355945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.383090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:07.386073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:07.398162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.400073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.401349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.402920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.406051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.407621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.510117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.510591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.530330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4dc81ad2-bcf0-4ffd-a3d0-16b1629ab6b2 tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/n-h2-851337-5/servers" status: 200 len: 591 microversion: 2.1 time: 0.189219 Aug 04 04:28:07.531011 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 736/1451] 10.222.0.69 () {58 vars in 1212 bytes} [Thu Aug 4 04:28:07 2022] GET /compute/v2.1/os-hypervisors/n-h2-851337-5/servers => generated 591 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:07.546593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Calling method '.version_select at 0x7f191a4f30d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:07.547626 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:07.547626 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:28:07.550894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.551440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.589360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.590246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.604981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.606476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.618469 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-96135742-f9b6-4bda-a7bf-082f4e6d4aef tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078097 Aug 04 04:28:07.619971 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 737/1452] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:28:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:07.633013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e86ac80-2b78-49a4-a4ec-29083ddb3f5c tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Calling method '.version_select at 0x7f191a4f3b80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:07.634603 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:07.634603 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:28:07.647293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e86ac80-2b78-49a4-a4ec-29083ddb3f5c tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.647760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e86ac80-2b78-49a4-a4ec-29083ddb3f5c tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.678593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e86ac80-2b78-49a4-a4ec-29083ddb3f5c tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:07.683638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e86ac80-2b78-49a4-a4ec-29083ddb3f5c tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:07.696224 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e86ac80-2b78-49a4-a4ec-29083ddb3f5c tempest-HypervisorAdminUnderV252Test-885274615 tempest-HypervisorAdminUnderV252Test-885274615-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/n-h2-851337-5/search" status: 200 len: 104 microversion: 2.1 time: 0.068876 Aug 04 04:28:07.698080 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 738/1453] 10.222.0.69 () {58 vars in 1209 bytes} [Thu Aug 4 04:28:07 2022] GET /compute/v2.1/os-hypervisors/n-h2-851337-5/search => generated 104 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:07.861144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:07.872767 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b0a4930-dd51-499a-b7a2-2e0b2566a731 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.494407 Aug 04 04:28:07.875494 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 716/1454] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:07 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:08.349503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:08.350205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:08.396909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:08.397728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:08.400765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:08.401220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:08.444585 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] HTTP exception thrown: Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b could not be found. Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Request method failure captured: Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b HTTP/1.1 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60mbGNqXpKdf8UxhS-qymP9KjfLriqfquH9FT_uOUh0K3xgfm7-nbNzb8HZwFW66MKRg3rgPoI5zlHUHpp5vSwP1vsVK2GDCKpAAAdaVQC9rt1T4TMh1qJ8eFzTopthpVo7en097BokWyw5qcyc97pDvO7xXfRkFEY_Bxul9OzdlgaQ Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e7531c85f5a4fbc8705fb94e4182c92", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 80bef27d84824d25b096a8507009d824 Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b could not be found. Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b'} Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b could not be found. Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b could not be found. Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:08.451438 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:08.456620 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:08.456620 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:08.456620 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:08.456620 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:08.456620 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:08.456620 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b could not be found. Aug 04 04:28:08.456620 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:08.463854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Returning 404 to user: Instance 127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:08.466260 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67588cba-2481-41f4-a96d-2f25d98bb13a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b" status: 404 len: 111 microversion: 2.1 time: 0.121703 Aug 04 04:28:08.468320 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 739/1455] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:08 2022] GET /compute/v2.1/servers/127ee5ff-1e39-44e9-bc0f-4b3e3dc4922b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:08.477794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33d850bc-ee70-4a62-98c2-e471b5457d0d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '.version_select at 0x7f1919f19310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:08.505525 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33d850bc-ee70-4a62-98c2-e471b5457d0d tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-195827440" status: 202 len: 0 microversion: 2.1 time: 0.030918 Aug 04 04:28:08.511328 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 717/1456] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-195827440 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:28:08.883050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8796cc35-3b27-4236-947a-30cc53856250 req-df6624f4-7a6c-4847-afcb-758597f814f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88db0ff0-bf7e-4b14-a90c-71b17c790a4a", "name": "network-vif-plugged", "status": "completed", "tag": "0d1ac246-e50f-4f80-a2aa-c83273a849fd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:08.897526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:08.898526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:08.918078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8796cc35-3b27-4236-947a-30cc53856250 req-df6624f4-7a6c-4847-afcb-758597f814f2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:08.918531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8796cc35-3b27-4236-947a-30cc53856250 req-df6624f4-7a6c-4847-afcb-758597f814f2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:08.928560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:08.929818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:08.934384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:08.937890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:08.992862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8796cc35-3b27-4236-947a-30cc53856250 req-df6624f4-7a6c-4847-afcb-758597f814f2 service nova] Creating event network-vif-plugged:0d1ac246-e50f-4f80-a2aa-c83273a849fd for instance 88db0ff0-bf7e-4b14-a90c-71b17c790a4a on n-h2-851337-5 Aug 04 04:28:09.010253 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8796cc35-3b27-4236-947a-30cc53856250 req-df6624f4-7a6c-4847-afcb-758597f814f2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138977 Aug 04 04:28:09.015023 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 740/1457] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:09.240525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:09.250512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-90e33a0e-2e2e-41cb-9fcd-40fa707ea71f tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.359122 Aug 04 04:28:09.253188 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 718/1458] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:08 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:10.162361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:10.163490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:10.172673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:10.173123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:10.173903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:10.174851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:10.207785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:28:10.273597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:10.274253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:10.290020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:10.290700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:10.291753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:10.292382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:10.324377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1135bc71-3ad1-4b3e-ba20-984cf35a19b0 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 204 len: 0 microversion: 2.1 time: 0.166629 Aug 04 04:28:10.325309 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 741/1459] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:28:10 2022] DELETE /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:10.339100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:10.340141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:10.343257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:10.351582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:10.352266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:10.353397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:10.354550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:10.744518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:10.758708 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1dc47235-377f-4f7b-83e9-ffca5a58c1f8 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1320 microversion: 2.1 time: 0.489177 Aug 04 04:28:10.760949 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 719/1460] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:10 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:10.764799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:10.776078 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fc2c0e2b-d89f-423f-9b00-f2529a28aef3 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1468 microversion: 2.1 time: 0.444040 Aug 04 04:28:10.776078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 742/1461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:10 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1468 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:11.783068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:11.784336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:11.797940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:11.798268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:11.807853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:11.809516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:11.810042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:11.813081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:11.837389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:11.839898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:11.844651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:11.845538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:12.806972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:12.823828 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-17b864a9-7860-4971-b947-36b58bdefeb5 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 200 len: 1508 microversion: 2.1 time: 1.038574 Aug 04 04:28:12.824491 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 720/1462] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:11 2022] GET /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 1508 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:12.834596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:12.845549 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd60371d-08a5-4252-9e8d-67f6199cefbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 200 len: 1468 microversion: 2.1 time: 1.053495 Aug 04 04:28:12.863363 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 743/1463] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:11 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 1468 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:12.882157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8b6aebf5-1f98-4e8f-8a1f-628665da960f req-64c0b40e-dc2f-4036-878e-fd845aa97016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce46d12e-0073-4f73-86fa-25bf2aac23f6", "name": "network-vif-deleted", "tag": "03e5c638-30f6-4365-bbec-9c7499d43113"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:12.902920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8b6aebf5-1f98-4e8f-8a1f-628665da960f req-64c0b40e-dc2f-4036-878e-fd845aa97016 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:12.903687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8b6aebf5-1f98-4e8f-8a1f-628665da960f req-64c0b40e-dc2f-4036-878e-fd845aa97016 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:12.926985 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8b6aebf5-1f98-4e8f-8a1f-628665da960f req-64c0b40e-dc2f-4036-878e-fd845aa97016 service nova] Creating event network-vif-deleted:03e5c638-30f6-4365-bbec-9c7499d43113 for instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 on n-h2-851337-5 Aug 04 04:28:12.941720 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8b6aebf5-1f98-4e8f-8a1f-628665da960f req-64c0b40e-dc2f-4036-878e-fd845aa97016 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076909 Aug 04 04:28:12.943028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 744/1464] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:12.951307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:12.959111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 9dfd1372-7d16-4a1e-8bd8-954a7f884a9d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:12.969910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:12.972634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:12.973841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:12.975152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.172800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Calling method '.version_select at 0x7f1919f870d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:13.173611 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:13.173611 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:28:13.175506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.175970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.213415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.214219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.234602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.245066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.252706 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6298ef7-01d5-431c-8f1f-608ce1f69f2d tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.412205 Aug 04 04:28:13.253635 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 721/1465] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:28:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:13.268186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c79f861-e77a-4a62-a285-e178963802df tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Calling method '.version_select at 0x7f1919f87940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:13.269352 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:13.269352 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:28:13.271616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c79f861-e77a-4a62-a285-e178963802df tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.272322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c79f861-e77a-4a62-a285-e178963802df tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.298572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c79f861-e77a-4a62-a285-e178963802df tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.299605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c79f861-e77a-4a62-a285-e178963802df tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.310080 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c79f861-e77a-4a62-a285-e178963802df tempest-HypervisorAdminV228Test-1420324658 tempest-HypervisorAdminV228Test-1420324658-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.048717 Aug 04 04:28:13.311053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 722/1466] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Aug 4 04:28:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:28:13.555540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:13.566814 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95f43360-7138-448c-b793-e6af154f1bb0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/9dfd1372-7d16-4a1e-8bd8-954a7f884a9d" status: 200 len: 1507 microversion: 2.1 time: 0.622112 Aug 04 04:28:13.568449 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 745/1467] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:12 2022] GET /compute/v2.1/servers/9dfd1372-7d16-4a1e-8bd8-954a7f884a9d => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:13.590162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:13.590678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 9dfd1372-7d16-4a1e-8bd8-954a7f884a9d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:13.597489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.597966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.598756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.600344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.638101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 9dfd1372-7d16-4a1e-8bd8-954a7f884a9d] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:28:13.832142 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7b2e3a0-fa2b-4b5a-8a46-07b7ab53c193 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9dfd1372-7d16-4a1e-8bd8-954a7f884a9d" status: 204 len: 0 microversion: 2.1 time: 0.244785 Aug 04 04:28:13.832142 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 723/1468] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:28:13 2022] DELETE /compute/v2.1/servers/9dfd1372-7d16-4a1e-8bd8-954a7f884a9d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:13.840402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:13.840956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:13.850678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.853183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.856547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.857601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.872060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:13.874406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: ce46d12e-0073-4f73-86fa-25bf2aac23f6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:13.896144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.899531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.902933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.903704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.923591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: 88db0ff0-bf7e-4b14-a90c-71b17c790a4a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:28:13.928382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] HTTP exception thrown: Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 could not be found. Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Request method failure captured: Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 HTTP/1.1 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mbGNqXpKdf8UxhS-qymP9KjfLriqfquH9FT_uOUh0K3xgfm7-nbNzb8HZwFW66MKRg3rgPoI5zlHUHpp5vSwP1vsVK2GDCKpAAAdaVQC9rt1T4TMh1qJ8eFzTopthpVo7en097BokWyw5qcyc97pDvO7xXfRkFEY_Bxul9OzdlgaQ Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e7531c85f5a4fbc8705fb94e4182c92", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 80bef27d84824d25b096a8507009d824 Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 could not be found. Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'ce46d12e-0073-4f73-86fa-25bf2aac23f6'} Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 could not be found. Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 could not be found. Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:13.930683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:13.934676 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:13.934676 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:13.934676 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:13.934676 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:13.934676 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:13.934676 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 could not be found. Aug 04 04:28:13.934676 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:13.937257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Returning 404 to user: Instance ce46d12e-0073-4f73-86fa-25bf2aac23f6 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:13.946833 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57e5ccc8-d103-4b33-802e-489ab1660df5 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6" status: 404 len: 111 microversion: 2.1 time: 0.072625 Aug 04 04:28:13.953121 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 724/1469] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:13 2022] GET /compute/v2.1/servers/ce46d12e-0073-4f73-86fa-25bf2aac23f6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:28:13.966622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:13.967630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:13.984060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.984869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.986151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:13.987548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:13.992213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:14.053662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:28:14.123954 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1590861e-f4f4-402c-a185-7be0d26a161a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "DELETE /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a" status: 204 len: 0 microversion: 2.1 time: 0.287123 Aug 04 04:28:14.125020 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 746/1470] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:28:13 2022] DELETE /compute/v2.1/servers/88db0ff0-bf7e-4b14-a90c-71b17c790a4a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:14.315711 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1f0bc09-a7df-4af6-9786-ebb78aef4fbc tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 204 len: 0 microversion: 2.1 time: 0.359717 Aug 04 04:28:14.320328 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 725/1471] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:28:13 2022] DELETE /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:14.329808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:14.330600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:14.341362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:14.350930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:14.353428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:14.355274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:14.363160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-362009313", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a7caa1d7-5ebf-4ff0-8dd5-b5e59187099d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:14.375112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:14.476334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] validate_networks() for [('a7caa1d7-5ebf-4ff0-8dd5-b5e59187099d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:28:15.063917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:15.079704 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-725c15f4-298c-4998-8df8-af452f51c666 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1467 microversion: 2.1 time: 0.754734 Aug 04 04:28:15.090979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 747/1472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:14 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1467 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:15.828423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:28:15.829890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:28:15.831608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:28:15.832471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:28:15.833058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:28:15.868261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:15.868733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:15.869633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:15.880193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:15.950867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Getting quotas for project 0baf2263b88a4de598e09ebe247d47d8. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:28:15.974706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Getting quotas for user 9a45d57b2a194fbaa90a2dd9f91189a8 and project 0baf2263b88a4de598e09ebe247d47d8. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:28:16.003979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Going to run 2 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:28:16.006643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:28:16.090209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:28:16.108816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:16.112971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:16.133277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:16.134378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:16.135677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:16.136437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:16.307469 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f864df1-7015-4ca3-adb8-84010823fc82 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.947461 Aug 04 04:28:16.312857 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 726/1473] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:28:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 1956 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:28:16.327848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:16.347992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:16.349337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Searching by: {'deleted': False, 'project_id': '0baf2263b88a4de598e09ebe247d47d8'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:28:16.399023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:16.399757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:16.402582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:16.403251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:16.456307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:28:16.506652 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4415af10-1ffd-476f-9f88-63a740c77edd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.190293 Aug 04 04:28:16.508721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 727/1474] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:28:16 2022] GET /compute/v2.1/servers => generated 1335 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:16.536544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6a432e28-7c46-40a9-8c39-a24f78a6991e tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:16.537167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6a432e28-7c46-40a9-8c39-a24f78a6991e tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:16.775933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6a432e28-7c46-40a9-8c39-a24f78a6991e tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:16.785368 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6a432e28-7c46-40a9-8c39-a24f78a6991e tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1217 microversion: 2.1 time: 0.267994 Aug 04 04:28:16.799765 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 728/1475] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:16 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1217 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:16.871489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:16.888108 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a40f5a1c-697f-4306-afa2-40d29186b1b8 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1467 microversion: 2.1 time: 0.788859 Aug 04 04:28:16.903045 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 748/1476] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:16 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1467 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:17.806328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7d33458-2b25-43ff-bf6f-758e852a8bdd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:17.806963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7d33458-2b25-43ff-bf6f-758e852a8bdd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:17.909720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:17.910335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:17.922722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:17.923636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:17.924892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:17.925765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:18.321665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f7d33458-2b25-43ff-bf6f-758e852a8bdd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:18.328841 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7d33458-2b25-43ff-bf6f-758e852a8bdd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1217 microversion: 2.1 time: 0.526649 Aug 04 04:28:18.335017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 729/1477] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:17 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1217 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:18.477003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:18.492111 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a2f2804-cb5e-4e47-98bc-9b175e696a69 tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1467 microversion: 2.1 time: 0.586109 Aug 04 04:28:18.492780 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 749/1478] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:17 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1467 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:18.886225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-31b033bc-0dca-48da-a320-38a3f96bc82e req-ff85e5fe-e347-4282-bc84-6143a26b3c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97ea115-9836-44d8-b12e-674b6434a8b7", "name": "network-vif-deleted", "tag": "0548d468-cd23-4c32-ac67-82a9fc6f4186"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:18.913828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-31b033bc-0dca-48da-a320-38a3f96bc82e req-ff85e5fe-e347-4282-bc84-6143a26b3c5e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:18.917374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-31b033bc-0dca-48da-a320-38a3f96bc82e req-ff85e5fe-e347-4282-bc84-6143a26b3c5e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:18.966374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-31b033bc-0dca-48da-a320-38a3f96bc82e req-ff85e5fe-e347-4282-bc84-6143a26b3c5e service nova] Creating event network-vif-deleted:0548d468-cd23-4c32-ac67-82a9fc6f4186 for instance a97ea115-9836-44d8-b12e-674b6434a8b7 on n-h1-851337-5 Aug 04 04:28:18.973420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d9a8dcae-5035-4173-a9c3-0d380f9012a4 req-c7a2e843-391b-442d-b6bf-3f4c5f5b16b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88db0ff0-bf7e-4b14-a90c-71b17c790a4a", "name": "network-vif-deleted", "tag": "0d1ac246-e50f-4f80-a2aa-c83273a849fd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:18.980799 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-31b033bc-0dca-48da-a320-38a3f96bc82e req-ff85e5fe-e347-4282-bc84-6143a26b3c5e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098654 Aug 04 04:28:18.981670 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 750/1479] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:18.993897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d9a8dcae-5035-4173-a9c3-0d380f9012a4 req-c7a2e843-391b-442d-b6bf-3f4c5f5b16b4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:18.994347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d9a8dcae-5035-4173-a9c3-0d380f9012a4 req-c7a2e843-391b-442d-b6bf-3f4c5f5b16b4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:19.032323 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d9a8dcae-5035-4173-a9c3-0d380f9012a4 req-c7a2e843-391b-442d-b6bf-3f4c5f5b16b4 service nova] Creating event network-vif-deleted:0d1ac246-e50f-4f80-a2aa-c83273a849fd for instance 88db0ff0-bf7e-4b14-a90c-71b17c790a4a on n-h2-851337-5 Aug 04 04:28:19.043462 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d9a8dcae-5035-4173-a9c3-0d380f9012a4 req-c7a2e843-391b-442d-b6bf-3f4c5f5b16b4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.448100 Aug 04 04:28:19.046308 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 730/1480] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:19.291329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:19.292290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:19.299138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:19.310002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:19.313614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:19.314317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:19.388392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:19.388392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:19.406873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:19.423241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:19.429562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:19.429562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:19.930983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:19.943040 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a24c048-08af-4247-aed7-5d7e0d653b7a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1269 microversion: 2.1 time: 0.593993 Aug 04 04:28:19.943630 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 731/1481] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:19 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1269 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:19.967872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:19.979501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:20.012080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:20.018795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:20.021922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:20.022501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:20.178879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:20.179366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:20.181973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lazy-loading 'fault' on Instance uuid a97ea115-9836-44d8-b12e-674b6434a8b7 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:28:20.354291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80bef27d84824d25b096a8507009d824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7531c85f5a4fbc8705fb94e4182c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:20.362834 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33fb216a-c4e3-4975-99eb-56d7f535b60a tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 200 len: 1302 microversion: 2.1 time: 0.418142 Aug 04 04:28:20.367689 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 732/1482] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:19 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 1302 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:20.497329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:20.522349 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43587e93-9e0b-402e-b8b6-fe650f978acb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 1.230148 Aug 04 04:28:20.525256 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 751/1483] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:19 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:20.556034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:20.556662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:20.576062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:20.576523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:20.577322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:20.577766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:20.651825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:20.969439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:20.971702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:20.999390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:21.001498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:21.002590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:21.006370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:21.283228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:21.297525 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1aceadf1-cea7-4621-8766-cb437dcf8168 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1275 microversion: 2.1 time: 0.330237 Aug 04 04:28:21.315440 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 752/1484] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:20 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1275 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:21.347297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-21e192c8-4f2e-49f5-92b5-8c1a84e6c5fc req-4947b83c-b6b1-4c2d-86bd-5b73159b5a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfd1372-7d16-4a1e-8bd8-954a7f884a9d", "name": "network-vif-deleted", "tag": "0ba4d6f2-a10d-49fc-8775-68fe1e21d570"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:21.392132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-21e192c8-4f2e-49f5-92b5-8c1a84e6c5fc req-4947b83c-b6b1-4c2d-86bd-5b73159b5a07 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:21.397232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-21e192c8-4f2e-49f5-92b5-8c1a84e6c5fc req-4947b83c-b6b1-4c2d-86bd-5b73159b5a07 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:21.404384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:21.415184 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad336219-dea8-467b-9d5c-7c718ae0e102 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.868579 Aug 04 04:28:21.415805 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 733/1485] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:20 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:21.433212 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-21e192c8-4f2e-49f5-92b5-8c1a84e6c5fc req-4947b83c-b6b1-4c2d-86bd-5b73159b5a07 service nova] Creating event network-vif-deleted:0ba4d6f2-a10d-49fc-8775-68fe1e21d570 for instance 9dfd1372-7d16-4a1e-8bd8-954a7f884a9d on n-h2-851337-5 Aug 04 04:28:21.434695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:21.439591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-21e192c8-4f2e-49f5-92b5-8c1a84e6c5fc req-4947b83c-b6b1-4c2d-86bd-5b73159b5a07 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120652 Aug 04 04:28:21.441794 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 753/1486] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:21.443091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] [instance: a97ea115-9836-44d8-b12e-674b6434a8b7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:21.452857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:21.454493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:21.455535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:21.456411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:21.456895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:21.457424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:21.476647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:21.477477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:21.478610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:21.479505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:21.515989 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] HTTP exception thrown: Instance a97ea115-9836-44d8-b12e-674b6434a8b7 could not be found. Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Request method failure captured: Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 HTTP/1.1 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60mbGNqXpKdf8UxhS-qymP9KjfLriqfquH9FT_uOUh0K3xgfm7-nbNzb8HZwFW66MKRg3rgPoI5zlHUHpp5vSwP1vsVK2GDCKpAAAdaVQC9rt1T4TMh1qJ8eFzTopthpVo7en097BokWyw5qcyc97pDvO7xXfRkFEY_Bxul9OzdlgaQ Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e7531c85f5a4fbc8705fb94e4182c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e7531c85f5a4fbc8705fb94e4182c92", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 9e7531c85f5a4fbc8705fb94e4182c92 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MigrationsAdminTest-127509479 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 80bef27d84824d25b096a8507009d824 Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MigrationsAdminTest-127509479-project Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a97ea115-9836-44d8-b12e-674b6434a8b7 could not be found. Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a97ea115-9836-44d8-b12e-674b6434a8b7'} Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97ea115-9836-44d8-b12e-674b6434a8b7 could not be found. Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97ea115-9836-44d8-b12e-674b6434a8b7 could not be found. Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:21.518382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97ea115-9836-44d8-b12e-674b6434a8b7 could not be found. Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:21.523026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] Returning 404 to user: Instance a97ea115-9836-44d8-b12e-674b6434a8b7 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:21.530639 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e83d4992-9f4f-4846-a039-e4a1e6eebd5f tempest-MigrationsAdminTest-127509479 tempest-MigrationsAdminTest-127509479-project] 10.222.0.69 "GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7" status: 404 len: 111 microversion: 2.1 time: 0.113724 Aug 04 04:28:21.537390 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 734/1487] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:21 2022] GET /compute/v2.1/servers/a97ea115-9836-44d8-b12e-674b6434a8b7 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:22.328185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:22.328812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:22.358589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:22.363243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:22.364181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:22.364643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:22.455762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:22.491378 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84129185-fb5c-44c3-a97e-f00e0a92189f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 1.047280 Aug 04 04:28:22.498784 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 754/1488] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:21 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:22.526310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f19de528-53a5-48c7-8ec8-3374c447e323 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1198196843"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:22.533887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f19de528-53a5-48c7-8ec8-3374c447e323 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:22.593720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f19de528-53a5-48c7-8ec8-3374c447e323 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:22.597640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f19de528-53a5-48c7-8ec8-3374c447e323 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:22.634045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f19de528-53a5-48c7-8ec8-3374c447e323 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:22.649322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f19de528-53a5-48c7-8ec8-3374c447e323 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:22.734183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:22.761679 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-23451c27-15b3-4601-98bb-2abb3c0a58a3 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1275 microversion: 2.1 time: 0.438613 Aug 04 04:28:22.766723 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 735/1489] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:22 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1275 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:23.382786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f19de528-53a5-48c7-8ec8-3374c447e323 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.858311 Aug 04 04:28:23.404852 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 755/1490] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:28:22 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 04:28:23.793544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:23.794418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:23.821227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:23.825128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:23.830100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:23.831465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:24.169149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20240286-cdbe-444f-bb69-7cc143b8e817 tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] Calling method '.version_select at 0x7f191aa20e50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:24.170290 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:24.170290 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:28:24.197855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20240286-cdbe-444f-bb69-7cc143b8e817 tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.775934 Aug 04 04:28:24.209650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 736/1491] 10.222.0.69 () {58 vars in 1185 bytes} [Thu Aug 4 04:28:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:24.214661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3e8de5c7-ea4e-42fe-a15c-47b5ad034c9a tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] Action: 'update', calling method: .version_select at 0x7f1919fd4670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:24.219123 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:24.219123 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:28:24.489048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:24.498657 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-499b5607-683c-4944-af63-8791dedbe666 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 0.711214 Aug 04 04:28:24.499313 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 756/1492] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:23 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:24.837714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=17,nova_api:UPDATE=11 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:24.934366 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3e8de5c7-ea4e-42fe-a15c-47b5ad034c9a tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.723333 Aug 04 04:28:24.936390 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 737/1493] 10.222.0.69 () {60 vars in 1206 bytes} [Thu Aug 4 04:28:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:24.949968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-15eba65e-cdcc-4cb3-ad8b-99053b474e58 tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] Calling method '.version_select at 0x7f191a729ca0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:24.950919 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:24.950919 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:28:24.993746 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-15eba65e-cdcc-4cb3-ad8b-99053b474e58 tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.047417 Aug 04 04:28:24.995396 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 757/1494] 10.222.0.69 () {58 vars in 1185 bytes} [Thu Aug 4 04:28:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:25.014302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2fd78ec2-7dff-41f3-9b15-bcc105783b01 tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] Action: 'update', calling method: .version_select at 0x7f191aa20940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:25.235800 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2fd78ec2-7dff-41f3-9b15-bcc105783b01 tempest-QuotaClassesAdminTestJSON-996217894 tempest-QuotaClassesAdminTestJSON-996217894-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.228364 Aug 04 04:28:25.236575 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 738/1495] 10.222.0.69 () {60 vars in 1206 bytes} [Thu Aug 4 04:28:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:25.522021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:25.522794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:25.543500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:25.543963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:25.544775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:25.545221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:26.147881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-12daed0b-9496-4753-b147-03f9e47f03ba req-332d01c6-7006-4571-9292-cdda141c3835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715", "tag": "eb1b15ae-f5aa-4230-a413-3e78355bccb9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:26.176013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-12daed0b-9496-4753-b147-03f9e47f03ba req-332d01c6-7006-4571-9292-cdda141c3835 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:26.179754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-12daed0b-9496-4753-b147-03f9e47f03ba req-332d01c6-7006-4571-9292-cdda141c3835 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:26.199105 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-12daed0b-9496-4753-b147-03f9e47f03ba req-332d01c6-7006-4571-9292-cdda141c3835 service nova] Creating event network-changed:eb1b15ae-f5aa-4230-a413-3e78355bccb9 for instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 on n-h1-851337-5 Aug 04 04:28:26.208709 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-12daed0b-9496-4753-b147-03f9e47f03ba req-332d01c6-7006-4571-9292-cdda141c3835 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073713 Aug 04 04:28:26.209332 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 739/1496] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:26.406398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-294fe9c3-b413-4d3a-beca-ba7dffd9cc27 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Action: 'create', calling method: .version_select at 0x7f1919fa2670>, body: {"keypair": {"name": "tempest-keypair-336772671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXtiGAxtlxWcRS5jfZVaW+k+t4tKZBIJvJIfX9A+9D1sRP+XijKI/CgoX2ESjZWJSi2SeySNto3yQ3XTuOI5OeZ3YIUjwUGicN6t118TqwUYk+OVUzpVHJcqdi+QMjaCQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:26.429473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-294fe9c3-b413-4d3a-beca-ba7dffd9cc27 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Getting quotas for project 53efe93fe7a643e989190f1e6a8c88cc. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:28:26.431915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.439204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-294fe9c3-b413-4d3a-beca-ba7dffd9cc27 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Getting quotas for user dd7e0b4b5ac549cbb1dce703af4c9690 and project 53efe93fe7a643e989190f1e6a8c88cc. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:28:26.560290 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-294fe9c3-b413-4d3a-beca-ba7dffd9cc27 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.342223 Aug 04 04:28:26.564640 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 740/1497] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:28:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:26.592650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:26.607611 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6cef3a8-73da-4596-adfd-2147f0945fd6 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 1.090166 Aug 04 04:28:26.625657 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 758/1498] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:25 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:27.381354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f7dab80e-6429-4ceb-9879-f68643f2a413 req-b1335ca3-d333-4925-ac80-f13f0b66878c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90106e5-34a6-483e-9f59-0310490458c7", "tag": "2296b277-9bef-49ab-95f0-97658f08b7ca"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:27.404921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f7dab80e-6429-4ceb-9879-f68643f2a413 req-b1335ca3-d333-4925-ac80-f13f0b66878c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:27.405468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f7dab80e-6429-4ceb-9879-f68643f2a413 req-b1335ca3-d333-4925-ac80-f13f0b66878c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:27.436114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f7dab80e-6429-4ceb-9879-f68643f2a413 req-b1335ca3-d333-4925-ac80-f13f0b66878c service nova] Creating event network-changed:2296b277-9bef-49ab-95f0-97658f08b7ca for instance f90106e5-34a6-483e-9f59-0310490458c7 on n-h1-851337-5 Aug 04 04:28:27.444540 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f7dab80e-6429-4ceb-9879-f68643f2a413 req-b1335ca3-d333-4925-ac80-f13f0b66878c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090371 Aug 04 04:28:27.445743 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 741/1499] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:27.634743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:27.636002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:27.654889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:27.655726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:27.659859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:27.660673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:28.052658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:28.073873 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-032dae97-c0fc-48b6-92a4-9ef1c5a29154 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 0.441999 Aug 04 04:28:28.076512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 759/1500] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:27 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:28.634212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16d7858d-ffa2-4df5-8adc-1fd3b6065863 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Calling method '.version_select at 0x7f1919da9040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:28.785552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-16d7858d-ffa2-4df5-8adc-1fd3b6065863 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:28:28.786539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-16d7858d-ffa2-4df5-8adc-1fd3b6065863 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Neutron security group 8a2af95d-acb3-4464-b921-4e780fbe612a not found {{(pid=119342) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:28:28.788084 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-16d7858d-ffa2-4df5-8adc-1fd3b6065863 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] HTTP exception thrown: Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist Aug 04 04:28:28.788084 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-7b6bdd8d-b36c-49d7-976e-4ee0d01c9e66'] Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16d7858d-ffa2-4df5-8adc-1fd3b6065863 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Request method failure captured: Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-security-groups/8a2af95d-acb3-4464-b921-4e780fbe612a HTTP/1.1 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60rsguiYTuUucKXakhWN0VfvcGdBI8vhmvcwnYog3tKQ35tH8BDEY834drDGO7EjDldvAsyNCXv_SWEYnpjnc7j8cWUwfG4RrNnq17zKny0wyRgfoh-ZmU9zDqB0LLBjXEGZwGw_9vAMM9eUzsEIiU-v0J6V_IddEy91zu5mbq_l08c Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3af55af7b1d64ba6a2c8e5e8fc9d7cea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5a4620604be24e3b9f20df781a59bf36 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-7b6bdd8d-b36c-49d7-976e-4ee0d01c9e66'] Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '8a2af95d-acb3-4464-b921-4e780fbe612a'} Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:28:28.792049 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6bdd8d-b36c-49d7-976e-4ee0d01c9e66'] Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6bdd8d-b36c-49d7-976e-4ee0d01c9e66'] Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6bdd8d-b36c-49d7-976e-4ee0d01c9e66'] Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6bdd8d-b36c-49d7-976e-4ee0d01c9e66'] Aug 04 04:28:28.796212 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:28.803372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16d7858d-ffa2-4df5-8adc-1fd3b6065863 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Returning 404 to user: Security group 8a2af95d-acb3-4464-b921-4e780fbe612a does not exist Aug 04 04:28:28.803372 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-7b6bdd8d-b36c-49d7-976e-4ee0d01c9e66'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:28.804674 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16d7858d-ffa2-4df5-8adc-1fd3b6065863 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/8a2af95d-acb3-4464-b921-4e780fbe612a" status: 404 len: 194 microversion: 2.1 time: 0.642995 Aug 04 04:28:28.810749 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 742/1501] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:28:28 2022] DELETE /compute/v2.1/os-security-groups/8a2af95d-acb3-4464-b921-4e780fbe612a => generated 194 bytes in 650 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:28.816345 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd108f04-1176-4c32-9fe7-4476379fd0b0 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004673 Aug 04 04:28:28.819754 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 760/1502] 10.222.0.69 () {58 vars in 1164 bytes} [Thu Aug 4 04:28:28 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 04:28:28.828141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fe7254d2-9fcc-4dc5-a07d-0ded09b388c1 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Calling method '.version_select at 0x7f191a912310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:29.099633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:29.101856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:29.118108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:29.118834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:29.119897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:29.124403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:30.287492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:30.337989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c7d2f11-3afe-46fb-94c3-d7291d558591 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 1.246509 Aug 04 04:28:30.339360 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 761/1503] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:29 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:30.481444 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fe7254d2-9fcc-4dc5-a07d-0ded09b388c1 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.657007 Aug 04 04:28:30.482984 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 743/1504] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:28:28 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:30.496560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7842ee45-c382-4b5f-95fa-2cb133f4319f tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Calling method '.version_select at 0x7f191a5c2f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:31.239006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd66a3b6-61c7-414a-b58c-a857a704619f tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Calling method '.version_select at 0x7f1919da9820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:31.429469 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd66a3b6-61c7-414a-b58c-a857a704619f tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 371 microversion: 2.1 time: 0.936798 Aug 04 04:28:31.436313 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 744/1505] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 04:28:30 2022] GET /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 371 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:31.454910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:31.465294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:31.479185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-7842ee45-c382-4b5f-95fa-2cb133f4319f tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:28:31.480541 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-7842ee45-c382-4b5f-95fa-2cb133f4319f tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 04 04:28:31.480541 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-5a47b27f-69ae-430b-ace9-66a89f01cffa'] Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7842ee45-c382-4b5f-95fa-2cb133f4319f tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Request method failure captured: Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-security-groups/737a65fe-a5fe-44dc-91c8-85c88b29d77b HTTP/1.1 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60rsguiYTuUucKXakhWN0VfvcGdBI8vhmvcwnYog3tKQ35tH8BDEY834drDGO7EjDldvAsyNCXv_SWEYnpjnc7j8cWUwfG4RrNnq17zKny0wyRgfoh-ZmU9zDqB0LLBjXEGZwGw_9vAMM9eUzsEIiU-v0J6V_IddEy91zu5mbq_l08c Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3af55af7b1d64ba6a2c8e5e8fc9d7cea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 5a4620604be24e3b9f20df781a59bf36 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: exception: Insufficient rights for removing default security group. Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-5a47b27f-69ae-430b-ace9-66a89f01cffa'] Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '737a65fe-a5fe-44dc-91c8-85c88b29d77b'} Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:28:31.483616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a47b27f-69ae-430b-ace9-66a89f01cffa'] Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a47b27f-69ae-430b-ace9-66a89f01cffa'] Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a47b27f-69ae-430b-ace9-66a89f01cffa'] Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a47b27f-69ae-430b-ace9-66a89f01cffa'] Aug 04 04:28:31.493836 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:31.496355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:31.496355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:31.496864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7842ee45-c382-4b5f-95fa-2cb133f4319f tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 04 04:28:31.496864 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-5a47b27f-69ae-430b-ace9-66a89f01cffa'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:31.497016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:31.497096 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7842ee45-c382-4b5f-95fa-2cb133f4319f tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/737a65fe-a5fe-44dc-91c8-85c88b29d77b" status: 400 len: 182 microversion: 2.1 time: 0.993322 Aug 04 04:28:31.497186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:31.497281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 762/1506] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:28:30 2022] DELETE /compute/v2.1/os-security-groups/737a65fe-a5fe-44dc-91c8-85c88b29d77b => generated 182 bytes in 995 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:28:31.510540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-267be985-9aea-4853-b9d6-71f34410e2b3 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Action: 'update', calling method: .version_select at 0x7f1920281dc0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:31.996141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:32.012050 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2a56c3a-f87b-4a03-b3eb-f8839d486b98 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 0.573027 Aug 04 04:28:32.024553 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 745/1507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:31 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:32.041470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e1ad778-b78b-4c20-a7d3-a702d822fde3 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Calling method '.version_select at 0x7f1919fff0d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:32.169883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-4e1ad778-b78b-4c20-a7d3-a702d822fde3 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:28:32.170863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-4e1ad778-b78b-4c20-a7d3-a702d822fde3 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Neutron security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 not found {{(pid=119342) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:28:32.171746 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4e1ad778-b78b-4c20-a7d3-a702d822fde3 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] HTTP exception thrown: Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist Aug 04 04:28:32.171746 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-24351ebc-42f1-4e74-b0f0-65d979450fad'] Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e1ad778-b78b-4c20-a7d3-a702d822fde3 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Request method failure captured: Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-security-groups/72dbc1da-bae3-421b-b513-0e4f0329bd41 HTTP/1.1 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60rsguiYTuUucKXakhWN0VfvcGdBI8vhmvcwnYog3tKQ35tH8BDEY834drDGO7EjDldvAsyNCXv_SWEYnpjnc7j8cWUwfG4RrNnq17zKny0wyRgfoh-ZmU9zDqB0LLBjXEGZwGw_9vAMM9eUzsEIiU-v0J6V_IddEy91zu5mbq_l08c Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3af55af7b1d64ba6a2c8e5e8fc9d7cea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5a4620604be24e3b9f20df781a59bf36 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-24351ebc-42f1-4e74-b0f0-65d979450fad'] Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '72dbc1da-bae3-421b-b513-0e4f0329bd41'} Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:28:32.175175 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24351ebc-42f1-4e74-b0f0-65d979450fad'] Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24351ebc-42f1-4e74-b0f0-65d979450fad'] Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24351ebc-42f1-4e74-b0f0-65d979450fad'] Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24351ebc-42f1-4e74-b0f0-65d979450fad'] Aug 04 04:28:32.179163 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.184396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e1ad778-b78b-4c20-a7d3-a702d822fde3 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Returning 404 to user: Security group 72dbc1da-bae3-421b-b513-0e4f0329bd41 does not exist Aug 04 04:28:32.184396 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-24351ebc-42f1-4e74-b0f0-65d979450fad'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:32.185953 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e1ad778-b78b-4c20-a7d3-a702d822fde3 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/72dbc1da-bae3-421b-b513-0e4f0329bd41" status: 404 len: 194 microversion: 2.1 time: 0.159916 Aug 04 04:28:32.187234 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 746/1508] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:28:32 2022] GET /compute/v2.1/os-security-groups/72dbc1da-bae3-421b-b513-0e4f0329bd41 => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:32.224598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267be985-9aea-4853-b9d6-71f34410e2b3 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:32.231409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267be985-9aea-4853-b9d6-71f34410e2b3 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:32.242369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267be985-9aea-4853-b9d6-71f34410e2b3 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:32.243067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267be985-9aea-4853-b9d6-71f34410e2b3 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:32.415183 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-267be985-9aea-4853-b9d6-71f34410e2b3 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 328 microversion: 2.1 time: 0.927174 Aug 04 04:28:32.415871 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 763/1509] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:28:31 2022] PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 328 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:32.427866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74f08174-0257-49d4-81c9-91cbba800729 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Action: 'update', calling method: .version_select at 0x7f191a7970d0>, body: {"security_group": {"name": "tempest-sg-1805352942", "description": "tempest-description-145825469"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:32.524641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-74f08174-0257-49d4-81c9-91cbba800729 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:28:32.528742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-74f08174-0257-49d4-81c9-91cbba800729 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Neutron security group 18785a30-7290-438d-ab44-fc28ca0ca28b not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:28:32.529655 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-74f08174-0257-49d4-81c9-91cbba800729 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] HTTP exception thrown: Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist Aug 04 04:28:32.529655 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-ed4329b6-5f38-479d-af2c-a868143e8bab'] Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74f08174-0257-49d4-81c9-91cbba800729 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Request method failure captured: Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/os-security-groups/18785a30-7290-438d-ab44-fc28ca0ca28b HTTP/1.1 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 101 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60rsguiYTuUucKXakhWN0VfvcGdBI8vhmvcwnYog3tKQ35tH8BDEY834drDGO7EjDldvAsyNCXv_SWEYnpjnc7j8cWUwfG4RrNnq17zKny0wyRgfoh-ZmU9zDqB0LLBjXEGZwGw_9vAMM9eUzsEIiU-v0J6V_IddEy91zu5mbq_l08c Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3af55af7b1d64ba6a2c8e5e8fc9d7cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3af55af7b1d64ba6a2c8e5e8fc9d7cea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 3af55af7b1d64ba6a2c8e5e8fc9d7cea Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 5a4620604be24e3b9f20df781a59bf36 Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1986810285-project Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: {"security_group": {"name": "tempest-sg-1805352942", "description": "tempest-description-145825469"}} Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-ed4329b6-5f38-479d-af2c-a868143e8bab'] Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '18785a30-7290-438d-ab44-fc28ca0ca28b', 'body': {'security_group': {'name': 'tempest-sg-1805352942', 'description': 'tempest-description-145825469'}}} Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:28:32.539571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed4329b6-5f38-479d-af2c-a868143e8bab'] Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed4329b6-5f38-479d-af2c-a868143e8bab'] Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed4329b6-5f38-479d-af2c-a868143e8bab'] Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed4329b6-5f38-479d-af2c-a868143e8bab'] Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74f08174-0257-49d4-81c9-91cbba800729 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] Returning 404 to user: Security group 18785a30-7290-438d-ab44-fc28ca0ca28b does not exist Aug 04 04:28:32.543585 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-ed4329b6-5f38-479d-af2c-a868143e8bab'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:32.546750 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74f08174-0257-49d4-81c9-91cbba800729 tempest-SecurityGroupsNegativeTestJSON-1986810285 tempest-SecurityGroupsNegativeTestJSON-1986810285-project] 10.222.0.69 "PUT /compute/v2.1/os-security-groups/18785a30-7290-438d-ab44-fc28ca0ca28b" status: 404 len: 194 microversion: 2.1 time: 0.122524 Aug 04 04:28:32.552884 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 764/1510] 10.222.0.69 () {60 vars in 1290 bytes} [Thu Aug 4 04:28:32 2022] PUT /compute/v2.1/os-security-groups/18785a30-7290-438d-ab44-fc28ca0ca28b => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:32.881064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a19d87fd-fed8-47a2-b2b7-ca8360053b07 req-8d64aa3f-3f7a-451d-b9b8-5d6d1b5b8f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-plugged", "status": "completed", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:32.900375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a19d87fd-fed8-47a2-b2b7-ca8360053b07 req-8d64aa3f-3f7a-451d-b9b8-5d6d1b5b8f33 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:32.900762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a19d87fd-fed8-47a2-b2b7-ca8360053b07 req-8d64aa3f-3f7a-451d-b9b8-5d6d1b5b8f33 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:32.935745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-748655744", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:32.936254 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a19d87fd-fed8-47a2-b2b7-ca8360053b07 req-8d64aa3f-3f7a-451d-b9b8-5d6d1b5b8f33 service nova] Creating event network-vif-plugged:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:28:32.960808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a19d87fd-fed8-47a2-b2b7-ca8360053b07 req-8d64aa3f-3f7a-451d-b9b8-5d6d1b5b8f33 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.772002 Aug 04 04:28:32.967415 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 747/1511] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:33.047818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:33.049266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:33.056587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:28:33.069886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:33.070365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:33.071247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:33.073012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:33.490509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:33.499292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:28:33.499981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:28:33.500546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:28:33.501064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:28:33.501203 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9c110203-58f3-48fb-980a-8c296e147947 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 0.455476 Aug 04 04:28:33.501627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:28:33.502038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 748/1512] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:33 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:33.521121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8f3c3440-e9e6-4f47-aa75-f605a7abbf7e"}], "security_groups": [{"name": "tempest-securitygroup--2109992250"}], "key_name": "tempest-keypair-336772671", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:33.525452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:33.526492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:33.527509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:33.528110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:33.550287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Getting quotas for project 6119fb3180fe4e6284242ad50e49bd37. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:28:33.557535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Getting quotas for user 41fce0f8c6a44e568e46460807aeb374 and project 6119fb3180fe4e6284242ad50e49bd37. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:28:33.581468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.utils [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] cores quota exceeded for 6119fb3180fe4e6284242ad50e49bd37, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119343) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 04:28:33.582577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Request method failure captured: Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 144 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60rs6LClP3lkSdiDdpN78GJg_NdUJp3iTlEP30dbJW1wm7wKLY_NUoDLth_27OlZLbwdeW726SmXzWqxVeFEdNLtL4Tmf7um7ZtVwsk2gTt3OBCVbcR-Ymtg9oaxglFs-46LMrbojIevio-cgjWK1o63_ufZyVKCPA26MUNfEUO5SEg Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6119fb3180fe4e6284242ad50e49bd37", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 41fce0f8c6a44e568e46460807aeb374 Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-748655744", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-748655744', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452'}}} Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:28:33.587550 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 04:28:33.592007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:33.597502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:33.598768 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31d1461d-8f6b-44d1-a1da-0c3724ee9aad tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.816705 Aug 04 04:28:33.600495 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 765/1513] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:28:32 2022] POST /compute/v2.1/servers => generated 111 bytes in 818 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:33.733978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] validate_networks() for [('8f3c3440-e9e6-4f47-aa75-f605a7abbf7e', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:28:33.805382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b741b58f-d3f5-4c43-a2d6-f0d20bf92fc9 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Action: 'update', calling method: .version_select at 0x7f191ae60550>, body: {"quota_set": {"ram": "5120"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:33.888734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b741b58f-d3f5-4c43-a2d6-f0d20bf92fc9 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:33.889559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b741b58f-d3f5-4c43-a2d6-f0d20bf92fc9 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:33.890567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b741b58f-d3f5-4c43-a2d6-f0d20bf92fc9 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:33.891225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b741b58f-d3f5-4c43-a2d6-f0d20bf92fc9 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:33.986207 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b741b58f-d3f5-4c43-a2d6-f0d20bf92fc9 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d" status: 200 len: 240 microversion: 2.36 time: 0.382463 Aug 04 04:28:33.988009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 766/1514] 10.222.0.69 () {62 vars in 1303 bytes} [Thu Aug 4 04:28:33 2022] PUT /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d => generated 240 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:33.997320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b6d0dd15-6e11-438c-bf90-f3293d96ba15 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Action: 'update', calling method: .version_select at 0x7f191a4f9f70>, body: {"quota_set": {"cores": 20}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:34.212483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6d0dd15-6e11-438c-bf90-f3293d96ba15 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.212878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6d0dd15-6e11-438c-bf90-f3293d96ba15 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:34.213675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6d0dd15-6e11-438c-bf90-f3293d96ba15 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.214112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6d0dd15-6e11-438c-bf90-f3293d96ba15 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:34.340253 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b6d0dd15-6e11-438c-bf90-f3293d96ba15 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 329 microversion: 2.1 time: 0.351098 Aug 04 04:28:34.340859 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 767/1515] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:28:33 2022] PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 329 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:34.346630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e02e5d86-1980-4709-bc90-03c69b71c976 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Calling method '.version_select at 0x7f191a729af0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:34.415970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:34.424881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e02e5d86-1980-4709-bc90-03c69b71c976 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.425996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e02e5d86-1980-4709-bc90-03c69b71c976 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:34.426829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e02e5d86-1980-4709-bc90-03c69b71c976 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.427579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e02e5d86-1980-4709-bc90-03c69b71c976 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:34.450693 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e02e5d86-1980-4709-bc90-03c69b71c976 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d/detail" status: 200 len: 672 microversion: 2.36 time: 0.108721 Aug 04 04:28:34.455121 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 768/1516] 10.222.0.69 () {60 vars in 1304 bytes} [Thu Aug 4 04:28:34 2022] GET /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d/detail => generated 672 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:34.457090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-327479445", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "50e30f39-3ea7-4335-a7da-5dfd49b29ac4"}], "block_device_mapping_v2": [{"uuid": "09b0765c-55bc-4d70-8528-580fd32e1ffc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:34.480731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:28:34.482060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:28:34.482876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:28:34.483749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:28:34.485134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:28:34.511306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.511763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:34.512586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.513015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:34.549777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Getting quotas for project 53efe93fe7a643e989190f1e6a8c88cc. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:28:34.561325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Getting quotas for user dd7e0b4b5ac549cbb1dce703af4c9690 and project 53efe93fe7a643e989190f1e6a8c88cc. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:28:34.571275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] validate_networks() for [('50e30f39-3ea7-4335-a7da-5dfd49b29ac4', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:28:34.594858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:28:34.606643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:28:34.698575 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f1c130da-0bb0-4900-be3c-e292e725dd5c tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.195182 Aug 04 04:28:34.706912 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 749/1517] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:28:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:28:34.720071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69109b7d-eafd-44f8-81cd-2f8e31ca2e2b tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Calling method '.version_select at 0x7f1919fff550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:34.895144 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69109b7d-eafd-44f8-81cd-2f8e31ca2e2b tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 371 microversion: 2.1 time: 0.184546 Aug 04 04:28:34.900453 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 750/1518] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 04:28:34 2022] GET /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:34.909219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:34.913915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:34.929248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.929536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:34.938009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:34.939270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.219061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:35.243676 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d99c1744-3008-4b6b-9016-32b1f95d52f0 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 0.341494 Aug 04 04:28:35.249209 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 751/1519] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:34 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:35.264825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-edee7be1-8352-4fbb-8c3b-58e8cdecfff3 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:35.267038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edee7be1-8352-4fbb-8c3b-58e8cdecfff3 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:35.368707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-edee7be1-8352-4fbb-8c3b-58e8cdecfff3 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:35.379690 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-edee7be1-8352-4fbb-8c3b-58e8cdecfff3 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1225 microversion: 2.1 time: 0.128317 Aug 04 04:28:35.393661 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 752/1520] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:35 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:35.399387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Action: 'update', calling method: .version_select at 0x7f1919fff5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:35.555273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.555837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.556680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.557131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.591184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:28:35.592370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:28:35.593112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:28:35.593776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:28:35.594499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:28:35.601263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.602043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.603411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.604069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.611120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.611755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.612852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.613654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.633573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=13,nova_api:INSERT=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:35.647668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:28:35.655417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Getting quotas for user eaff90b8a434488f9d2731070edf30fe and project 300e53e93c2a4678b2b5695d002ac286. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:28:35.754495 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5394f493-fa6c-4c18-9e6c-d35a0c5fe5e7 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d?user_id=6e913e47031142839359d53cc4f066a9" status: 200 len: 240 microversion: 2.36 time: 0.358983 Aug 04 04:28:35.755661 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 753/1521] 10.222.0.69 () {62 vars in 1384 bytes} [Thu Aug 4 04:28:35 2022] PUT /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d?user_id=6e913e47031142839359d53cc4f066a9 => generated 240 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:35.771827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c302c1f-a098-41b9-98b3-14572cfa94bf tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Action: 'update', calling method: .version_select at 0x7f191a70f790>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:35.836608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:28:35.840272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='09b0765c-55bc-4d70-8528-580fd32e1ffc',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:28:35.925520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c302c1f-a098-41b9-98b3-14572cfa94bf tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.927710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c302c1f-a098-41b9-98b3-14572cfa94bf tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:35.931542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c302c1f-a098-41b9-98b3-14572cfa94bf tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:35.932237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c302c1f-a098-41b9-98b3-14572cfa94bf tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:36.051732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:36.078627 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c302c1f-a098-41b9-98b3-14572cfa94bf tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 328 microversion: 2.1 time: 0.321445 Aug 04 04:28:36.090277 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 754/1522] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:28:35 2022] PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 328 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:36.098167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4b7f21b7-aec8-4a30-ac5a-617f829509e1 req-9971f3bd-2285-4fce-8a13-bdc6a9df469c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715", "name": "network-vif-plugged", "status": "completed", "tag": "eb1b15ae-f5aa-4230-a413-3e78355bccb9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:36.112000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4b7f21b7-aec8-4a30-ac5a-617f829509e1 req-9971f3bd-2285-4fce-8a13-bdc6a9df469c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:36.112454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4b7f21b7-aec8-4a30-ac5a-617f829509e1 req-9971f3bd-2285-4fce-8a13-bdc6a9df469c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:36.129686 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4b7f21b7-aec8-4a30-ac5a-617f829509e1 req-9971f3bd-2285-4fce-8a13-bdc6a9df469c service nova] Creating event network-vif-plugged:eb1b15ae-f5aa-4230-a413-3e78355bccb9 for instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 on n-h1-851337-5 Aug 04 04:28:36.136711 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4b7f21b7-aec8-4a30-ac5a-617f829509e1 req-9971f3bd-2285-4fce-8a13-bdc6a9df469c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044664 Aug 04 04:28:36.138053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 755/1523] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:36.145752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-06dafacc-b1c8-4bbe-bc42-9f5c1b3f9c63 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] Calling method '.version_select at 0x7f1919fff0d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:36.207468 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-859fa56b-bd4c-4ce2-bfa6-d8e77f6df423 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.753794 Aug 04 04:28:36.214340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 769/1524] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:28:36.236214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87368aa2-b6cc-4cc9-b8ea-e71901be2295 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:36.240942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87368aa2-b6cc-4cc9-b8ea-e71901be2295 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:36.305832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-06dafacc-b1c8-4bbe-bc42-9f5c1b3f9c63 tempest-QuotasAdminTestV236-1096898389 tempest-QuotasAdminTestV236-1096898389-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d?user_id=6e913e47031142839359d53cc4f066a9" status: 200 len: 282 microversion: 2.36 time: 0.166447 Aug 04 04:28:36.306627 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 756/1525] 10.222.0.69 () {60 vars in 1364 bytes} [Thu Aug 4 04:28:36 2022] GET /compute/v2.1/os-quota-sets/3ba9e8fdfdc442c29c006fd5301b802d?user_id=6e913e47031142839359d53cc4f066a9 => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:36.344799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:36.349470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:36.362916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:36.374814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:36.378591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:36.382472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:36.634573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87368aa2-b6cc-4cc9-b8ea-e71901be2295 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:36.656155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87368aa2-b6cc-4cc9-b8ea-e71901be2295 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:36.662604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87368aa2-b6cc-4cc9-b8ea-e71901be2295 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:36.669102 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87368aa2-b6cc-4cc9-b8ea-e71901be2295 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1103 microversion: 2.25 time: 0.451549 Aug 04 04:28:36.674407 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 770/1526] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:36 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1103 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:36.692930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-204097197", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:36.832314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:28:37.177156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:37.187257 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-114564b5-7d72-4f04-b2dc-f075184257fd tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 0.858656 Aug 04 04:28:37.189153 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 757/1527] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:36 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:37.194252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:37.202660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:37.213528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:37.217984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:37.219742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:37.221264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:37.401514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:28:37.402094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:37.402422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:28:37.403094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:28:37.403829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:28:37.404413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:28:37.416505 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2c266b0a-b49d-49e0-a441-0039dc878ecd tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1283 microversion: 2.1 time: 0.223552 Aug 04 04:28:37.417275 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 758/1528] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:37 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1283 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:37.418317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:37.418982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:37.420287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:37.420897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:37.445807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Getting quotas for project 6119fb3180fe4e6284242ad50e49bd37. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:28:37.453965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Getting quotas for user 41fce0f8c6a44e568e46460807aeb374 and project 6119fb3180fe4e6284242ad50e49bd37. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:28:37.475006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.utils [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] instances quota exceeded for 6119fb3180fe4e6284242ad50e49bd37, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119343) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 04:28:37.476366 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Request method failure captured: Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 144 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60rs6LClP3lkSdiDdpN78GJg_NdUJp3iTlEP30dbJW1wm7wKLY_NUoDLth_27OlZLbwdeW726SmXzWqxVeFEdNLtL4Tmf7um7ZtVwsk2gTt3OBCVbcR-Ymtg9oaxglFs-46LMrbojIevio-cgjWK1o63_ufZyVKCPA26MUNfEUO5SEg Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6119fb3180fe4e6284242ad50e49bd37", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 41fce0f8c6a44e568e46460807aeb374 Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-204097197", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-204097197', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452'}}} Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:28:37.479486 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 04:28:37.485316 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:37.488737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:37.495167 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-095889b6-53b9-4edf-a1a7-08b5d80cf401 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.804903 Aug 04 04:28:37.496371 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 771/1529] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:28:36 2022] POST /compute/v2.1/servers => generated 119 bytes in 819 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:37.504939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69fd6e05-c2bd-4628-81ee-5ee53fb2b645 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Action: 'update', calling method: .version_select at 0x7f191a266c10>, body: {"quota_set": {"instances": 10}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:37.700606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:37.702434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:37.724434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:37.730260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:37.732175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:37.735960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:37.810679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:37.903238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:37.915691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:37.917290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:37.918642 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-71354e37-91bc-4727-8340-897982d326e5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1232 microversion: 2.25 time: 0.222186 Aug 04 04:28:37.928364 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 772/1530] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:37 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1232 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:28:38.022863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69fd6e05-c2bd-4628-81ee-5ee53fb2b645 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:38.023743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69fd6e05-c2bd-4628-81ee-5ee53fb2b645 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:38.024827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69fd6e05-c2bd-4628-81ee-5ee53fb2b645 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:38.025509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69fd6e05-c2bd-4628-81ee-5ee53fb2b645 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:38.156475 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69fd6e05-c2bd-4628-81ee-5ee53fb2b645 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 329 microversion: 2.1 time: 0.655754 Aug 04 04:28:38.158051 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 759/1531] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:28:37 2022] PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 329 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:38.170751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbae8c65-e267-4ca9-acc8-497ebb5fa7b7 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Calling method '.version_select at 0x7f191a79b3a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:38.211240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:38.213439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:38.240120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:38.240569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:38.241385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:38.241826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:38.530646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cbae8c65-e267-4ca9-acc8-497ebb5fa7b7 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 371 microversion: 2.1 time: 0.364323 Aug 04 04:28:38.542551 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 773/1532] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 04:28:38 2022] GET /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:38.547600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:38.548831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:38.555871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:38.556562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:38.557798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:38.558440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:38.926653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:38.948857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb1bbf5f-575d-473f-84aa-2170c4e7219a tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1283 microversion: 2.1 time: 0.403531 Aug 04 04:28:38.952089 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 774/1533] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:38 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1283 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:38.982551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cde21e4d-2e56-454b-b6c0-0973ff7c924d tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Action: 'update', calling method: .version_select at 0x7f191a729670>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:39.116617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde21e4d-2e56-454b-b6c0-0973ff7c924d tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:39.117073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde21e4d-2e56-454b-b6c0-0973ff7c924d tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:39.117888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde21e4d-2e56-454b-b6c0-0973ff7c924d tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:39.118324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde21e4d-2e56-454b-b6c0-0973ff7c924d tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:39.282627 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cde21e4d-2e56-454b-b6c0-0973ff7c924d tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 325 microversion: 2.1 time: 0.315131 Aug 04 04:28:39.283312 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 775/1534] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:28:38 2022] PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:39.314813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:39.315514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:39.331881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:39.342133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:39.343010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:39.343468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:39.586077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:39.609803 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e5415d1-d102-430e-acdf-35719b9e1ae7 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 1.402948 Aug 04 04:28:39.611004 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 760/1535] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:38 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:39.623076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3dfd7f41-2d4c-4d3a-b7b9-01f5b0e37af2 req-379f6805-508e-4192-8270-2393d2c4d7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90106e5-34a6-483e-9f59-0310490458c7", "name": "network-vif-plugged", "status": "completed", "tag": "2296b277-9bef-49ab-95f0-97658f08b7ca"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:39.663195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3dfd7f41-2d4c-4d3a-b7b9-01f5b0e37af2 req-379f6805-508e-4192-8270-2393d2c4d7c5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:39.664108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3dfd7f41-2d4c-4d3a-b7b9-01f5b0e37af2 req-379f6805-508e-4192-8270-2393d2c4d7c5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:39.706510 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3dfd7f41-2d4c-4d3a-b7b9-01f5b0e37af2 req-379f6805-508e-4192-8270-2393d2c4d7c5 service nova] Creating event network-vif-plugged:2296b277-9bef-49ab-95f0-97658f08b7ca for instance f90106e5-34a6-483e-9f59-0310490458c7 on n-h1-851337-5 Aug 04 04:28:39.717924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3dfd7f41-2d4c-4d3a-b7b9-01f5b0e37af2 req-379f6805-508e-4192-8270-2393d2c4d7c5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103456 Aug 04 04:28:39.721100 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 761/1536] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:39.742199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-554527197", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:39.782146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:39.797404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:39.800619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:39.801988 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fef7de46-ad38-43bd-8863-05219f31fe45 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1250 microversion: 2.25 time: 0.493675 Aug 04 04:28:39.803788 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 776/1537] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:39 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1250 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:39.878439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:28:39.975086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:39.975721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:39.997566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:39.998253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:39.999078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:39.999521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:40.382438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:40.392856 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a6b4672f-1181-4542-b8b2-23004b419ca2 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1351 microversion: 2.1 time: 0.422845 Aug 04 04:28:40.398014 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 777/1538] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:39 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1351 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:40.604013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:28:40.604588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:28:40.604910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:28:40.605331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:28:40.606359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:28:40.631319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:40.631946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:40.647737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:40.648329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:40.649202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:40.649652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:40.655507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:40.656052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:40.657437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:40.657838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:40.742446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Getting quotas for project 6119fb3180fe4e6284242ad50e49bd37. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:28:40.768228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Getting quotas for user 41fce0f8c6a44e568e46460807aeb374 and project 6119fb3180fe4e6284242ad50e49bd37. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:28:40.802582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.utils [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] ram quota exceeded for 6119fb3180fe4e6284242ad50e49bd37, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119342) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 04:28:40.803565 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Request method failure captured: Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 144 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60rs6LClP3lkSdiDdpN78GJg_NdUJp3iTlEP30dbJW1wm7wKLY_NUoDLth_27OlZLbwdeW726SmXzWqxVeFEdNLtL4Tmf7um7ZtVwsk2gTt3OBCVbcR-Ymtg9oaxglFs-46LMrbojIevio-cgjWK1o63_ufZyVKCPA26MUNfEUO5SEg Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6119fb3180fe4e6284242ad50e49bd37", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 41fce0f8c6a44e568e46460807aeb374 Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-554527197", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-554527197', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452'}}} Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:28:40.811283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 04:28:40.816759 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:40.821642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:40.821907 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b282df04-d528-4739-8b5b-db2adb8f4f05 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.099100 Aug 04 04:28:40.831081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 762/1539] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:28:39 2022] POST /compute/v2.1/servers => generated 110 bytes in 1109 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:40.836577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:40.840144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:40.865271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:40.865734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:40.866555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:40.867019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:41.208763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:41.217648 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e71087a9-98aa-44a9-90cd-00a34406bcc4 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1317 microversion: 2.1 time: 0.590041 Aug 04 04:28:41.238105 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 778/1540] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:40 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:41.255021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d81a2ce5-02df-468d-91e8-90dc249046b2 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Action: 'update', calling method: .version_select at 0x7f191a83f040>, body: {"quota_set": {"ram": 51200}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:41.268356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:41.294336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:41.296314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:41.301350 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e029fae9-c328-4eb9-8976-010b10bf80e7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1292 microversion: 2.25 time: 0.468775 Aug 04 04:28:41.306773 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 763/1541] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:40 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1292 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:41.464274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:41.464274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:41.473038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:41.474096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:41.474911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:41.479262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:42.083765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d81a2ce5-02df-468d-91e8-90dc249046b2 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:42.084218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d81a2ce5-02df-468d-91e8-90dc249046b2 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:42.094903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d81a2ce5-02df-468d-91e8-90dc249046b2 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:42.100801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d81a2ce5-02df-468d-91e8-90dc249046b2 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:42.143966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:42.156700 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2abebf6-0991-47b3-888b-af346a8065b5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1351 microversion: 2.1 time: 0.729621 Aug 04 04:28:42.157360 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 764/1542] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:41 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1351 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:42.181118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4427c629-d0b4-4b6c-a191-018f2a145660 req-adab3428-85c3-4f3d-a1ed-c32deb799b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4b4968-f676-446f-b205-3ffe98d273c6", "tag": "c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:42.210372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4427c629-d0b4-4b6c-a191-018f2a145660 req-adab3428-85c3-4f3d-a1ed-c32deb799b14 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:42.223305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4427c629-d0b4-4b6c-a191-018f2a145660 req-adab3428-85c3-4f3d-a1ed-c32deb799b14 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:42.242469 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d81a2ce5-02df-468d-91e8-90dc249046b2 tempest-QuotasAdminNegativeTest-190547244 tempest-QuotasAdminNegativeTest-190547244-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 200 len: 329 microversion: 2.1 time: 0.999572 Aug 04 04:28:42.255469 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 779/1543] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:28:41 2022] PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 329 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:42.267424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4427c629-d0b4-4b6c-a191-018f2a145660 req-adab3428-85c3-4f3d-a1ed-c32deb799b14 service nova] Creating event network-changed:c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91 for instance ed4b4968-f676-446f-b205-3ffe98d273c6 on n-h2-851337-5 Aug 04 04:28:42.268195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:42.270418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:42.273095 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4427c629-d0b4-4b6c-a191-018f2a145660 req-adab3428-85c3-4f3d-a1ed-c32deb799b14 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112641 Aug 04 04:28:42.274206 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 765/1544] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:42.289973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72dfa3d1-ee05-407f-90e3-0fd4f4db5668 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Action: 'update', calling method: .version_select at 0x7f1919ff4280>, body: {"quota_set": {"ram": 0}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:42.301233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:42.304713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:42.306287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-72dfa3d1-ee05-407f-90e3-0fd4f4db5668 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '41fce0f8c6a44e568e46460807aeb374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6119fb3180fe4e6284242ad50e49bd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:42.307814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:42.309265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72dfa3d1-ee05-407f-90e3-0fd4f4db5668 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Request method failure captured: Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 HTTP/1.1 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 25 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60rs6LClP3lkSdiDdpN78GJg_NdUJp3iTlEP30dbJW1wm7wKLY_NUoDLth_27OlZLbwdeW726SmXzWqxVeFEdNLtL4Tmf7um7ZtVwsk2gTt3OBCVbcR-Ymtg9oaxglFs-46LMrbojIevio-cgjWK1o63_ufZyVKCPA26MUNfEUO5SEg Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6119fb3180fe4e6284242ad50e49bd37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6119fb3180fe4e6284242ad50e49bd37", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 6119fb3180fe4e6284242ad50e49bd37 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1421100428 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 41fce0f8c6a44e568e46460807aeb374 Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-QuotasAdminNegativeTest-1421100428-project Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: {"quota_set": {"ram": 0}} Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6119fb3180fe4e6284242ad50e49bd37', 'body': {'quota_set': {'ram': 0}}} Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:28:42.312078 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 04:28:42.317762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:42.320182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72dfa3d1-ee05-407f-90e3-0fd4f4db5668 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:42.321222 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-72dfa3d1-ee05-407f-90e3-0fd4f4db5668 tempest-QuotasAdminNegativeTest-1421100428 tempest-QuotasAdminNegativeTest-1421100428-project] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37" status: 403 len: 116 microversion: 2.1 time: 0.038145 Aug 04 04:28:42.322044 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 766/1545] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:28:42 2022] PUT /compute/v2.1/os-quota-sets/6119fb3180fe4e6284242ad50e49bd37 => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:42.338223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:42.338990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:42.370617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:42.371158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:42.381839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:42.383156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.008507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:43.019249 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3dc3831a-06e2-4535-9bc3-124b1dcc646a tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1504 microversion: 2.1 time: 0.762510 Aug 04 04:28:43.031300 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 780/1546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:42 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1504 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:43.056893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:43.057799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:43.074180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.076284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.079466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.083399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.162328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:43.196464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:43.202969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:43.209718 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e9d1ef4-b5e5-4826-84be-5a2de1e5393b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1292 microversion: 2.25 time: 0.879919 Aug 04 04:28:43.210300 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 767/1547] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:42 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1292 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:43.231316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:43.231947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:43.276269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.276659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.277489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.277942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.542828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:43.558457 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2caa97e9-9628-42e8-a621-920ef02e1655 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715" status: 200 len: 1505 microversion: 2.1 time: 0.508319 Aug 04 04:28:43.562168 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 781/1548] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:43 2022] GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:43.575514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b60bba10-9bba-4a55-b949-979d07b9fe60 req-38931b44-12b8-482e-a8b6-5d47c5af104e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afb265e-c6c3-4316-a3b9-09c9d2369bf6", "tag": "dc457375-ebe1-4a91-a227-1248b241056c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:43.618256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b60bba10-9bba-4a55-b949-979d07b9fe60 req-38931b44-12b8-482e-a8b6-5d47c5af104e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.618776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b60bba10-9bba-4a55-b949-979d07b9fe60 req-38931b44-12b8-482e-a8b6-5d47c5af104e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.666897 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b60bba10-9bba-4a55-b949-979d07b9fe60 req-38931b44-12b8-482e-a8b6-5d47c5af104e service nova] Creating event network-changed:dc457375-ebe1-4a91-a227-1248b241056c for instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 on n-h2-851337-5 Aug 04 04:28:43.674158 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b60bba10-9bba-4a55-b949-979d07b9fe60 req-38931b44-12b8-482e-a8b6-5d47c5af104e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107705 Aug 04 04:28:43.675401 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 782/1549] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:43.683333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:43.683802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:43.692344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.693062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.694162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.694783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.758714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:28:43.776884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:43.791503 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-340915eb-2e34-493f-bc6b-5cab456b20af tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1351 microversion: 2.1 time: 0.562447 Aug 04 04:28:43.802580 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 768/1550] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:43 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1351 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:43.930397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c614d5af-b37e-4514-83a0-21e437da1578 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715" status: 204 len: 0 microversion: 2.1 time: 0.253144 Aug 04 04:28:43.931104 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 783/1551] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:28:43 2022] DELETE /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:43.943952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:43.950809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:43.961018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.961470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:43.962271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:43.964033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:44.041817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:28:44.051864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:44.233316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:44.234030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:44.256913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:44.258359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:44.259366 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0028b43e-a4ab-462c-8c3e-49c0d5889c74 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 204 len: 0 microversion: 2.1 time: 0.312220 Aug 04 04:28:44.261123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:44.264827 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 769/1552] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:28:43 2022] DELETE /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:44.265047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:44.293499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:44.293499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:44.311695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:44.312307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:44.313717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:44.314177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:45.069150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:45.085721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:45.096137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:45.097951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2aede10a-6811-463f-bbf2-7dfed850ad43 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1292 microversion: 2.25 time: 0.869737 Aug 04 04:28:45.115283 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 784/1553] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:44 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1292 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:45.184645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:45.195583 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-459d222b-8e60-40a4-83fe-44f432a5d628 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715" status: 200 len: 1511 microversion: 2.1 time: 0.924463 Aug 04 04:28:45.197526 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 770/1554] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:44 2022] GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 => generated 1511 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:45.238565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:45.245898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:45.262111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:45.262744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:45.277112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:45.278566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:45.409848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9154ee75-6797-4a95-86bb-1c62d771312c tempest-AZV2TestJSON-1592082502 tempest-AZV2TestJSON-1592082502-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:45.411820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9154ee75-6797-4a95-86bb-1c62d771312c tempest-AZV2TestJSON-1592082502 tempest-AZV2TestJSON-1592082502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:45.412390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9154ee75-6797-4a95-86bb-1c62d771312c tempest-AZV2TestJSON-1592082502 tempest-AZV2TestJSON-1592082502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:45.413310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9154ee75-6797-4a95-86bb-1c62d771312c tempest-AZV2TestJSON-1592082502 tempest-AZV2TestJSON-1592082502-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:45.414361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9154ee75-6797-4a95-86bb-1c62d771312c tempest-AZV2TestJSON-1592082502 tempest-AZV2TestJSON-1592082502-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:45.433806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:45.443933 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9154ee75-6797-4a95-86bb-1c62d771312c tempest-AZV2TestJSON-1592082502 tempest-AZV2TestJSON-1592082502-project] 10.222.0.69 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.327177 Aug 04 04:28:45.455674 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 785/1555] 10.222.0.69 () {58 vars in 1164 bytes} [Thu Aug 4 04:28:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:28:45.711397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:45.728915 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6030726-cd52-4d17-a9a0-19a55f0830f7 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1351 microversion: 2.1 time: 0.495925 Aug 04 04:28:45.732329 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 771/1556] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:45 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1351 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:46.121978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:46.122762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:46.138196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:46.139017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:46.142499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:46.144090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:46.221060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:46.221989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:46.233019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:46.236121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:46.237827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:46.241500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:46.758846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:46.781044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:46.787096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:46.788682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b19393dc-fd7f-4325-a6c4-22d735df0025 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1292 microversion: 2.25 time: 0.670613 Aug 04 04:28:46.789796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 786/1557] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:46 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1292 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:46.794627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:46.803924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:46.814211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:46.815010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:46.816059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:46.816693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:47.517651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:47.526565 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-345dba13-d521-46cf-91c0-6ee7d66f3e80 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715" status: 200 len: 1511 microversion: 2.1 time: 1.310887 Aug 04 04:28:47.534996 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 772/1558] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:46 2022] GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 => generated 1511 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:47.819021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:47.819695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:47.836913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:47.837365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:47.839419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:47.841132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:47.882485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:47.896260 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9239b623-4bc4-4a00-a88c-3d85c9484fe9 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1351 microversion: 2.1 time: 1.105150 Aug 04 04:28:47.901436 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 787/1559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:46 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1351 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:48.236605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:48.260377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:48.285613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:48.286826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd7a4e10-b839-47df-8677-0495c53d6188 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1292 microversion: 2.25 time: 0.472700 Aug 04 04:28:48.299121 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 773/1560] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:47 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1292 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:28:48.562400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:48.566304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:48.582926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:48.585416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:48.597891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:48.600108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:48.761734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:48.762501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:48.765940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lazy-loading 'fault' on Instance uuid e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:28:48.825965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4721f61d-de0a-4c17-b7fa-f4645c8646c9 req-cdea51f7-d43d-461e-9f4b-3dfe724a841b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715", "name": "network-vif-deleted", "tag": "eb1b15ae-f5aa-4230-a413-3e78355bccb9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:48.856888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:48.874046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1da017cf-135c-4beb-9cfa-73fa9e1dff53 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715" status: 200 len: 1307 microversion: 2.1 time: 0.315398 Aug 04 04:28:48.876297 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 774/1561] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:48 2022] GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:48.896267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4721f61d-de0a-4c17-b7fa-f4645c8646c9 req-cdea51f7-d43d-461e-9f4b-3dfe724a841b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:48.899441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4721f61d-de0a-4c17-b7fa-f4645c8646c9 req-cdea51f7-d43d-461e-9f4b-3dfe724a841b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:48.920855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:48.921473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:48.926476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:48.944135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:48.945888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:48.948814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:48.949509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:48.988509 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4721f61d-de0a-4c17-b7fa-f4645c8646c9 req-cdea51f7-d43d-461e-9f4b-3dfe724a841b service nova] Creating event network-vif-deleted:eb1b15ae-f5aa-4230-a413-3e78355bccb9 for instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 on n-h1-851337-5 Aug 04 04:28:49.003893 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4721f61d-de0a-4c17-b7fa-f4645c8646c9 req-cdea51f7-d43d-461e-9f4b-3dfe724a841b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.642442 Aug 04 04:28:49.005965 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 788/1562] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:49.316428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:49.318202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:49.329257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:49.335664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:49.337056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:49.337770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:49.732858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:49.749342 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aeb0d036-2758-4bef-88e8-ce69d2c27255 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1351 microversion: 2.1 time: 0.832362 Aug 04 04:28:49.753552 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 775/1563] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:48 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1351 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:49.796618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-65e01dec-3438-40b2-811d-e24274db501e req-73a8f722-4759-430f-8c46-175ac3e7fac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90106e5-34a6-483e-9f59-0310490458c7", "name": "network-vif-deleted", "tag": "2296b277-9bef-49ab-95f0-97658f08b7ca"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:49.827867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-65e01dec-3438-40b2-811d-e24274db501e req-73a8f722-4759-430f-8c46-175ac3e7fac9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:49.828539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-65e01dec-3438-40b2-811d-e24274db501e req-73a8f722-4759-430f-8c46-175ac3e7fac9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:49.884228 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-65e01dec-3438-40b2-811d-e24274db501e req-73a8f722-4759-430f-8c46-175ac3e7fac9 service nova] Creating event network-vif-deleted:2296b277-9bef-49ab-95f0-97658f08b7ca for instance f90106e5-34a6-483e-9f59-0310490458c7 on n-h1-851337-5 Aug 04 04:28:49.896799 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-65e01dec-3438-40b2-811d-e24274db501e req-73a8f722-4759-430f-8c46-175ac3e7fac9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102716 Aug 04 04:28:49.902460 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 776/1564] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:28:49.914737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:49.917597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:49.926766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:49.944937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:49.951768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:49.954126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:49.955255 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e39dcb05-8c76-4570-8496-653d216ffbec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1292 microversion: 2.25 time: 0.643955 Aug 04 04:28:49.955843 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 789/1565] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:49 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1292 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:49.956016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:49.957199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:49.961958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:50.010988 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] HTTP exception thrown: Instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 could not be found. Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Request method failure captured: Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 HTTP/1.1 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60rDzek2DZ0_F1pkOSbkdPwbSqgKj3X0yBV6Ai-lEpbC-nVCutrfehdYdlYnMmuDm4S1_Qtk-eMBY4W4XDbwxJdvDjlv3RdtD9-YmcX3GCUN28t7Jo_qOeW7dt_Zea5g7k2T0wVWsBSx6rzkDZ3yxAbA14GgRAdjCtLCPCVlbonEGpg Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 0baf2263b88a4de598e09ebe247d47d8 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MultipleCreateTestJSON-1644049278 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0baf2263b88a4de598e09ebe247d47d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0baf2263b88a4de598e09ebe247d47d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0baf2263b88a4de598e09ebe247d47d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0baf2263b88a4de598e09ebe247d47d8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MultipleCreateTestJSON-1644049278 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 0baf2263b88a4de598e09ebe247d47d8 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1644049278 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MultipleCreateTestJSON-1644049278-project Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 9a45d57b2a194fbaa90a2dd9f91189a8 Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MultipleCreateTestJSON-1644049278-project Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 could not be found. Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715'} Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 could not be found. Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 could not be found. Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:50.014366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 could not be found. Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Returning 404 to user: Instance e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:50.021354 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c530acde-7cad-47ff-be86-a0cddcb60b40 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715" status: 404 len: 111 microversion: 2.1 time: 0.117671 Aug 04 04:28:50.033085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:50.033779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:50.035684 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 777/1566] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:49 2022] GET /compute/v2.1/servers/e0207bd3-b926-4ddd-ae4f-ca2ddfbdf715 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:28:50.048560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:50.049018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:50.056561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:50.057032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:50.171547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:50.172288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:50.174491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lazy-loading 'fault' on Instance uuid f90106e5-34a6-483e-9f59-0310490458c7 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:28:50.248639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a45d57b2a194fbaa90a2dd9f91189a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf2263b88a4de598e09ebe247d47d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:50.258419 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf611522-0389-41d3-be59-bf4488d2b407 tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 200 len: 1307 microversion: 2.1 time: 0.232226 Aug 04 04:28:50.281275 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 790/1567] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:50 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:50.373029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-06ee095d-f268-4c74-8216-450371dab70a req-8301f8e3-bf90-48d6-a81d-02804ad8464f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4b4968-f676-446f-b205-3ffe98d273c6", "name": "network-vif-plugged", "status": "completed", "tag": "c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:50.415889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-06ee095d-f268-4c74-8216-450371dab70a req-8301f8e3-bf90-48d6-a81d-02804ad8464f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:50.417962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-06ee095d-f268-4c74-8216-450371dab70a req-8301f8e3-bf90-48d6-a81d-02804ad8464f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:50.457900 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-06ee095d-f268-4c74-8216-450371dab70a req-8301f8e3-bf90-48d6-a81d-02804ad8464f service nova] Creating event network-vif-plugged:c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91 for instance ed4b4968-f676-446f-b205-3ffe98d273c6 on n-h2-851337-5 Aug 04 04:28:50.507290 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-06ee095d-f268-4c74-8216-450371dab70a req-8301f8e3-bf90-48d6-a81d-02804ad8464f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135787 Aug 04 04:28:50.512600 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 778/1568] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:50.774683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:50.775578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:50.777666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=13 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:50.791086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=18 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:50.812639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:50.815498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:50.817467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:50.817918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:51.138112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ad24e07-6f29-4b23-8dea-883fc38b6e52 tempest-ListImageFiltersNegativeTestJSON-317454908 tempest-ListImageFiltersNegativeTestJSON-317454908-project] Calling method '.version_select at 0x7f191a6f94c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:51.177909 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0ad24e07-6f29-4b23-8dea-883fc38b6e52 tempest-ListImageFiltersNegativeTestJSON-317454908 tempest-ListImageFiltersNegativeTestJSON-317454908-project] HTTP exception thrown: Image not found. Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ad24e07-6f29-4b23-8dea-883fc38b6e52 tempest-ListImageFiltersNegativeTestJSON-317454908 tempest-ListImageFiltersNegativeTestJSON-317454908-project] Request method failure captured: Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/images/4cc4c866-b5d8-4991-b3a1-ee414ba70050 HTTP/1.1 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sCS0jX8TVpf4tnKsT3CTX22eiXx6vzQH5hM0ohZbY3vKBlpNd0LaFeRgLzI3Xoo6Ilfb1n_FOxxBk3yBSOokKgGd8SAllTMTjkyHNFyAdQ2MAAxC4Yl8PH1uEH82VRrrvOzknfBQobQfqY0DaK2dJ_Sk5AzganbgC48e820mWvWf8 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b56e32fa82f04fe9ace974fbfce01b97 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-317454908 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b56e32fa82f04fe9ace974fbfce01b97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b56e32fa82f04fe9ace974fbfce01b97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b56e32fa82f04fe9ace974fbfce01b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b56e32fa82f04fe9ace974fbfce01b97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-317454908 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b56e32fa82f04fe9ace974fbfce01b97 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-317454908 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListImageFiltersNegativeTestJSON-317454908-project Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 1d5440c6945d4e21b9d1032cab24493b Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-317454908-project Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '4cc4c866-b5d8-4991-b3a1-ee414ba70050'} Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4cc4c866-b5d8-4991-b3a1-ee414ba70050 Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:28:51.180789 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4cc4c866-b5d8-4991-b3a1-ee414ba70050 could not be found. Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ad24e07-6f29-4b23-8dea-883fc38b6e52 tempest-ListImageFiltersNegativeTestJSON-317454908 tempest-ListImageFiltersNegativeTestJSON-317454908-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ad24e07-6f29-4b23-8dea-883fc38b6e52 tempest-ListImageFiltersNegativeTestJSON-317454908 tempest-ListImageFiltersNegativeTestJSON-317454908-project] 10.222.0.69 "GET /compute/v2.1/images/4cc4c866-b5d8-4991-b3a1-ee414ba70050" status: 404 len: 62 microversion: 2.1 time: 0.715785 Aug 04 04:28:51.189452 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 791/1569] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:28:50 2022] GET /compute/v2.1/images/4cc4c866-b5d8-4991-b3a1-ee414ba70050 => generated 62 bytes in 717 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 04:28:51.218361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:51.219569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:51.222683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:51.230534 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-882df78a-e1de-4543-8c55-52352e1cc752 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1351 microversion: 2.1 time: 0.460570 Aug 04 04:28:51.232072 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 779/1570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:50 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1351 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:51.263774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:51.264235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:51.265040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:51.272813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:51.286687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:51.290635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:51.291622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] [instance: f90106e5-34a6-483e-9f59-0310490458c7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:51.302885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:51.303775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:51.307600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:51.308335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:51.340799 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] HTTP exception thrown: Instance f90106e5-34a6-483e-9f59-0310490458c7 could not be found. Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Request method failure captured: Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 HTTP/1.1 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60rDzek2DZ0_F1pkOSbkdPwbSqgKj3X0yBV6Ai-lEpbC-nVCutrfehdYdlYnMmuDm4S1_Qtk-eMBY4W4XDbwxJdvDjlv3RdtD9-YmcX3GCUN28t7Jo_qOeW7dt_Zea5g7k2T0wVWsBSx6rzkDZ3yxAbA14GgRAdjCtLCPCVlbonEGpg Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 0baf2263b88a4de598e09ebe247d47d8 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MultipleCreateTestJSON-1644049278 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0baf2263b88a4de598e09ebe247d47d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0baf2263b88a4de598e09ebe247d47d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0baf2263b88a4de598e09ebe247d47d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0baf2263b88a4de598e09ebe247d47d8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MultipleCreateTestJSON-1644049278 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 0baf2263b88a4de598e09ebe247d47d8 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1644049278 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MultipleCreateTestJSON-1644049278-project Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 9a45d57b2a194fbaa90a2dd9f91189a8 Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MultipleCreateTestJSON-1644049278-project Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance f90106e5-34a6-483e-9f59-0310490458c7 could not be found. Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f90106e5-34a6-483e-9f59-0310490458c7'} Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90106e5-34a6-483e-9f59-0310490458c7 could not be found. Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90106e5-34a6-483e-9f59-0310490458c7 could not be found. Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:28:51.345769 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.350211 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:28:51.350211 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:28:51.350211 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:28:51.350211 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:28:51.350211 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:28:51.350211 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90106e5-34a6-483e-9f59-0310490458c7 could not be found. Aug 04 04:28:51.350211 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:28:51.356127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] Returning 404 to user: Instance f90106e5-34a6-483e-9f59-0310490458c7 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:28:51.359116 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-283915b6-416a-447f-ba50-e9353dbcf1bf tempest-MultipleCreateTestJSON-1644049278 tempest-MultipleCreateTestJSON-1644049278-project] 10.222.0.69 "GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7" status: 404 len: 111 microversion: 2.1 time: 0.075952 Aug 04 04:28:51.361081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 780/1571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:51 2022] GET /compute/v2.1/servers/f90106e5-34a6-483e-9f59-0310490458c7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:28:51.902357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:51.911245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:51.912793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:51.924475 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5d404c5-9368-45a5-b80d-4d08ea80362a tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 0.740185 Aug 04 04:28:51.925579 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 792/1572] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:51 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:52.270008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:52.271695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:52.294983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:52.299314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:52.301277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:52.305067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:52.563960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf58f4a3-0186-4eca-9704-681787a1fff5 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:52.564571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf58f4a3-0186-4eca-9704-681787a1fff5 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:52.566465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=66 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:52.581662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf58f4a3-0186-4eca-9704-681787a1fff5 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:52.582989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf58f4a3-0186-4eca-9704-681787a1fff5 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:52.585893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf58f4a3-0186-4eca-9704-681787a1fff5 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:52.588318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf58f4a3-0186-4eca-9704-681787a1fff5 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:53.670685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:53.685721 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1724b95-861f-4ddf-ae0c-1ba6f8fba770 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1541 microversion: 2.1 time: 1.433102 Aug 04 04:28:53.686729 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 781/1573] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:52 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1541 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:53.695769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:53.699243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:53.711829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:53.714673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:53.715865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:53.724963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:54.319718 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf58f4a3-0186-4eca-9704-681787a1fff5 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1811 microversion: 2.1 time: 1.757235 Aug 04 04:28:54.320892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 793/1574] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:28:52 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1811 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:28:54.328044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ceabc11-476b-48d9-971b-bb04c3c80410 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:54.329625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4ceabc11-476b-48d9-971b-bb04c3c80410 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:54.356772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceabc11-476b-48d9-971b-bb04c3c80410 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:54.358452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceabc11-476b-48d9-971b-bb04c3c80410 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:54.362768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceabc11-476b-48d9-971b-bb04c3c80410 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:54.363605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ceabc11-476b-48d9-971b-bb04c3c80410 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:54.826019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:54.834923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:54.836484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:54.837630 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-28d00afb-087b-487c-a168-a06708d41d40 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 1.149707 Aug 04 04:28:54.863151 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 782/1575] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:53 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:54.885344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fccfe95c-c122-4f95-a58b-91e514791afc tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:54.886649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ceabc11-476b-48d9-971b-bb04c3c80410 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.563325 Aug 04 04:28:54.888094 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 794/1576] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:28:54 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6/os-interface => generated 284 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:54.893501 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:28:54.893501 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:28:54.897423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fccfe95c-c122-4f95-a58b-91e514791afc tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:54.897889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fccfe95c-c122-4f95-a58b-91e514791afc tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:54.912991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fccfe95c-c122-4f95-a58b-91e514791afc tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:54.918081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fccfe95c-c122-4f95-a58b-91e514791afc tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:54.955545 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fccfe95c-c122-4f95-a58b-91e514791afc tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.090972 Aug 04 04:28:54.956763 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 783/1577] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:28:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:55.858186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=20 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:55.864667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:55.865653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:55.898497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:55.898982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:55.899808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:55.900255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:56.232757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ced07417-be0e-4055-b318-f0c97a2e5ff0 tempest-AbsoluteLimitsTestJSON-1698312923 tempest-AbsoluteLimitsTestJSON-1698312923-project] Calling method '.version_select at 0x7f191a266550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:56.259412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced07417-be0e-4055-b318-f0c97a2e5ff0 tempest-AbsoluteLimitsTestJSON-1698312923 tempest-AbsoluteLimitsTestJSON-1698312923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:56.259874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced07417-be0e-4055-b318-f0c97a2e5ff0 tempest-AbsoluteLimitsTestJSON-1698312923 tempest-AbsoluteLimitsTestJSON-1698312923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:56.260712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced07417-be0e-4055-b318-f0c97a2e5ff0 tempest-AbsoluteLimitsTestJSON-1698312923 tempest-AbsoluteLimitsTestJSON-1698312923-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:56.261150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ced07417-be0e-4055-b318-f0c97a2e5ff0 tempest-AbsoluteLimitsTestJSON-1698312923 tempest-AbsoluteLimitsTestJSON-1698312923-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:56.323822 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ced07417-be0e-4055-b318-f0c97a2e5ff0 tempest-AbsoluteLimitsTestJSON-1698312923 tempest-AbsoluteLimitsTestJSON-1698312923-project] 10.222.0.69 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.459922 Aug 04 04:28:56.324453 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 784/1578] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 04:28:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:28:57.838211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:57.851784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:57.867431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:28:57.869084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98d4a629-36af-4a2a-9487-2ce4b4cad3ea tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 2.011494 Aug 04 04:28:57.882057 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 795/1579] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:55 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:28:58.898413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:28:58.899092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:58.924080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:58.928331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:58.932216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:58.935671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:59.453778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1b0f97f-58e3-497e-8b3e-97982b9187ce tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08c87cbd-8e48-492e-b35f-f51b4eb39e36", "device": "/dev/xvdb"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:28:59.456571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1b0f97f-58e3-497e-8b3e-97982b9187ce tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:28:59.477926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b0f97f-58e3-497e-8b3e-97982b9187ce tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:59.478441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b0f97f-58e3-497e-8b3e-97982b9187ce tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:28:59.487775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b0f97f-58e3-497e-8b3e-97982b9187ce tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:28:59.488281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b0f97f-58e3-497e-8b3e-97982b9187ce tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:00.012480 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1b0f97f-58e3-497e-8b3e-97982b9187ce tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "POST /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564005 Aug 04 04:29:00.017425 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 796/1580] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:28:59 2022] POST /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:29:00.452305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:00.465151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:00.473849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:00.481824 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fefae816-38ec-44ae-927a-c347b4f543c4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 1.587402 Aug 04 04:29:00.504514 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 785/1581] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:28:58 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:01.518184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:01.519719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:01.529395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:01.538913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:01.544729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:01.545442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:01.595837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6ed37a5e-0bfe-4158-ae53-1305e7fc6aa2 req-c860e420-8e82-4769-9102-ae1e14c8c696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4b4968-f676-446f-b205-3ffe98d273c6", "tag": "c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:01.617763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ed37a5e-0bfe-4158-ae53-1305e7fc6aa2 req-c860e420-8e82-4769-9102-ae1e14c8c696 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:01.618702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ed37a5e-0bfe-4158-ae53-1305e7fc6aa2 req-c860e420-8e82-4769-9102-ae1e14c8c696 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:01.670856 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6ed37a5e-0bfe-4158-ae53-1305e7fc6aa2 req-c860e420-8e82-4769-9102-ae1e14c8c696 service nova] Creating event network-changed:c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91 for instance ed4b4968-f676-446f-b205-3ffe98d273c6 on n-h2-851337-5 Aug 04 04:29:01.690714 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6ed37a5e-0bfe-4158-ae53-1305e7fc6aa2 req-c860e420-8e82-4769-9102-ae1e14c8c696 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098552 Aug 04 04:29:01.706169 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 786/1582] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:29:02.266426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:02.284467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:02.288545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:02.304627 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-16c27202-479f-4182-b514-5388a3774630 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 0.788612 Aug 04 04:29:02.321934 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 797/1583] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:01 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:03.830665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:03.833202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:03.853819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:03.855938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:03.857296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:03.864259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:04.492802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:04.494141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:04.511211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:04.515761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:04.518410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:04.519220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:04.798289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:04.808493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:04.810031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:04.819253 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99968a04-e05c-40fd-8569-dcf14405707e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 1.485623 Aug 04 04:29:04.835053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 787/1584] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:03 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:04.908336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:04.918997 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6b864ef2-b108-45df-a3ad-fd32be40dcae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.430726 Aug 04 04:29:04.921207 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 798/1585] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:04 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:05.851508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:05.858684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:05.890787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:05.899191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:05.900304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:05.900915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:05.942985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:05.943897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:05.972106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:05.972718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:05.974468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:05.975976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:06.250850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:06.290201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:06.811718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:06.820100 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d788fb1a-f931-49bc-b086-53a9e229863d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.881707 Aug 04 04:29:06.831380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 799/1586] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:05 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:06.846636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6caff5b2-f437-422e-80d6-818afb90639e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1716540652"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:06.849513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6caff5b2-f437-422e-80d6-818afb90639e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:06.870978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6caff5b2-f437-422e-80d6-818afb90639e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:06.871633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6caff5b2-f437-422e-80d6-818afb90639e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:06.872801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6caff5b2-f437-422e-80d6-818afb90639e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:06.874497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6caff5b2-f437-422e-80d6-818afb90639e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:06.934861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:06.959866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:06.962699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:06.975886 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbe2206f-c843-4f99-80d6-52fbf3674958 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 1.128310 Aug 04 04:29:06.991021 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 788/1587] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:05 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:07.420818 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6caff5b2-f437-422e-80d6-818afb90639e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.578363 Aug 04 04:29:07.423040 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 800/1588] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:29:06 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 04:29:08.014616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:08.015957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:08.031860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:08.032394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:08.033240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:08.034473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:08.129343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:08.735164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:08.748306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:08.752394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:08.758149 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4eb2b1c4-7165-44f6-8b15-be59bf7be352 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 0.752097 Aug 04 04:29:08.763167 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 789/1589] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:08 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:09.586125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-cf47a9af-0d54-4cc0-9b64-cad462bdb792 req-42c4adb0-c63b-45e2-9243-07850aa8c2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-unplugged", "status": "completed", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:09.610917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cf47a9af-0d54-4cc0-9b64-cad462bdb792 req-42c4adb0-c63b-45e2-9243-07850aa8c2c9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:09.611395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cf47a9af-0d54-4cc0-9b64-cad462bdb792 req-42c4adb0-c63b-45e2-9243-07850aa8c2c9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:09.668152 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-cf47a9af-0d54-4cc0-9b64-cad462bdb792 req-42c4adb0-c63b-45e2-9243-07850aa8c2c9 service nova] Creating event network-vif-unplugged:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:29:09.686064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-cf47a9af-0d54-4cc0-9b64-cad462bdb792 req-42c4adb0-c63b-45e2-9243-07850aa8c2c9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118256 Aug 04 04:29:09.688064 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 801/1590] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:09.788579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:09.789157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:09.807284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:09.807776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:09.809954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:09.811050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:10.667813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:10.709294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:10.727516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:10.732120 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2363f2c5-aeec-42f1-9e83-446922b4598e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 0.947875 Aug 04 04:29:10.747972 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 790/1591] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:09 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:11.758852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:11.770666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:11.787170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:11.788304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:11.789541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:11.790187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:12.125955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a47fbdd7-d37a-42a8-8add-33cce19ec9b2 req-2c961dc6-c984-4b40-aa5b-974b159e9614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afb265e-c6c3-4316-a3b9-09c9d2369bf6", "name": "network-vif-plugged", "status": "completed", "tag": "dc457375-ebe1-4a91-a227-1248b241056c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:12.172139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a47fbdd7-d37a-42a8-8add-33cce19ec9b2 req-2c961dc6-c984-4b40-aa5b-974b159e9614 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:12.172625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a47fbdd7-d37a-42a8-8add-33cce19ec9b2 req-2c961dc6-c984-4b40-aa5b-974b159e9614 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:12.212229 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a47fbdd7-d37a-42a8-8add-33cce19ec9b2 req-2c961dc6-c984-4b40-aa5b-974b159e9614 service nova] Creating event network-vif-plugged:dc457375-ebe1-4a91-a227-1248b241056c for instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 on n-h2-851337-5 Aug 04 04:29:12.229530 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a47fbdd7-d37a-42a8-8add-33cce19ec9b2 req-2c961dc6-c984-4b40-aa5b-974b159e9614 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108347 Aug 04 04:29:12.230163 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 791/1592] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:12.943609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:12.957091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:12.959078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:12.966243 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd2621e0-124b-4deb-a497-6388eb31fcd5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 1.213202 Aug 04 04:29:12.990277 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 802/1593] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:11 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:13.991477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:13.992205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:14.019143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:14.019680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:14.020511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:14.020961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:15.229131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:15.243185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:15.248079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:15.250136 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8b4d097-1fa4-4517-93a6-f37aa4796df4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1280 microversion: 2.25 time: 1.263788 Aug 04 04:29:15.254803 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 792/1594] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:13 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1280 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:16.275895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:16.277030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:16.279503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=36 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:16.293438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:16.293934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:16.294847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:16.305154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:17.502885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:17.549123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:17.574349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:17.579743 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-792b7acd-6363-4821-8c94-48eecb9b34f7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1476 microversion: 2.25 time: 1.304368 Aug 04 04:29:17.591131 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 803/1595] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:16 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1476 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:17.617575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:17.618900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:17.637123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:17.644597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:17.646141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:17.647298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:18.018691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:29:18.038683 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3fb63a91-7a12-46b2-8e7a-84cd51a1d9b0 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1968 microversion: 2.25 time: 0.426225 Aug 04 04:29:18.055768 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 793/1596] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:17 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1968 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:18.067420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:18.068344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:18.076122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:18.076932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:18.078000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:18.078661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:18.319167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:29:18.354857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8655169a-ec8c-47f8-a8ce-b7541465b3be tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1968 microversion: 2.25 time: 0.289541 Aug 04 04:29:18.373456 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 804/1597] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:18 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1968 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:18.403946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-713cca82-19fb-49fc-9108-4047b9419b70 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:18.411191 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:29:18.411191 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:29:18.417340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-713cca82-19fb-49fc-9108-4047b9419b70 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:18.418170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-713cca82-19fb-49fc-9108-4047b9419b70 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:18.419918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-713cca82-19fb-49fc-9108-4047b9419b70 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:18.421369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-713cca82-19fb-49fc-9108-4047b9419b70 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:18.491079 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-713cca82-19fb-49fc-9108-4047b9419b70 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.091472 Aug 04 04:29:18.502968 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 805/1598] 10.222.0.69 () {60 vars in 1217 bytes} [Thu Aug 4 04:29:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:29:18.513132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851337-5", "block_migration": "auto"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:18.535628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:18.543153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:18.543855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:18.545181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:18.546620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:18.594487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'flavor' on Instance uuid 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:29:18.657462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Going to try to live migrate instance to n-h1-851337-5 {{(pid=119343) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:29:18.727324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ee4c9b78-38b7-427b-988c-4de1f153c454 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f1919fa2a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2022981900", "description": "tempest-description-55499142"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:18.783316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:19.262982 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ee4c9b78-38b7-427b-988c-4de1f153c454 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.121695 Aug 04 04:29:19.267643 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 794/1599] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:29:18 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:19.274039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67c0778e-5434-44e2-a521-e60315195d3d tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:19.274872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67c0778e-5434-44e2-a521-e60315195d3d tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:19.284392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=43 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:19.311265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67c0778e-5434-44e2-a521-e60315195d3d tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:19.312347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67c0778e-5434-44e2-a521-e60315195d3d tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:19.313182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67c0778e-5434-44e2-a521-e60315195d3d tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:19.313660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67c0778e-5434-44e2-a521-e60315195d3d tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:19.700838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67c0778e-5434-44e2-a521-e60315195d3d tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1857 microversion: 2.1 time: 0.431779 Aug 04 04:29:19.763081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 795/1600] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:19 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1857 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:19.794844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b76b6266-8347-4335-9eec-026aa1445fea tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191a03baf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1933244729", "description": "tempest-description-358059963"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:20.103778 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b76b6266-8347-4335-9eec-026aa1445fea tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.334235 Aug 04 04:29:20.115997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 796/1601] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:29:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:20.130706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-5", "block_migration": true, "disk_over_commit": false}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:20.134163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:20.175427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:20.176644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:20.179762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:20.180914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:20.235288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lazy-loading 'flavor' on Instance uuid ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:29:20.267672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Going to try to live migrate instance to n-h2-851337-5 {{(pid=119342) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:29:23.090583 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-331c7731-ce2a-4df6-9da9-67a156cec662 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6/action" status: 202 len: 0 microversion: 2.25 time: 4.585599 Aug 04 04:29:23.091365 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 806/1602] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:29:18 2022] POST /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6/action => generated 0 bytes in 4587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:29:23.096946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1493563117", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "08d6e8c3-8a4e-49fe-9b5d-2da9c4cd6bac"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:23.292400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] validate_networks() for [('08d6e8c3-8a4e-49fe-9b5d-2da9c4cd6bac', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:29:26.022756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:29:26.023517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:29:26.023517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:29:26.024019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:29:26.024523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:29:26.059732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:26.060189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:26.061197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:26.061652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:26.198510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Getting quotas for project 2a364fd6ed2a46f2849f116d13c8556d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:29:26.228338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Getting quotas for user 04be216c81cd4a1b91d7f7a5d681eba2 and project 2a364fd6ed2a46f2849f116d13c8556d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:29:26.289464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:29:26.301163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:29:26.430015 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2cfbf83-7357-43f7-836e-6a3b513daa77 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/action" status: 202 len: 0 microversion: 2.1 time: 6.312681 Aug 04 04:29:26.430645 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 797/1603] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:29:20 2022] POST /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/action => generated 0 bytes in 6314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:29:26.444106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8f0c4977-b9c4-44d9-b4a6-8c43c41c4a0b req-958d810c-002b-4deb-aa17-aaf6be2de413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-plugged", "status": "completed", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:26.501917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8f0c4977-b9c4-44d9-b4a6-8c43c41c4a0b req-958d810c-002b-4deb-aa17-aaf6be2de413 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:26.609545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8f0c4977-b9c4-44d9-b4a6-8c43c41c4a0b req-958d810c-002b-4deb-aa17-aaf6be2de413 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.104s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:26.657511 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f168f372-d1c6-47d1-88c0-6cd4706f8331 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.565061 Aug 04 04:29:26.710662 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 807/1604] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:29:26.713541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8f0c4977-b9c4-44d9-b4a6-8c43c41c4a0b req-958d810c-002b-4deb-aa17-aaf6be2de413 service nova] Creating event network-vif-plugged:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:29:26.728179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:26.729741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:26.742162 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8f0c4977-b9c4-44d9-b4a6-8c43c41c4a0b req-958d810c-002b-4deb-aa17-aaf6be2de413 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294021 Aug 04 04:29:26.742901 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 798/1605] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:26.744698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:26.750835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:26.752347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:26.753690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:26.761032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:26.761755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:26.828319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:26.828850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:26.829753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:26.834790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:29.213525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:29.247309 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e55b19c2-d83a-485d-ae04-ec25091d2ccf tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 2.494012 Aug 04 04:29:29.266924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 799/1606] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:26 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:29.283255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:29.284465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:29.304969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:29.313329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:29.316499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:29.318815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:30.775578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:30.800037 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc3d1ba3-f422-466a-aed7-9ad976542bc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1212 microversion: 2.1 time: 1.531397 Aug 04 04:29:30.805583 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 800/1607] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:29 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1212 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:30.822425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:30.822964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:30.864034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:30.864582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:30.865476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:30.865930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:30.879233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:30.938321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:30.940404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:30.952728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b4f8d9d-45bb-4d09-b9a1-75248a18f704 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 4.240377 Aug 04 04:29:30.953340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 808/1608] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:26 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 4242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:31.001410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:31.002047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:31.039523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:31.039973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:31.040774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:31.052741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:31.054157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:29:31.395774 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-055ce955-39c9-442b-b94a-b6200f087d64 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 204 len: 0 microversion: 2.1 time: 0.588578 Aug 04 04:29:31.396404 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 801/1609] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:29:30 2022] DELETE /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:29:31.422527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:31.425702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:31.438274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:31.441088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:31.446647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:31.447839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:31.854239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:31.889812 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b5913a45-e6d6-4ed3-a717-eab4678bf23d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.905218 Aug 04 04:29:31.904205 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 809/1610] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:30 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:31.934725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:31.935728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:31.972209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:31.972468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:31.974499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:31.983578 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55ec5d79-686c-47e3-80bd-855c32e92aef tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1666 microversion: 2.1 time: 0.578475 Aug 04 04:29:31.988256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:31.989177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:31.991917 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 802/1611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:31 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1666 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:32.006535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:32.015511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:32.025841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:32.030558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:32.035353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:32.036056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:32.276819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:32.299619 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2b175c00-d873-40de-be64-5577170bdb0b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1274 microversion: 2.1 time: 0.387482 Aug 04 04:29:32.300969 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 810/1612] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:31 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1274 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:32.936463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:32.937835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:32.950475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:32.953219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:32.960256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:32.965451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:33.032000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:33.043695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:33.060009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:33.061775 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9946c525-c0f0-4acc-bee0-bcf9916183e9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 1.068655 Aug 04 04:29:33.075593 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 803/1613] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:31 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:33.095212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:33.114354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:33.142328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:33.142834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:33.143861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:33.144313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:34.339651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:34.361264 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eaddee8a-8bcb-43d8-83c1-d10463fc4683 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1666 microversion: 2.1 time: 1.280898 Aug 04 04:29:34.362245 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 804/1614] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:33 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1666 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:34.383993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:34.388479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:34.410433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:34.412705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:34.415219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:34.422605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:34.431362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:35.120321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:35.141744 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b13ab22-c5c4-48f0-abac-bb2c2f433877 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 2.200562 Aug 04 04:29:35.161596 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 811/1615] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:32 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:29:35.195835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:35.196473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:35.237438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:35.237898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:35.247477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:35.253520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:36.144319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:36.265506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:36.463218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:36.472363 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bfd6802d-415a-4193-bb6f-a9b08ba1efe6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 2.107730 Aug 04 04:29:36.480705 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 805/1616] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:34 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:36.502141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:36.503159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:36.561352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:36.565080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:36.567018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:36.574651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:36.756553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:36.775163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:36.783780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:36.789316 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-323c9677-684a-43f5-b2f1-e91a3e0612ae tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 1.622481 Aug 04 04:29:36.789920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 812/1617] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:35 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:36.805057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:36.805704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:36.845620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:36.846136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:36.851020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:36.852483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:36.857262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:36.884853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67cd4fb1-73b3-414a-82b9-89e3be665110 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1598 microversion: 2.1 time: 0.402477 Aug 04 04:29:36.914986 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 806/1618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:36 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1598 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:37.447100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:37.466449 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-39daa3f1-cd18-4b74-a6df-228772962f96 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.672125 Aug 04 04:29:37.471456 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 813/1619] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:36 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:37.502161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:37.502798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:37.521753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:37.522546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:37.540242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:37.540666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:37.790894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7c6b0adb-d958-441b-bf16-c774f2e29177 req-bd6d8cc5-296c-447c-be4f-0e0dce3b514b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4b4968-f676-446f-b205-3ffe98d273c6", "name": "network-vif-deleted", "tag": "c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:37.846633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7c6b0adb-d958-441b-bf16-c774f2e29177 req-bd6d8cc5-296c-447c-be4f-0e0dce3b514b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:37.855986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7c6b0adb-d958-441b-bf16-c774f2e29177 req-bd6d8cc5-296c-447c-be4f-0e0dce3b514b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:37.903609 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7c6b0adb-d958-441b-bf16-c774f2e29177 req-bd6d8cc5-296c-447c-be4f-0e0dce3b514b service nova] Creating event network-vif-deleted:c74f38e4-8f0b-4a25-a8a9-b8cd3bee7d91 for instance ed4b4968-f676-446f-b205-3ffe98d273c6 on n-h2-851337-5 Aug 04 04:29:37.922010 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7c6b0adb-d958-441b-bf16-c774f2e29177 req-bd6d8cc5-296c-447c-be4f-0e0dce3b514b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135331 Aug 04 04:29:37.931229 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 814/1620] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:37.948145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:37.950458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:37.968895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:37.969665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:37.972313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:37.974247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:38.065667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:38.082813 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8090f82e-a907-459e-9474-fd1d054f2b6d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 0.585051 Aug 04 04:29:38.103182 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 807/1621] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:37 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:38.124289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:38.125326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:38.134698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:38.142429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:38.144621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:38.145067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:38.263504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:38.275127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:38.275956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lazy-loading 'fault' on Instance uuid ed4b4968-f676-446f-b205-3ffe98d273c6 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:29:38.527527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7e0b4b5ac549cbb1dce703af4c9690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53efe93fe7a643e989190f1e6a8c88cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:38.540555 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8105ccdb-01d5-48b0-8414-80d3bfbc8d7b tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 200 len: 1315 microversion: 2.1 time: 0.433923 Aug 04 04:29:38.552231 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 808/1622] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:38 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:38.638673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:38.661286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:38.671408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:38.672965 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0bcb8162-b623-4b66-97dd-b35bf5e51829 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.740053 Aug 04 04:29:38.694075 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 815/1623] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:37 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:38.701038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:38.717530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:38.750852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3263a657-5c65-46ae-882f-e6e63544421d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: .version_select at 0x7f1919f19160>, body: {"keypair": {"name": "tempest-keypair-589754822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXZ5bmkMkyx0w+XhRanqxkni9RBqm6QNaDxUt5Terd94btO5AM8BKK5BbOHdKHeKwrEb9+1U3qXSSJ78WASlQluUw3Dw7WKg72Hd6y2D23t7d28FOYvY1dl3wA6yt+zUQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:38.764463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:38.766839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:38.767830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:38.771477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:38.825915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3263a657-5c65-46ae-882f-e6e63544421d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:29:38.853236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3263a657-5c65-46ae-882f-e6e63544421d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:29:38.944823 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3263a657-5c65-46ae-882f-e6e63544421d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.391065 Aug 04 04:29:38.945624 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 809/1624] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:29:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:39.113155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:39.113946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:39.136657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:39.136657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:39.136657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:39.143598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:39.265872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:39.284778 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f1aca747-7d84-4130-b16b-6954d3d18262 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.589335 Aug 04 04:29:39.291123 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 816/1625] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:38 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:39.580432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:39.582005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] [instance: ed4b4968-f676-446f-b205-3ffe98d273c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:39.645334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:39.650072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:39.657625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:39.661636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:39.739821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] HTTP exception thrown: Instance ed4b4968-f676-446f-b205-3ffe98d273c6 could not be found. Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Request method failure captured: Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 HTTP/1.1 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60rq_7bH2Om3Vm8nVc_Xmvpu18stUZ3xGjw4dTfklDH39A8yVn_GRe-oSgpnNV03KoLeyCvitxZckBO7krw-itye6A4Gw3q6f6H1wrqGYbf5orYZNXhXd-JmL_2OScJ0E4cQMzIKImOD9DDskn0NecDbasig5uzUSo7TlCAc_M2st64 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 53efe93fe7a643e989190f1e6a8c88cc Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestFqdnHostnames-1423489247 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53efe93fe7a643e989190f1e6a8c88cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/53efe93fe7a643e989190f1e6a8c88cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53efe93fe7a643e989190f1e6a8c88cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_53efe93fe7a643e989190f1e6a8c88cc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestFqdnHostnames-1423489247 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 53efe93fe7a643e989190f1e6a8c88cc Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1423489247 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestFqdnHostnames-1423489247-project Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: dd7e0b4b5ac549cbb1dce703af4c9690 Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestFqdnHostnames-1423489247-project Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance ed4b4968-f676-446f-b205-3ffe98d273c6 could not be found. Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'ed4b4968-f676-446f-b205-3ffe98d273c6'} Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4b4968-f676-446f-b205-3ffe98d273c6 could not be found. Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4b4968-f676-446f-b205-3ffe98d273c6 could not be found. Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:29:39.751352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:29:39.757056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:29:39.757056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:29:39.757056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:29:39.757056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:29:39.757056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:29:39.757056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4b4968-f676-446f-b205-3ffe98d273c6 could not be found. Aug 04 04:29:39.757056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:29:39.761296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Returning 404 to user: Instance ed4b4968-f676-446f-b205-3ffe98d273c6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:29:39.769062 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4532146a-7011-4a16-a0b3-27b9f6976479 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6" status: 404 len: 111 microversion: 2.1 time: 0.196570 Aug 04 04:29:39.771177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 817/1626] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:39 2022] GET /compute/v2.1/servers/ed4b4968-f676-446f-b205-3ffe98d273c6 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:29:39.790320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:39.804713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:39.807945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:39.808393 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2dc54f8e-6eee-45bf-9290-ac103dea78ff tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 0.698640 Aug 04 04:29:39.811756 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 810/1627] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:39 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:39.836815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f3c9927-c53d-4ec0-821c-28c1fa9050f5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] Calling method '.version_select at 0x7f1919f6c160>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:39.842225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:39.846465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:39.852470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:39.854475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:39.919082 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f3c9927-c53d-4ec0-821c-28c1fa9050f5 tempest-ServersTestFqdnHostnames-1423489247 tempest-ServersTestFqdnHostnames-1423489247-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-336772671" status: 202 len: 0 microversion: 2.1 time: 0.102752 Aug 04 04:29:39.923326 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 811/1628] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:29:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-336772671 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:29:40.082677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b1b9e196-d042-445f-a356-1671b703ea47 req-e04f455b-c027-4275-84d7-60ab339b8b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf836cb-a8af-4574-9b76-a85b36799229", "tag": "b27126bb-829e-4b19-8153-6d22f289286d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:40.169882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b1b9e196-d042-445f-a356-1671b703ea47 req-e04f455b-c027-4275-84d7-60ab339b8b6f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:40.172160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b1b9e196-d042-445f-a356-1671b703ea47 req-e04f455b-c027-4275-84d7-60ab339b8b6f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:40.236921 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b1b9e196-d042-445f-a356-1671b703ea47 req-e04f455b-c027-4275-84d7-60ab339b8b6f service nova] Creating event network-changed:b27126bb-829e-4b19-8153-6d22f289286d for instance ebf836cb-a8af-4574-9b76-a85b36799229 on n-h1-851337-5 Aug 04 04:29:40.268242 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b1b9e196-d042-445f-a356-1671b703ea47 req-e04f455b-c027-4275-84d7-60ab339b8b6f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181137 Aug 04 04:29:40.274425 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 812/1629] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:40.316375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:40.316758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:40.331842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:40.344245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:40.346676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:40.347246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:41.144454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:41.155400 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e7178994-5948-495d-8a30-5460c4dae3b4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.845252 Aug 04 04:29:41.156063 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 813/1630] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:40 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:29:41.191704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:41.192281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:41.215220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:41.230633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:41.236818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:41.238569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:41.239552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:41.240592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:41.241048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:41.246934 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-42e51443-0299-45a8-8dda-3e29be9dca88 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 1.473121 Aug 04 04:29:41.256406 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 818/1631] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:39 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:41.860963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:41.895751 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-40c719e9-6c39-4407-93b0-8c6ee33ce496 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 0.715509 Aug 04 04:29:41.900636 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 814/1632] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:41 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:42.177820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:42.178414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:42.198131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:42.198627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:42.199505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:42.199950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:42.287342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:42.288218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:42.321046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:42.323451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:42.325547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:42.342080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:43.040231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:43.064615 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8a3b7d6e-43b3-4dc8-9497-e85a1169681f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.889585 Aug 04 04:29:43.071322 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 819/1633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:42 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:43.094919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:43.114073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:43.136679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:43.143296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:43.144640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:43.147574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:43.347370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:43.363479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:43.369959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:43.373712 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-86c819a5-f5b5-4310-a1a6-10ad77a9317e tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 1.092002 Aug 04 04:29:43.374917 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 815/1634] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:42 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:29:43.809689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:43.833285 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cad653e9-29dd-4aa9-a06a-b4a4d927fb9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 0.750829 Aug 04 04:29:43.835661 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 820/1635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:43 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:44.096450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:44.098929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:44.117028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:44.120775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:44.123785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:44.126277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:44.405843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:44.407882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:44.446048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:44.450109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:44.453022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:44.456864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:46.604779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:46.623402 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0d17a726-2153-4e14-b6cb-764f53296f9b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 2.528226 Aug 04 04:29:46.627695 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 816/1636] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:44 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:29:46.647001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1726428969", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99037335-254b-4262-8aa6-b4fe7cbe9d37"}], "security_groups": [{"name": "tempest-securitygroup--958313923"}], "key_name": "tempest-keypair-589754822", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:46.918457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:46.939777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:46.943598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:46.945245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b26053a1-efe7-4a60-b2fa-38c8ae73a498 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 2.548755 Aug 04 04:29:46.946981 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 821/1637] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:44 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:46.954238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:46.956917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:46.963362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:46.965414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:46.966142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:46.968011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:46.968838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:47.650604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:47.678270 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-600e3665-7c28-4c11-9880-408d9165ab23 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 0.726519 Aug 04 04:29:47.680800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 822/1638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:46 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:47.695727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:47.697209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:47.713257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:47.714904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:47.718419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] validate_networks() for [('99037335-254b-4262-8aa6-b4fe7cbe9d37', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:29:47.719163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:47.719811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:48.788149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:48.801293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a77891d0-a4b0-4055-ba85-ea01827b1327 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 1.117611 Aug 04 04:29:48.802927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 823/1639] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:47 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:48.815793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:48.822783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:48.844862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:48.844862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:48.844862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:48.844862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:48.897661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:48.908468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:49.543361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:49.555232 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-282eae4e-8a5b-4fbc-8bc5-066e60643359 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.750962 Aug 04 04:29:49.562744 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 824/1640] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:48 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:49.580688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:49.581904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:49.588987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:49.592172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:49.593157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:49.595102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:49.800953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:29:49.801376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:29:49.801850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:29:49.802565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:29:49.803008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:29:49.805537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:49.824507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:49.827357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:49.828225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:49.828677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:49.876839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:29:49.896513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:29:49.925294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:29:49.928973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:29:50.056056 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33d0c904-d20e-4510-aa7b-65cc2d64f421 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.425528 Aug 04 04:29:50.059721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 817/1641] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:29:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 3430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:29:50.070145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:50.071090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:50.089774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:50.090499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:50.092422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:50.093045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:50.637462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:50.652702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:50.654622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:50.659258 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9803be2c-3f30-4192-97db-c2015df098b9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 1.094336 Aug 04 04:29:50.663057 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 825/1642] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:49 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:50.683137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:50.683330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:50.706630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:50.707105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:50.708156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:50.708337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:50.866164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:50.878533 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c3773dd9-b3a3-4ac7-9706-b8eb50db7da1 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 0.817337 Aug 04 04:29:50.898322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 818/1643] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:50 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:50.913136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e08f73d-5f9a-4f6a-8046-1e815c501c41 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:50.914098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e08f73d-5f9a-4f6a-8046-1e815c501c41 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:51.159512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e08f73d-5f9a-4f6a-8046-1e815c501c41 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:51.173078 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e08f73d-5f9a-4f6a-8046-1e815c501c41 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1241 microversion: 2.1 time: 0.273311 Aug 04 04:29:51.176135 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 819/1644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:50 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1241 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:51.189700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:51.190619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:51.222671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:51.226662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:51.228098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:51.228921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:51.590550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:51.604200 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-05507581-2856-4fe7-82bc-4345b5429120 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.939825 Aug 04 04:29:51.635238 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 826/1645] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:50 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:51.637275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6ef67f52-57c0-42b1-8999-bed26edca424 req-471390e4-4042-4ead-9ead-5f525ff1c195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf836cb-a8af-4574-9b76-a85b36799229", "name": "network-vif-plugged", "status": "completed", "tag": "b27126bb-829e-4b19-8153-6d22f289286d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:51.670662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6ef67f52-57c0-42b1-8999-bed26edca424 req-471390e4-4042-4ead-9ead-5f525ff1c195 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:51.673018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6ef67f52-57c0-42b1-8999-bed26edca424 req-471390e4-4042-4ead-9ead-5f525ff1c195 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:51.718085 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6ef67f52-57c0-42b1-8999-bed26edca424 req-471390e4-4042-4ead-9ead-5f525ff1c195 service nova] Creating event network-vif-plugged:b27126bb-829e-4b19-8153-6d22f289286d for instance ebf836cb-a8af-4574-9b76-a85b36799229 on n-h1-851337-5 Aug 04 04:29:51.741826 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6ef67f52-57c0-42b1-8999-bed26edca424 req-471390e4-4042-4ead-9ead-5f525ff1c195 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098713 Aug 04 04:29:51.742982 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 827/1646] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:51.765591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd18917b-fb8e-40a3-9c05-8f45fdb6d982 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1045481749"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:51.768830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd18917b-fb8e-40a3-9c05-8f45fdb6d982 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:51.790244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:51.801471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35b6e43f-711e-4592-b694-d8c7e0e4655c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.623569 Aug 04 04:29:51.802326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd18917b-fb8e-40a3-9c05-8f45fdb6d982 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:51.803128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd18917b-fb8e-40a3-9c05-8f45fdb6d982 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:51.806112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd18917b-fb8e-40a3-9c05-8f45fdb6d982 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:51.808456 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 820/1647] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:51 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:51.808833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd18917b-fb8e-40a3-9c05-8f45fdb6d982 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:51.814432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:51.815633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:51.825039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:51.826403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:51.827415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:51.829518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:52.231946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:52.259326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:52.261235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:52.267632 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b857c56d-2904-4ba4-98fb-22a4bf900d8f tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.457657 Aug 04 04:29:52.277281 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 821/1648] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:51 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:52.291622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:52.292975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:52.324018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:52.324487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:52.325305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:52.326282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:52.944252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:52.957544 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32639f61-b605-4e69-8b67-b5292dde9765 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1316 microversion: 2.1 time: 0.678376 Aug 04 04:29:52.975212 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 822/1649] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:52 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:52.981460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:52.985072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:53.000238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:53.002335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:53.004129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:53.006793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:53.217118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:53.230416 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-539c391d-e95b-4be0-a7a1-dc0c583e5096 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1299 microversion: 2.1 time: 0.253505 Aug 04 04:29:53.238198 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 823/1650] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:52 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:53.244463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:53.252607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:53.272572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:53.277655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:53.279989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:53.283367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:53.947399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:53.962642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8d92120-aa7c-42c2-9228-45a3495ccfb8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.716354 Aug 04 04:29:53.976166 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 824/1651] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:53 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:53.989378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:53.990306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:54.003878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:54.009421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:54.010513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:54.011172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:54.726092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:54.734738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:54.751529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:54.755763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:54.758625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e620a4a-43ac-4a85-a4f4-ff912788a634 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.781124 Aug 04 04:29:54.760190 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 825/1652] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:53 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:54.783096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-01e8a9a9-d511-403e-939a-d6b8319ba954 req-58ec76d9-100f-402b-8b0c-c3b9e95d1afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-unplugged", "status": "completed", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:54.811591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-01e8a9a9-d511-403e-939a-d6b8319ba954 req-58ec76d9-100f-402b-8b0c-c3b9e95d1afc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:54.815356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-01e8a9a9-d511-403e-939a-d6b8319ba954 req-58ec76d9-100f-402b-8b0c-c3b9e95d1afc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:54.870018 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-01e8a9a9-d511-403e-939a-d6b8319ba954 req-58ec76d9-100f-402b-8b0c-c3b9e95d1afc service nova] Creating event network-vif-unplugged:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:29:54.914094 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-01e8a9a9-d511-403e-939a-d6b8319ba954 req-58ec76d9-100f-402b-8b0c-c3b9e95d1afc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125232 Aug 04 04:29:54.917516 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 826/1653] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:29:54.941351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:54.942390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:54.966571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:54.969227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:54.973284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:54.974183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:55.818532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:55.835091 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1e63917d-fb0b-4234-b699-9eb0be0a6b7c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1504 microversion: 2.1 time: 0.907787 Aug 04 04:29:55.838000 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 827/1654] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:54 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1504 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:55.866735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:55.869045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:55.886864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:55.888621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:55.890905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:55.894146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:56.398544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:56.414718 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b0afa6c-b864-485f-8b2f-d4d1a3b5f906 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1366 microversion: 2.1 time: 0.571537 Aug 04 04:29:56.426545 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 828/1655] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:55 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:56.441910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:56.443426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:56.457141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:56.459237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:56.460423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:56.461050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:57.106791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:57.128085 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7aedffa-1ae6-4738-b398-50361083d546 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.687147 Aug 04 04:29:57.143060 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 829/1656] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:56 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:29:57.150546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:57.151513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:57.183596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:57.186549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:57.189888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:57.190361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:58.015270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:58.036466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:58.047552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:29:58.052594 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a79a4b7-ae84-4243-badb-ef115bd03848 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.918889 Aug 04 04:29:58.065047 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 830/1657] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:29:57 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:29:58.092588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2022981900"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:29:58.097221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:58.130695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:58.134607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:58.138143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:58.139590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:58.815772 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.network.security_group_api [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Adding security group 3e0bd1fa-f5e8-4c79-bfa2-5474b805b273 to port b27126bb-829e-4b19-8153-6d22f289286d Aug 04 04:29:59.564850 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd18917b-fb8e-40a3-9c05-8f45fdb6d982 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 7.816311 Aug 04 04:29:59.568186 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 828/1658] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:29:51 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 7823 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 04:29:59.579106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:29:59.581741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:29:59.599252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:59.600932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:59.602278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:29:59.603929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:29:59.851002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:00.030816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:00.045898 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d2dd2aa3-61d0-4355-8556-f106ca7f761c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1366 microversion: 2.1 time: 0.473718 Aug 04 04:30:00.061934 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 829/1659] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:29:59 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:00.067205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b937399f-e7ba-4149-9464-bc9e30320bba req-0ec9404d-67e1-4cd0-9d13-ebda67e998d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afb265e-c6c3-4316-a3b9-09c9d2369bf6", "name": "network-vif-unplugged", "status": "completed", "tag": "dc457375-ebe1-4a91-a227-1248b241056c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:00.078400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b937399f-e7ba-4149-9464-bc9e30320bba req-0ec9404d-67e1-4cd0-9d13-ebda67e998d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:00.079132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b937399f-e7ba-4149-9464-bc9e30320bba req-0ec9404d-67e1-4cd0-9d13-ebda67e998d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:00.097663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b937399f-e7ba-4149-9464-bc9e30320bba req-0ec9404d-67e1-4cd0-9d13-ebda67e998d5 service nova] Creating event network-vif-unplugged:dc457375-ebe1-4a91-a227-1248b241056c for instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 on n-h2-851337-5 Aug 04 04:30:00.103215 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b937399f-e7ba-4149-9464-bc9e30320bba req-0ec9404d-67e1-4cd0-9d13-ebda67e998d5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039524 Aug 04 04:30:00.109875 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 830/1660] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:00.117055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:00.117773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:00.124493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:00.124935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:00.125906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:00.126506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:00.517194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:00.529482 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08b5d536-fdff-4ed6-8070-97b4cc8f208e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.417041 Aug 04 04:30:00.530792 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 831/1661] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:00 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:00.535770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1ebcb3f3-292f-4e03-b7da-7837b935284b req-424b768d-4717-4f1a-aa63-a48dd8947895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491721d5-4a6a-44c9-bb27-3dff3ce3ae79", "tag": "97471e22-4905-4b19-8122-e7420162ebba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:00.548287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1ebcb3f3-292f-4e03-b7da-7837b935284b req-424b768d-4717-4f1a-aa63-a48dd8947895 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:00.548787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1ebcb3f3-292f-4e03-b7da-7837b935284b req-424b768d-4717-4f1a-aa63-a48dd8947895 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:00.567079 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1ebcb3f3-292f-4e03-b7da-7837b935284b req-424b768d-4717-4f1a-aa63-a48dd8947895 service nova] Creating event network-changed:97471e22-4905-4b19-8122-e7420162ebba for instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 on n-h2-851337-5 Aug 04 04:30:00.574214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1ebcb3f3-292f-4e03-b7da-7837b935284b req-424b768d-4717-4f1a-aa63-a48dd8947895 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041890 Aug 04 04:30:00.577032 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 832/1662] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:00.584752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:00.585750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:00.596480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:00.597924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:00.601251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:00.611019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:00.628040 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed5012f3-df79-4603-b658-320096b7d51d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229/action" status: 202 len: 0 microversion: 2.1 time: 2.550875 Aug 04 04:30:00.629621 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 831/1663] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:29:58 2022] POST /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229/action => generated 0 bytes in 2556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:01.045116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:01.070516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:01.077631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:01.082564 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02164d3b-093b-427e-9f9e-a6f32a7fdda0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.501955 Aug 04 04:30:01.083215 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 833/1664] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:00 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:01.094141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:01.094875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:01.105575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:01.106040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:01.116448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:01.116971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:01.171431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:01.188558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07d4df00-c238-4b3d-9dae-2a1e1bfe48f3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Action: 'create', calling method: .version_select at 0x7f191aa20160>, body: {"keypair": {"name": "tempest-keypair-1939213939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/AMI6QMZPOSD/9p3mQ6okOP3KK+tgFrMA+GrxSd0Cv90tpqBc/L0NhHOpHtFKRzRodgNaFaQV651bvpWSoPEiLjqyINISJzKJ/Wu9+jFxAlWMPLNisGw8qWKKXRaw54Q=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:01.267451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d4df00-c238-4b3d-9dae-2a1e1bfe48f3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Getting quotas for project 8bf94eaa7716467888b61e00d69b953f. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:30:01.280294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d4df00-c238-4b3d-9dae-2a1e1bfe48f3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Getting quotas for user d31076ca54a542d9bfdf09c52c69741f and project 8bf94eaa7716467888b61e00d69b953f. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:30:01.371302 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07d4df00-c238-4b3d-9dae-2a1e1bfe48f3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.738827 Aug 04 04:30:01.377569 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 832/1665] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:30:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:01.394788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1933244729"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:01.396367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:01.412485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:01.414442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:01.417814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:01.418614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:01.550806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:01.564574 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5242a42-1ad6-484e-8038-f4ce05291c1d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.480061 Aug 04 04:30:01.578883 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 834/1666] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:01 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:01.578883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:01.578883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:01.587550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:01.588094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:01.590432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:01.590911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:01.821558 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.network.security_group_api [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Adding security group 80c22ce5-50c1-4b64-a9af-675592032b9d to port b27126bb-829e-4b19-8153-6d22f289286d Aug 04 04:30:02.048135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:02.058017 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0620e024-8035-4b5e-866c-6db8284714ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1366 microversion: 2.1 time: 0.490376 Aug 04 04:30:02.071440 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 835/1667] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:01 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:02.078223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:02.078850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:02.085314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:02.085776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:02.086569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:02.087113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:02.637086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:02.654691 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-256cf1fb-db90-4f74-bfa9-1be54b799c5a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.582007 Aug 04 04:30:02.656163 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 836/1668] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:02 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:02.673098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:02.673963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:02.681379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:02.681828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:02.682616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:02.683233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.019013 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-68923217-f00e-4e95-8d4d-918eee581094 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229/action" status: 202 len: 0 microversion: 2.1 time: 1.638764 Aug 04 04:30:03.019946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 833/1669] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:30:01 2022] POST /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229/action => generated 0 bytes in 1642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:03.027836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-aa4aad47-8816-410d-992f-523043d4e342 req-db161f95-df70-409a-9c3b-d6139c5838e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afb265e-c6c3-4316-a3b9-09c9d2369bf6", "tag": "dc457375-ebe1-4a91-a227-1248b241056c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:03.055981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aa4aad47-8816-410d-992f-523043d4e342 req-db161f95-df70-409a-9c3b-d6139c5838e4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.057251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aa4aad47-8816-410d-992f-523043d4e342 req-db161f95-df70-409a-9c3b-d6139c5838e4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.079140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:03.080859 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-aa4aad47-8816-410d-992f-523043d4e342 req-db161f95-df70-409a-9c3b-d6139c5838e4 service nova] Creating event network-changed:dc457375-ebe1-4a91-a227-1248b241056c for instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 on n-h2-851337-5 Aug 04 04:30:03.092447 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-aa4aad47-8816-410d-992f-523043d4e342 req-db161f95-df70-409a-9c3b-d6139c5838e4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070447 Aug 04 04:30:03.094351 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 834/1670] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:03.098276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:03.100251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:03.102193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-220b8879-ce9e-4ba6-8eae-f645d073d0f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.444819 Aug 04 04:30:03.103487 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 837/1671] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:02 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:03.111962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:03.112889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:03.119325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b06c9f45-7f7a-4696-9387-99a1ef22b82a req-f776311d-c5cb-4c17-a036-e69dae520a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf836cb-a8af-4574-9b76-a85b36799229", "tag": "b27126bb-829e-4b19-8153-6d22f289286d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:03.131595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.132055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.132859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.133300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.145003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b06c9f45-7f7a-4696-9387-99a1ef22b82a req-f776311d-c5cb-4c17-a036-e69dae520a85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.145358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b06c9f45-7f7a-4696-9387-99a1ef22b82a req-f776311d-c5cb-4c17-a036-e69dae520a85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.167145 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b06c9f45-7f7a-4696-9387-99a1ef22b82a req-f776311d-c5cb-4c17-a036-e69dae520a85 service nova] Creating event network-changed:b27126bb-829e-4b19-8153-6d22f289286d for instance ebf836cb-a8af-4574-9b76-a85b36799229 on n-h1-851337-5 Aug 04 04:30:03.185580 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b06c9f45-7f7a-4696-9387-99a1ef22b82a req-f776311d-c5cb-4c17-a036-e69dae520a85 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079627 Aug 04 04:30:03.186582 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 838/1672] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:03.192374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b17be4ff-26cb-49c0-9511-54c7fc98fce2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:03.192948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b17be4ff-26cb-49c0-9511-54c7fc98fce2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:03.214906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b17be4ff-26cb-49c0-9511-54c7fc98fce2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.219531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b17be4ff-26cb-49c0-9511-54c7fc98fce2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.220645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b17be4ff-26cb-49c0-9511-54c7fc98fce2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.227636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b17be4ff-26cb-49c0-9511-54c7fc98fce2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.558176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:03.567507 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db9ea456-0254-4b6e-840c-17e6d065ce02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1688 microversion: 2.1 time: 0.471471 Aug 04 04:30:03.584784 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 835/1673] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:03 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1688 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:03.596417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:03.602090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:03.625073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.625537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.626342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:03.627207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:03.655079 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b17be4ff-26cb-49c0-9511-54c7fc98fce2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.466264 Aug 04 04:30:03.656411 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 839/1674] 10.222.0.69 () {58 vars in 1293 bytes} [Thu Aug 4 04:30:03 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229/os-security-groups => generated 1156 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:03.678091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-94229206", "imageRef": "3b2c4aa8-6ef9-4a1c-b6da-ed619f436107", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "672aa1c6-b26a-4e72-a221-febd0c2c4a2f"}], "security_groups": [{"name": "tempest-securitygroup--966165925"}], "key_name": "tempest-keypair-1939213939", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:03.932744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] validate_networks() for [('672aa1c6-b26a-4e72-a221-febd0c2c4a2f', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:30:03.948282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:03.965211 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07e5d2d7-fbfd-474f-b89c-054a104064dc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1366 microversion: 2.1 time: 0.366439 Aug 04 04:30:03.966538 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 836/1675] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:03 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:03.978787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6c83c481-a2cd-4d5f-beb6-9993fab0866b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191a250040>, body: {"security_group": {"name": " tempest-securitygroup -9983959 ", "description": "tempest-description-894289374"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:04.793026 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6c83c481-a2cd-4d5f-beb6-9993fab0866b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.824694 Aug 04 04:30:04.795900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 837/1676] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:30:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:04.810274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:04.810916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:04.835858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:04.836535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:04.838120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:04.839404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:05.439923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:05.456220 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-86442af5-6eae-47ac-a8da-7c4fcb134b99 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.658216 Aug 04 04:30:05.471542 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 838/1677] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:04 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:05.471542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:05.486970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:05.508030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:05.509832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:05.512214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:05.513746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:05.546505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:30:05.547106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:30:05.547455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:30:05.548071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:30:05.548728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:30:05.567088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:05.567847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:05.572106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:05.573076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:05.664228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Getting quotas for project 8bf94eaa7716467888b61e00d69b953f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:30:05.686442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Getting quotas for user d31076ca54a542d9bfdf09c52c69741f and project 8bf94eaa7716467888b61e00d69b953f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:30:05.756967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:30:05.769647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b2c4aa8-6ef9-4a1c-b6da-ed619f436107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:30:05.917729 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf792f15-afff-4107-994e-37aace0f0e73 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.259972 Aug 04 04:30:05.923465 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 840/1678] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:30:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:30:05.946357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:05.961990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:05.962669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:05.975955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:05.977487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:05.978686 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73b5ac1d-8e8e-42d0-a320-17fcb8d1ccf2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.516530 Aug 04 04:30:05.979301 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 839/1679] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:05 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:06.000019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.001511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:06.002540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.003907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:06.022213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a1647ba-3333-43e7-b3ff-cd8c0ff5d443 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f1919fa20d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:06.393090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a1647ba-3333-43e7-b3ff-cd8c0ff5d443 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006" status: 200 len: 220 microversion: 2.1 time: 0.389241 Aug 04 04:30:06.393684 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 840/1680] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:30:06 2022] GET /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006 => generated 220 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:06.406817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:06.407515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:06.425545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:06.431522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.436051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:06.437425 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f0676691-c2f9-4a9e-9746-8cb494c4242a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1688 microversion: 2.1 time: 0.509312 Aug 04 04:30:06.438317 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 841/1681] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:05 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1688 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:06.440783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.441241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:06.447790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ed16caef-4ac5-4da6-986d-4558a34df704 req-c08f8715-f253-4698-8238-d8792ae71974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491721d5-4a6a-44c9-bb27-3dff3ce3ae79", "name": "network-vif-plugged", "status": "completed", "tag": "97471e22-4905-4b19-8122-e7420162ebba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:06.471403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ed16caef-4ac5-4da6-986d-4558a34df704 req-c08f8715-f253-4698-8238-d8792ae71974 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.474373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ed16caef-4ac5-4da6-986d-4558a34df704 req-c08f8715-f253-4698-8238-d8792ae71974 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:06.500219 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ed16caef-4ac5-4da6-986d-4558a34df704 req-c08f8715-f253-4698-8238-d8792ae71974 service nova] Creating event network-vif-plugged:97471e22-4905-4b19-8122-e7420162ebba for instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 on n-h2-851337-5 Aug 04 04:30:06.548811 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ed16caef-4ac5-4da6-986d-4558a34df704 req-c08f8715-f253-4698-8238-d8792ae71974 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109032 Aug 04 04:30:06.557380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 842/1682] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:06.578328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-63a9d890-a3d2-4e04-8af6-b394e567908f req-6bda2731-ea67-460a-9643-b851f091bbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf836cb-a8af-4574-9b76-a85b36799229", "tag": "b27126bb-829e-4b19-8153-6d22f289286d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:06.629628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-63a9d890-a3d2-4e04-8af6-b394e567908f req-6bda2731-ea67-460a-9643-b851f091bbe7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.633808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-63a9d890-a3d2-4e04-8af6-b394e567908f req-6bda2731-ea67-460a-9643-b851f091bbe7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:06.668144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-63a9d890-a3d2-4e04-8af6-b394e567908f req-6bda2731-ea67-460a-9643-b851f091bbe7 service nova] Creating event network-changed:b27126bb-829e-4b19-8153-6d22f289286d for instance ebf836cb-a8af-4574-9b76-a85b36799229 on n-h1-851337-5 Aug 04 04:30:06.688528 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-63a9d890-a3d2-4e04-8af6-b394e567908f req-6bda2731-ea67-460a-9643-b851f091bbe7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122946 Aug 04 04:30:06.690389 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 843/1683] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:06.707278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88da25af-20ef-4a17-a789-d412d04ed6c9 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:06.708009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-88da25af-20ef-4a17-a789-d412d04ed6c9 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:06.911358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-88da25af-20ef-4a17-a789-d412d04ed6c9 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:06.916264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:06.926123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-88da25af-20ef-4a17-a789-d412d04ed6c9 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1244 microversion: 2.1 time: 0.234111 Aug 04 04:30:06.928541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a7982261-1946-48a7-894c-72a4f288716e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1366 microversion: 2.1 time: 0.528460 Aug 04 04:30:06.928830 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 844/1684] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:06 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1244 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:06.929241 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 841/1685] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:06 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:06.937056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:06.937935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:06.951037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51cacaaf-bfad-431c-8497-99fc710408ec tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f19204fe3a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:06.973442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.974105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:06.984769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:06.985225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:07.420129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:07.435917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83c2ddad-7d42-4f24-9b17-8d89cd5b815b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.503633 Aug 04 04:30:07.437069 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 842/1686] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:06 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:07.444189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:07.444998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:07.459213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:07.460283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:07.461934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:07.462642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:07.714768 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51cacaaf-bfad-431c-8497-99fc710408ec tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006" status: 202 len: 0 microversion: 2.1 time: 0.781532 Aug 04 04:30:07.715996 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 845/1687] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:30:06 2022] DELETE /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006 => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:07.721649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:07.722501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:07.724002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:07.740806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:07.742342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:07.744047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:07.744285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:07.745497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:07.748460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:07.749907 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02381f0d-10bc-4188-9b70-4c2b9a366fec tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.310993 Aug 04 04:30:07.770246 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 843/1688] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:07 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:07.776799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b710b335-4e70-4d2d-a28e-6655d466097e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a250430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:07.795819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:07.848365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-b710b335-4e70-4d2d-a28e-6655d466097e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:30:07.850684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-b710b335-4e70-4d2d-a28e-6655d466097e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group f74d524c-31a3-4cdc-b88c-6ba4165db006 not found {{(pid=119342) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:30:07.851990 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b710b335-4e70-4d2d-a28e-6655d466097e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:30:07.851990 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-003354ed-55a9-441d-92f1-20c0f61ecfa4'] Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b710b335-4e70-4d2d-a28e-6655d466097e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006 HTTP/1.1 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-003354ed-55a9-441d-92f1-20c0f61ecfa4'] Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f74d524c-31a3-4cdc-b88c-6ba4165db006'} Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:30:07.854913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003354ed-55a9-441d-92f1-20c0f61ecfa4'] Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003354ed-55a9-441d-92f1-20c0f61ecfa4'] Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003354ed-55a9-441d-92f1-20c0f61ecfa4'] Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003354ed-55a9-441d-92f1-20c0f61ecfa4'] Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b710b335-4e70-4d2d-a28e-6655d466097e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-003354ed-55a9-441d-92f1-20c0f61ecfa4'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:30:07.860355 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b710b335-4e70-4d2d-a28e-6655d466097e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006" status: 404 len: 194 microversion: 2.1 time: 0.087970 Aug 04 04:30:07.865328 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 844/1689] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:30:07 2022] GET /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:30:07.878381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a8c6190-b57a-4065-9f8a-086c8622e6e2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191a495040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1387948675", "description": "tempest-description-1261947390"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:08.087028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:08.097918 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b61c5532-d41b-4b4d-8c28-9fd0a17cea95 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1688 microversion: 2.1 time: 0.380487 Aug 04 04:30:08.098612 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 846/1690] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:07 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1688 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:08.103301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:08.106988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:08.125267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:08.126652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:08.129134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:08.129759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:08.438456 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4a8c6190-b57a-4065-9f8a-086c8622e6e2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.564678 Aug 04 04:30:08.447812 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 845/1691] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:30:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:08.454125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:08.454751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:08.463873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:08.464586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:08.465528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:08.466156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:08.552633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:08.561773 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-890cc506-7ced-4b50-9d61-df14d483da81 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1366 microversion: 2.1 time: 0.461887 Aug 04 04:30:08.566765 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 847/1692] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:08 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:08.582599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84c95c39-b02e-4b4d-92b6-0a286d8285f0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191aad34c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2113975126", "description": "tempest-description-703176717"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:08.681872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:08.705256 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50822fed-2594-40f1-b660-7036e8d01310 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1296 microversion: 2.1 time: 0.254775 Aug 04 04:30:08.707620 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 846/1693] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:08 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1296 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:08.722741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:08.723393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:08.733470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:08.734242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:08.735282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:08.735919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:09.649759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:09.680599 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69adf0dd-1d2f-4551-ae21-f4a2b1df097c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.967456 Aug 04 04:30:09.687566 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 847/1694] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:08 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:09.698589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:09.701201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:09.714456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:09.718443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:09.719946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:09.721705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:09.761754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84c95c39-b02e-4b4d-92b6-0a286d8285f0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.193395 Aug 04 04:30:09.769463 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 848/1695] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:30:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:09.791608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:09.794859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:09.804836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:09.805564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:09.807076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:09.807686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:10.540374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:10.562836 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b85c0af-ef23-43f5-a7b9-27befc10f337 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.782214 Aug 04 04:30:10.565796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 849/1696] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:09 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:10.582895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-49639b89-f90e-4f03-a08d-700f5a4799ca req-132d4732-5da2-4dd6-b782-0ddc73edb16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-plugged", "status": "completed", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:10.610065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-49639b89-f90e-4f03-a08d-700f5a4799ca req-132d4732-5da2-4dd6-b782-0ddc73edb16b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:10.611072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-49639b89-f90e-4f03-a08d-700f5a4799ca req-132d4732-5da2-4dd6-b782-0ddc73edb16b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:10.636539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:10.638476 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-49639b89-f90e-4f03-a08d-700f5a4799ca req-132d4732-5da2-4dd6-b782-0ddc73edb16b service nova] Creating event network-vif-plugged:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:30:10.656193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-49639b89-f90e-4f03-a08d-700f5a4799ca req-132d4732-5da2-4dd6-b782-0ddc73edb16b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085279 Aug 04 04:30:10.657494 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 850/1697] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:10.667729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:10.669899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:10.671158 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ac4ab08d-8636-4cdb-9b71-85834d31dab7 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.981724 Aug 04 04:30:10.676848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 848/1698] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:09 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:10.682567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-65acc035-22ce-44f9-9df7-acd549d745fa req-552e0576-4959-4b41-9d11-6683121c6158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3", "name": "network-vif-unplugged", "status": "completed", "tag": "d71b6231-503c-4161-8202-4ace91baf877"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:10.693695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:10.694487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:10.709587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-65acc035-22ce-44f9-9df7-acd549d745fa req-552e0576-4959-4b41-9d11-6683121c6158 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:10.710391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-65acc035-22ce-44f9-9df7-acd549d745fa req-552e0576-4959-4b41-9d11-6683121c6158 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:10.711310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:10.711822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:10.712644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:10.713118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:10.741385 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-65acc035-22ce-44f9-9df7-acd549d745fa req-552e0576-4959-4b41-9d11-6683121c6158 service nova] Creating event network-vif-unplugged:d71b6231-503c-4161-8202-4ace91baf877 for instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 on n-h1-851337-5 Aug 04 04:30:10.760330 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-65acc035-22ce-44f9-9df7-acd549d745fa req-552e0576-4959-4b41-9d11-6683121c6158 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081725 Aug 04 04:30:10.766429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 849/1699] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:10.800510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:10.801960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:10.816908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:10.819504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:10.820566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:10.826314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:10.830146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:11.190777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:11.201919 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2547dff4-01e7-4992-89fc-2af8fdb04c40 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1302 microversion: 2.1 time: 0.431170 Aug 04 04:30:11.207079 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 850/1700] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:10 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1302 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:11.225484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c601c581-b8a7-469a-8e59-662033462c9b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191a2f64c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1501145816", "description": "tempest-description-472326678"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:11.311830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:11.901541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:11.926822 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-451f75ef-4005-40ce-a0dd-3c41566de640 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1557 microversion: 2.1 time: 1.267499 Aug 04 04:30:11.928676 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 851/1701] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:10 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1557 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:11.936461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:11.937326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:11.945832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:11.946625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:11.948007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:11.948714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:12.208675 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c601c581-b8a7-469a-8e59-662033462c9b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.000109 Aug 04 04:30:12.216949 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 851/1702] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:30:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:12.223453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:12.227147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:12.239954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:12.242854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:12.244003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:12.246852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:12.789054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:12.815140 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35f73b01-9e7e-440f-bd0b-45e18d5261bc tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.879596 Aug 04 04:30:12.816395 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 852/1703] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:11 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:12.821478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:12.831965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:12.851825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:12.854710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:12.856038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:12.859880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:12.986436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:12.995245 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-562e80ce-52a4-4b8c-a4f0-a48b2ad9f1eb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.776766 Aug 04 04:30:13.013373 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 852/1704] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:12 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:13.018828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-58998875-4504-4748-a656-24f87b4a1286 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:13.030092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-58998875-4504-4748-a656-24f87b4a1286 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:13.042040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58998875-4504-4748-a656-24f87b4a1286 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:13.042780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58998875-4504-4748-a656-24f87b4a1286 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:13.044462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58998875-4504-4748-a656-24f87b4a1286 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:13.047564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58998875-4504-4748-a656-24f87b4a1286 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:13.579246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:13.589765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:13.608718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:13.613130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03431d75-d012-47f2-bc66-6efb23b5cc03 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1486 microversion: 2.25 time: 0.795447 Aug 04 04:30:13.627818 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 853/1705] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:12 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1486 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:13.660255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f51735a3-e76a-49d6-bbe1-1a16bfe32f9b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191abe3550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:13.795533 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-58998875-4504-4748-a656-24f87b4a1286 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.780529 Aug 04 04:30:13.797085 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 853/1706] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:30:13 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-interface => generated 285 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:13.802790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:13.803719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:13.829076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:13.841958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:13.842980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:13.845946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:15.103275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:15.114727 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b917e1d8-2beb-4999-b5a9-c6d7e04a11ac tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 1.316297 Aug 04 04:30:15.119450 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 854/1707] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:13 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:15.131927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-25621130-70a1-4ab3-bb61-9504ea6ee949 req-4cbd75b7-f832-44f3-b978-425d0f8f7d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3", "tag": "d71b6231-503c-4161-8202-4ace91baf877"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:15.173242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-25621130-70a1-4ab3-bb61-9504ea6ee949 req-4cbd75b7-f832-44f3-b978-425d0f8f7d04 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:15.186415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-25621130-70a1-4ab3-bb61-9504ea6ee949 req-4cbd75b7-f832-44f3-b978-425d0f8f7d04 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:15.221584 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-25621130-70a1-4ab3-bb61-9504ea6ee949 req-4cbd75b7-f832-44f3-b978-425d0f8f7d04 service nova] Creating event network-changed:d71b6231-503c-4161-8202-4ace91baf877 for instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 on n-h1-851337-5 Aug 04 04:30:15.249384 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-25621130-70a1-4ab3-bb61-9504ea6ee949 req-4cbd75b7-f832-44f3-b978-425d0f8f7d04 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120919 Aug 04 04:30:15.252476 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 855/1708] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:15.280049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:15.282797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:15.313900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:15.315656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:15.317687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:15.320720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:15.638503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:16.824027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:16.841727 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-352760d1-119a-48e4-9118-589bb4749c9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 1.579287 Aug 04 04:30:16.844802 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 856/1709] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:15 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:16.885452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:16.891014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:16.920797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:16.923737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:16.948031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:16.958599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:16.966822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:17.145862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f51735a3-e76a-49d6-bbe1-1a16bfe32f9b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 3.521167 Aug 04 04:30:17.147096 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 854/1710] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:30:13 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 3523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:17.153264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:17.153898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:17.155877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:17.178747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:17.181997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:17.185891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:17.187103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:17.457755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:17.479326 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab448275-929d-4a04-928e-724de93285a5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.621119 Aug 04 04:30:17.483460 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 857/1711] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:16 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:17.505119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:17.506119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:17.524676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:17.528008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:17.529161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:17.531564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:17.655080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:17.695204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:17.699308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:17.704547 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-729587a8-1196-43bb-ae3e-9c82d56a53ce tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1476 microversion: 2.25 time: 0.556423 Aug 04 04:30:17.711946 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 855/1712] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:17 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1476 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:17.740649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-98719cfc-ae41-4366-966b-34eeff1e5ed8 req-4b01f67d-0170-4210-b8a8-87ac9f71e5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c808db1-8983-4e22-8af7-874d85053f0d", "tag": "90f37175-7c5d-48be-a746-e74d623a1085"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:17.763739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-98719cfc-ae41-4366-966b-34eeff1e5ed8 req-4b01f67d-0170-4210-b8a8-87ac9f71e5d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:17.764964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-98719cfc-ae41-4366-966b-34eeff1e5ed8 req-4b01f67d-0170-4210-b8a8-87ac9f71e5d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:17.795520 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-98719cfc-ae41-4366-966b-34eeff1e5ed8 req-4b01f67d-0170-4210-b8a8-87ac9f71e5d6 service nova] Creating event network-changed:90f37175-7c5d-48be-a746-e74d623a1085 for instance 0c808db1-8983-4e22-8af7-874d85053f0d on n-h2-851337-5 Aug 04 04:30:17.812283 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-98719cfc-ae41-4366-966b-34eeff1e5ed8 req-4b01f67d-0170-4210-b8a8-87ac9f71e5d6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098638 Aug 04 04:30:17.823624 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 856/1713] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:17.848688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51572c0e-2f6c-4127-b3dd-58e694a53758 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a79baf0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:18.033035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:18.052182 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03f4e487-e798-4dd4-9af0-c54467352939 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.567253 Aug 04 04:30:18.053182 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 858/1714] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:17 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:18.064144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e68215e1-9a36-404d-8c11-0c505fbcefe7 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '.version_select at 0x7f191a4d85e0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:18.078833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e68215e1-9a36-404d-8c11-0c505fbcefe7 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:18.083541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e68215e1-9a36-404d-8c11-0c505fbcefe7 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:18.123128 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e68215e1-9a36-404d-8c11-0c505fbcefe7 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.067725 Aug 04 04:30:18.124158 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 859/1715] 10.222.0.69 () {60 vars in 1184 bytes} [Thu Aug 4 04:30:18 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:18.138841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c93b231b-3a47-4bdf-bc9b-cee8eee30891 req-46d00f34-e15c-4018-b9d5-631968c768c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491721d5-4a6a-44c9-bb27-3dff3ce3ae79", "tag": "97471e22-4905-4b19-8122-e7420162ebba"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:18.157768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c93b231b-3a47-4bdf-bc9b-cee8eee30891 req-46d00f34-e15c-4018-b9d5-631968c768c9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:18.158720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c93b231b-3a47-4bdf-bc9b-cee8eee30891 req-46d00f34-e15c-4018-b9d5-631968c768c9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:18.173556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c93b231b-3a47-4bdf-bc9b-cee8eee30891 req-46d00f34-e15c-4018-b9d5-631968c768c9 service nova] Creating event network-changed:97471e22-4905-4b19-8122-e7420162ebba for instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 on n-h2-851337-5 Aug 04 04:30:18.182448 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c93b231b-3a47-4bdf-bc9b-cee8eee30891 req-46d00f34-e15c-4018-b9d5-631968c768c9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056760 Aug 04 04:30:18.183776 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 860/1716] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:18.194531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:18.199426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:18.236508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:18.244373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:18.244881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:18.245727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:18.246173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:19.521556 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51572c0e-2f6c-4127-b3dd-58e694a53758 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc" status: 202 len: 0 microversion: 2.1 time: 1.693137 Aug 04 04:30:19.522845 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 857/1717] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:30:17 2022] DELETE /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc => generated 0 bytes in 1698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:19.528750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:19.529746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:19.563515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:19.565554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:19.566658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:19.568747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:19.979861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:20.002929 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1896a4a-49a8-4143-a8ca-29bade687281 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 1.812483 Aug 04 04:30:20.003786 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 861/1718] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:18 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:20.032834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:20.033496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:20.058459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:20.058919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:20.059882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:20.060598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:20.515230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] Lazy-loading 'services' on Instance uuid 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:30:20.568595 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4315f51f-0bd6-453e-9582-225546d62452 tempest-LiveAutoBlockMigrationV225Test-245549833 tempest-LiveAutoBlockMigrationV225Test-245549833-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1968 microversion: 2.25 time: 1.044209 Aug 04 04:30:20.572422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:20.584185 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c379df95-50b4-4b08-bd9d-d570a89d346e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.579447 Aug 04 04:30:20.584764 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 862/1719] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:20 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:20.593484 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 858/1720] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:19 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1968 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:20.598372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:20.599516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:20.604715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8382ef25-b169-44e9-bf06-eed3dc78b88e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a9b5c10>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:20.618076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:20.618537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:20.619372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:20.619819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:20.940817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-8382ef25-b169-44e9-bf06-eed3dc78b88e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:30:20.941462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-8382ef25-b169-44e9-bf06-eed3dc78b88e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group 819309ee-29d9-4597-96cc-9045e0307efc not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:30:20.942547 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-8382ef25-b169-44e9-bf06-eed3dc78b88e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:30:20.942547 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-6e22a234-298e-4c51-b3d6-145a51bcd15d'] Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8382ef25-b169-44e9-bf06-eed3dc78b88e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc HTTP/1.1 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-6e22a234-298e-4c51-b3d6-145a51bcd15d'] Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '819309ee-29d9-4597-96cc-9045e0307efc'} Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:30:20.945023 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e22a234-298e-4c51-b3d6-145a51bcd15d'] Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e22a234-298e-4c51-b3d6-145a51bcd15d'] Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e22a234-298e-4c51-b3d6-145a51bcd15d'] Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e22a234-298e-4c51-b3d6-145a51bcd15d'] Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8382ef25-b169-44e9-bf06-eed3dc78b88e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-6e22a234-298e-4c51-b3d6-145a51bcd15d'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8382ef25-b169-44e9-bf06-eed3dc78b88e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc" status: 404 len: 194 microversion: 2.1 time: 0.349531 Aug 04 04:30:20.953786 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 859/1721] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:30:20 2022] GET /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc => generated 194 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:30:20.967973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:20.968532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:20.994540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:21.001526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:21.003326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:21.006480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:21.358861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:30:21.401058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:21.424050 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c45fe16c-c178-47f0-a045-cddc1ed1debe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.836736 Aug 04 04:30:21.438249 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 863/1722] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:20 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:21.460504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c20adad-d966-4410-bd5c-f48e1823854f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a4d3550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:21.647610 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9bb5b6b-ba80-4363-88ec-0a8240aefe73 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 204 len: 0 microversion: 2.25 time: 0.695277 Aug 04 04:30:21.664353 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 860/1723] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:30:20 2022] DELETE /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:30:21.670331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:21.671120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:21.688684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:21.689420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:21.690400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:21.691083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:22.201281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:22.210231 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5247234-3145-4aff-892a-397100f5e11f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.544236 Aug 04 04:30:22.225333 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 861/1724] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:21 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:22.236202 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c20adad-d966-4410-bd5c-f48e1823854f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266" status: 202 len: 0 microversion: 2.1 time: 0.796516 Aug 04 04:30:22.236920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:22.237298 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 864/1725] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:30:21 2022] DELETE /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266 => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:22.237551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:22.243859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:22.246552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:22.255832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:22.256285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:22.261508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:22.264090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:22.283259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:22.287206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:22.291755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:22.293632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:22.630013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:22.638588 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d183d2f-460e-4550-888a-ecb84da83094 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.418634 Aug 04 04:30:22.648048 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 862/1726] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:22 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:22.671172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a721277-1793-4af5-a5ab-9ad9362e0b86 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a8845e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:22.910843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:22.924300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-2a721277-1793-4af5-a5ab-9ad9362e0b86 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:30:22.925634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-2a721277-1793-4af5-a5ab-9ad9362e0b86 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group 37f57182-4015-4464-83fc-ec53a2165266 not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:30:22.926146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:22.928357 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2a721277-1793-4af5-a5ab-9ad9362e0b86 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:30:22.928357 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-82967292-b494-4b95-bd76-8ca1bbe27a68'] Aug 04 04:30:22.928595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:22.931176 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3bb2b5a-f6ec-4aea-a104-732d1688874b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1482 microversion: 2.25 time: 0.692502 Aug 04 04:30:22.932133 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 865/1727] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:22 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1482 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a721277-1793-4af5-a5ab-9ad9362e0b86 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266 HTTP/1.1 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-82967292-b494-4b95-bd76-8ca1bbe27a68'] Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '37f57182-4015-4464-83fc-ec53a2165266'} Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:30:22.939315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82967292-b494-4b95-bd76-8ca1bbe27a68'] Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82967292-b494-4b95-bd76-8ca1bbe27a68'] Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82967292-b494-4b95-bd76-8ca1bbe27a68'] Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82967292-b494-4b95-bd76-8ca1bbe27a68'] Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a721277-1793-4af5-a5ab-9ad9362e0b86 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-82967292-b494-4b95-bd76-8ca1bbe27a68'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2a721277-1793-4af5-a5ab-9ad9362e0b86 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266" status: 404 len: 194 microversion: 2.1 time: 0.291440 Aug 04 04:30:22.951135 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 863/1728] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:30:22 2022] GET /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266 => generated 194 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:30:22.962739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:22.969855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:22.974464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9fe0540-aff5-4020-be2a-f0e1f64b00b0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f1921183160>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:23.015273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:23.017587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:23.021206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:23.022605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:23.388757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:23.412920 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83e54748-4f22-4ecb-b39c-f3688f50e7e5 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.474443 Aug 04 04:30:23.428378 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 866/1729] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:22 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:23.438868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:23.438868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:23.446517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:23.447340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:23.448598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:23.449292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:23.459850 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9fe0540-aff5-4020-be2a-f0e1f64b00b0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e" status: 202 len: 0 microversion: 2.1 time: 0.507825 Aug 04 04:30:23.463534 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 864/1730] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:30:22 2022] DELETE /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:23.476311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02caf1dc-5326-4d7c-93e9-4d7a6f7643e0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a4d7040>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:23.554353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-02caf1dc-5326-4d7c-93e9-4d7a6f7643e0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:30:23.555251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-02caf1dc-5326-4d7c-93e9-4d7a6f7643e0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group ccc421d6-09a2-4548-abdd-19f619dee57e not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:30:23.555880 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-02caf1dc-5326-4d7c-93e9-4d7a6f7643e0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:30:23.555880 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-0d11397f-f9e6-4b6c-bd49-52949b68ba2e'] Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02caf1dc-5326-4d7c-93e9-4d7a6f7643e0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e HTTP/1.1 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-0d11397f-f9e6-4b6c-bd49-52949b68ba2e'] Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'ccc421d6-09a2-4548-abdd-19f619dee57e'} Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:30:23.558146 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d11397f-f9e6-4b6c-bd49-52949b68ba2e'] Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d11397f-f9e6-4b6c-bd49-52949b68ba2e'] Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d11397f-f9e6-4b6c-bd49-52949b68ba2e'] Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d11397f-f9e6-4b6c-bd49-52949b68ba2e'] Aug 04 04:30:23.563846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:30:23.569000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02caf1dc-5326-4d7c-93e9-4d7a6f7643e0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:30:23.569000 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-0d11397f-f9e6-4b6c-bd49-52949b68ba2e'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:30:23.569000 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02caf1dc-5326-4d7c-93e9-4d7a6f7643e0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e" status: 404 len: 194 microversion: 2.1 time: 0.102929 Aug 04 04:30:23.579480 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 865/1731] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:30:23 2022] GET /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:30:23.589915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3b725067-fffc-451d-8c59-12473f5962d8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a88dd30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:23.990764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:24.008556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-032f983a-ab9c-426d-bd2d-a5f2773eac20 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.576513 Aug 04 04:30:24.014448 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 867/1732] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:23 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:24.031628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:24.033562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:24.055848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:24.058765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:24.062374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:24.063984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:24.139267 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3b725067-fffc-451d-8c59-12473f5962d8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.556598 Aug 04 04:30:24.140595 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 866/1733] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:30:23 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:24.167473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:24.168359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:24.184937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:24.185725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:24.189334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:24.190009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:24.294447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:24.305276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-de58a278-e6ad-44ca-ab18-a613fd4d2d2b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.288680 Aug 04 04:30:24.308747 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 868/1734] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:24 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:24.330603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d70a965-c7f1-48e1-9dbc-efc6e840d607 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191a250280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-299126141", "description": "tempest-description-1011400543"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:24.412329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:24.435201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:24.437073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:24.438657 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b47fdd4a-2839-4765-9cda-55d149b63ca0 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1440 microversion: 2.25 time: 0.274989 Aug 04 04:30:24.440967 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 867/1735] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:24 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1440 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:24.457171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:24.458873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:24.478807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:24.481853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:24.487305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:24.490680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:25.171675 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d70a965-c7f1-48e1-9dbc-efc6e840d607 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.860347 Aug 04 04:30:25.172424 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 869/1736] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:30:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:25.178245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:25.179748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:25.206319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:25.207467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:25.208662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:25.209456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:25.220190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:25.234638 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eaef307a-924d-4aa6-8550-7f1188d3338f tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.789079 Aug 04 04:30:25.236231 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 868/1737] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:24 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:25.262251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d06cf754-a873-46d3-b538-d3ca36b33e0d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191a8848b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-623296027", "description": "tempest-description-1210087007"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:25.890150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:25.903352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-efc54cc7-5204-4f4e-a7a9-44e627c3c208 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.726249 Aug 04 04:30:25.915735 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 870/1738] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:25 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:25.928033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:25.931002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:25.953633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:25.954174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:25.957731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:25.958275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:26.298561 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d06cf754-a873-46d3-b538-d3ca36b33e0d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.054681 Aug 04 04:30:26.311880 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 869/1739] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:30:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:26.320910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-af640376-8e9b-457d-a8f5-817a0cb05557 req-1082b72f-a03a-4030-9496-884383236c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afb265e-c6c3-4316-a3b9-09c9d2369bf6", "name": "network-vif-deleted", "tag": "dc457375-ebe1-4a91-a227-1248b241056c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:26.373264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-af640376-8e9b-457d-a8f5-817a0cb05557 req-1082b72f-a03a-4030-9496-884383236c1b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:26.377068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-af640376-8e9b-457d-a8f5-817a0cb05557 req-1082b72f-a03a-4030-9496-884383236c1b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:26.420448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-af640376-8e9b-457d-a8f5-817a0cb05557 req-1082b72f-a03a-4030-9496-884383236c1b service nova] Creating event network-vif-deleted:dc457375-ebe1-4a91-a227-1248b241056c for instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 on n-h1-851337-5 Aug 04 04:30:26.467507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-af640376-8e9b-457d-a8f5-817a0cb05557 req-1082b72f-a03a-4030-9496-884383236c1b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154019 Aug 04 04:30:26.471769 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 870/1740] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:26.489219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:26.489219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:26.525420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:26.543028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:26.544514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:26.547484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:26.676783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:26.685401 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3dba79a5-42c6-41e2-8875-a6bf2d680a8a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.765324 Aug 04 04:30:26.685997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 871/1741] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:25 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:26.730507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:26.732500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:26.787622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:26.789396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:26.797524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:26.798403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:26.801132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:26.818913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:26.821583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:26.823132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:26.830524 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19b0ed41-4ac7-4849-8188-fe274592123d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.352630 Aug 04 04:30:26.849133 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 871/1742] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:26 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:26.863793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-68084763", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "08d6e8c3-8a4e-49fe-9b5d-2da9c4cd6bac"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:27.184945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:27.195438 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad742bfe-7d15-4d03-8cea-c763336d5ff7 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.479505 Aug 04 04:30:27.196755 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 872/1743] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:26 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:27.205938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:27.206274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:27.213771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:27.214559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:27.215415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:27.216027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:27.638639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:27.662148 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f9a30e9d-fce8-4c64-b9c5-52e94928c56d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.460402 Aug 04 04:30:27.683297 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 873/1744] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:27 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:27.712507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:27.713311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:27.727842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:27.730458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:27.732090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:27.735752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:28.153382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:28.164362 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aca9e31d-2997-4fb8-85ce-35bb17572836 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.457732 Aug 04 04:30:28.170402 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 874/1745] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:27 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:28.188466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:28.189423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:28.208691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:28.213944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:28.215144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:28.222926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:28.388326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:28.405718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:28.416376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:28.418124 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbd7eb6b-708a-44b6-a3ce-4f0654b4d48b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.246321 Aug 04 04:30:28.422564 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 875/1746] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:28 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:28.435824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:28.438089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:28.454916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:28.458337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:28.460065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:28.462189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:28.909139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:28.926237 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7fbdb22-79b8-4031-b1ef-9e9eb4d9bce1 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.501904 Aug 04 04:30:28.939123 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 876/1747] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:28 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:28.953041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:28.953690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:28.978727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:28.986406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:28.992606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:29.003581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:29.474907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:29.492605 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aca569e2-6d74-4bdb-b42d-226e610988ba tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 0.552166 Aug 04 04:30:29.500743 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 877/1748] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:28 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:29.536632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:29.537267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:29.552488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:29.553534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:29.555347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:29.556056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:30.102610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:30.114541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6cca3f21-a05d-4b54-a166-35824eb12ca9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1683 microversion: 2.1 time: 0.612572 Aug 04 04:30:30.115965 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 878/1749] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:29 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1683 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:30.141013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] validate_networks() for [('08d6e8c3-8a4e-49fe-9b5d-2da9c4cd6bac', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:30:30.156334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:30.159790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:30.170574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:30.171414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:30.172478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:30.173149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:30.399273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:30.425545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:30.432816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:30.435992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c347133a-b502-47c0-a51a-070f0c85e91c tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.318000 Aug 04 04:30:30.451252 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 879/1750] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:30 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:30.456977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:30.463624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:30.486153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:30.488931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:30.491349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:30.494357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:31.004815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:31.016236 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffa6726d-fa1c-4abf-9d61-f49152e41954 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.563387 Aug 04 04:30:31.023066 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 880/1751] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:30 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:31.056638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:31.059324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:31.099235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:31.099774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:31.100577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:31.101080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:32.357286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:30:32.357737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:30:32.358037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:30:32.358459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:30:32.358916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:30:32.380777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:32.381234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:32.382053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:32.382508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:32.402324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:32.421328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:32.426200 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-17f557ee-9874-498e-958a-2e9f04c8e1fe tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1716 microversion: 2.1 time: 1.400337 Aug 04 04:30:32.427648 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 881/1752] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:31 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1716 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:32.445233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Getting quotas for project 2a364fd6ed2a46f2849f116d13c8556d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:30:32.448193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:32.458613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Getting quotas for user 04be216c81cd4a1b91d7f7a5d681eba2 and project 2a364fd6ed2a46f2849f116d13c8556d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:30:32.458816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:32.497609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:32.504016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:32.506276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:32.509442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:32.530402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:30:32.537810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:30:32.686947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5601e3c5-15c7-4529-802f-712703fc7ad8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.836471 Aug 04 04:30:32.691336 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 872/1753] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:30:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 5842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:30:32.707126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:32.711804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:32.728914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:32.730213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:32.740093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:32.745182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:32.907108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:32.923192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:32.930825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:32.934779 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-087f735b-b50a-497e-bcfa-ca58e5e6ee10 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.241539 Aug 04 04:30:32.942131 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 873/1754] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:32 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:32.957203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:32.965981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:32.998932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:32.999438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:33.000344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:33.000787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:33.052639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:33.085096 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a70a2672-3d6b-4c56-bcfd-7f0c5f8e9313 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.655728 Aug 04 04:30:33.093316 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 882/1755] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:32 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:33.101255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba7f3ffe-eb47-41c7-b77f-2a67b9d7bcc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:33.102237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ba7f3ffe-eb47-41c7-b77f-2a67b9d7bcc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:33.349283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ba7f3ffe-eb47-41c7-b77f-2a67b9d7bcc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:33.359274 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba7f3ffe-eb47-41c7-b77f-2a67b9d7bcc0 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1214 microversion: 2.1 time: 0.262191 Aug 04 04:30:33.359854 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 883/1756] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:33 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:33.450467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:33.452007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:33.467365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:33.468143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:33.475884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:33.476728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:33.838365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:33.858613 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-47cb3fd3-630b-483b-82df-9a0307f37538 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.915103 Aug 04 04:30:33.878467 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 874/1757] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:32 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:33.913057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:33.913697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:33.941724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:33.942176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:33.952588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:33.953052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.293979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:34.310258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5ed79092-f938-43a0-bf7a-36994e5516fa tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1706 microversion: 2.1 time: 0.863798 Aug 04 04:30:34.315049 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 884/1758] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:33 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1706 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:34.328904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:34.341226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:34.368372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.375301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.383813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.384553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.434140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:34.445405 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b7a520b-29e4-49f5-995b-ca7e6bebcb68 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.536868 Aug 04 04:30:34.451349 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 875/1759] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:33 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:30:34.460533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82b8bb7e-2087-4890-bfa5-88221cd59517 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '.version_select at 0x7f191a614c10>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:34.473067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82b8bb7e-2087-4890-bfa5-88221cd59517 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.473738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82b8bb7e-2087-4890-bfa5-88221cd59517 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.511417 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-82b8bb7e-2087-4890-bfa5-88221cd59517 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.058507 Aug 04 04:30:34.515317 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 876/1760] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:30:34 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:34.531604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:34.532359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:34.551911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.553229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.554888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.557101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.601901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:34.630112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:34.643035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:34.667027 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e572a756-61b3-4f80-a2d7-a1c7d3fe12d1 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.348376 Aug 04 04:30:34.670010 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 885/1761] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:34 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:34.685851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d2e6123-b6ee-43c8-b5bc-705f88d39fa7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:34.691437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d2e6123-b6ee-43c8-b5bc-705f88d39fa7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:34.713699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2e6123-b6ee-43c8-b5bc-705f88d39fa7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.725374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2e6123-b6ee-43c8-b5bc-705f88d39fa7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.728038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2e6123-b6ee-43c8-b5bc-705f88d39fa7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.730133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d2e6123-b6ee-43c8-b5bc-705f88d39fa7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:34.850919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:34.869674 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-716a29a8-7e59-4a42-816a-62d45fa17ae6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1210 microversion: 2.1 time: 0.346104 Aug 04 04:30:34.874930 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 877/1762] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:34 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1210 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:34.888454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ee7486d7-ae00-4be5-90f8-28b67011c370 req-0583eec8-7387-49df-9edf-2cfe5df5a9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-unplugged", "status": "completed", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:34.955526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ee7486d7-ae00-4be5-90f8-28b67011c370 req-0583eec8-7387-49df-9edf-2cfe5df5a9c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:34.969401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ee7486d7-ae00-4be5-90f8-28b67011c370 req-0583eec8-7387-49df-9edf-2cfe5df5a9c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:35.036964 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ee7486d7-ae00-4be5-90f8-28b67011c370 req-0583eec8-7387-49df-9edf-2cfe5df5a9c4 service nova] Creating event network-vif-unplugged:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:30:35.058936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ee7486d7-ae00-4be5-90f8-28b67011c370 req-0583eec8-7387-49df-9edf-2cfe5df5a9c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176162 Aug 04 04:30:35.060518 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 878/1763] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:35.066195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:35.067830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:35.084060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:35.092284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:35.093393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:35.094166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:35.303770 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d2e6123-b6ee-43c8-b5bc-705f88d39fa7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1857 microversion: 2.1 time: 0.630630 Aug 04 04:30:35.306175 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 886/1764] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:34 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1857 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:35.324735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b8c6c0f-7809-4713-8e24-947f1e39def7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:35.325810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b8c6c0f-7809-4713-8e24-947f1e39def7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:35.342595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b8c6c0f-7809-4713-8e24-947f1e39def7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:35.345869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b8c6c0f-7809-4713-8e24-947f1e39def7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:35.347256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b8c6c0f-7809-4713-8e24-947f1e39def7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:35.352046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b8c6c0f-7809-4713-8e24-947f1e39def7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:36.027378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:36.046484 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f06dee74-e377-4f82-a613-7e4db347af24 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.984347 Aug 04 04:30:36.084274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 879/1765] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:35 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:36.120336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:36.121651 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b8c6c0f-7809-4713-8e24-947f1e39def7 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1857 microversion: 2.1 time: 0.801445 Aug 04 04:30:36.128198 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 887/1766] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:35 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1857 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:30:36.131689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:36.146225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:36.157776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:36.177937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:36.178396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:36.188221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:36.202624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:36.210492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:36.210990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:36.226033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:36.226529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:36.549538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:36.586690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:36.594879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:36.614238 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f88c9681-efbb-48ed-8e42-4675a0bf86a4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.528283 Aug 04 04:30:36.627057 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 880/1767] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:36 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:36.665168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:36.680531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:36.707435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:36.707907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:36.708717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:36.709162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:36.756042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:36.768548 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-750f3bc1-cbf1-4987-95cd-97065b9df8d9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1274 microversion: 2.1 time: 0.638976 Aug 04 04:30:36.769843 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 888/1768] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:36 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1274 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:36.981566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lazy-loading 'services' on Instance uuid ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:30:37.094243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:37.094888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:37.107555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.108105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.125246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.126036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.398094 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9c15227-1fd3-4543-b887-439ab70eea8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments/08c87cbd-8e48-492e-b35f-f51b4eb39e36" status: 202 len: 0 microversion: 2.1 time: 0.769113 Aug 04 04:30:37.404473 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 881/1769] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:30:36 2022] DELETE /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments/08c87cbd-8e48-492e-b35f-f51b4eb39e36 => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:37.421887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-300ace1e-7e76-4cdd-a126-e599fe8c4d0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:37.448265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-300ace1e-7e76-4cdd-a126-e599fe8c4d0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:37.477918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-300ace1e-7e76-4cdd-a126-e599fe8c4d0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.480033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-300ace1e-7e76-4cdd-a126-e599fe8c4d0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.484528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-300ace1e-7e76-4cdd-a126-e599fe8c4d0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.486128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-300ace1e-7e76-4cdd-a126-e599fe8c4d0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.589478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:37.594365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:37.602184 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-300ace1e-7e76-4cdd-a126-e599fe8c4d0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193243 Aug 04 04:30:37.610091 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 882/1770] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:37 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:37.613600 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2eee11fd-acf9-409c-b46b-8a3d3d37eb1a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.524204 Aug 04 04:30:37.631695 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 889/1771] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:37 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:37.669655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:37.670469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:37.673731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:37.674492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:37.683070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.688592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.691104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.692080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.692637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.695222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.696148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.707872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.874941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:37.896346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:37.906235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:37.910448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3aa60b7e-669c-4c85-962a-e6b638649d0d tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.255437 Aug 04 04:30:37.912091 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 883/1772] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:37 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:37.921545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:37.927704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:37.944509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.946151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:37.948270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:37.949169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.115291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:38.118010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:38.127156 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9090a23c-5390-4289-a4e4-0fe030f9aab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.469367 Aug 04 04:30:38.130110 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 890/1773] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:37 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:38.154756 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-34c336d8-3e1e-46c6-8f92-818f3438e186 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1272 microversion: 2.1 time: 0.239284 Aug 04 04:30:38.155119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:38.155768 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 884/1774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:37 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:38.156294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:38.170898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.172607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.173696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.174857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.463487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:38.487709 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0e53cac-c05a-43d5-8c2a-e688dd1b3466 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.336481 Aug 04 04:30:38.489283 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 891/1775] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:38 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:38.514482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:38.515849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:38.538270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.539042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.540049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.540658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.624810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-625740a9-8b86-461a-815d-2ff352be46b1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:38.637874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-625740a9-8b86-461a-815d-2ff352be46b1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:38.664082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-625740a9-8b86-461a-815d-2ff352be46b1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.667041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-625740a9-8b86-461a-815d-2ff352be46b1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.668239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-625740a9-8b86-461a-815d-2ff352be46b1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.674810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-625740a9-8b86-461a-815d-2ff352be46b1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.756217 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-625740a9-8b86-461a-815d-2ff352be46b1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139721 Aug 04 04:30:38.761917 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 892/1776] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:38 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:38.772767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:38.777887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:38.797245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.797808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.802059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.815841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.888671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:38.901731 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8633b2b-226a-4202-8c48-1d5f7f60cb1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.393244 Aug 04 04:30:38.903320 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 885/1777] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:38 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:38.951876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f6190de-7433-439d-a918-fdd0ba22bd22 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:38.959079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f6190de-7433-439d-a918-fdd0ba22bd22 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:38.985539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f6190de-7433-439d-a918-fdd0ba22bd22 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.989620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f6190de-7433-439d-a918-fdd0ba22bd22 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:38.993913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f6190de-7433-439d-a918-fdd0ba22bd22 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:38.994345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f6190de-7433-439d-a918-fdd0ba22bd22 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.110265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:39.124616 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-79d6c29e-f3e1-4b57-886e-6434c3c80abe tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.360763 Aug 04 04:30:39.143333 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 893/1778] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:38 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:39.182444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:39.185822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:39.211205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.212777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.215365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.216507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.229293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f6190de-7433-439d-a918-fdd0ba22bd22 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.304896 Aug 04 04:30:39.239600 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 886/1779] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:30:38 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:39.267017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:39.270899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:39.294054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.306308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.308657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.310767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.389115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:39.407673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:39.414493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:39.419872 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cbd55c5e-bb62-4da3-b47a-fd41cbb05906 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 200 len: 1265 microversion: 2.25 time: 0.271063 Aug 04 04:30:39.432699 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 894/1780] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:39 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:39.468368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:39.472786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:39.504445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.508389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.512090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.514636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:39.515192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.528789 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01c46ed6-b6c4-4e50-8aac-cba9a7e670a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1272 microversion: 2.1 time: 0.286732 Aug 04 04:30:39.530465 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 887/1781] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:39 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:39.770798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ee6db06-362c-49bd-b74c-4f30a96020c0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:39.775062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ee6db06-362c-49bd-b74c-4f30a96020c0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:39.788969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ee6db06-362c-49bd-b74c-4f30a96020c0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.791621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ee6db06-362c-49bd-b74c-4f30a96020c0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.795062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ee6db06-362c-49bd-b74c-4f30a96020c0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:39.795708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ee6db06-362c-49bd-b74c-4f30a96020c0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:39.920058 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ee6db06-362c-49bd-b74c-4f30a96020c0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154354 Aug 04 04:30:39.922163 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 888/1782] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:39 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:40.044358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:40.059678 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42b317ab-af07-4e54-8941-c7926a2f104e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1672 microversion: 2.1 time: 0.620643 Aug 04 04:30:40.063026 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 895/1783] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:39 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1672 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:40.150816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:40.152016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:40.165839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.166726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:40.167874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.169215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:40.173128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:40.444184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:40.444732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 3afb265e-c6c3-4316-a3b9-09c9d2369bf6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:40.461724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.462171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:40.472776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.473512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:40.522408 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] HTTP exception thrown: Instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 could not be found. Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Request method failure captured: Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 HTTP/1.1 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nS7Bh1lvi1HIXpWbWKdOOf2DkzwjGPtkM_CeRG0Xf-qJGyqHQlx3Az-8nVmykPwQxTc6PDwpcuqXP5-NeNoL4zaqgDfXV-RCMWY755JzhYQu7E8gt4E8Y-22MY1VS7aVtaapYXvmQSZifcBiB1glVfwubCrXwF-l8sLhfxFTWNIoo Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_300e53e93c2a4678b2b5695d002ac286", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: eaff90b8a434488f9d2731070edf30fe Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 could not be found. Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3afb265e-c6c3-4316-a3b9-09c9d2369bf6'} Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 could not be found. Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 could not be found. Aug 04 04:30:40.524149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 could not be found. Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:30:40.529598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Returning 404 to user: Instance 3afb265e-c6c3-4316-a3b9-09c9d2369bf6 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:30:40.537831 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b093c8a2-ef11-4366-bd45-ee5438449561 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6" status: 404 len: 111 microversion: 2.25 time: 0.085629 Aug 04 04:30:40.539071 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 896/1784] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:40 2022] GET /compute/v2.1/servers/3afb265e-c6c3-4316-a3b9-09c9d2369bf6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:30:40.555307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:40.562193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:40.563824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:40.576045 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1494f4aa-959a-4a44-ad35-742e62939c3b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.429205 Aug 04 04:30:40.578460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.581180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:40.582920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.590060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:40.590316 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 889/1785] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:40 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:40.933197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6b366fe5-8493-4563-9c23-75705c9e5e37 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:40.936524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6b366fe5-8493-4563-9c23-75705c9e5e37 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:40.956858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:40.965325 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f1da2fb-f2ca-4154-ac09-c3e5107be654 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.408446 Aug 04 04:30:40.971092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b366fe5-8493-4563-9c23-75705c9e5e37 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.975636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b366fe5-8493-4563-9c23-75705c9e5e37 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:40.979808 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 897/1786] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:40 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:40.983761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b366fe5-8493-4563-9c23-75705c9e5e37 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:40.984497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b366fe5-8493-4563-9c23-75705c9e5e37 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.084394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:41.085317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:41.095917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.114844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.115892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.116502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.124678 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6b366fe5-8493-4563-9c23-75705c9e5e37 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194746 Aug 04 04:30:41.130923 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 890/1787] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:40 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:30:41.385654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:41.397685 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0608ad59-aa1d-4648-8441-340ed0f480e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1672 microversion: 2.1 time: 0.315166 Aug 04 04:30:41.411042 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 898/1788] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:41 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1672 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:41.597254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:41.597865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:41.612836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.613636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.615212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.624332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.995969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:41.998322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:42.008878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:42.009743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:42.010820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:42.011680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:42.126696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:42.197004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b319cb26-5da9-439f-8e06-1b43eaee0a0c tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.583458 Aug 04 04:30:42.208884 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 891/1789] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:41 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:42.251224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bff72ab3-e7c4-4589-9b79-6218362115b5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:42.255723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bff72ab3-e7c4-4589-9b79-6218362115b5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:42.292101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bff72ab3-e7c4-4589-9b79-6218362115b5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:42.294500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bff72ab3-e7c4-4589-9b79-6218362115b5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:42.295386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bff72ab3-e7c4-4589-9b79-6218362115b5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:42.295827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bff72ab3-e7c4-4589-9b79-6218362115b5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:42.402198 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bff72ab3-e7c4-4589-9b79-6218362115b5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190738 Aug 04 04:30:42.407021 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 892/1790] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:42 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:42.414685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:42.428688 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd2ed812-9e7d-40ef-bb7d-11740ba4e069 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.439655 Aug 04 04:30:42.439906 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 899/1791] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:41 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:42.440915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:42.441705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:42.453920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:42.458183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:42.460487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:42.461501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:42.464101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:42.524165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:42.727907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:42.737253 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fed9705f-d3d5-4f05-b194-978393e404b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1672 microversion: 2.1 time: 0.317174 Aug 04 04:30:42.738494 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 893/1792] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:42 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1672 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:43.225568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:43.226186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:43.239590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.243924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.248595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.251391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.359385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:43.419188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75973868-697c-4aa6-a97c-ff33682b0633 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:43.424612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-75973868-697c-4aa6-a97c-ff33682b0633 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:43.439923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75973868-697c-4aa6-a97c-ff33682b0633 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.442429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75973868-697c-4aa6-a97c-ff33682b0633 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.443817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75973868-697c-4aa6-a97c-ff33682b0633 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.445710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75973868-697c-4aa6-a97c-ff33682b0633 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.538036 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-75973868-697c-4aa6-a97c-ff33682b0633 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121865 Aug 04 04:30:43.545171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:43.558004 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 894/1793] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:43 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:30:43.560517 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-145e3926-6e69-43d3-b2d0-841882227c35 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.339409 Aug 04 04:30:43.564175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:43.565960 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 900/1794] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:43 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:43.581220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:43.601066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9c0aa443-9611-44b0-97b7-01c01a951d7c req-295ef411-a795-47a2-92fe-b26b0e0b1dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c808db1-8983-4e22-8af7-874d85053f0d", "name": "network-vif-plugged", "status": "completed", "tag": "90f37175-7c5d-48be-a746-e74d623a1085"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:43.608663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.611259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.612278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.612985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.628063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9c0aa443-9611-44b0-97b7-01c01a951d7c req-295ef411-a795-47a2-92fe-b26b0e0b1dff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.629310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9c0aa443-9611-44b0-97b7-01c01a951d7c req-295ef411-a795-47a2-92fe-b26b0e0b1dff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.679473 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9c0aa443-9611-44b0-97b7-01c01a951d7c req-295ef411-a795-47a2-92fe-b26b0e0b1dff service nova] Creating event network-vif-plugged:90f37175-7c5d-48be-a746-e74d623a1085 for instance 0c808db1-8983-4e22-8af7-874d85053f0d on n-h2-851337-5 Aug 04 04:30:43.690446 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9c0aa443-9611-44b0-97b7-01c01a951d7c req-295ef411-a795-47a2-92fe-b26b0e0b1dff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097113 Aug 04 04:30:43.692149 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 901/1795] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:43.761006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:43.761882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:43.813179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.813911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:43.814863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:43.817976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:44.051957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:44.071805 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-42ef3356-7cda-4090-8ce7-dd7715572621 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.512507 Aug 04 04:30:44.072629 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 895/1796] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:43 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:44.179925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:44.196855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b074d06e-f049-46ee-9889-895c28030a65 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1677 microversion: 2.1 time: 0.441029 Aug 04 04:30:44.198095 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 902/1797] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:43 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1677 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:30:44.413374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-dabda6fa-b466-4c99-9242-c55f388273e1 req-67322757-ff05-460e-9380-3f1deb276566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f10d48f-480a-45f4-8406-278b6e8b6cd4", "tag": "8c5ff226-8f92-4272-b992-16d7dde124cc"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:44.440898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-dabda6fa-b466-4c99-9242-c55f388273e1 req-67322757-ff05-460e-9380-3f1deb276566 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:44.441343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-dabda6fa-b466-4c99-9242-c55f388273e1 req-67322757-ff05-460e-9380-3f1deb276566 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:44.456301 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-dabda6fa-b466-4c99-9242-c55f388273e1 req-67322757-ff05-460e-9380-3f1deb276566 service nova] Creating event network-changed:8c5ff226-8f92-4272-b992-16d7dde124cc for instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 on n-h1-851337-5 Aug 04 04:30:44.463281 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-dabda6fa-b466-4c99-9242-c55f388273e1 req-67322757-ff05-460e-9380-3f1deb276566 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056363 Aug 04 04:30:44.464189 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 896/1798] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:44.562215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00eb84b4-8cf5-4306-b2d5-4fe959aeab9c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:44.568140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-00eb84b4-8cf5-4306-b2d5-4fe959aeab9c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:44.579362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00eb84b4-8cf5-4306-b2d5-4fe959aeab9c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:44.580201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00eb84b4-8cf5-4306-b2d5-4fe959aeab9c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:44.581210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00eb84b4-8cf5-4306-b2d5-4fe959aeab9c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:44.582260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00eb84b4-8cf5-4306-b2d5-4fe959aeab9c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:44.598776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:44.602479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:44.628986 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00eb84b4-8cf5-4306-b2d5-4fe959aeab9c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070961 Aug 04 04:30:44.630336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 903/1799] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:44 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:44.631161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:44.631693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:44.632532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:44.632972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:44.903603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:44.912535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2385f59c-38eb-4a45-9b64-ac5fe35fb9c0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1369 microversion: 2.1 time: 0.329088 Aug 04 04:30:44.917974 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 897/1800] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:44 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1369 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:45.100119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:45.101494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:45.125182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.128053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.131563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.135162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.222039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:45.222701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:45.241189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.246389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.248748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.252738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.526230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:45.539065 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52e36947-06b2-4c74-bd90-876949d9cc3e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.445183 Aug 04 04:30:45.540320 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 904/1801] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:45 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:45.578089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:45.590188 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e32f7396-34b7-409e-a0cf-1c9d2e337107 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.372321 Aug 04 04:30:45.592104 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 898/1802] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:45 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:45.617648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a3146b6-477d-42e8-86c6-82e3a68e4869 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:45.620304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a3146b6-477d-42e8-86c6-82e3a68e4869 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:45.636429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3146b6-477d-42e8-86c6-82e3a68e4869 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.636897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3146b6-477d-42e8-86c6-82e3a68e4869 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.638282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3146b6-477d-42e8-86c6-82e3a68e4869 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.647203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3146b6-477d-42e8-86c6-82e3a68e4869 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.648671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f95e2d58-f9ab-4662-8f81-41327c18f649 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:45.653687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f95e2d58-f9ab-4662-8f81-41327c18f649 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:45.667881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f95e2d58-f9ab-4662-8f81-41327c18f649 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.670063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f95e2d58-f9ab-4662-8f81-41327c18f649 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.671303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f95e2d58-f9ab-4662-8f81-41327c18f649 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.671984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f95e2d58-f9ab-4662-8f81-41327c18f649 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.711826 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f95e2d58-f9ab-4662-8f81-41327c18f649 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073204 Aug 04 04:30:45.713140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 899/1803] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:45 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:45.934820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:45.935670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:45.946609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.947814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:45.948639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:45.950718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:46.171724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:46.180625 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f065872f-87e1-499b-9708-2dc7b9809217 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1555 microversion: 2.1 time: 0.250302 Aug 04 04:30:46.195468 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 900/1804] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:45 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1555 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:30:46.208596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b770ef32-64ce-494c-a9de-9eb71f1b921b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:46.209098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b770ef32-64ce-494c-a9de-9eb71f1b921b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:46.221188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b770ef32-64ce-494c-a9de-9eb71f1b921b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:46.221925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b770ef32-64ce-494c-a9de-9eb71f1b921b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:46.225930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b770ef32-64ce-494c-a9de-9eb71f1b921b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:46.227265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b770ef32-64ce-494c-a9de-9eb71f1b921b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:46.361378 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b770ef32-64ce-494c-a9de-9eb71f1b921b tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161704 Aug 04 04:30:46.361988 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 901/1805] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:30:46 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:46.562057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:46.562765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:46.573290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:46.573776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:46.574819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:46.575295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:47.092704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:47.103873 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-419d52ec-db8c-453d-8651-af054f4680fc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.546530 Aug 04 04:30:47.107606 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 902/1806] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:46 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:47.113418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-864892e9-f7db-4a72-b04e-e0bd0587525a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:47.116756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-864892e9-f7db-4a72-b04e-e0bd0587525a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:47.125183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:47.128456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864892e9-f7db-4a72-b04e-e0bd0587525a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:47.129248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864892e9-f7db-4a72-b04e-e0bd0587525a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:47.132974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864892e9-f7db-4a72-b04e-e0bd0587525a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:47.136927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864892e9-f7db-4a72-b04e-e0bd0587525a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:47.189133 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-864892e9-f7db-4a72-b04e-e0bd0587525a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080101 Aug 04 04:30:47.190157 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 903/1807] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:47 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:47.747491 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a3146b6-477d-42e8-86c6-82e3a68e4869 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 200 len: 324 microversion: 2.1 time: 2.132934 Aug 04 04:30:47.748844 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 905/1808] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:30:45 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 324 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:47.759731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:47.760361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:47.776997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:47.790663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:47.792178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:47.792818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:48.128587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:48.129610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:48.153443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:48.155974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:48.157722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:48.158526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.235271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:49.251924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d44c631-bcc7-4967-a679-39233f50ec45 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 1.128447 Aug 04 04:30:49.252740 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 906/1809] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:48 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:49.273134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cebc0598-ec46-467c-9b89-e34d14606452 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:49.279223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:49.281569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cebc0598-ec46-467c-9b89-e34d14606452 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:49.292365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=90 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:49.293947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36db9ab7-7586-4f0e-8955-7c5c03b9a912 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 1.538882 Aug 04 04:30:49.299770 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 904/1810] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:47 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:49.302810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebc0598-ec46-467c-9b89-e34d14606452 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:49.313766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebc0598-ec46-467c-9b89-e34d14606452 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.320251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63969066-b139-494f-aa15-1199bb42039a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:49.322004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63969066-b139-494f-aa15-1199bb42039a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:49.322189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebc0598-ec46-467c-9b89-e34d14606452 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:49.323597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebc0598-ec46-467c-9b89-e34d14606452 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.348804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63969066-b139-494f-aa15-1199bb42039a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:49.350849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63969066-b139-494f-aa15-1199bb42039a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.363740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63969066-b139-494f-aa15-1199bb42039a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:49.365732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63969066-b139-494f-aa15-1199bb42039a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.445505 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cebc0598-ec46-467c-9b89-e34d14606452 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183712 Aug 04 04:30:49.447953 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 907/1811] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:30:49 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3/os-volume_attachments => generated 25 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:30:49.461458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:49.463364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:49.484443 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63969066-b139-494f-aa15-1199bb42039a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/ips" status: 200 len: 151 microversion: 2.1 time: 0.179818 Aug 04 04:30:49.493139 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 905/1812] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:30:49 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/ips => generated 151 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:49.500928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:49.503704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.504735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:49.505456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.520992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9252d9e4-5787-492a-a69b-851da8de642f req-91a7b9b5-bd46-4b33-a08a-3416a1be8f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c808db1-8983-4e22-8af7-874d85053f0d", "tag": "90f37175-7c5d-48be-a746-e74d623a1085"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:49.527117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:49.551519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9252d9e4-5787-492a-a69b-851da8de642f req-91a7b9b5-bd46-4b33-a08a-3416a1be8f35 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:49.557491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9252d9e4-5787-492a-a69b-851da8de642f req-91a7b9b5-bd46-4b33-a08a-3416a1be8f35 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:49.599304 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9252d9e4-5787-492a-a69b-851da8de642f req-91a7b9b5-bd46-4b33-a08a-3416a1be8f35 service nova] Creating event network-changed:90f37175-7c5d-48be-a746-e74d623a1085 for instance 0c808db1-8983-4e22-8af7-874d85053f0d on n-h2-851337-5 Aug 04 04:30:49.617270 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9252d9e4-5787-492a-a69b-851da8de642f req-91a7b9b5-bd46-4b33-a08a-3416a1be8f35 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101743 Aug 04 04:30:49.624405 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 906/1813] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:30:49.997356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:50.027391 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-122cb42c-3a34-4313-967c-eb6bb19d9487 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.573285 Aug 04 04:30:50.037940 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 908/1814] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:49 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:50.052236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:50.059114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:50.098529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:50.103115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:50.110922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:50.113820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:50.275041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:50.275801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:50.304359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:50.309519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:50.311942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:50.315223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:50.989833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:50.992948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:51.006895 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9db9aca-9647-4e1e-9aee-ceb02488df4a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.962145 Aug 04 04:30:51.011697 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 907/1815] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:50 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:51.034327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:51.037796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:51.068846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:51.069313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:51.070125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:51.070580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:51.155180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:51.164424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6438ed4c-bbc6-4c8d-813b-e6577ca7f97e tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.894082 Aug 04 04:30:51.171995 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 909/1816] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:50 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:51.526192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:51.536383 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4388d4e5-e032-4c45-9548-3b075119f0ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.505874 Aug 04 04:30:51.552111 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 908/1817] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:51 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:51.798273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-390808931", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "fcf37719-691e-4ce4-8b13-247de9c8f621"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:52.196125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:52.196944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:52.197143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] validate_networks() for [('fcf37719-691e-4ce4-8b13-247de9c8f621', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:30:52.213915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:52.221068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:52.222120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:52.222675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:52.855849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:52.878014 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe39b486-748f-4657-bbc5-cbdb33c94300 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.685717 Aug 04 04:30:52.880794 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 909/1818] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:52 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:53.209609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:30:53.210195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:30:53.210899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:30:53.213383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:30:53.214105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:30:53.236020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:53.239420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:53.240416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:53.241469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:53.295644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:30:53.310469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for user d51068c4cce544e38ad1b23996efdec3 and project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:30:53.369420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:30:53.375428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:30:53.553805 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0472ed51-90d6-4d8a-a9ef-49f10035bfdf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759403 Aug 04 04:30:53.561188 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 910/1819] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:30:53.571809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7502c8e5-56a0-4aad-9a4d-2a3bd0522c48 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:53.573258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7502c8e5-56a0-4aad-9a4d-2a3bd0522c48 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:53.594172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11fa63bd-d976-4050-8cc5-4f55a30f7614 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "527fc694-22b9-4ab9-9a4d-24f3154e4b8b"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:53.599460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-11fa63bd-d976-4050-8cc5-4f55a30f7614 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:53.611239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11fa63bd-d976-4050-8cc5-4f55a30f7614 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:53.611688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11fa63bd-d976-4050-8cc5-4f55a30f7614 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:53.612688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11fa63bd-d976-4050-8cc5-4f55a30f7614 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:53.613411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11fa63bd-d976-4050-8cc5-4f55a30f7614 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:53.789053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7502c8e5-56a0-4aad-9a4d-2a3bd0522c48 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:53.798023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7502c8e5-56a0-4aad-9a4d-2a3bd0522c48 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1214 microversion: 2.1 time: 0.230056 Aug 04 04:30:53.810088 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 910/1820] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:53 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:53.900740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:53.901371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:53.917551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:53.918009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:53.918898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:53.919371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:54.225962 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11fa63bd-d976-4050-8cc5-4f55a30f7614 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643858 Aug 04 04:30:54.233644 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 911/1821] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:30:53 2022] POST /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:54.239860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5ba282ab-f602-4d03-b549-6a3a5aa6979f req-35af9082-b548-42d7-9e3a-1fe1f91a9bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f10d48f-480a-45f4-8406-278b6e8b6cd4", "name": "network-vif-plugged", "status": "completed", "tag": "8c5ff226-8f92-4272-b992-16d7dde124cc"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:54.251476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:54.251792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5ba282ab-f602-4d03-b549-6a3a5aa6979f req-35af9082-b548-42d7-9e3a-1fe1f91a9bfa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:54.252675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5ba282ab-f602-4d03-b549-6a3a5aa6979f req-35af9082-b548-42d7-9e3a-1fe1f91a9bfa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:54.267181 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd12ce00-d089-4093-8bc9-1450ae47f8a8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.369267 Aug 04 04:30:54.268466 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 911/1822] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:53 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:30:54.297955 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5ba282ab-f602-4d03-b549-6a3a5aa6979f req-35af9082-b548-42d7-9e3a-1fe1f91a9bfa service nova] Creating event network-vif-plugged:8c5ff226-8f92-4272-b992-16d7dde124cc for instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 on n-h1-851337-5 Aug 04 04:30:54.310055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5ba282ab-f602-4d03-b549-6a3a5aa6979f req-35af9082-b548-42d7-9e3a-1fe1f91a9bfa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069514 Aug 04 04:30:54.318827 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 912/1823] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:30:54.823513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:54.825338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:54.833525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:54.834734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:54.836963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:54.839011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:54.976485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:54.997603 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3024e967-7717-4d4d-8fb0-651ac2dc9372 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1266 microversion: 2.1 time: 0.180154 Aug 04 04:30:54.998756 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 912/1824] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:54 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:55.296001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:55.296898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:55.326566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:55.327788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:55.332670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:55.333462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:55.630501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:55.641908 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41b86263-72b6-415d-86f9-9cf130252bf3 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1314 microversion: 2.1 time: 0.352659 Aug 04 04:30:55.666881 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 913/1825] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:55 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:55.710058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:55.710576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:55.721001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:55.721465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:55.722276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:55.722789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:55.788396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:30:56.022415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:56.023183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:56.036190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:56.041029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:56.042984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:56.045587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:56.081625 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4adf2c7f-20f1-4962-8239-de07f10c4be6 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 204 len: 0 microversion: 2.25 time: 0.375129 Aug 04 04:30:56.088504 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 913/1826] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:30:55 2022] DELETE /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:30:56.098320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:56.100772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:56.113513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:56.117402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:56.121977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:56.123858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:56.206871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:56.223249 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d08b9efe-5f69-44f4-9f73-6ccb24f59afd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1272 microversion: 2.1 time: 0.201427 Aug 04 04:30:56.224439 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 914/1827] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:56 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:30:56.665231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:56.666828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:56.693029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:56.693852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:56.694916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:56.695650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:56.764989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:56.779455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:56.786355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:56.790618 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-de4bbc88-0aaa-4a82-8ff2-144200038d49 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1731 microversion: 2.25 time: 0.700770 Aug 04 04:30:56.798553 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 914/1828] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:56 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1731 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:30:57.248251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:57.248986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:57.265610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:57.267509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:57.270858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:57.271746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:57.420085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:57.430915 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ef4a277f-571d-4a75-b0bd-057ba0736dc0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1272 microversion: 2.1 time: 0.188702 Aug 04 04:30:57.435730 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 915/1829] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:57 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:30:57.526457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:57.538022 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00b83436-5c55-454e-9e27-d482dcab56a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1502 microversion: 2.1 time: 0.876563 Aug 04 04:30:57.541814 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 915/1830] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:56 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1502 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:30:57.568503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-299126141"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:30:57.570835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:57.590053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:57.593883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:57.600097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:57.602467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:57.821436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:57.822577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:57.836960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:57.837708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:57.840790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:57.843181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:58.059797 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Adding security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 to port 8c5ff226-8f92-4272-b992-16d7dde124cc Aug 04 04:30:58.636066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:58.670681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:58.672968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:58.674167 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0ec2da2a-4953-4eb5-9bc7-7eab3ee5c5fc tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1731 microversion: 2.25 time: 0.857552 Aug 04 04:30:58.675321 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 916/1831] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:30:57 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1731 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:30:58.688749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:58.689717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:30:58.703139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:58.703856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:58.706338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:58.707084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:59.451522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6df190b6-ff51-4858-b234-e6d416148237 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4/action" status: 202 len: 0 microversion: 2.1 time: 1.888054 Aug 04 04:30:59.456904 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 916/1832] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:30:57 2022] POST /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4/action => generated 0 bytes in 1894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:30:59.465999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76a3e26b-fdcd-4df4-a368-3d48fbe2094f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a3a7ca0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:59.953856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:30:59.966599 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55884f3b-09fa-4fdd-ae06-1e17c6ff4b1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1314 microversion: 2.1 time: 1.285800 Aug 04 04:30:59.994986 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 917/1833] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:30:58 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:00.003237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8c0ef7ab-be38-4a69-9b68-3443aa2b01be req-8ae5c711-6ad6-4c1a-a739-336f30daf266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f10d48f-480a-45f4-8406-278b6e8b6cd4", "tag": "8c5ff226-8f92-4272-b992-16d7dde124cc"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:00.046730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8c0ef7ab-be38-4a69-9b68-3443aa2b01be req-8ae5c711-6ad6-4c1a-a739-336f30daf266 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.047506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8c0ef7ab-be38-4a69-9b68-3443aa2b01be req-8ae5c711-6ad6-4c1a-a739-336f30daf266 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.065717 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8c0ef7ab-be38-4a69-9b68-3443aa2b01be req-8ae5c711-6ad6-4c1a-a739-336f30daf266 service nova] Creating event network-changed:8c5ff226-8f92-4272-b992-16d7dde124cc for instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 on n-h1-851337-5 Aug 04 04:31:00.073565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-76a3e26b-fdcd-4df4-a368-3d48fbe2094f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use.", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:00.075312 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-76a3e26b-fdcd-4df4-a368-3d48fbe2094f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use. Aug 04 04:31:00.075312 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-e18a3f29-0579-4174-a40a-17b7480ba641'] Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76a3e26b-fdcd-4df4-a368-3d48fbe2094f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2 HTTP/1.1 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: exception: Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use. Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-e18a3f29-0579-4174-a40a-17b7480ba641'] Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '586db7aa-ea84-4a88-a6cf-cda01c185df2'} Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:00.077383 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use. Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e18a3f29-0579-4174-a40a-17b7480ba641'] Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use. Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e18a3f29-0579-4174-a40a-17b7480ba641'] Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use. Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e18a3f29-0579-4174-a40a-17b7480ba641'] Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use. Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e18a3f29-0579-4174-a40a-17b7480ba641'] Aug 04 04:31:00.083535 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:00.092280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8c0ef7ab-be38-4a69-9b68-3443aa2b01be req-8ae5c711-6ad6-4c1a-a739-336f30daf266 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086887 Aug 04 04:31:00.092280 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 918/1834] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:00.094978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76a3e26b-fdcd-4df4-a368-3d48fbe2094f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 400 to user: Security Group 586db7aa-ea84-4a88-a6cf-cda01c185df2 in use. Aug 04 04:31:00.094978 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-e18a3f29-0579-4174-a40a-17b7480ba641'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:00.094978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76a3e26b-fdcd-4df4-a368-3d48fbe2094f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2" status: 400 len: 185 microversion: 2.1 time: 0.633269 Aug 04 04:31:00.094978 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 917/1835] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:30:59 2022] DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2 => generated 185 bytes in 634 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:31:00.103828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4efdb44c-56a6-4134-8a66-e2c60ec59fdd req-a7e57e9b-0132-4103-b277-6d2caa4cc2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1543d282-7d4f-4c87-b761-049a3c1ab46a", "name": "network-vif-deleted", "tag": "20d3f61f-c31d-4334-aab1-aebea15b1651"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:00.117775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:00.124236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:00.146157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4efdb44c-56a6-4134-8a66-e2c60ec59fdd req-a7e57e9b-0132-4103-b277-6d2caa4cc2ce service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.146914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4efdb44c-56a6-4134-8a66-e2c60ec59fdd req-a7e57e9b-0132-4103-b277-6d2caa4cc2ce service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.148782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.149322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.150781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.152047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.163834 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4efdb44c-56a6-4134-8a66-e2c60ec59fdd req-a7e57e9b-0132-4103-b277-6d2caa4cc2ce service nova] Creating event network-vif-deleted:20d3f61f-c31d-4334-aab1-aebea15b1651 for instance 1543d282-7d4f-4c87-b761-049a3c1ab46a on n-h1-851337-5 Aug 04 04:31:00.173595 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4efdb44c-56a6-4134-8a66-e2c60ec59fdd req-a7e57e9b-0132-4103-b277-6d2caa4cc2ce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080167 Aug 04 04:31:00.175389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 919/1836] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:00.182315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-30e56a06-f547-4abd-a2a5-70f9960f73cb tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:00.187257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-30e56a06-f547-4abd-a2a5-70f9960f73cb tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:00.197364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30e56a06-f547-4abd-a2a5-70f9960f73cb tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.199627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30e56a06-f547-4abd-a2a5-70f9960f73cb tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.201232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30e56a06-f547-4abd-a2a5-70f9960f73cb tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.203526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30e56a06-f547-4abd-a2a5-70f9960f73cb tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.311998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.320601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.321287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lazy-loading 'fault' on Instance uuid 1543d282-7d4f-4c87-b761-049a3c1ab46a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:31:00.531046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-30e56a06-f547-4abd-a2a5-70f9960f73cb tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4/action" status: 202 len: 0 microversion: 2.1 time: 0.353598 Aug 04 04:31:00.535388 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 920/1837] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:31:00 2022] POST /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:31:00.557561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:00.573574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:00.575126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:00.592896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:00.601131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:00.603076 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-364e22c4-2971-47b7-be5b-6759e413effb tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 200 len: 1375 microversion: 2.25 time: 0.506453 Aug 04 04:31:00.610492 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 918/1838] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:00 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 1375 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:00.613815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.614420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.624186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:00.625044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:00.991752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:00.992659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:01.004513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:01.007550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:01.008588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:01.009820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:01.274407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:01.291689 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-de836245-03c9-44a2-bfc9-56914132ea9c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1572 microversion: 2.1 time: 0.745485 Aug 04 04:31:01.292935 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 921/1839] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:00 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1572 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:01.651383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:01.651933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 1543d282-7d4f-4c87-b761-049a3c1ab46a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:01.673545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:01.674306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:01.675253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:01.683681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:01.690221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:01.725217 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] HTTP exception thrown: Instance 1543d282-7d4f-4c87-b761-049a3c1ab46a could not be found. Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Request method failure captured: Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a HTTP/1.1 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nS7Bh1lvi1HIXpWbWKdOOf2DkzwjGPtkM_CeRG0Xf-qJGyqHQlx3Az-8nVmykPwQxTc6PDwpcuqXP5-NeNoL4zaqgDfXV-RCMWY755JzhYQu7E8gt4E8Y-22MY1VS7aVtaapYXvmQSZifcBiB1glVfwubCrXwF-l8sLhfxFTWNIoo Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_300e53e93c2a4678b2b5695d002ac286", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: eaff90b8a434488f9d2731070edf30fe Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 1543d282-7d4f-4c87-b761-049a3c1ab46a could not be found. Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '1543d282-7d4f-4c87-b761-049a3c1ab46a'} Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1543d282-7d4f-4c87-b761-049a3c1ab46a could not be found. Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1543d282-7d4f-4c87-b761-049a3c1ab46a could not be found. Aug 04 04:31:01.730740 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1543d282-7d4f-4c87-b761-049a3c1ab46a could not be found. Aug 04 04:31:01.736917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:01.738017 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b74527ab-0bbf-4764-ac54-0b7fc32b44c7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1314 microversion: 2.1 time: 0.740605 Aug 04 04:31:01.738017 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 919/1840] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:00 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:01.741567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Returning 404 to user: Instance 1543d282-7d4f-4c87-b761-049a3c1ab46a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:01.742687 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e6d5c6f-3a42-41dd-bb1f-4d76dfa59696 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a" status: 404 len: 111 microversion: 2.25 time: 0.108694 Aug 04 04:31:01.751016 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 922/1841] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:01 2022] GET /compute/v2.1/servers/1543d282-7d4f-4c87-b761-049a3c1ab46a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:31:01.754746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-42bd66c8-60a9-430b-b02a-9aea45784685 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '.version_select at 0x7f191a63fdc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:01.798337 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-42bd66c8-60a9-430b-b02a-9aea45784685 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025088252" status: 204 len: 0 microversion: 2.25 time: 0.049594 Aug 04 04:31:01.799217 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 920/1842] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:31:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025088252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:31:02.253288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-566992f6-5820-4d68-81e4-f3078a38b55c req-cf21b9ff-03b1-4ff7-8d5d-3b780e1e845a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3289802-1dfa-4410-b3c9-e36f6989c7e6", "tag": "518caf45-1b1a-4f28-a9a4-31fc977746eb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:02.289304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-566992f6-5820-4d68-81e4-f3078a38b55c req-cf21b9ff-03b1-4ff7-8d5d-3b780e1e845a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:02.290015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-566992f6-5820-4d68-81e4-f3078a38b55c req-cf21b9ff-03b1-4ff7-8d5d-3b780e1e845a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:02.314690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:02.315505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:02.344608 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-566992f6-5820-4d68-81e4-f3078a38b55c req-cf21b9ff-03b1-4ff7-8d5d-3b780e1e845a service nova] Creating event network-changed:518caf45-1b1a-4f28-a9a4-31fc977746eb for instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 on n-h2-851337-5 Aug 04 04:31:02.349858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:02.350456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:02.353110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:02.358256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:02.369984 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-566992f6-5820-4d68-81e4-f3078a38b55c req-cf21b9ff-03b1-4ff7-8d5d-3b780e1e845a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119498 Aug 04 04:31:02.377958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 923/1843] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:02.761265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:02.763304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:02.779210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:02.779822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:02.780621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:02.781851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:03.264146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:03.348439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:03.394184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:03.412862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-686f70a0-99f4-4d86-ab8b-dac1a5ac9eb5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1314 microversion: 2.1 time: 0.649531 Aug 04 04:31:03.413628 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 924/1844] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:02 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:03.433278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:03.445190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab0a27c8-bf49-487b-9055-b96303252d74 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1572 microversion: 2.1 time: 1.135784 Aug 04 04:31:03.450858 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 921/1845] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:02 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1572 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:04.436598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:04.437235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:04.463199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:04.463918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:04.467291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:04.468126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:04.470521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:04.471399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:04.474024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:04.508359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:04.509704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:04.513525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:04.514246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:05.004718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:05.018770 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38cbf9ba-b754-4d59-a331-ac132419abc9 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1572 microversion: 2.1 time: 0.553129 Aug 04 04:31:05.019571 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 922/1846] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:04 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1572 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:05.020262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:05.032613 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02e37e7c-8d5a-4d22-b2a9-0573e60074d5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1314 microversion: 2.1 time: 0.601487 Aug 04 04:31:05.037825 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 925/1847] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:04 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:05.053145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:05.054629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:05.064607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:05.066402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:05.067559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:05.068250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:05.096321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e1cf885-46b5-407b-8b9a-9d31b1182512 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Action: 'create', calling method: .version_select at 0x7f1923b13b80>, body: {"keypair": {"name": "tempest-keypair-2066359939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBwjGeA0t4QWLl/HYttIc4yOO37RBXUww43Hnx8BcDRT0YCqioGWq48nT+S3tXMEey04vDlTm7J7CdWi62TlGOJFXoJwF3OmH4FKDNNXNLmSQJNtoysALYze5YkbTxXAA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:05.150049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:31:05.150214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4e1cf885-46b5-407b-8b9a-9d31b1182512 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Getting quotas for project 1642d2eb789f4ec49d07523481fd11f4. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:05.167446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4e1cf885-46b5-407b-8b9a-9d31b1182512 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Getting quotas for user 37dc980aa515445d9d71f4c20daecef9 and project 1642d2eb789f4ec49d07523481fd11f4. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:05.241864 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e1cf885-46b5-407b-8b9a-9d31b1182512 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.159677 Aug 04 04:31:05.243432 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 926/1848] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:31:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 04:31:05.361195 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-14c608b9-e29c-40fa-b0f6-4cc1ad83c25b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 204 len: 0 microversion: 2.25 time: 0.330331 Aug 04 04:31:05.362319 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 923/1849] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:31:05 2022] DELETE /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:31:05.370920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:05.372396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:05.383539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:05.385259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:05.388778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:05.389653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:05.430339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:05.736581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:05.749516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:05.756778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:05.763100 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0be5b282-de8f-4313-9f0f-4c322a046da4 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1549 microversion: 2.25 time: 0.395977 Aug 04 04:31:05.763832 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 927/1850] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:05 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1549 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:06.056029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:06.057076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:06.058196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:06.060018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:06.067947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:06.068683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:06.070750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:06.071384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:06.076250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:06.077332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:06.078812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:06.082659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:06.131718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.053s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:06.607340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:06.634085 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8daac5cf-a99c-41dc-9f0b-83cb90736525 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1314 microversion: 2.1 time: 0.581747 Aug 04 04:31:06.637164 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 928/1851] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:06 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:06.656223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:06.683374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b61247d8-367b-4d53-a555-4d2d15cbb39a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1572 microversion: 2.1 time: 0.633648 Aug 04 04:31:06.700557 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 924/1852] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:06 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1572 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:06.788161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:06.788821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:06.800003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:06.800861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:06.803225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:06.809753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:07.025235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:07.042224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:07.047602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:07.057368 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c42de34d-8de0-44fd-bb94-27ce439c0a84 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 200 len: 1507 microversion: 2.25 time: 0.274086 Aug 04 04:31:07.058013 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 929/1853] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:06 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:07.093173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a9a4ae3d-7ee9-4bde-a5c1-14d7f54cede9 req-fc541ea5-db83-48c3-966d-a7e490d8e87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47b14c1-c8b1-4fdf-b601-48b469cda68e", "name": "network-vif-deleted", "tag": "64e2eaf4-f301-4449-9ef9-f80bf581a3cf"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:07.118087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a9a4ae3d-7ee9-4bde-a5c1-14d7f54cede9 req-fc541ea5-db83-48c3-966d-a7e490d8e87c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:07.118893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a9a4ae3d-7ee9-4bde-a5c1-14d7f54cede9 req-fc541ea5-db83-48c3-966d-a7e490d8e87c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:07.136805 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a9a4ae3d-7ee9-4bde-a5c1-14d7f54cede9 req-fc541ea5-db83-48c3-966d-a7e490d8e87c service nova] Creating event network-vif-deleted:64e2eaf4-f301-4449-9ef9-f80bf581a3cf for instance b47b14c1-c8b1-4fdf-b601-48b469cda68e on n-h1-851337-5 Aug 04 04:31:07.148018 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a9a4ae3d-7ee9-4bde-a5c1-14d7f54cede9 req-fc541ea5-db83-48c3-966d-a7e490d8e87c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059103 Aug 04 04:31:07.149350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 925/1854] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:07.656619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:07.657577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:07.669473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:07.670126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:07.670931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:07.672528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:07.706984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:07.708134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:07.717550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:07.718455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:07.721953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:07.722502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.377464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:08.389393 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4fffe29-f1b8-42f8-9ebd-cffa40bf6c96 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1314 microversion: 2.1 time: 0.736679 Aug 04 04:31:08.402617 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 930/1855] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:07 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:08.407338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6dd4b1d0-2f6b-41ea-9c9f-bb68ee2e0e08 req-f06e96a5-3cb0-4ab4-aaac-8c68bd24eae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3289802-1dfa-4410-b3c9-e36f6989c7e6", "name": "network-vif-plugged", "status": "completed", "tag": "518caf45-1b1a-4f28-a9a4-31fc977746eb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:08.425070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6dd4b1d0-2f6b-41ea-9c9f-bb68ee2e0e08 req-f06e96a5-3cb0-4ab4-aaac-8c68bd24eae8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.432000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6dd4b1d0-2f6b-41ea-9c9f-bb68ee2e0e08 req-f06e96a5-3cb0-4ab4-aaac-8c68bd24eae8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.450621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6dd4b1d0-2f6b-41ea-9c9f-bb68ee2e0e08 req-f06e96a5-3cb0-4ab4-aaac-8c68bd24eae8 service nova] Creating event network-vif-plugged:518caf45-1b1a-4f28-a9a4-31fc977746eb for instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 on n-h2-851337-5 Aug 04 04:31:08.455809 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6dd4b1d0-2f6b-41ea-9c9f-bb68ee2e0e08 req-f06e96a5-3cb0-4ab4-aaac-8c68bd24eae8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061511 Aug 04 04:31:08.456451 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 931/1856] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:08.462686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:08.463732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: b47b14c1-c8b1-4fdf-b601-48b469cda68e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:08.469034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:08.470360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.471379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.472298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.473259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.485214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ce667d2b-998a-4c0a-b0c9-8634006c93de tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1570 microversion: 2.1 time: 0.782499 Aug 04 04:31:08.485939 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 926/1857] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:07 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1570 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:08.501255 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] HTTP exception thrown: Instance b47b14c1-c8b1-4fdf-b601-48b469cda68e could not be found. Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Request method failure captured: Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e HTTP/1.1 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60nS7Bh1lvi1HIXpWbWKdOOf2DkzwjGPtkM_CeRG0Xf-qJGyqHQlx3Az-8nVmykPwQxTc6PDwpcuqXP5-NeNoL4zaqgDfXV-RCMWY755JzhYQu7E8gt4E8Y-22MY1VS7aVtaapYXvmQSZifcBiB1glVfwubCrXwF-l8sLhfxFTWNIoo Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_300e53e93c2a4678b2b5695d002ac286", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: eaff90b8a434488f9d2731070edf30fe Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance b47b14c1-c8b1-4fdf-b601-48b469cda68e could not be found. Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b47b14c1-c8b1-4fdf-b601-48b469cda68e'} Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47b14c1-c8b1-4fdf-b601-48b469cda68e could not be found. Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47b14c1-c8b1-4fdf-b601-48b469cda68e could not be found. Aug 04 04:31:08.503064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47b14c1-c8b1-4fdf-b601-48b469cda68e could not be found. Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Returning 404 to user: Instance b47b14c1-c8b1-4fdf-b601-48b469cda68e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b8eee7a-c7a7-4084-a7d2-fefcace0f2b3 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e" status: 404 len: 111 microversion: 2.25 time: 0.046777 Aug 04 04:31:08.507947 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 932/1858] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:08 2022] GET /compute/v2.1/servers/b47b14c1-c8b1-4fdf-b601-48b469cda68e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:31:08.514590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-623296027"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:08.515266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:08.528526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.530396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.538216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:08.543099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.544492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:08.544666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.564513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.565329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.566375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.566897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.618940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:31:08.718823 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0d1d460-aa27-4939-8946-d2d6b046c36b tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 204 len: 0 microversion: 2.25 time: 0.196691 Aug 04 04:31:08.720691 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 933/1859] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:31:08 2022] DELETE /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:31:08.728987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:08.730110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:08.738281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.739171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.741066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:08.741985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:08.767247 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Adding security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 to port 8c5ff226-8f92-4272-b992-16d7dde124cc Aug 04 04:31:09.026214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:09.039656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:09.041632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:09.043175 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-28bf7a2e-fec0-4051-b941-dfe05b7677f9 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1564 microversion: 2.25 time: 0.319030 Aug 04 04:31:09.044888 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 934/1860] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:08 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1564 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:09.053313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-987157669", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e5e01355-2060-4141-8f4d-bdcf61bc7edd"}, {"port": "603a0716-af65-4b22-943b-fc75552e52cb", "tag": "port-1"}, {"port": "6170383e-7582-4f81-92f2-d72b1ef66d77", "tag": "port-2"}, {"uuid": "6e6a2e63-abec-47fb-9edb-c9fcee91f754", "tag": "net-1"}, {"uuid": "6e6a2e63-abec-47fb-9edb-c9fcee91f754"}, {"uuid": "fe4c2e0e-d52e-4951-9ed6-83d278eddf51", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fe4c2e0e-d52e-4951-9ed6-83d278eddf51", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "752265e6-cd03-40c2-9e1a-a2abd73172a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3ebbe2ec-5401-40bd-b184-2870511e3a24", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4274cad2-24b0-4b7c-bfc0-38e325de4efd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1954807481"}], "key_name": "tempest-keypair-2066359939", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:09.267283 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-16a744c1-5bcc-4982-bc69-033458ff3cd4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4/action" status: 202 len: 0 microversion: 2.1 time: 0.757248 Aug 04 04:31:09.268834 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 927/1861] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:31:08 2022] POST /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:31:09.276772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-df8c53c2-2524-4222-a95d-3f88a9ecacca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a33eca0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:09.446246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-df8c53c2-2524-4222-a95d-3f88a9ecacca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use.", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:09.446246 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-df8c53c2-2524-4222-a95d-3f88a9ecacca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use. Aug 04 04:31:09.446246 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-73c1fd2a-08a4-43fd-9088-ba2a5a8a938f'] Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-df8c53c2-2524-4222-a95d-3f88a9ecacca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 HTTP/1.1 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: exception: Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use. Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-73c1fd2a-08a4-43fd-9088-ba2a5a8a938f'] Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f307d1e5-d7ed-434d-b3b1-7ed28a1998f8'} Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:09.447575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use. Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73c1fd2a-08a4-43fd-9088-ba2a5a8a938f'] Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use. Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73c1fd2a-08a4-43fd-9088-ba2a5a8a938f'] Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use. Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73c1fd2a-08a4-43fd-9088-ba2a5a8a938f'] Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use. Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73c1fd2a-08a4-43fd-9088-ba2a5a8a938f'] Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-df8c53c2-2524-4222-a95d-3f88a9ecacca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 400 to user: Security Group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 in use. Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-73c1fd2a-08a4-43fd-9088-ba2a5a8a938f'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-df8c53c2-2524-4222-a95d-3f88a9ecacca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8" status: 400 len: 185 microversion: 2.1 time: 0.176275 Aug 04 04:31:09.453510 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 928/1862] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:09 2022] DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 => generated 185 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:31:09.461481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4cd4315e-5e4c-423a-8137-0dcfedfe6e30 req-b08927aa-ca5b-42d8-baba-5448d59f7dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f10d48f-480a-45f4-8406-278b6e8b6cd4", "tag": "8c5ff226-8f92-4272-b992-16d7dde124cc"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:09.471628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4cd4315e-5e4c-423a-8137-0dcfedfe6e30 req-b08927aa-ca5b-42d8-baba-5448d59f7dba service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:09.472358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4cd4315e-5e4c-423a-8137-0dcfedfe6e30 req-b08927aa-ca5b-42d8-baba-5448d59f7dba service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:09.486499 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4cd4315e-5e4c-423a-8137-0dcfedfe6e30 req-b08927aa-ca5b-42d8-baba-5448d59f7dba service nova] Creating event network-changed:8c5ff226-8f92-4272-b992-16d7dde124cc for instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 on n-h1-851337-5 Aug 04 04:31:09.493662 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4cd4315e-5e4c-423a-8137-0dcfedfe6e30 req-b08927aa-ca5b-42d8-baba-5448d59f7dba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042257 Aug 04 04:31:09.494764 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 929/1863] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:09.503134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:09.503851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:09.511741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:09.512940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:09.514747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:09.515753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:09.720259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:09.731421 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d4172aa5-2330-4314-ac7e-cf58146dcfd9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1314 microversion: 2.1 time: 0.234536 Aug 04 04:31:09.747947 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 930/1864] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:09 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:09.754520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:09.755357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:09.765952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:09.766067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:09.766944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:09.767427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:09.814847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:31:09.971353 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2c004b9-6f1a-46f8-b71f-a6990a63adf6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 204 len: 0 microversion: 2.1 time: 0.220155 Aug 04 04:31:09.973597 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 931/1865] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:31:09 2022] DELETE /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:31:09.990117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:09.991660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:10.009951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:10.011056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:10.013578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:10.015444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:10.251072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:10.262607 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-013be279-ab33-4915-820f-a2ef5ccff9ca tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1644 microversion: 2.1 time: 0.283311 Aug 04 04:31:10.275836 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 932/1866] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:09 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1644 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:10.282381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:10.283160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:10.289846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:10.290427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:10.291373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:10.291909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:10.464629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:10.476575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:10.479316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:10.481004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4b2822fd-2f45-459a-adb7-e6d875682433 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1564 microversion: 2.25 time: 0.203901 Aug 04 04:31:10.481687 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 933/1867] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:10 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:10.545283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-dfc7a0e3-0b4a-4634-84b8-68be02606cdb req-f4e32e31-3fe1-4be5-b9d5-cad1f9632397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a042fbb-c3f2-4215-8132-6d5f33961b30", "name": "network-vif-deleted", "tag": "312e5f6a-5467-4b81-b150-30a4209bcd76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:10.556004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-dfc7a0e3-0b4a-4634-84b8-68be02606cdb req-f4e32e31-3fe1-4be5-b9d5-cad1f9632397 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:10.556464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-dfc7a0e3-0b4a-4634-84b8-68be02606cdb req-f4e32e31-3fe1-4be5-b9d5-cad1f9632397 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:10.569098 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-dfc7a0e3-0b4a-4634-84b8-68be02606cdb req-f4e32e31-3fe1-4be5-b9d5-cad1f9632397 service nova] Creating event network-vif-deleted:312e5f6a-5467-4b81-b150-30a4209bcd76 for instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 on n-h2-851337-5 Aug 04 04:31:10.574151 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-dfc7a0e3-0b4a-4634-84b8-68be02606cdb req-f4e32e31-3fe1-4be5-b9d5-cad1f9632397 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032530 Aug 04 04:31:10.578224 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 934/1868] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:31:10.754591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:10.755417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:10.762018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:10.762422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:10.763250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:10.763694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:10.971735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:10.981387 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9ef8df2-2a13-427f-875e-0a53192029ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1502 microversion: 2.1 time: 0.231567 Aug 04 04:31:10.983320 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 935/1869] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:10 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:11.006909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-29086d16-dc08-477a-a1aa-82f9b564fea9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:11.015937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29086d16-dc08-477a-a1aa-82f9b564fea9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.016456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29086d16-dc08-477a-a1aa-82f9b564fea9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.096068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-29086d16-dc08-477a-a1aa-82f9b564fea9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:31:11.179364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-29086d16-dc08-477a-a1aa-82f9b564fea9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6/action" status: 202 len: 0 microversion: 2.1 time: 0.178857 Aug 04 04:31:11.180581 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 936/1870] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:31:10 2022] POST /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:31:11.193832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:11.194826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:11.208337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.208849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.210275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.210781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.423676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:11.432535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1549f7df-be4c-408e-8de6-21152a088a17 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.244906 Aug 04 04:31:11.433350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 937/1871] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:11 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:11.438234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:11.438854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:11.445047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.445762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.446736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.447378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.617596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:11.629750 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc47d4bc-7133-4f57-85f3-58f961746bfc tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1644 microversion: 2.1 time: 0.195022 Aug 04 04:31:11.630721 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 938/1872] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:11 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1644 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:11.651432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:11.652062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:11.663677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.664855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.665774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.666220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.715920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:11.716450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:11.717429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lazy-loading 'fault' on Instance uuid 9a042fbb-c3f2-4215-8132-6d5f33961b30 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:31:11.795758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:11.808886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:11.811457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaff90b8a434488f9d2731070edf30fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300e53e93c2a4678b2b5695d002ac286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:11.815225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc46a720-657a-4c57-82ca-4e468f6223b5 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 200 len: 1351 microversion: 2.25 time: 0.169331 Aug 04 04:31:11.816157 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 939/1873] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:11 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:12.362118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c941e38-09cc-4d92-98f4-8c98a88c114a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: .version_select at 0x7f191abe3670>, body: {"keypair": {"name": "tempest-keypair-1726355252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOyr7YOWF6EOxuvM7mm4Oz/fjUmsm4RSVfNqzQVI1yh3fRVKHmjHFIMcxYKYlKQjipcvUbD0/XRtxkX1wh6El1N4IJiEkrVx6UVYysQzILxIv8wNKDJY+KNtfoJWithjA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:12.407346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0c941e38-09cc-4d92-98f4-8c98a88c114a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:12.413799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:12.435225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0c941e38-09cc-4d92-98f4-8c98a88c114a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:12.513774 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c941e38-09cc-4d92-98f4-8c98a88c114a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156951 Aug 04 04:31:12.520486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 940/1874] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:31:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:31:12.546047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:12.547020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:12.566691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:12.569592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:12.573887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:12.576194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:12.861206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:12.872689 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64a9c6ed-3692-4eb6-8a45-07f8f1294deb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.334733 Aug 04 04:31:12.879028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 941/1875] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:12 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:12.880141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-da9f152d-d989-4d98-a808-8e54c06298de req-0230d5d5-544e-4d41-b35b-ce43dded44e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f10d48f-480a-45f4-8406-278b6e8b6cd4", "name": "network-vif-deleted", "tag": "8c5ff226-8f92-4272-b992-16d7dde124cc"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:12.890530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-da9f152d-d989-4d98-a808-8e54c06298de req-0230d5d5-544e-4d41-b35b-ce43dded44e2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:12.891013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-da9f152d-d989-4d98-a808-8e54c06298de req-0230d5d5-544e-4d41-b35b-ce43dded44e2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:12.896720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:12.905930 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-da9f152d-d989-4d98-a808-8e54c06298de req-0230d5d5-544e-4d41-b35b-ce43dded44e2 service nova] Creating event network-vif-deleted:8c5ff226-8f92-4272-b992-16d7dde124cc for instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 on n-h1-851337-5 Aug 04 04:31:12.911528 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-da9f152d-d989-4d98-a808-8e54c06298de req-0230d5d5-544e-4d41-b35b-ce43dded44e2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035617 Aug 04 04:31:12.912500 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 942/1876] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:12.919134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:12.919854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:12.928607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:12.929051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:12.930076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:12.930341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:12.972477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:12.973197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:12.973822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lazy-loading 'fault' on Instance uuid 1f10d48f-480a-45f4-8406-278b6e8b6cd4 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:31:13.039986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:13.055478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77167ef6-f2ad-4da9-abca-0a0a8a4b66a4 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 200 len: 1304 microversion: 2.1 time: 0.141161 Aug 04 04:31:13.068192 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 943/1877] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:12 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:13.076022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:13.076949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] [instance: 9a042fbb-c3f2-4215-8132-6d5f33961b30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:13.089016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:13.089448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:13.091879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:13.092431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:13.112039 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] HTTP exception thrown: Instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 could not be found. Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Request method failure captured: Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 HTTP/1.1 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60nS7Bh1lvi1HIXpWbWKdOOf2DkzwjGPtkM_CeRG0Xf-qJGyqHQlx3Az-8nVmykPwQxTc6PDwpcuqXP5-NeNoL4zaqgDfXV-RCMWY755JzhYQu7E8gt4E8Y-22MY1VS7aVtaapYXvmQSZifcBiB1glVfwubCrXwF-l8sLhfxFTWNIoo Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/300e53e93c2a4678b2b5695d002ac286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_300e53e93c2a4678b2b5695d002ac286", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 300e53e93c2a4678b2b5695d002ac286 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-398031229 Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: eaff90b8a434488f9d2731070edf30fe Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-398031229-project Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 could not be found. Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '9a042fbb-c3f2-4215-8132-6d5f33961b30'} Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 could not be found. Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 could not be found. Aug 04 04:31:13.114932 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 could not be found. Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] Returning 404 to user: Instance 9a042fbb-c3f2-4215-8132-6d5f33961b30 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b81b94d-24c2-435a-835e-fc6098b349c2 tempest-LiveAutoBlockMigrationV225Test-398031229 tempest-LiveAutoBlockMigrationV225Test-398031229-project] 10.222.0.69 "GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30" status: 404 len: 111 microversion: 2.25 time: 0.047732 Aug 04 04:31:13.119947 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 944/1878] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:13 2022] GET /compute/v2.1/servers/9a042fbb-c3f2-4215-8132-6d5f33961b30 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:31:13.900765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:13.907107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:13.916869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:13.917665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:13.919270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:13.919936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:14.194426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:14.207437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-69ef644f-2e59-46fd-a3ed-763b078133ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.311823 Aug 04 04:31:14.214815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 945/1879] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:13 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:14.221329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:14.224718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:14.245665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:14.246122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:14.246945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:14.247417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:14.263077 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 HTTP/1.1 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1f10d48f-480a-45f4-8406-278b6e8b6cd4'} Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:14.264645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06e4b9c8-84ca-468d-91b4-8ee4307abbe7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 404 len: 111 microversion: 2.1 time: 0.049114 Aug 04 04:31:14.273492 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 946/1880] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:14 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:14.275464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb47624f-2367-4efa-9b4d-c7bd79d85bfa tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a33e4c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:14.665377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb47624f-2367-4efa-9b4d-c7bd79d85bfa tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2" status: 202 len: 0 microversion: 2.1 time: 0.394270 Aug 04 04:31:14.666182 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 947/1881] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:14 2022] DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:31:14.682260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2021715629", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99037335-254b-4262-8aa6-b4fe7cbe9d37"}], "security_groups": [{"name": "tempest-securitygroup--1864540664"}], "key_name": "tempest-keypair-1726355252", "user_data": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:14.997570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] validate_networks() for [('e5e01355-2060-4141-8f4d-bdcf61bc7edd', None, None, None, None, None), (None, None, '603a0716-af65-4b22-943b-fc75552e52cb', None, None, None), (None, None, '6170383e-7582-4f81-92f2-d72b1ef66d77', None, None, None), ('6e6a2e63-abec-47fb-9edb-c9fcee91f754', None, None, None, None, None), ('6e6a2e63-abec-47fb-9edb-c9fcee91f754', None, None, None, None, None), ('fe4c2e0e-d52e-4951-9ed6-83d278eddf51', '10.2.2.100', None, None, None, None), ('fe4c2e0e-d52e-4951-9ed6-83d278eddf51', '10.2.2.200', None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:31:15.056029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] validate_networks() for [('99037335-254b-4262-8aa6-b4fe7cbe9d37', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:31:15.198572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:16.544115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:31:16.544653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:31:16.545020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:31:16.545440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:31:16.545879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:31:16.558670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:16.564982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:16.565946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:16.566401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:16.606018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:16.615401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:16.638580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:31:16.641496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:31:16.713490 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f0e92bd9-479b-4dae-88a9-beecc873e84e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.045846 Aug 04 04:31:16.714199 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 948/1882] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:31:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:31:16.725555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-af34ea30-9133-4c59-93eb-458c53ca22e6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191aa074c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:17.443318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-af34ea30-9133-4c59-93eb-458c53ca22e6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8" status: 202 len: 0 microversion: 2.1 time: 0.727943 Aug 04 04:31:17.444027 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 949/1883] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:16 2022] DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:31:17.455708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:17.456611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:17.475149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:17.475880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:17.476862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:17.477736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:17.867817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:17.894656 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8d642cbe-2b61-4e04-8fef-024278752985 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.449337 Aug 04 04:31:17.909765 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 950/1884] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:17 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:17.926932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:17.927885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:17.947814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:17.948273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:17.949092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:17.950172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:18.084792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:18.107113 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-109c142e-9058-426d-ab0b-3b4b2a4564cc tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1294 microversion: 2.1 time: 0.195423 Aug 04 04:31:18.108445 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 951/1885] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:17 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1294 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:18.113561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5dbcbc5-126b-40f3-834c-6c3fdff2514c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'create', calling method: .version_select at 0x7f191a2dce50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-879738511", "description": "tempest-description-1180351987"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:18.803861 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5dbcbc5-126b-40f3-834c-6c3fdff2514c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.693823 Aug 04 04:31:18.804923 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 952/1886] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:31:18 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:18.827647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-adeef094-3382-444d-be00-a8732d509edf tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Action: 'update', calling method: .version_select at 0x7f191a4d7700>, body: {"security_group": {"name": "tempest-sg-hth-300687885", "description": "tempest-description-hth-734180650"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:19.031370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:19.535271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-adeef094-3382-444d-be00-a8732d509edf tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "PUT /compute/v2.1/os-security-groups/4e70fe35-77b3-4529-817f-f6ce93dad84b" status: 200 len: 216 microversion: 2.1 time: 0.719945 Aug 04 04:31:19.545377 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 953/1887] 10.222.0.69 () {60 vars in 1290 bytes} [Thu Aug 4 04:31:18 2022] PUT /compute/v2.1/os-security-groups/4e70fe35-77b3-4529-817f-f6ce93dad84b => generated 216 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:19.715530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:19.716145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:19.724433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:19.725551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:19.726671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:19.727312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:20.441745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:20.456810 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-728f4765-794f-45a7-812d-2ca21bcff05f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.909902 Aug 04 04:31:20.473547 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 954/1888] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:19 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:20.490018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:20.493127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:20.518230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:20.519141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:20.520189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:20.521013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:21.286834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:21.307505 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f46fe49-f6a3-4628-b087-965fd154594e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1368 microversion: 2.1 time: 0.832333 Aug 04 04:31:21.308101 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 955/1889] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:20 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1368 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:21.327001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9bddbf6e-5631-48dd-9eca-ab3bf6fa3dab tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a33e4c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:21.467923 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9bddbf6e-5631-48dd-9eca-ab3bf6fa3dab tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/4e70fe35-77b3-4529-817f-f6ce93dad84b" status: 200 len: 216 microversion: 2.1 time: 0.145479 Aug 04 04:31:21.468526 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 956/1890] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:31:21 2022] GET /compute/v2.1/os-security-groups/4e70fe35-77b3-4529-817f-f6ce93dad84b => generated 216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:21.488309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:31:21.496294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:31:21.497127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:31:21.506583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:31:21.507150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:31:21.509355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:21.548366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a8baba9-2e8c-49dc-ba39-34eca294ac21 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a688ee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:21.667503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:21.671780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:21.678633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:21.679532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:21.713331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Getting quotas for project 1642d2eb789f4ec49d07523481fd11f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:21.744160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Getting quotas for user 37dc980aa515445d9d71f4c20daecef9 and project 1642d2eb789f4ec49d07523481fd11f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:22.032536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:31:22.037164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='752265e6-cd03-40c2-9e1a-a2abd73172a7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3ebbe2ec-5401-40bd-b184-2870511e3a24',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4274cad2-24b0-4b7c-bfc0-38e325de4efd',volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:31:22.334145 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2a8baba9-2e8c-49dc-ba39-34eca294ac21 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/4e70fe35-77b3-4529-817f-f6ce93dad84b" status: 202 len: 0 microversion: 2.1 time: 0.841870 Aug 04 04:31:22.335627 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 957/1891] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:21 2022] DELETE /compute/v2.1/os-security-groups/4e70fe35-77b3-4529-817f-f6ce93dad84b => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:31:22.347624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:22.350633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:22.384450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:22.384910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:22.388740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:22.389265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:22.812967 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aa38ee71-322a-4c77-8d71-d3a2bc1aea1c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 13.766192 Aug 04 04:31:22.814801 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 935/1892] 10.222.0.69 () {62 vars in 1189 bytes} [Thu Aug 4 04:31:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 13769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:31:22.821993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:22.828475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b7097daa-c019-4e4d-b318-df6b5a4f94c6 req-9a0178b6-1651-4b01-9636-a52f3eb5f9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab3ca78-87df-46a4-a7f7-7648c150a4c4", "tag": "c6089696-8361-468a-8309-c124a89e47ea"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:22.835833 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ed3e9d8e-166f-41b7-9a43-dd0bde0b55db tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.498587 Aug 04 04:31:22.838544 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 958/1893] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:22 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:22.845427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b7097daa-c019-4e4d-b318-df6b5a4f94c6 req-9a0178b6-1651-4b01-9636-a52f3eb5f9cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:22.849447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b7097daa-c019-4e4d-b318-df6b5a4f94c6 req-9a0178b6-1651-4b01-9636-a52f3eb5f9cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:22.851707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:22.852576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:22.870683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:22.871896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:22.873014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:22.873480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:22.878774 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b7097daa-c019-4e4d-b318-df6b5a4f94c6 req-9a0178b6-1651-4b01-9636-a52f3eb5f9cb service nova] Creating event network-changed:c6089696-8361-468a-8309-c124a89e47ea for instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 on n-h1-851337-5 Aug 04 04:31:22.895163 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b7097daa-c019-4e4d-b318-df6b5a4f94c6 req-9a0178b6-1651-4b01-9636-a52f3eb5f9cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078946 Aug 04 04:31:22.898671 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 936/1894] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:22.905538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:22.907098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:22.915415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:22.916212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:22.917221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:22.917907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:22.936595 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 HTTP/1.1 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '1f10d48f-480a-45f4-8406-278b6e8b6cd4'} Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:22.938903 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:22.945630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:22.949043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:22.951208 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8041a662-df05-4acd-b2a9-f4633cff09c8 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 404 len: 111 microversion: 2.1 time: 0.051227 Aug 04 04:31:22.956764 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 937/1895] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:31:22 2022] DELETE /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:22.964669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-90544767-3cb5-41c5-837f-ae1014510717 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:22.972799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-90544767-3cb5-41c5-837f-ae1014510717 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:23.236000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-90544767-3cb5-41c5-837f-ae1014510717 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:23.247952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-90544767-3cb5-41c5-837f-ae1014510717 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:23.249499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-90544767-3cb5-41c5-837f-ae1014510717 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:23.256682 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-90544767-3cb5-41c5-837f-ae1014510717 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1285 microversion: 2.32 time: 0.300133 Aug 04 04:31:23.257118 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 938/1896] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:22 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:23.269551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.270447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: 1f10d48f-480a-45f4-8406-278b6e8b6cd4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:23.288475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:23.295716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:23.297093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:23.297745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:23.326657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 HTTP/1.1 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '1f10d48f-480a-45f4-8406-278b6e8b6cd4'} Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.331058 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.336512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Instance 1f10d48f-480a-45f4-8406-278b6e8b6cd4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:23.337514 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f77a8888-1be9-4fec-a521-3e0092f1f6d5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4" status: 404 len: 111 microversion: 2.1 time: 0.074342 Aug 04 04:31:23.341783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 939/1897] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:23 2022] GET /compute/v2.1/servers/1f10d48f-480a-45f4-8406-278b6e8b6cd4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:23.350919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44fbf2b9-cd3a-4e7a-87e8-f7034d49af4b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a28e700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.424169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:23.425290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-44fbf2b9-cd3a-4e7a-87e8-f7034d49af4b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:23.426006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-44fbf2b9-cd3a-4e7a-87e8-f7034d49af4b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 not found {{(pid=119342) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:31:23.426645 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-44fbf2b9-cd3a-4e7a-87e8-f7034d49af4b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist Aug 04 04:31:23.426645 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-1d85c3c5-1bca-425e-a184-faca8ab4cdd2'] Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44fbf2b9-cd3a-4e7a-87e8-f7034d49af4b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 HTTP/1.1 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-1d85c3c5-1bca-425e-a184-faca8ab4cdd2'] Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f307d1e5-d7ed-434d-b3b1-7ed28a1998f8'} Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:23.428710 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d85c3c5-1bca-425e-a184-faca8ab4cdd2'] Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d85c3c5-1bca-425e-a184-faca8ab4cdd2'] Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d85c3c5-1bca-425e-a184-faca8ab4cdd2'] Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d85c3c5-1bca-425e-a184-faca8ab4cdd2'] Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44fbf2b9-cd3a-4e7a-87e8-f7034d49af4b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 does not exist Aug 04 04:31:23.434033 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-1d85c3c5-1bca-425e-a184-faca8ab4cdd2'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:23.443579 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4c45e8b-4943-4e7d-ba36-28fb3f8ab155 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1368 microversion: 2.1 time: 0.596246 Aug 04 04:31:23.443579 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 959/1898] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:22 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1368 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:23.443803 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44fbf2b9-cd3a-4e7a-87e8-f7034d49af4b tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8" status: 404 len: 194 microversion: 2.1 time: 0.089964 Aug 04 04:31:23.443803 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 940/1899] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:23 2022] DELETE /compute/v2.1/os-security-groups/f307d1e5-d7ed-434d-b3b1-7ed28a1998f8 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:31:23.455051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7b2227a-7fae-4ded-8dcd-ed195a15537d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a4f9670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.497459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-d7b2227a-7fae-4ded-8dcd-ed195a15537d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:23.498193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-d7b2227a-7fae-4ded-8dcd-ed195a15537d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:31:23.499157 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-d7b2227a-7fae-4ded-8dcd-ed195a15537d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist Aug 04 04:31:23.499157 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-ae52e835-4eb0-48a4-a586-504e09e29652'] Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7b2227a-7fae-4ded-8dcd-ed195a15537d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2 HTTP/1.1 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-ae52e835-4eb0-48a4-a586-504e09e29652'] Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '586db7aa-ea84-4a88-a6cf-cda01c185df2'} Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:23.501869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae52e835-4eb0-48a4-a586-504e09e29652'] Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae52e835-4eb0-48a4-a586-504e09e29652'] Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae52e835-4eb0-48a4-a586-504e09e29652'] Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae52e835-4eb0-48a4-a586-504e09e29652'] Aug 04 04:31:23.507315 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.511671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7b2227a-7fae-4ded-8dcd-ed195a15537d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group 586db7aa-ea84-4a88-a6cf-cda01c185df2 does not exist Aug 04 04:31:23.511671 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-ae52e835-4eb0-48a4-a586-504e09e29652'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:23.513305 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7b2227a-7fae-4ded-8dcd-ed195a15537d tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2" status: 404 len: 194 microversion: 2.1 time: 0.066523 Aug 04 04:31:23.514064 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 960/1900] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:23 2022] DELETE /compute/v2.1/os-security-groups/586db7aa-ea84-4a88-a6cf-cda01c185df2 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:23.525256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24df3592-3acd-470b-9d3e-d83594de3c81 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a6d03a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.603529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-24df3592-3acd-470b-9d3e-d83594de3c81 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:23.604587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-24df3592-3acd-470b-9d3e-d83594de3c81 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group ccc421d6-09a2-4548-abdd-19f619dee57e not found {{(pid=119342) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:31:23.608320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-24df3592-3acd-470b-9d3e-d83594de3c81 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:31:23.608320 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-a5bc23bd-0777-4ff4-a6ce-dc1427c07430'] Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24df3592-3acd-470b-9d3e-d83594de3c81 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e HTTP/1.1 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-a5bc23bd-0777-4ff4-a6ce-dc1427c07430'] Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'ccc421d6-09a2-4548-abdd-19f619dee57e'} Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:23.613156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bc23bd-0777-4ff4-a6ce-dc1427c07430'] Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bc23bd-0777-4ff4-a6ce-dc1427c07430'] Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bc23bd-0777-4ff4-a6ce-dc1427c07430'] Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bc23bd-0777-4ff4-a6ce-dc1427c07430'] Aug 04 04:31:23.618415 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.624679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24df3592-3acd-470b-9d3e-d83594de3c81 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group ccc421d6-09a2-4548-abdd-19f619dee57e does not exist Aug 04 04:31:23.624679 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-a5bc23bd-0777-4ff4-a6ce-dc1427c07430'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:23.630990 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24df3592-3acd-470b-9d3e-d83594de3c81 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e" status: 404 len: 194 microversion: 2.1 time: 0.111279 Aug 04 04:31:23.635668 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 941/1901] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:23 2022] DELETE /compute/v2.1/os-security-groups/ccc421d6-09a2-4548-abdd-19f619dee57e => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:23.640999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-639d86a6-7c0a-4041-9dac-8c47248e8dda tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a2dc9d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.675931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-639d86a6-7c0a-4041-9dac-8c47248e8dda tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:23.676982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-639d86a6-7c0a-4041-9dac-8c47248e8dda tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group 37f57182-4015-4464-83fc-ec53a2165266 not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:31:23.677726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-639d86a6-7c0a-4041-9dac-8c47248e8dda tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:31:23.677726 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-3e29b6c1-0eb9-496c-a5e8-dbbb76264717'] Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-639d86a6-7c0a-4041-9dac-8c47248e8dda tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266 HTTP/1.1 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-3e29b6c1-0eb9-496c-a5e8-dbbb76264717'] Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '37f57182-4015-4464-83fc-ec53a2165266'} Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:23.680735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e29b6c1-0eb9-496c-a5e8-dbbb76264717'] Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e29b6c1-0eb9-496c-a5e8-dbbb76264717'] Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e29b6c1-0eb9-496c-a5e8-dbbb76264717'] Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e29b6c1-0eb9-496c-a5e8-dbbb76264717'] Aug 04 04:31:23.687915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.696116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-639d86a6-7c0a-4041-9dac-8c47248e8dda tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group 37f57182-4015-4464-83fc-ec53a2165266 does not exist Aug 04 04:31:23.696116 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-3e29b6c1-0eb9-496c-a5e8-dbbb76264717'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:23.696116 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-639d86a6-7c0a-4041-9dac-8c47248e8dda tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266" status: 404 len: 194 microversion: 2.1 time: 0.055852 Aug 04 04:31:23.696116 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 961/1902] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:23 2022] DELETE /compute/v2.1/os-security-groups/37f57182-4015-4464-83fc-ec53a2165266 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:23.707368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ec2ec80-c640-47f1-95c4-6393cb5d8c4f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191a36d700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.776390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-5ec2ec80-c640-47f1-95c4-6393cb5d8c4f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:23.777779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-5ec2ec80-c640-47f1-95c4-6393cb5d8c4f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group 819309ee-29d9-4597-96cc-9045e0307efc not found {{(pid=119342) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:31:23.778765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5ec2ec80-c640-47f1-95c4-6393cb5d8c4f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:31:23.778765 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-7a00bf7f-cf83-4e37-8d8f-98711d2be9d3'] Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ec2ec80-c640-47f1-95c4-6393cb5d8c4f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc HTTP/1.1 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-7a00bf7f-cf83-4e37-8d8f-98711d2be9d3'] Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '819309ee-29d9-4597-96cc-9045e0307efc'} Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:23.782496 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a00bf7f-cf83-4e37-8d8f-98711d2be9d3'] Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a00bf7f-cf83-4e37-8d8f-98711d2be9d3'] Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a00bf7f-cf83-4e37-8d8f-98711d2be9d3'] Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a00bf7f-cf83-4e37-8d8f-98711d2be9d3'] Aug 04 04:31:23.789814 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:23.809746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ec2ec80-c640-47f1-95c4-6393cb5d8c4f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group 819309ee-29d9-4597-96cc-9045e0307efc does not exist Aug 04 04:31:23.809746 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-7a00bf7f-cf83-4e37-8d8f-98711d2be9d3'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:23.811934 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5ec2ec80-c640-47f1-95c4-6393cb5d8c4f tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc" status: 404 len: 194 microversion: 2.1 time: 0.111652 Aug 04 04:31:23.816648 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 942/1903] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:23 2022] DELETE /compute/v2.1/os-security-groups/819309ee-29d9-4597-96cc-9045e0307efc => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:23.821660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be357a2d-5009-449c-8b65-d56f81d4cb82 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f191aaf3700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.862320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:23.864156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:23.872574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:23.873144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:23.874032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:23.874720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.047347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG neutronclient.v2_0.client [None req-be357a2d-5009-449c-8b65-d56f81d4cb82 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist", "detail": ""}} {{(pid=119343) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:31:24.048285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.security_group_api [None req-be357a2d-5009-449c-8b65-d56f81d4cb82 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Neutron security group f74d524c-31a3-4cdc-b88c-6ba4165db006 not found {{(pid=119343) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:31:24.049099 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-be357a2d-5009-449c-8b65-d56f81d4cb82 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:31:24.049099 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-e4e9d4bb-c785-4683-8c4b-1d9d539dc2cd'] Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be357a2d-5009-449c-8b65-d56f81d4cb82 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006 HTTP/1.1 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-e4e9d4bb-c785-4683-8c4b-1d9d539dc2cd'] Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f74d524c-31a3-4cdc-b88c-6ba4165db006'} Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:31:24.054200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4e9d4bb-c785-4683-8c4b-1d9d539dc2cd'] Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4e9d4bb-c785-4683-8c4b-1d9d539dc2cd'] Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4e9d4bb-c785-4683-8c4b-1d9d539dc2cd'] Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4e9d4bb-c785-4683-8c4b-1d9d539dc2cd'] Aug 04 04:31:24.060683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:24.067500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be357a2d-5009-449c-8b65-d56f81d4cb82 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Security group f74d524c-31a3-4cdc-b88c-6ba4165db006 does not exist Aug 04 04:31:24.067500 n-d-851337-5 devstack@n-api.service[119343]: Neutron server returns request_ids: ['req-e4e9d4bb-c785-4683-8c4b-1d9d539dc2cd'] {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:24.068395 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-be357a2d-5009-449c-8b65-d56f81d4cb82 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006" status: 404 len: 194 microversion: 2.1 time: 0.250900 Aug 04 04:31:24.068974 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 962/1904] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:23 2022] DELETE /compute/v2.1/os-security-groups/f74d524c-31a3-4cdc-b88c-6ba4165db006 => generated 194 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:24.078022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:24.078533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:24.085762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.087027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.088639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.090379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.127008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:31:24.184993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:24.196829 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-28a95a4b-3a00-455c-be3c-39594e692745 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.341256 Aug 04 04:31:24.197797 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 943/1905] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:23 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:24.247487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3cb7bef0-06e1-4bac-807b-ae3f28e8df8c tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 204 len: 0 microversion: 2.1 time: 0.172938 Aug 04 04:31:24.248281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 963/1906] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:31:24 2022] DELETE /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:31:24.256437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:24.257276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:24.264617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.265213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.266227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.266778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.294724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:24.296114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:24.303824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.304265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.305309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.305744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.457634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:24.467933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:24.469691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:24.472242 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2f62cee3-0427-4bfa-9f29-ba2faaa8abe6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1527 microversion: 2.32 time: 0.183802 Aug 04 04:31:24.477704 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 964/1907] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:24 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1527 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:24.491398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:24.492230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:24.500329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.501045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.501995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:24.502673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:24.558191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:24.579479 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a604fc9-6413-47cc-a93f-048ca1fbc2c5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1648 microversion: 2.1 time: 0.325826 Aug 04 04:31:24.580415 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 944/1908] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:24 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1648 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:24.736596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:24.744868 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24868888-327c-4c20-a9d9-9ac2a6ab25d8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1368 microversion: 2.1 time: 0.265627 Aug 04 04:31:24.747537 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 965/1909] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:24 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:25.218680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:25.219433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:25.237619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.238109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:25.240672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.241145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:25.495928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:25.496715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:25.538459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.541232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:25.542760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.544498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:25.577541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:25.592285 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-da5482c4-7a83-4238-a392-583c00fe83b5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.378209 Aug 04 04:31:25.592914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 945/1910] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:25 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:25.611957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:25.614814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:25.651435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.652992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:25.654322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.654994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:25.674845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:25.693579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:25.698820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:25.703049 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd2dd403-272b-4c8f-b3cb-7c55db62d44b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1527 microversion: 2.32 time: 0.211430 Aug 04 04:31:25.708265 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 966/1911] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:25 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:25.777229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:25.778297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:25.811674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.813195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:25.825560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:25.826789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:26.289083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:26.297169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-820957ca-7505-43da-a305-159f3d610e2a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1368 microversion: 2.1 time: 0.530748 Aug 04 04:31:26.302454 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 967/1912] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:25 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1368 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:26.378312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:26.396628 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3938c9fc-b945-460b-8288-d1f0ecb751a5 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1648 microversion: 2.1 time: 0.792996 Aug 04 04:31:26.397800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 946/1913] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:25 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1648 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:26.618217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:26.626500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:26.629428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:26.642329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:26.665585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:26.667999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:26.670032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:26.670798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:26.701252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:26.742594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:26.743732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:26.756361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:26.757297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:26.758381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:26.760105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:27.252064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:27.274142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:27.277996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:27.282372 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b9634202-09f0-49fb-a171-13591de29573 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1575 microversion: 2.32 time: 0.549748 Aug 04 04:31:27.301501 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 947/1914] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:26 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1575 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:27.302792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:27.312808 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3db18252-6ffe-4923-a30a-b267015bf415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.697929 Aug 04 04:31:27.317823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:27.318740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:27.331916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 968/1915] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:26 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:27.333022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:27.333762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:27.334777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:27.335471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:27.419405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:27.420551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:27.441683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:27.447404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:27.449062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:27.451046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:27.982274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:28.004409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f17fdaea-5bfc-4939-a424-437a3ed2a1d7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1648 microversion: 2.1 time: 0.590404 Aug 04 04:31:28.024345 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 969/1916] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:27 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1648 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:28.227725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab8c9911-2dd7-4591-abe3-785e5424be02 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59e5b0aa-d2a9-4d10-896a-7f5491adbb31"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:28.233653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab8c9911-2dd7-4591-abe3-785e5424be02 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:28.256178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab8c9911-2dd7-4591-abe3-785e5424be02 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:28.259115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab8c9911-2dd7-4591-abe3-785e5424be02 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:28.259934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab8c9911-2dd7-4591-abe3-785e5424be02 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:28.260586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab8c9911-2dd7-4591-abe3-785e5424be02 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:28.324057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:28.334684 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-49cf261b-9876-4fa8-8cae-c36ff8d80f76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1368 microversion: 2.1 time: 1.019173 Aug 04 04:31:28.339288 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 948/1917] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:27 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1368 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:28.351137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:28.355366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:28.363111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:28.363427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:28.364203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:28.364690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:28.497107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:28.519829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:28.536170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:28.537385 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0c2c3600-394c-4f95-a2db-4810ffe1f605 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1593 microversion: 2.32 time: 0.196351 Aug 04 04:31:28.554613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 949/1918] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:28 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1593 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:28.564277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:28.564277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:28.580722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:28.585726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:28.590944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:28.591811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:28.800507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab8c9911-2dd7-4591-abe3-785e5424be02 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "POST /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582786 Aug 04 04:31:28.801441 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 970/1919] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:31:28 2022] POST /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:28.811127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-27369b03-f8e6-4d67-99bd-64f3176c10b9 req-7df218a5-f667-4c9d-9399-45959f749901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab3ca78-87df-46a4-a7f7-7648c150a4c4", "name": "network-vif-plugged", "status": "completed", "tag": "c6089696-8361-468a-8309-c124a89e47ea"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:28.839852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-27369b03-f8e6-4d67-99bd-64f3176c10b9 req-7df218a5-f667-4c9d-9399-45959f749901 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:28.840696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-27369b03-f8e6-4d67-99bd-64f3176c10b9 req-7df218a5-f667-4c9d-9399-45959f749901 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:28.863991 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-27369b03-f8e6-4d67-99bd-64f3176c10b9 req-7df218a5-f667-4c9d-9399-45959f749901 service nova] Creating event network-vif-plugged:c6089696-8361-468a-8309-c124a89e47ea for instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 on n-h1-851337-5 Aug 04 04:31:28.876807 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-27369b03-f8e6-4d67-99bd-64f3176c10b9 req-7df218a5-f667-4c9d-9399-45959f749901 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073864 Aug 04 04:31:28.879263 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 971/1920] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:28.973075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:28.985009 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a87cf0d4-e606-4f83-99e7-29043309542a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.435986 Aug 04 04:31:28.985879 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 950/1921] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:28 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:29.031106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:29.031897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:29.042567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:29.047413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:29.048541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:29.049237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:29.246093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:29.257123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bfd7673c-7a09-4336-b3ed-e3cf2d4b93c6 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1468 microversion: 2.1 time: 0.230763 Aug 04 04:31:29.272386 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 972/1922] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:29 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1468 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:29.358224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:29.358991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:29.372570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:29.373128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:29.374410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:29.376110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:29.571590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:29.573512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:29.588841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:29.589489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:29.590618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:29.591201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:30.003005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:30.017966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:30.022870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:30.025466 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60f3e012-ca0e-4644-9db1-d2a7e3416e53 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1593 microversion: 2.32 time: 0.456945 Aug 04 04:31:30.030458 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 973/1923] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:29 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1593 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:30.040568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c5c87d51-7bdb-451b-8ebb-8261cb3a5659 req-31c99dff-0a97-4d80-97d8-0f80e4c5b8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf836cb-a8af-4574-9b76-a85b36799229", "name": "network-vif-deleted", "tag": "b27126bb-829e-4b19-8153-6d22f289286d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:30.066763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5c87d51-7bdb-451b-8ebb-8261cb3a5659 req-31c99dff-0a97-4d80-97d8-0f80e4c5b8d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:30.067583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5c87d51-7bdb-451b-8ebb-8261cb3a5659 req-31c99dff-0a97-4d80-97d8-0f80e4c5b8d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:30.093052 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c5c87d51-7bdb-451b-8ebb-8261cb3a5659 req-31c99dff-0a97-4d80-97d8-0f80e4c5b8d9 service nova] Creating event network-vif-deleted:b27126bb-829e-4b19-8153-6d22f289286d for instance ebf836cb-a8af-4574-9b76-a85b36799229 on n-h1-851337-5 Aug 04 04:31:30.108843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c5c87d51-7bdb-451b-8ebb-8261cb3a5659 req-31c99dff-0a97-4d80-97d8-0f80e4c5b8d9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073052 Aug 04 04:31:30.111355 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 974/1924] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:30.127688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:30.129172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:30.142230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:30.142890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:30.144130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:30.144880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:30.195111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:30.206758 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b70afe1e-99b6-44a5-ae60-fe6226c6301b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1368 microversion: 2.1 time: 0.853595 Aug 04 04:31:30.207484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 951/1925] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:29 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1368 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:30.280432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:30.281049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:30.297672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:30.298175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:30.299091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:30.299563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:30.360636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:30.366328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:30.366871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lazy-loading 'fault' on Instance uuid ebf836cb-a8af-4574-9b76-a85b36799229 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:31:30.417375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:30.428630 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5e7bfcb-f5a8-4e82-8a7c-de584c211526 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.315830 Aug 04 04:31:30.441398 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 975/1926] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:30 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:30.465472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04be216c81cd4a1b91d7f7a5d681eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a364fd6ed2a46f2849f116d13c8556d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:30.475046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e2c4fe4-568a-4de5-a629-c5b08cbaccc7 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 200 len: 1306 microversion: 2.1 time: 0.201161 Aug 04 04:31:30.489264 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 952/1927] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:30 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 1306 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:31.063793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:31.064580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:31.087826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.088281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.090614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.093623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.227437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:31.228096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:31.235763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.236629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.237691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.238845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.316786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:31.331474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:31.333308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:31.334653 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1aaaae56-4aef-436e-bd2f-bce0e2b08e07 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1661 microversion: 2.32 time: 0.284713 Aug 04 04:31:31.336523 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 976/1928] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:31 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1661 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:31.438132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:31.447805 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-18dcd686-8833-44f0-b2ce-aa3101025c50 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1559 microversion: 2.1 time: 0.224098 Aug 04 04:31:31.455826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:31.457776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:31.457948 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 953/1929] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:31 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:31.466794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.468814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.472894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87d69932-0e69-4205-ac47-2392ada53b76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:31.474054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-87d69932-0e69-4205-ac47-2392ada53b76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:31.479986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.480690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.482818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87d69932-0e69-4205-ac47-2392ada53b76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.483670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87d69932-0e69-4205-ac47-2392ada53b76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.485342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87d69932-0e69-4205-ac47-2392ada53b76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.486074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87d69932-0e69-4205-ac47-2392ada53b76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.702102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:31.940010 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-87d69932-0e69-4205-ac47-2392ada53b76 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.473082 Aug 04 04:31:31.940778 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 954/1930] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:31:31 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4/os-interface => generated 285 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:31.949386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:31.950031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] [instance: ebf836cb-a8af-4574-9b76-a85b36799229] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:31.964492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.964994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:31.965806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:31.966260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:32.026621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] HTTP exception thrown: Instance ebf836cb-a8af-4574-9b76-a85b36799229 could not be found. Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Request method failure captured: Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 HTTP/1.1 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sd2io97Sk8JZq2NG6ky97qCLD3m6qsSwX7ZVYPhWEJXsbNzAhQAnaTZGS_vXCsuxorUzFhze7FT57dUHDopLvzMQXSjgAFYUaPLcOQQlfe3jlIpkmNqrBluEQHn7MIwrpdXcBQSubpgs85iIqSZfcLIgsmR7uBfvPVnU75KGsnIlc Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2a364fd6ed2a46f2849f116d13c8556d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2a364fd6ed2a46f2849f116d13c8556d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2a364fd6ed2a46f2849f116d13c8556d Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500197820 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04be216c81cd4a1b91d7f7a5d681eba2 Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupsTestJSON-1500197820-project Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance ebf836cb-a8af-4574-9b76-a85b36799229 could not be found. Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'ebf836cb-a8af-4574-9b76-a85b36799229'} Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf836cb-a8af-4574-9b76-a85b36799229 could not be found. Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf836cb-a8af-4574-9b76-a85b36799229 could not be found. Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:32.043632 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf836cb-a8af-4574-9b76-a85b36799229 could not be found. Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:31:32.049876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Returning 404 to user: Instance ebf836cb-a8af-4574-9b76-a85b36799229 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:32.058232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b8a98720-92ea-4cd1-9cc5-8099466cce7a tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229" status: 404 len: 111 microversion: 2.1 time: 0.116265 Aug 04 04:31:32.060324 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 955/1931] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:31 2022] GET /compute/v2.1/servers/ebf836cb-a8af-4574-9b76-a85b36799229 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:31:32.077853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f45b0ce0-68ee-446b-bd8e-7da62a6d7d02 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f1923aceee0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:32.091131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:32.109908 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1e2bcbfd-3c09-4860-9153-e103d8e6b146 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.661141 Aug 04 04:31:32.110511 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 977/1932] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:31 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:32.359690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:32.360528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:32.373157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:32.373723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:32.374400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:32.374843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:32.409490 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f45b0ce0-68ee-446b-bd8e-7da62a6d7d02 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/80c22ce5-50c1-4b64-a9af-675592032b9d" status: 202 len: 0 microversion: 2.1 time: 0.344048 Aug 04 04:31:32.410502 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 956/1933] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:32 2022] DELETE /compute/v2.1/os-security-groups/80c22ce5-50c1-4b64-a9af-675592032b9d => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:31:32.420697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5124bcb3-1759-4cf9-958d-23801736bbf2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] Calling method '.version_select at 0x7f1923ace670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:32.687645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:32.706639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:32.706639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:32.715434 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-436cb45e-d9b9-4474-aeb7-bf233e10c49e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1708 microversion: 2.32 time: 0.359516 Aug 04 04:31:32.734806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 978/1934] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:32 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1708 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:32.811122 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5124bcb3-1759-4cf9-958d-23801736bbf2 tempest-SecurityGroupsTestJSON-1500197820 tempest-SecurityGroupsTestJSON-1500197820-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/3e0bd1fa-f5e8-4c79-bfa2-5474b805b273" status: 202 len: 0 microversion: 2.1 time: 0.396651 Aug 04 04:31:32.814250 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 957/1935] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:31:32 2022] DELETE /compute/v2.1/os-security-groups/3e0bd1fa-f5e8-4c79-bfa2-5474b805b273 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:31:33.133957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:33.134587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:33.150320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:33.151078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:33.152883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:33.154178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:33.449513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:33.462989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a96fd1bb-29b4-470d-b492-b7c156414f3b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.333090 Aug 04 04:31:33.463794 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 979/1936] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:33 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:33.742147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:33.747316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:33.747947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:33.768178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:33.768629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:33.769433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:33.769885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:34.038877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:34.054915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:34.057932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:34.061625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a863777-c599-4da6-ad86-99507acf7abf tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1755 microversion: 2.32 time: 0.320523 Aug 04 04:31:34.063944 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 958/1937] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:33 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:34.249272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-5247d0d9-7677-4a4a-b58e-6b95c55eff5a req-2afc4d84-661a-46bb-97fe-c9e1e48a0fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab3ca78-87df-46a4-a7f7-7648c150a4c4", "tag": "c6089696-8361-468a-8309-c124a89e47ea"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:34.272567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5247d0d9-7677-4a4a-b58e-6b95c55eff5a req-2afc4d84-661a-46bb-97fe-c9e1e48a0fc0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:34.276703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5247d0d9-7677-4a4a-b58e-6b95c55eff5a req-2afc4d84-661a-46bb-97fe-c9e1e48a0fc0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:34.314190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-5247d0d9-7677-4a4a-b58e-6b95c55eff5a req-2afc4d84-661a-46bb-97fe-c9e1e48a0fc0 service nova] Creating event network-changed:c6089696-8361-468a-8309-c124a89e47ea for instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 on n-h1-851337-5 Aug 04 04:31:34.338916 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-5247d0d9-7677-4a4a-b58e-6b95c55eff5a req-2afc4d84-661a-46bb-97fe-c9e1e48a0fc0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091663 Aug 04 04:31:34.340824 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 980/1938] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:34.485224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:34.486313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:34.499383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:34.504199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:34.505231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:34.507483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:34.969668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:34.989991 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-276c74f9-50fa-49ec-a243-088f64fd0415 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.508877 Aug 04 04:31:35.009443 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 959/1939] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:34 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:35.088270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:35.089210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:35.105986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:35.106880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:35.111334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:35.133396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:35.461785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:35.495462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:35.502912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:35.505091 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1015aac-249a-476e-bbd4-fdd60a120258 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1755 microversion: 2.32 time: 0.423674 Aug 04 04:31:35.507803 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 981/1940] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:35 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1755 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:36.022576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:36.025220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:36.066664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:36.067902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:36.069012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:36.069818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:36.535135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:36.535788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:36.567440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:36.567884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:36.568948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:36.569595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:36.616751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:36.621865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:36.640925 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f9bd7428-2dc9-4f74-afdb-5d2cf15df611 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1512 microversion: 2.1 time: 0.620046 Aug 04 04:31:36.644727 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 960/1941] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:36 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1512 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:36.977294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:36.990934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:37.000772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:37.001993 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5d4444eb-e5d8-42e0-892d-80aa1060a12e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1802 microversion: 2.32 time: 0.471315 Aug 04 04:31:37.002588 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 982/1942] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:36 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1802 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:37.665884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:37.666388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:37.675933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:37.676839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:37.677884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:37.678545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.036918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:38.039531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:38.056250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.057123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.058036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.060686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.061797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:38.070038 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3be83f04-7c67-4763-954c-207634767871 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1489 microversion: 2.1 time: 0.408158 Aug 04 04:31:38.074901 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 961/1943] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:37 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1489 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:38.103269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-856c7850-c05d-4954-a2cc-0cc8da019854 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:38.106366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-856c7850-c05d-4954-a2cc-0cc8da019854 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:38.125653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-856c7850-c05d-4954-a2cc-0cc8da019854 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.133758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-856c7850-c05d-4954-a2cc-0cc8da019854 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.133873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-856c7850-c05d-4954-a2cc-0cc8da019854 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.134279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-856c7850-c05d-4954-a2cc-0cc8da019854 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.228913 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-856c7850-c05d-4954-a2cc-0cc8da019854 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 200 len: 161 microversion: 2.1 time: 0.136438 Aug 04 04:31:38.231318 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 962/1944] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:31:38 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 161 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:38.241842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:38.242871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:38.250939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.251735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.252845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.253494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.467169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:38.481870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:38.483694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:38.489701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c94da020-e996-4414-89ad-6d3a1b7f2dab tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1802 microversion: 2.32 time: 0.459892 Aug 04 04:31:38.503503 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 983/1945] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:38 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1802 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:38.591259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:38.627784 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ac9df6b3-337c-4e4b-a5cb-6bd16946b30e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.390329 Aug 04 04:31:38.642049 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 963/1946] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:38 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:31:38.661777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:38.664407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:38.675880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:38.679453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.683730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:38.694012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:38.694666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:39.045626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:39.060125 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c7644b9f-2796-4441-99df-bd2a5a06653f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.404498 Aug 04 04:31:39.062931 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 984/1947] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:38 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:39.086361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:39.087829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:39.101473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:39.102020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:39.103349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:39.103883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:39.313196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:39.321262 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-959e6c39-ccf4-462e-a621-ceb445d7be4b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.239661 Aug 04 04:31:39.335253 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 964/1948] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:39 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:39.348153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:39.348935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:39.375596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:39.376402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:39.377345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:39.378305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:39.518863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:39.520040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:39.532805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:39.533283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:39.534084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:39.538569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:40.120810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:40.125348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:40.135458 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03d3b55a-f4b6-438a-913c-41b2883b37d0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.793535 Aug 04 04:31:40.140095 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 985/1949] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:39 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:40.151796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1959117928", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6f5fc760-036b-4db9-9515-31d6fe212ea8"}], "block_device_mapping_v2": [{"uuid": "2073539f-324c-4f3c-82c0-de770a0a2d01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:40.368024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:40.382229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:40.389186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:40.390649 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f51cc8f3-7e47-4064-aab4-c47a71d4bc34 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1849 microversion: 2.32 time: 0.876987 Aug 04 04:31:40.411847 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 965/1950] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:39 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1849 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:40.508393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-559634875", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "fcf37719-691e-4ce4-8b13-247de9c8f621"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:40.602031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] validate_networks() for [('fcf37719-691e-4ce4-8b13-247de9c8f621', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:31:41.832394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:31:41.832974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:31:41.833290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:31:41.833900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:31:41.834492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:31:41.854212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:41.856714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:41.858269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:41.858911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:41.902465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:41.910416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for user d51068c4cce544e38ad1b23996efdec3 and project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:41.930526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:31:41.934844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:31:42.009954 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-202076bb-08d8-44c3-ad4b-8cf8db7aa9ce tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502947 Aug 04 04:31:42.012867 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 966/1951] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:31:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:31:42.096886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] validate_networks() for [('6f5fc760-036b-4db9-9515-31d6fe212ea8', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:31:42.274278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1160549324", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": "none"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:42.367893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:31:42.368408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:31:42.369145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:31:42.370562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:31:42.372669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:31:42.388241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:42.388927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:42.390038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:42.390739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:42.417612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Getting quotas for project c084dab11fba48239b1475b5ddcd7362. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:42.426206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Getting quotas for user f4d1f2cdf4d245ec89f0645ad3ff0194 and project c084dab11fba48239b1475b5ddcd7362. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:42.444504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:31:42.447896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:31:42.536904 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-218579d4-54bf-4616-9648-2f1de30b31c9 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.522458 Aug 04 04:31:42.537764 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 967/1952] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:31:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:31:42.550343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-97e7e85f-b3fd-4d0f-a0f0-4174e416bb03 req-f9e4292b-5da1-4004-8d19-13fe907604f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "dcc19c32-c8b8-456f-bd9a-701b882de6be"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:42.556893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:42.565886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-97e7e85f-b3fd-4d0f-a0f0-4174e416bb03 req-f9e4292b-5da1-4004-8d19-13fe907604f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:42.566412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-97e7e85f-b3fd-4d0f-a0f0-4174e416bb03 req-f9e4292b-5da1-4004-8d19-13fe907604f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:42.581052 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-97e7e85f-b3fd-4d0f-a0f0-4174e416bb03 req-f9e4292b-5da1-4004-8d19-13fe907604f0 service nova] Creating event network-changed:dcc19c32-c8b8-456f-bd9a-701b882de6be for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:31:42.586698 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-97e7e85f-b3fd-4d0f-a0f0-4174e416bb03 req-f9e4292b-5da1-4004-8d19-13fe907604f0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047544 Aug 04 04:31:42.588162 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 968/1953] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:42.596301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:42.597188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:42.607464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:42.608561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:42.609738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:42.611103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:43.458493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:43.475884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:43.477598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:43.478801 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aa21e731-aab4-4679-ada3-01b002363953 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1870 microversion: 2.32 time: 0.889361 Aug 04 04:31:43.479414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 969/1954] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:42 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1870 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:43.503696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:43.505080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:43.530558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:43.531383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:43.532421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:43.533037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:43.702240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:43.710814 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3a9dafed-ca87-44ba-b36d-9f5172d760bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1266 microversion: 2.1 time: 0.228845 Aug 04 04:31:43.731419 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 970/1955] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:43 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:43.743137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:43.744076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:43.759976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:43.760797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:43.762890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:43.764994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:43.973371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:43.990505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:43.998984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:44.004704 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-68accbc0-9ace-4b20-99da-4811c25ba795 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 200 len: 1277 microversion: 2.47 time: 0.269254 Aug 04 04:31:44.008685 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 971/1956] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:43 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:44.348019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:31:44.348019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:31:44.348563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:31:44.348677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:31:44.349017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:31:44.363426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:44.363885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:44.369696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:44.370360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:44.420644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:44.436241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Getting quotas for user 53377b39d2804967aa0d5b71ee57e9a8 and project 465a4e68c9e042c2ae95bd8c8ee07fb1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:44.507810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:44.508454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:44.525243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:44.526579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:44.529726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:44.532105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:44.619445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:31:44.629402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2073539f-324c-4f3c-82c0-de770a0a2d01',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:31:45.015424 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab233aa3-9a6d-4995-98f5-f017e8c5d4ff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.873769 Aug 04 04:31:45.028179 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 986/1957] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:31:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 4887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:31:45.055201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:45.058138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:45.097497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:45.099509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:45.102433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:45.105952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:45.338691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.360184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.368567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.390896 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46847cd0-bfa0-43e3-9d8e-4ba3c3c12ff3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1272 microversion: 2.1 time: 0.361355 Aug 04 04:31:45.392395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.407639 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 987/1958] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:45 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:45.409574 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d54b0797-bfa7-4cfb-bcab-2455531cf321 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1870 microversion: 2.32 time: 0.906667 Aug 04 04:31:45.432319 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 972/1959] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:44 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1870 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:45.444132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6b313148-84b6-41cf-8123-e4345cca95f8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:45.464372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:45.465520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:45.468456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6b313148-84b6-41cf-8123-e4345cca95f8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:45.486463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:45.488205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:45.490935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:45.492226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:45.700087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.714191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.718618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.731165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6b313148-84b6-41cf-8123-e4345cca95f8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:45.736345 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-95a4de37-f47c-4cc9-a432-a62dd9f25569 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 200 len: 1339 microversion: 2.47 time: 0.302255 Aug 04 04:31:45.740935 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 973/1960] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:45 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 1339 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:45.742966 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6b313148-84b6-41cf-8123-e4345cca95f8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1053 microversion: 2.1 time: 0.329959 Aug 04 04:31:45.759494 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 988/1961] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:45 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1053 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:45.764581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4c9e7c70-82ae-4c47-ac3b-68990faa1d85 req-16834dd7-6a9d-4663-bfa2-8c7fc69aebfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "603a0716-af65-4b22-943b-fc75552e52cb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:45.789071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4c9e7c70-82ae-4c47-ac3b-68990faa1d85 req-16834dd7-6a9d-4663-bfa2-8c7fc69aebfa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:45.789605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4c9e7c70-82ae-4c47-ac3b-68990faa1d85 req-16834dd7-6a9d-4663-bfa2-8c7fc69aebfa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:45.819000 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4c9e7c70-82ae-4c47-ac3b-68990faa1d85 req-16834dd7-6a9d-4663-bfa2-8c7fc69aebfa service nova] Creating event network-changed:603a0716-af65-4b22-943b-fc75552e52cb for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:31:45.830065 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4c9e7c70-82ae-4c47-ac3b-68990faa1d85 req-16834dd7-6a9d-4663-bfa2-8c7fc69aebfa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086431 Aug 04 04:31:45.831641 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 974/1962] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:46.428033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:46.429360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:46.438277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:46.454472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:46.456279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:46.456884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:46.457983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:46.460145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:46.467054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:46.468512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:46.471103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:46.472896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:46.808904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:46.830366 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06d6c650-d1d7-48f8-ac9a-a68b74405900 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1272 microversion: 2.1 time: 0.404803 Aug 04 04:31:46.831709 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 989/1963] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:46 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:46.837852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:46.839311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:46.847639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:46.848375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:46.849878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:46.850643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:47.137871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:47.151357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:47.153620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:47.166014 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d359a5b6-08fb-4bd7-beab-b2af0df17f86 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 200 len: 1339 microversion: 2.47 time: 0.332949 Aug 04 04:31:47.166984 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 990/1964] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:46 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 1339 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:47.188123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:47.189847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:47.197908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:47.198768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:47.200932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:47.201947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:47.484096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:47.499669 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73c99237-3aff-4df3-91a5-3685736e638a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1169 microversion: 2.1 time: 0.318615 Aug 04 04:31:47.503287 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 991/1965] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:47 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1169 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:47.595926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:47.619073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:47.629838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:47.631390 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83ca11ef-d8f9-4899-becb-9afc96e3a2c6 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 1.197516 Aug 04 04:31:47.632436 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 975/1966] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:46 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:47.857690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:47.861092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:47.888970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:47.889352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:47.893679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:47.895997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.041700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:48.053597 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61da4964-ba06-4005-b85a-9c314785e4a8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1272 microversion: 2.1 time: 0.201103 Aug 04 04:31:48.056632 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 992/1967] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:47 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:48.192687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:48.193321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:48.211279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.213020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.213901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.220471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.527780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:48.528613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:48.545819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.547205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.550685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.551434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.777837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:48.787536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:48.796768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:48.798313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2c8fc9ae-27ac-4644-9399-9fcc77032189 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 200 len: 1360 microversion: 2.47 time: 0.611092 Aug 04 04:31:48.802618 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 976/1968] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:48 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 1360 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:48.811653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c52e4586-abc6-4148-97b6-e4554cbccbb0 req-e6ff5841-114b-40e4-9a0d-8d7740a39018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "6170383e-7582-4f81-92f2-d72b1ef66d77"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:48.837300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c52e4586-abc6-4148-97b6-e4554cbccbb0 req-e6ff5841-114b-40e4-9a0d-8d7740a39018 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.838263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c52e4586-abc6-4148-97b6-e4554cbccbb0 req-e6ff5841-114b-40e4-9a0d-8d7740a39018 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.866122 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c52e4586-abc6-4148-97b6-e4554cbccbb0 req-e6ff5841-114b-40e4-9a0d-8d7740a39018 service nova] Creating event network-changed:6170383e-7582-4f81-92f2-d72b1ef66d77 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:31:48.881951 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c52e4586-abc6-4148-97b6-e4554cbccbb0 req-e6ff5841-114b-40e4-9a0d-8d7740a39018 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077740 Aug 04 04:31:48.882575 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 977/1969] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:48.904396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:48.905122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:48.908332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:48.911573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.912024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.912802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.913238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.943331 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-053c58b9-cbdd-4dbc-b34f-02fb427a1fa0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1169 microversion: 2.1 time: 0.420898 Aug 04 04:31:48.943976 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 993/1970] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:48 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1169 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:48.961874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c8d5e693-7cc0-409a-ab23-e97360a2693b tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1651173198"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:48.976079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c8d5e693-7cc0-409a-ab23-e97360a2693b tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:48.987505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8d5e693-7cc0-409a-ab23-e97360a2693b tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.990201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8d5e693-7cc0-409a-ab23-e97360a2693b tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:48.991251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8d5e693-7cc0-409a-ab23-e97360a2693b tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:48.993916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8d5e693-7cc0-409a-ab23-e97360a2693b tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.380912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:49.394016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:49.400899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:49.403065 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83eb7bc0-bf3c-42f9-899d-ed80ee04a9f2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 0.518680 Aug 04 04:31:49.416110 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 978/1971] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:48 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:49.421395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:49.422266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:49.428700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.430721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.431791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.441266 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c8d5e693-7cc0-409a-ab23-e97360a2693b tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "POST /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5/action" status: 202 len: 52 microversion: 2.47 time: 0.495538 Aug 04 04:31:49.441996 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 994/1972] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:31:48 2022] POST /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5/action => generated 52 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 04 04:31:49.442450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.460193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:49.460988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:49.479982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.480512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.485882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.488479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.561817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:31:49.728598 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-333cad34-be0d-4438-8164-0559c4de4a18 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 204 len: 0 microversion: 2.47 time: 0.275780 Aug 04 04:31:49.732708 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 995/1973] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:31:49 2022] DELETE /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 04:31:49.735353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:49.741426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:49.744662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:49.746519 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c6e2295-78c1-4bda-8764-f7e56b93eff2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1272 microversion: 2.1 time: 0.328313 Aug 04 04:31:49.754256 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 979/1974] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:49 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:49.774728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.775215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.776011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.776647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.921167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:49.938738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:49.940608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:49.942033 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-279d017b-6694-4aa2-9667-fc486290ecd2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 200 len: 1366 microversion: 2.47 time: 0.207476 Aug 04 04:31:49.942592 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 996/1975] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:49 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:49.969658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:49.970279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:49.977507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.977957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:49.979019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:49.979469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:50.439319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:50.439319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:50.447341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:50.449661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:50.449661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:50.449661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:50.869774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:50.884187 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d34b118-541e-46bf-b4dd-db2935e57eff tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1211 microversion: 2.1 time: 0.918038 Aug 04 04:31:50.891355 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 980/1976] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:49 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1211 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:50.908943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:50.910729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:50.929835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:50.930295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:50.937527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:50.938037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:50.958977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:51.795510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:51.812780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:51.817483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:51.818729 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c4886e84-24de-4a7d-b489-315470b94db3 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 1.384364 Aug 04 04:31:51.829775 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 997/1977] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:50 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:51.861586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:51.863273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:51.888602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:51.889379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:51.890487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:51.891712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:52.409156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:52.438323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:52.515557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:52.526840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:52.531163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:52.535325 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9f3f92f6-b25c-4b81-b008-f7f72ce806b2 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 200 len: 1366 microversion: 2.47 time: 0.692805 Aug 04 04:31:52.536048 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 998/1978] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:51 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 1366 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:52.549023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:52.554269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38490df9-0bc7-4c9e-83c7-8994c7bbe93a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Action: 'create', calling method: .version_select at 0x7f191a2b5670>, body: {"keypair": {"name": "tempest-keypair-1035125892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/CilrpfGcjKyYUPBzpDtePi3SRJU3bPjoLzLQQwbRMlEzBGZWIZGzw1hiTCbCk8npY9EZZyyFZdi5nRHYOH66y2Cm4r8YRzVXCo662MJc/cQkFe/wCmcJssGaLl48bNw=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:52.565287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ca2e456-bb39-4929-bd2d-caaa70538b77 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1314 microversion: 2.1 time: 1.672697 Aug 04 04:31:52.574800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 981/1979] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:50 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1314 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:52.590552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-38490df9-0bc7-4c9e-83c7-8994c7bbe93a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Getting quotas for project 3b830d9d8e7a41bba8030bc549484aa2. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:31:52.595070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:52.595695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:52.603570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:52.604297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:52.605903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:52.606530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:52.611337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-38490df9-0bc7-4c9e-83c7-8994c7bbe93a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Getting quotas for user 68ad7b2e7ed14adba4edddd770e0da5d and project 3b830d9d8e7a41bba8030bc549484aa2. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:31:52.673109 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38490df9-0bc7-4c9e-83c7-8994c7bbe93a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.134957 Aug 04 04:31:52.674785 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 999/1980] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:31:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 04:31:52.684437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0dc44466-891b-4bc1-99da-e6598ff14054 req-7945672c-35cd-41a7-84ff-9e986c05ab45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "b91f7631-35bc-4019-9c98-469955f4c3a6"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:52.711614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0dc44466-891b-4bc1-99da-e6598ff14054 req-7945672c-35cd-41a7-84ff-9e986c05ab45 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:52.712888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0dc44466-891b-4bc1-99da-e6598ff14054 req-7945672c-35cd-41a7-84ff-9e986c05ab45 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:52.746363 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0dc44466-891b-4bc1-99da-e6598ff14054 req-7945672c-35cd-41a7-84ff-9e986c05ab45 service nova] Creating event network-changed:b91f7631-35bc-4019-9c98-469955f4c3a6 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:31:52.764363 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0dc44466-891b-4bc1-99da-e6598ff14054 req-7945672c-35cd-41a7-84ff-9e986c05ab45 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083654 Aug 04 04:31:52.767630 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1000/1981] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:52.857715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:52.864249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:52.882806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:52.883592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:52.888400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:52.890536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:53.637406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:53.665516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:53.668969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:53.676941 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8f1c18d-089f-4b46-b387-231056883452 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 0.825154 Aug 04 04:31:53.691746 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1001/1982] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:52 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:53.697696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-37cab08f-5370-4074-b166-b295743a77be req-2dd70e44-a9f1-43ba-aa95-6c2b3ab211db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb0ce6c-996d-499a-8b2c-665598ed8aaa", "tag": "c279607f-09ae-431b-bd1d-0ade6bbcd772"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:53.723845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-37cab08f-5370-4074-b166-b295743a77be req-2dd70e44-a9f1-43ba-aa95-6c2b3ab211db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:53.724398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-37cab08f-5370-4074-b166-b295743a77be req-2dd70e44-a9f1-43ba-aa95-6c2b3ab211db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:53.729926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:53.749472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-37cab08f-5370-4074-b166-b295743a77be req-2dd70e44-a9f1-43ba-aa95-6c2b3ab211db service nova] Creating event network-changed:c279607f-09ae-431b-bd1d-0ade6bbcd772 for instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa on n-h1-851337-5 Aug 04 04:31:53.752549 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6362f46-121b-4d31-8aba-782b4489fd8f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1211 microversion: 2.1 time: 1.158816 Aug 04 04:31:53.758544 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-37cab08f-5370-4074-b166-b295743a77be req-2dd70e44-a9f1-43ba-aa95-6c2b3ab211db service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069700 Aug 04 04:31:53.765484 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1002/1983] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:53.771153 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 982/1984] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:52 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1211 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:53.773066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:53.781763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:53.784014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:53.784687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:53.789251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:53.789936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:53.797709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:53.798363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:53.799811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:53.800283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:53.801085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:53.801531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:53.825409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:53.868273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:53.871930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:53.883741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lazy-loading 'fault' on Instance uuid b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:31:54.046862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:54.057986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:54.064134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4d1f2cdf4d245ec89f0645ad3ff0194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c084dab11fba48239b1475b5ddcd7362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:54.067512 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dcfd57fd-49bc-4a58-8027-d556114274e5 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 200 len: 1371 microversion: 2.47 time: 0.300752 Aug 04 04:31:54.072323 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1003/1985] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:53 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:54.177288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:54.186560 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c105553b-4234-4233-8c26-794c5bdbd22a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1314 microversion: 2.1 time: 0.413778 Aug 04 04:31:54.191857 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 983/1986] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:53 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:54.705096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:54.705848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:54.708662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:54.726552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:54.727317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:54.730737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:54.731453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:54.778278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:54.779132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:54.806484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:54.809000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:54.810242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:54.810642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:55.632875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:55.649702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:55.651442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:55.655782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:55.668278 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c20fd99-9bd4-4c8e-acae-1920827fb26f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1211 microversion: 2.1 time: 0.894582 Aug 04 04:31:55.669847 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98ce1408-6613-46ea-ae71-fcbd1e609747 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 0.969711 Aug 04 04:31:55.671115 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 984/1987] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:54 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1211 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:55.672267 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1004/1988] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:54 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:31:55.678116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-422ba389-1924-4205-9562-2e4555cd5be5 req-b08321f5-fd15-4035-996d-2d86b7b0e487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516857b7-6247-41be-a977-883970904cd0", "tag": "7729b6c9-8d05-4315-915b-46108809ceec"}, {"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "9a838a5c-abf8-4025-8590-88accc375b4d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:55.688041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:55.688804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] [instance: b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:55.691508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-422ba389-1924-4205-9562-2e4555cd5be5 req-b08321f5-fd15-4035-996d-2d86b7b0e487 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:55.692227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-422ba389-1924-4205-9562-2e4555cd5be5 req-b08321f5-fd15-4035-996d-2d86b7b0e487 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:55.706425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:55.706873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:55.707901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:55.708340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:55.713723 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-422ba389-1924-4205-9562-2e4555cd5be5 req-b08321f5-fd15-4035-996d-2d86b7b0e487 service nova] Creating event network-changed:7729b6c9-8d05-4315-915b-46108809ceec for instance 516857b7-6247-41be-a977-883970904cd0 on n-h2-851337-5 Aug 04 04:31:55.715414 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-422ba389-1924-4205-9562-2e4555cd5be5 req-b08321f5-fd15-4035-996d-2d86b7b0e487 service nova] Creating event network-changed:9a838a5c-abf8-4025-8590-88accc375b4d for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:31:55.732260 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-422ba389-1924-4205-9562-2e4555cd5be5 req-b08321f5-fd15-4035-996d-2d86b7b0e487 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058455 Aug 04 04:31:55.733389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 985/1989] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:55.742591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] HTTP exception thrown: Instance b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 could not be found. Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Request method failure captured: Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 HTTP/1.1 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60usWLwi_NUxnjywoKphE8pbCdP_S2IAoZfuOryq7QZjJg-BumNWRGdDXsv98OskT8FJG-TXxCWmHX1bK4W4Hwm6Owawe61l5cwoKiFY2QwdlsAKHShUFtvNyE_W0-OEbGEVHURMzIw9yZssSYA8TMepVkX7pSAfZKHmkrNzjoFSshQ Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: c084dab11fba48239b1475b5ddcd7362 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersAaction247Test-350661570 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c084dab11fba48239b1475b5ddcd7362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c084dab11fba48239b1475b5ddcd7362"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c084dab11fba48239b1475b5ddcd7362"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c084dab11fba48239b1475b5ddcd7362", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersAaction247Test-350661570 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: c084dab11fba48239b1475b5ddcd7362 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersAaction247Test-350661570 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersAaction247Test-350661570-project Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f4d1f2cdf4d245ec89f0645ad3ff0194 Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersAaction247Test-350661570-project Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 could not be found. Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5'} Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 could not be found. Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 could not be found. Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:31:55.744394 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 could not be found. Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:31:55.750142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] Returning 404 to user: Instance b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:31:55.751194 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ce28e598-e005-4100-a876-b7c3a4ade613 tempest-ServersAaction247Test-350661570 tempest-ServersAaction247Test-350661570-project] 10.222.0.69 "GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5" status: 404 len: 111 microversion: 2.47 time: 0.072638 Aug 04 04:31:55.752303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1005/1990] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:55 2022] GET /compute/v2.1/servers/b3c69d8c-ed16-4e22-8fba-b0fc659e9ea5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:31:55.754588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:55.779140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:55.790690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:55.791439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:55.800305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:55.800961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:56.296200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:56.334895 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5cf4cdc3-f9aa-476b-8d9f-3dd1e5846d99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1314 microversion: 2.1 time: 0.594198 Aug 04 04:31:56.335777 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 986/1991] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:55 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:56.691731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:56.693066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:56.718248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:56.719306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:56.730748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:56.733517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:56.744161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:56.748279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:56.748882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:56.749522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:56.756006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:56.756597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:57.561958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:57.572048 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f9bbe42c-5a38-4501-90fb-f01a7bb41b2b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1211 microversion: 2.1 time: 0.884062 Aug 04 04:31:57.572988 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1006/1992] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:56 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1211 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:57.580727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:57.587461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:57.603651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:57.604697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:57.608412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:57.609139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:58.632781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:58.661726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:58.670072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:58.676363 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0155c151-9e81-4cce-ad39-2887d26645b7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 1.970133 Aug 04 04:31:58.677693 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 987/1993] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:56 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:31:58.697392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-80dd17a8-65bd-42ae-bab3-429e63b22fea req-98aead64-0299-44ae-ad4e-81f0216b5c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "087ed3c0-9d5d-41c5-b873-d6a51295c4ad"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:31:58.715916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-80dd17a8-65bd-42ae-bab3-429e63b22fea req-98aead64-0299-44ae-ad4e-81f0216b5c3d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:58.716758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-80dd17a8-65bd-42ae-bab3-429e63b22fea req-98aead64-0299-44ae-ad4e-81f0216b5c3d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:58.742945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-80dd17a8-65bd-42ae-bab3-429e63b22fea req-98aead64-0299-44ae-ad4e-81f0216b5c3d service nova] Creating event network-changed:087ed3c0-9d5d-41c5-b873-d6a51295c4ad for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:31:58.756781 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-80dd17a8-65bd-42ae-bab3-429e63b22fea req-98aead64-0299-44ae-ad4e-81f0216b5c3d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076514 Aug 04 04:31:58.757699 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 988/1994] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:58.764716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:58.765754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:58.788944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:58.791506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:58.792315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:58.794226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:59.281447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:59.300494 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7f0cb522-4f4d-462d-9294-eab05d8c330e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1314 microversion: 2.1 time: 1.723818 Aug 04 04:31:59.312769 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1007/1995] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:57 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1314 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:59.456861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:31:59.465437 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-10ed1a88-e54a-49b5-a586-40f5c44b44d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1211 microversion: 2.1 time: 0.705711 Aug 04 04:31:59.469943 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 989/1996] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:31:58 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1211 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:31:59.705721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:59.706842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:31:59.720349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:59.720818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:31:59.721609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:31:59.722643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:00.149411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:00.192090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:00.198452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:00.204996 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ccee8bec-2cb8-4d2b-8c71-4233b6bd096e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 0.501770 Aug 04 04:32:00.207963 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1008/1997] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:31:59 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:00.326849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:00.327513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:00.346583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:00.347360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:00.348322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:00.348930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:00.507482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:00.508469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:00.525428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:00.526740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:00.530535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:00.533304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:01.091532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:01.105017 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c8cfe293-1d9c-4a4a-8e7e-273b105e53b8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1314 microversion: 2.1 time: 0.782520 Aug 04 04:32:01.107459 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 990/1998] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:00 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:01.118724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-962975747", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2967661a-8910-4d3d-b023-a7ceb514bdc8"}, {"port": "b41c6896-92e5-4741-afbd-09bad08f2d4e", "tag": "port-1"}, {"port": "9fb40d66-e6ad-4a8d-a857-8c35535ad0d2", "tag": "port-2"}, {"uuid": "816da28f-3303-49b2-befa-dfcda7a1f3b3", "tag": "net-1"}, {"uuid": "816da28f-3303-49b2-befa-dfcda7a1f3b3"}, {"uuid": "7d8d8c4f-ad64-4a1c-9bea-7f536bd6b27e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7d8d8c4f-ad64-4a1c-9bea-7f536bd6b27e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f2a65f71-1835-4278-898e-693295cfeaba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c222bb51-9864-496a-8202-082331d0ed05", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fd69ffeb-e348-4919-9f59-5749a34811fa", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--134536607"}], "key_name": "tempest-keypair-1035125892", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:01.149717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:01.160856 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1587f7eb-e85b-4567-9040-8e047ad2500f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1211 microversion: 2.1 time: 0.674203 Aug 04 04:32:01.166549 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1009/1999] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:00 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1211 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:01.173083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1b7898e1-1cbd-4a1c-9e14-4aaac7467c03 req-b845ee98-d8a2-412d-b248-7184571b2c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "79a80cce-aa43-459a-b8bf-02f7dc9b7e38"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:01.192548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b7898e1-1cbd-4a1c-9e14-4aaac7467c03 req-b845ee98-d8a2-412d-b248-7184571b2c37 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:01.193450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b7898e1-1cbd-4a1c-9e14-4aaac7467c03 req-b845ee98-d8a2-412d-b248-7184571b2c37 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:01.218700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1b7898e1-1cbd-4a1c-9e14-4aaac7467c03 req-b845ee98-d8a2-412d-b248-7184571b2c37 service nova] Creating event network-changed:79a80cce-aa43-459a-b8bf-02f7dc9b7e38 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:01.225982 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1b7898e1-1cbd-4a1c-9e14-4aaac7467c03 req-b845ee98-d8a2-412d-b248-7184571b2c37 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057895 Aug 04 04:32:01.230905 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1010/2000] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:01.244699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:01.245753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:01.254673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:01.255421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:01.257266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:01.257982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:01.423947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] validate_networks() for [('2967661a-8910-4d3d-b023-a7ceb514bdc8', None, None, None, None, None), (None, None, 'b41c6896-92e5-4741-afbd-09bad08f2d4e', None, None, None), (None, None, '9fb40d66-e6ad-4a8d-a857-8c35535ad0d2', None, None, None), ('816da28f-3303-49b2-befa-dfcda7a1f3b3', None, None, None, None, None), ('816da28f-3303-49b2-befa-dfcda7a1f3b3', None, None, None, None, None), ('7d8d8c4f-ad64-4a1c-9bea-7f536bd6b27e', '10.2.2.100', None, None, None, None), ('7d8d8c4f-ad64-4a1c-9bea-7f536bd6b27e', '10.2.2.200', None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:32:01.732457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:01.767663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:01.773761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:01.779094 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d1f134c-1efe-4b41-9408-a5d79f69f960 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 0.541632 Aug 04 04:32:01.784066 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1011/2001] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:01 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:02.139818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:02.141159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:02.182823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:02.183790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:02.189690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:02.195387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:02.637851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:03.090763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:03.110374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56e74576-c689-4d94-8af1-de15295be7bf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1314 microversion: 2.1 time: 0.983847 Aug 04 04:32:03.111890 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1012/2002] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:02 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1314 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:03.118777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:03.119918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:03.158523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:03.159026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:03.160048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:03.160675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:03.579155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:03.592738 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-009d7728-6e82-4634-b476-d7d09d6e46c7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.479260 Aug 04 04:32:03.594341 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1013/2003] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:03 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:03.600555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0e0708d1-4ac3-44c4-aafc-979f15c926ba tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:03.604262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0e0708d1-4ac3-44c4-aafc-979f15c926ba tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:03.618698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e0708d1-4ac3-44c4-aafc-979f15c926ba tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:03.620237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e0708d1-4ac3-44c4-aafc-979f15c926ba tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:03.621294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e0708d1-4ac3-44c4-aafc-979f15c926ba tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:03.621971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e0708d1-4ac3-44c4-aafc-979f15c926ba tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:03.686211 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0e0708d1-4ac3-44c4-aafc-979f15c926ba tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090134 Aug 04 04:32:03.686807 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1014/2004] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:32:03 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:03.692201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-39b8fa50-5fd0-47d5-a3b4-77680e02ddb1 req-6aa573b6-2865-4bf5-86e4-5052dea37c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516857b7-6247-41be-a977-883970904cd0", "name": "network-vif-plugged", "status": "completed", "tag": "7729b6c9-8d05-4315-915b-46108809ceec"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:03.703470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-39b8fa50-5fd0-47d5-a3b4-77680e02ddb1 req-6aa573b6-2865-4bf5-86e4-5052dea37c49 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:03.704198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-39b8fa50-5fd0-47d5-a3b4-77680e02ddb1 req-6aa573b6-2865-4bf5-86e4-5052dea37c49 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:03.717407 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-39b8fa50-5fd0-47d5-a3b4-77680e02ddb1 req-6aa573b6-2865-4bf5-86e4-5052dea37c49 service nova] Creating event network-vif-plugged:7729b6c9-8d05-4315-915b-46108809ceec for instance 516857b7-6247-41be-a977-883970904cd0 on n-h2-851337-5 Aug 04 04:32:03.723935 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-39b8fa50-5fd0-47d5-a3b4-77680e02ddb1 req-6aa573b6-2865-4bf5-86e4-5052dea37c49 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035565 Aug 04 04:32:03.725089 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1015/2005] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:03.732775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:03.733995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:03.742169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:03.743098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:03.744161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:03.744807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:04.283436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:04.297502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:04.299339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:04.300756 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c1a6a1a-a855-4d29-81e4-80fbd42b2ef5 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1891 microversion: 2.32 time: 0.574182 Aug 04 04:32:04.315386 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1016/2006] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:03 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1891 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:04.322359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:04.323170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:04.325414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:04.331532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:04.332061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:04.332973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:04.333407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:04.425542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lazy-loading 'services' on Instance uuid 0c808db1-8983-4e22-8af7-874d85053f0d {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:32:04.543094 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0630718a-7a75-4ad0-ba3a-d8a5a3d663e3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments/59e5b0aa-d2a9-4d10-896a-7f5491adbb31" status: 202 len: 0 microversion: 2.1 time: 0.225951 Aug 04 04:32:04.546657 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1017/2007] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:32:04 2022] DELETE /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments/59e5b0aa-d2a9-4d10-896a-7f5491adbb31 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:04.580965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:04.587334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:04.606533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:04.609154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:04.622796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:04.625441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:05.099865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:05.119272 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0100f382-cb0b-4948-8e93-86ef4aa92dbd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1314 microversion: 2.1 time: 0.567611 Aug 04 04:32:05.120800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1018/2008] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:04 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:05.127618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:05.128797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:05.137569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:05.138764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:05.139886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:05.140563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:05.589396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:05.598626 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2be9537b-f322-4e2c-be34-04b6a4e82b31 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.475746 Aug 04 04:32:05.608822 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1019/2009] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:05 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:05.614106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:05.615386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:05.627851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:05.631199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:05.636028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:05.637137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:06.568210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:06.581257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:06.582779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:06.597937 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13921b96-b5b8-41cb-a9ff-9caf0e6a73e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.987767 Aug 04 04:32:06.615143 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1020/2010] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:05 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:06.626293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:06.626915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:06.662269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:06.665837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:06.666911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:06.668550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:06.675901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:07.236835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:07.245854 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cdb57894-cf17-436d-94ac-e3821d973b81 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1501 microversion: 2.1 time: 0.623380 Aug 04 04:32:07.260107 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1021/2011] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:06 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1501 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:07.270075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:07.271180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:07.281804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:07.282659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:07.283777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:07.284458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:07.992721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:08.001478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-db63aeb7-4613-4428-a2ea-5e00ccefef0d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.739876 Aug 04 04:32:08.002078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1022/2012] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:07 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:08.015743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-030564c4-67f8-4229-bfc1-7382c3f93d04 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:08.018525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-030564c4-67f8-4229-bfc1-7382c3f93d04 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:08.035778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030564c4-67f8-4229-bfc1-7382c3f93d04 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:08.040286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030564c4-67f8-4229-bfc1-7382c3f93d04 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:08.046281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030564c4-67f8-4229-bfc1-7382c3f93d04 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:08.051085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030564c4-67f8-4229-bfc1-7382c3f93d04 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:08.120005 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-030564c4-67f8-4229-bfc1-7382c3f93d04 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action" status: 200 len: 14 microversion: 2.1 time: 0.116522 Aug 04 04:32:08.120699 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1023/2013] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:08 2022] POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:32:08.130511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:08.137653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:08.154785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:08.155449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:08.156441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:08.158141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:08.844030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:08.857766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:08.859761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:08.863979 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6cd182f9-b2c3-4b07-b55b-8332ecd57a3b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.738977 Aug 04 04:32:08.864806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1024/2014] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:08 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:09.026639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:09.028524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:09.036694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.037405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:09.039063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.040119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:09.536248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:09.566045 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f4c2c697-8cae-4c9d-a13d-d8020fee298f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.546205 Aug 04 04:32:09.569481 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1025/2015] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:09 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:09.580177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-afef3555-6a40-4978-bebe-98a3b80e5d53 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:09.585044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-afef3555-6a40-4978-bebe-98a3b80e5d53 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:09.593226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afef3555-6a40-4978-bebe-98a3b80e5d53 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.593959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afef3555-6a40-4978-bebe-98a3b80e5d53 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:09.594245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afef3555-6a40-4978-bebe-98a3b80e5d53 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.594669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afef3555-6a40-4978-bebe-98a3b80e5d53 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:09.644167 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-afef3555-6a40-4978-bebe-98a3b80e5d53 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action" status: 200 len: 14 microversion: 2.1 time: 0.069840 Aug 04 04:32:09.653640 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1026/2016] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:09 2022] POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:32:09.718441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:32:09.718850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:32:09.719351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:32:09.719753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:32:09.720159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:32:09.736748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.737200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:09.738064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.739596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:09.789971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Getting quotas for project 3b830d9d8e7a41bba8030bc549484aa2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:32:09.807416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Getting quotas for user 68ad7b2e7ed14adba4edddd770e0da5d and project 3b830d9d8e7a41bba8030bc549484aa2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:32:09.894155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:09.895350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:09.912135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.920970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:09.923287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:09.925072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:10.174900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:32:10.178065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f2a65f71-1835-4278-898e-693295cfeaba',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c222bb51-9864-496a-8202-082331d0ed05',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd69ffeb-e348-4919-9f59-5749a34811fa',volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:32:10.541004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:10.575022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:10.581843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:10.583133 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-080a9181-90ce-4c4e-aa48-c2ff180cb896 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.694356 Aug 04 04:32:10.591808 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1027/2017] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:09 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:10.597057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:10.608727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:10.620295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:10.629432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:10.630721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:10.636704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:11.068620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:11.082924 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eabe069a-e65f-42c2-adf9-2f0f4507fc43 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.488168 Aug 04 04:32:11.087281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1028/2018] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:10 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:11.098737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8b90a9e-6396-404c-9347-b158b66a418d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:11.112653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8b90a9e-6396-404c-9347-b158b66a418d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:11.116838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-05ff50a2-dc76-465b-ac00-830d7768ee08 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.007731 Aug 04 04:32:11.117848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 991/2019] 10.222.0.69 () {62 vars in 1189 bytes} [Thu Aug 4 04:32:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 10009 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:32:11.130415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-826490f7-6235-4893-a881-931834a535c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:11.131064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-826490f7-6235-4893-a881-931834a535c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:11.137745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8b90a9e-6396-404c-9347-b158b66a418d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:11.138268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8b90a9e-6396-404c-9347-b158b66a418d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:11.140777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8b90a9e-6396-404c-9347-b158b66a418d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:11.141261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8b90a9e-6396-404c-9347-b158b66a418d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:11.236054 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8b90a9e-6396-404c-9347-b158b66a418d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action" status: 200 len: 14 microversion: 2.1 time: 0.147346 Aug 04 04:32:11.236705 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1029/2020] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:11 2022] POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:32:11.388645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-826490f7-6235-4893-a881-931834a535c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:11.400335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-826490f7-6235-4893-a881-931834a535c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:11.405230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-826490f7-6235-4893-a881-931834a535c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:11.406788 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-826490f7-6235-4893-a881-931834a535c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1285 microversion: 2.42 time: 0.282203 Aug 04 04:32:11.411463 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 992/2021] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:11 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:11.616640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:11.617234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:11.629387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:11.629841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:11.630635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:11.637552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:12.112463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:12.113008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:12.120667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:12.121330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:12.140095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:12.147419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:13.072962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:13.102341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:13.106442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:13.108748 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-12a0624b-0389-4647-8876-776e5cb937bd tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 1.496665 Aug 04 04:32:13.110547 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1030/2022] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:11 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:13.117602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35cc609a-dfb0-47a7-8da7-071986d39303 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:13.121070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35cc609a-dfb0-47a7-8da7-071986d39303 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:13.129604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35cc609a-dfb0-47a7-8da7-071986d39303 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:13.130276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35cc609a-dfb0-47a7-8da7-071986d39303 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:13.131294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35cc609a-dfb0-47a7-8da7-071986d39303 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:13.132476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35cc609a-dfb0-47a7-8da7-071986d39303 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:13.172540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:13.188839 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5592b411-4f49-4f63-876d-3e20511f0772 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 1.080468 Aug 04 04:32:13.190147 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 993/2023] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:12 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:13.202552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:13.203406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:13.212127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:13.213829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:13.215263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:13.216323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:13.216904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:13.234452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35cc609a-dfb0-47a7-8da7-071986d39303 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action" status: 200 len: 14 microversion: 2.1 time: 0.117461 Aug 04 04:32:13.236502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1031/2024] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:13 2022] POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:32:13.485938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:13.510260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:13.514134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:13.515608 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6dbc360-b930-4793-bf7f-f4c21d1b8194 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1575 microversion: 2.42 time: 0.324275 Aug 04 04:32:13.517129 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 994/2025] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:13 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1575 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:13.885104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee187e54-0195-44fc-aa62-cd9ca79bc680 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:13.888539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee187e54-0195-44fc-aa62-cd9ca79bc680 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:13.910072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee187e54-0195-44fc-aa62-cd9ca79bc680 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:13.912691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee187e54-0195-44fc-aa62-cd9ca79bc680 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:13.915402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee187e54-0195-44fc-aa62-cd9ca79bc680 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:13.916124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee187e54-0195-44fc-aa62-cd9ca79bc680 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:13.996454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee187e54-0195-44fc-aa62-cd9ca79bc680 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124237 Aug 04 04:32:13.999950 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1032/2026] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:32:13 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:32:14.098852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2220846d-16ae-4dbe-a8bb-5e9ccfd06ca3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:14.101431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2220846d-16ae-4dbe-a8bb-5e9ccfd06ca3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:14.135011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:14.137393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:14.155443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:14.156600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2220846d-16ae-4dbe-a8bb-5e9ccfd06ca3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:14.157261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2220846d-16ae-4dbe-a8bb-5e9ccfd06ca3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:14.158291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2220846d-16ae-4dbe-a8bb-5e9ccfd06ca3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:14.159052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:14.159706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2220846d-16ae-4dbe-a8bb-5e9ccfd06ca3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:14.165168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:14.168454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:14.244303 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2220846d-16ae-4dbe-a8bb-5e9ccfd06ca3 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149306 Aug 04 04:32:14.245887 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 995/2027] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:32:14 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:32:14.250697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:14.260852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:14.274272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:14.280217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:14.281518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:14.286088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:14.744071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:14.769158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:14.772425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:14.776630 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-392b6cde-6c80-4758-bf17-6afe360b6498 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.646302 Aug 04 04:32:14.778112 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1033/2028] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:14 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:14.937816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:14.964906 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a40db233-70ad-4632-9749-0441d5152dbd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.717053 Aug 04 04:32:14.966476 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 996/2029] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:14 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:14.971488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f3ff362-18fb-4f25-a98c-5bf7c56ef4b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:14.980916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1f3ff362-18fb-4f25-a98c-5bf7c56ef4b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:15.009578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f3ff362-18fb-4f25-a98c-5bf7c56ef4b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:15.010771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f3ff362-18fb-4f25-a98c-5bf7c56ef4b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:15.012291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f3ff362-18fb-4f25-a98c-5bf7c56ef4b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:15.012889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f3ff362-18fb-4f25-a98c-5bf7c56ef4b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:15.066550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-368408660", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "0bab375b-2b25-4890-9d00-9003398a8c3e"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:15.087497 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f3ff362-18fb-4f25-a98c-5bf7c56ef4b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action" status: 200 len: 14 microversion: 2.1 time: 0.119497 Aug 04 04:32:15.091820 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 997/2030] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:14 2022] POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:32:15.102219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:15.107882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:15.127666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:15.128306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:15.129239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:15.130723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:15.212479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:32:15.243707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] validate_networks() for [('0bab375b-2b25-4890-9d00-9003398a8c3e', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:32:15.422326 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d323bff-fb62-4788-9a4d-e9c57f75d0b8 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 204 len: 0 microversion: 2.1 time: 0.331891 Aug 04 04:32:15.423873 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 998/2031] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:32:15 2022] DELETE /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:32:15.429839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:15.430785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:15.466138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:15.466622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:15.467466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:15.471149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:15.525776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:15.999719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:16.014435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:16.018466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:16.022736 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc90385b-5963-4566-a865-f0c1f59b40b5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1593 microversion: 2.42 time: 0.594707 Aug 04 04:32:16.027557 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 999/2032] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:15 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1593 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:16.052246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-798b686d-9c0a-40b0-a853-ecd453ab674a req-58e74a06-8708-4f66-bf44-996ccd07e6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb0ce6c-996d-499a-8b2c-665598ed8aaa", "name": "network-vif-plugged", "status": "completed", "tag": "c279607f-09ae-431b-bd1d-0ade6bbcd772"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:16.076179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-798b686d-9c0a-40b0-a853-ecd453ab674a req-58e74a06-8708-4f66-bf44-996ccd07e6b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.079331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-798b686d-9c0a-40b0-a853-ecd453ab674a req-58e74a06-8708-4f66-bf44-996ccd07e6b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.111570 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-798b686d-9c0a-40b0-a853-ecd453ab674a req-58e74a06-8708-4f66-bf44-996ccd07e6b5 service nova] Creating event network-vif-plugged:c279607f-09ae-431b-bd1d-0ade6bbcd772 for instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa on n-h1-851337-5 Aug 04 04:32:16.122299 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-798b686d-9c0a-40b0-a853-ecd453ab674a req-58e74a06-8708-4f66-bf44-996ccd07e6b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081258 Aug 04 04:32:16.124250 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1000/2033] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:16.134739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:16.138296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:16.152058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.152667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.153471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.154004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.668718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:32:16.669763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:32:16.670520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:32:16.671280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:32:16.671847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:32:16.685700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.686438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.687494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.688237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.738671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Getting quotas for project 2de51297aa8c4ad79e3c2db20dfcecbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:32:16.764006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Getting quotas for user bb8b6898aef4442d92533ec2f4d027be and project 2de51297aa8c4ad79e3c2db20dfcecbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:32:16.804914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:32:16.808763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:32:16.826111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:16.840508 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6bab4bcb-fbbe-4b0a-8586-cfbd330b30fc tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1680 microversion: 2.1 time: 0.712070 Aug 04 04:32:16.842903 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1001/2034] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:16 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1680 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:16.853856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:16.854812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:16.892641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.893226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.894078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.894672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.928158 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e8253ea-f35c-4572-b81c-b93c092c7542 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126098 Aug 04 04:32:16.930787 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1034/2035] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:32:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:32:16.942269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:16.944470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:16.968515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.970208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:16.972955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:16.974254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:17.610577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:17.619601 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a0c8fd46-9731-4ad3-878d-ec46cec38dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.688425 Aug 04 04:32:17.622928 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1035/2036] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:16 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:17.631912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cadf2b9b-87ce-4ae1-8217-c271ef1a9ff6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:17.639702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cadf2b9b-87ce-4ae1-8217-c271ef1a9ff6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:17.653259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cadf2b9b-87ce-4ae1-8217-c271ef1a9ff6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:17.658909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:17.665231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cadf2b9b-87ce-4ae1-8217-c271ef1a9ff6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:17.666154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cadf2b9b-87ce-4ae1-8217-c271ef1a9ff6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:17.666604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cadf2b9b-87ce-4ae1-8217-c271ef1a9ff6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:17.677999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:17.679543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:17.680724 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-edda6798-9c8c-43c8-9d9d-eb93907b3407 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.836251 Aug 04 04:32:17.681292 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1002/2037] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:16 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:17.727450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a08532af-fbc4-433c-9fbb-12becdc44ff0 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:17.728055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a08532af-fbc4-433c-9fbb-12becdc44ff0 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:17.746931 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cadf2b9b-87ce-4ae1-8217-c271ef1a9ff6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action" status: 200 len: 8205 microversion: 2.1 time: 0.122420 Aug 04 04:32:17.749958 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1036/2038] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:17 2022] POST /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0/action => generated 8205 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:17.759298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:17.760451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:17.783456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:17.784038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:17.785457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:17.785630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:17.970050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a08532af-fbc4-433c-9fbb-12becdc44ff0 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:17.985600 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a08532af-fbc4-433c-9fbb-12becdc44ff0 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1224 microversion: 2.1 time: 0.278349 Aug 04 04:32:17.993016 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1003/2039] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:17 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1224 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:18.010682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:18.012409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:18.028918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.029383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.030184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.030621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.288031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:18.297979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:18.299703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:18.301060 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-32742959-b50e-4bb6-ae1b-1b2072c25212 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1660 microversion: 2.42 time: 0.549742 Aug 04 04:32:18.301777 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1037/2040] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:17 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1660 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:18.308460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:18.309254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:18.325882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.326581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.327559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.328000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.506027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:18.517106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-264c1d88-3dee-481d-8ea8-d8c246f497fd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.522317 Aug 04 04:32:18.517699 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1004/2041] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:17 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:18.545303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:18.545921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:18.553229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.553873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.554797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.555478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.702671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:18.716254 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc725580-78ef-49f3-b5bb-b7699bc6b7b0 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1680 microversion: 2.1 time: 0.411265 Aug 04 04:32:18.716254 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1038/2042] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:18 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1680 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:18.722350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:18.722997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:18.737791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.738247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.739079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.739519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.777744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:18.785387 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b3f8c7bd-7b4b-45b3-939b-bd24cb2d69cc tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.244535 Aug 04 04:32:18.785993 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1005/2043] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:18 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:18.790661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:18.791315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:18.809340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.810836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:18.811858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:18.812295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.101607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:19.113406 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ef81201-200b-4562-bda7-589fbc3e7a72 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1199 microversion: 2.1 time: 0.396051 Aug 04 04:32:19.114531 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1039/2044] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:18 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1199 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:19.123186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:19.123806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:19.145643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.146095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.146888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.151634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.217046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:19.243001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:19.257780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:19.259359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:19.260657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-01619af1-2aec-42ea-9ec1-1171f3d657d4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.473629 Aug 04 04:32:19.261785 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1006/2045] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:18 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:19.298200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:19.304379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:19.316183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.322018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.323226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.324363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.569073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:19.579466 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cfbb1df0-ea89-439a-b5cf-5d9895f33e67 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1276 microversion: 2.1 time: 0.291225 Aug 04 04:32:19.580831 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1007/2046] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:19 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:19.598058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:19.599084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:19.626345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:19.640501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.641446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.643613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.645223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.649078 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7c9a7a25-201f-4343-9ad0-d83cbed3d907 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.523125 Aug 04 04:32:19.649743 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1040/2047] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:19 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:19.672960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:19.673589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:19.720556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.721040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.721864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:19.728311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:19.767865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:20.054001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:20.063843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:20.073661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:20.080156 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0136ecc4-b6e8-4c68-98bd-0d981c009a14 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1706 microversion: 2.42 time: 0.497783 Aug 04 04:32:20.080763 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1008/2048] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:19 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1706 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:20.095790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:20.096589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:20.108013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.108470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.109512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.109945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.158882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:20.167416 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24b0e468-0cee-4e55-b044-0f5ce5aae3b4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.498114 Aug 04 04:32:20.168028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1041/2049] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:19 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:20.174995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:20.186715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:20.203660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.204168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.204974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.205409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.418911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31076ca54a542d9bfdf09c52c69741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf94eaa7716467888b61e00d69b953f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:20.430818 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-449aee02-f100-4e79-9683-534ce262ff42 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 200 len: 1613 microversion: 2.1 time: 0.335809 Aug 04 04:32:20.432218 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1009/2050] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:20 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 1613 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:20.439385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:20.440139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:20.446888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.447568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.449647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.450229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.461625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:20.475200 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c1edac6-fea5-461b-a469-6eaf4c642d8c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1382 microversion: 2.1 time: 0.303752 Aug 04 04:32:20.476407 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1042/2051] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:20 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1382 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:20.484665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:20.485545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:20.500266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.502160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.504240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.507081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.576741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Locking {{(pid=119342) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 04 04:32:20.653785 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4616c18c-b046-45c4-84e3-960120dfa676 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.219804 Aug 04 04:32:20.660008 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1010/2052] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:20 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:20.969400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8f5797a4-25bc-440e-86fe-e71c675803f6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:20.970333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8f5797a4-25bc-440e-86fe-e71c675803f6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:20.981067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f5797a4-25bc-440e-86fe-e71c675803f6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.983136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f5797a4-25bc-440e-86fe-e71c675803f6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:20.986263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f5797a4-25bc-440e-86fe-e71c675803f6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:20.986897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f5797a4-25bc-440e-86fe-e71c675803f6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.349481 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8f5797a4-25bc-440e-86fe-e71c675803f6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1533 microversion: 2.1 time: 0.687769 Aug 04 04:32:21.350073 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1011/2053] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:20 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1533 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:21.362293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:21.367030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:21.385038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:21.385499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.386482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:21.387119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.431494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:21.443958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:21.445484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:21.450326 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6e20a506-9fe0-474c-8d68-48687f257d5b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.970390 Aug 04 04:32:21.471503 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1043/2054] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:20 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:21.478530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:21.483302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:21.495137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:21.496140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.497128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:21.497555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.640275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:21.661136 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f84344b-cf56-4e82-bb58-4dcf9d79f958 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1282 microversion: 2.1 time: 0.306713 Aug 04 04:32:21.676288 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1012/2055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:21 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1282 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:21.689476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:21.690385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:21.707897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:21.708672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.711273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:21.712453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.895353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:21.904865 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-47256b3b-4fb1-499b-938e-29b1e5afe7c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.431947 Aug 04 04:32:21.921927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1044/2056] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:21 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:21.939061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1f92574e-c086-45f1-906d-e12e2dfc47c9 req-13e49076-bf87-4d79-a5a7-074ab835cc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c808db1-8983-4e22-8af7-874d85053f0d", "name": "network-vif-deleted", "tag": "90f37175-7c5d-48be-a746-e74d623a1085"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:21.973494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1f92574e-c086-45f1-906d-e12e2dfc47c9 req-13e49076-bf87-4d79-a5a7-074ab835cc76 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:21.974032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1f92574e-c086-45f1-906d-e12e2dfc47c9 req-13e49076-bf87-4d79-a5a7-074ab835cc76 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:21.989919 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1f92574e-c086-45f1-906d-e12e2dfc47c9 req-13e49076-bf87-4d79-a5a7-074ab835cc76 service nova] Creating event network-vif-deleted:90f37175-7c5d-48be-a746-e74d623a1085 for instance 0c808db1-8983-4e22-8af7-874d85053f0d on n-h2-851337-5 Aug 04 04:32:22.006418 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1f92574e-c086-45f1-906d-e12e2dfc47c9 req-13e49076-bf87-4d79-a5a7-074ab835cc76 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083061 Aug 04 04:32:22.007424 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1045/2057] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:22.025239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56a88c40-7fb6-481a-aa59-d45250736206 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:22.025957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56a88c40-7fb6-481a-aa59-d45250736206 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:22.033766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56a88c40-7fb6-481a-aa59-d45250736206 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.034214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56a88c40-7fb6-481a-aa59-d45250736206 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.036363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56a88c40-7fb6-481a-aa59-d45250736206 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.042119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56a88c40-7fb6-481a-aa59-d45250736206 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.078315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:22.094655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:22.100120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:22.101394 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4074a704-1745-4a08-b25b-92b880560199 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1706 microversion: 2.42 time: 0.423660 Aug 04 04:32:22.110997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1013/2058] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:21 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1706 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:22.116473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:22.120529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:22.136716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.137545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.140978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.142506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.186420 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] HTTP exception thrown: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Request method failure captured: Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d HTTP/1.1 Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sIjr9b7W7CXgtuZn8xtHss8zsxRpbcz6Sbrav_xYVlKwnX9KHNafOD-t3SdNy8NAJeGQgFS2OPElpoBUI21MxsCwDOwCUU73Uc53bnohvB4Ozfx3DhnDoCNzAdMUM2Sb0cDePcw0XDYx8OljVd3abRp0w3mPpsfCdFPX0m3YEAQkc Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 8bf94eaa7716467888b61e00d69b953f Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bf94eaa7716467888b61e00d69b953f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 8bf94eaa7716467888b61e00d69b953f Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachSCSIVolumeTestJSON-204988184-project Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d31076ca54a542d9bfdf09c52c69741f Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-204988184-project Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0c808db1-8983-4e22-8af7-874d85053f0d'} Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:22.191553 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.194931 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:22.194931 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:22.194931 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:22.194931 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:22.194931 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:22.194931 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:22.194931 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.199618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Returning 404 to user: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:22.201972 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7959e770-5f9f-4370-b68e-0e61e60fbf31 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 404 len: 111 microversion: 2.1 time: 0.096621 Aug 04 04:32:22.208092 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1014/2059] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:22 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:32:22.219378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02bf8616-3eaa-465f-a9b4-b5b04b09c960 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:22.235666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02bf8616-3eaa-465f-a9b4-b5b04b09c960 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.236209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02bf8616-3eaa-465f-a9b4-b5b04b09c960 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.295332 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56a88c40-7fb6-481a-aa59-d45250736206 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1533 microversion: 2.1 time: 0.286576 Aug 04 04:32:22.295905 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1046/2060] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:22 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1533 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:22.315119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-892f7871-4eb5-4ab3-876f-80c3ef3ba319 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '.version_select at 0x7f191a1dcaf0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:22.360998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-892f7871-4eb5-4ab3-876f-80c3ef3ba319 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939213939" status: 202 len: 0 microversion: 2.1 time: 0.050880 Aug 04 04:32:22.362829 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1047/2061] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939213939 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:22.367784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44628156-ded5-4749-92d5-59e6cfde2064 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:22.370654 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:32:22.370654 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:32:22.376537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44628156-ded5-4749-92d5-59e6cfde2064 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.377209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44628156-ded5-4749-92d5-59e6cfde2064 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.380802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44628156-ded5-4749-92d5-59e6cfde2064 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.381399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44628156-ded5-4749-92d5-59e6cfde2064 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.381817 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-02bf8616-3eaa-465f-a9b4-b5b04b09c960 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] HTTP exception thrown: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 is locked Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02bf8616-3eaa-465f-a9b4-b5b04b09c960 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Request method failure captured: Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action HTTP/1.1 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 15 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60podco1f1NQ0KFnlgq8TCri7jZxUHHhpInTe6jkNOHea4c7wAydUcrbpODtgrywLF0DQaMyYkEcCulE5qEI-M3fqkd0qZhdMyEZOgxzVoyjw67KLhJi1VRrANM6iMnVdxQdPEcc687SbyWJ3FnKHeoMk0guuJgomB9rSnjVgUsvuuI Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85353a54064c4117bfedd41efcde07db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85353a54064c4117bfedd41efcde07db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-325245739 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d51068c4cce544e38ad1b23996efdec3 Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: {"os-stop": {}} Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 is locked Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '5af37cd4-f81e-4645-a5e0-b12e2eead3c5', 'body': {'os-stop': {}}} Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 is locked Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 is locked Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 is locked Aug 04 04:32:22.384838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:22.388651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02bf8616-3eaa-465f-a9b4-b5b04b09c960 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Returning 409 to user: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 is locked {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:22.392071 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02bf8616-3eaa-465f-a9b4-b5b04b09c960 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 409 len: 107 microversion: 2.1 time: 0.180991 Aug 04 04:32:22.396093 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1015/2062] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:22 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 107 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:32:22.409626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:22.410240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:22.427066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.427523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.432730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.435464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.458187 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44628156-ded5-4749-92d5-59e6cfde2064 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093906 Aug 04 04:32:22.459116 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1048/2063] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 04:32:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:22.471813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-5", "block_migration": false, "disk_over_commit": false}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:22.474597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:22.484237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:22.498913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.499428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.515627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.516553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.564852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lazy-loading 'flavor' on Instance uuid 7cb0ce6c-996d-499a-8b2c-665598ed8aaa {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:32:22.606504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Going to try to live migrate instance to n-h2-851337-5 {{(pid=119343) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 04:32:22.610480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Unlocking {{(pid=119342) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 04:32:22.797908 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a4eb4fe8-6261-40e8-bf59-f293279675d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.399001 Aug 04 04:32:22.802522 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1016/2064] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:22 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:22.819938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:22.820766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:22.853969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.854450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:22.860070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:22.860532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:23.360452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:23.379854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:23.384523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:23.386734 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b56ff98-0718-4fd7-b178-8a2322c61673 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.582132 Aug 04 04:32:23.400327 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1017/2065] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:22 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:23.412765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:23.413552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:23.428507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:23.431443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:23.437584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:23.438195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:23.568007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:23.581954 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d0957ef4-953f-4407-bb42-abc4d79b763c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1282 microversion: 2.1 time: 0.174659 Aug 04 04:32:23.599716 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1018/2066] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:23 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:23.607394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8d817e9-4b9f-47e1-933b-5dde0b65c5b1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:23.627077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d817e9-4b9f-47e1-933b-5dde0b65c5b1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:23.628506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d817e9-4b9f-47e1-933b-5dde0b65c5b1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:23.691980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e8d817e9-4b9f-47e1-933b-5dde0b65c5b1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Going to try to stop instance {{(pid=119342) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:32:23.785269 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8d817e9-4b9f-47e1-933b-5dde0b65c5b1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.183622 Aug 04 04:32:23.786151 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1019/2067] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:23 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:23.805520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:23.809839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:23.824708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:23.825166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:23.826021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:23.826410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:24.186710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:24.207709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:24.234346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:24.243820 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d7f62e88-092f-4b83-9823-806dc0683acf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1752 microversion: 2.42 time: 0.448228 Aug 04 04:32:24.244511 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1020/2068] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:23 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1752 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:24.269599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:24.270616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:24.279026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:24.279642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:24.280836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:24.281425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:24.493265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:24.504258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5350a4d9-b4ac-4345-8814-c04a270c9a4e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.241486 Aug 04 04:32:24.506909 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1021/2069] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:24 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:24.518247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:24.518782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:24.533133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:24.535832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:24.536668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:24.537116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:24.867778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:24.882705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:24.884466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:24.885728 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03a08c51-b4d8-4201-8354-f599e471c12b tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.377748 Aug 04 04:32:24.886377 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1022/2070] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:24 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:24.912878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:24.913687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:24.931817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:24.932530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:24.934107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:24.936417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:25.223549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:25.231735 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3047e8ca-6e54-4ffc-83d6-d6480a10b456 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.327367 Aug 04 04:32:25.235315 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1023/2071] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:24 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:25.272148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:25.272785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:25.280855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:25.281316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:25.286619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:25.287430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:25.722794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:25.740562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:25.742534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:25.747335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-046ecc0d-edf2-44f8-a1a7-f56e413a482b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1798 microversion: 2.42 time: 0.479385 Aug 04 04:32:25.748834 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1024/2072] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:25 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1798 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:25.761719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:25.762868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:25.777483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:25.778144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:25.779146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:25.779732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:26.427060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:26.444942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33565bae-3249-49ab-96c1-950b6cc39628 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.694800 Aug 04 04:32:26.447892 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1025/2073] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:25 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:26.465180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:26.467404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:26.488888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:26.490754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-16116c3f-fe4d-4952-948d-97faa0009635 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa/action" status: 202 len: 0 microversion: 2.1 time: 4.022418 Aug 04 04:32:26.492104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:26.492579 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1049/2074] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:22 2022] POST /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa/action => generated 0 bytes in 4025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:32:26.495091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:26.497324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:26.499324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:26.500082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:26.517597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:26.524452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:26.526779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:26.535801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:26.785023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:27.042748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.060465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.063332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.066159 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d57c2e3f-57cf-4ca0-a250-6e9dfb6fdce7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.611758 Aug 04 04:32:27.067320 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1026/2075] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:26 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:27.077936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:27.079647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:27.098367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:27.099127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:27.101993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:27.102930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:27.397033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.410764 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e44498cd-eee9-4876-becc-f0a30d68c177 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.916779 Aug 04 04:32:27.411395 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1050/2076] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:26 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:27.427139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:27.427761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:27.444652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:27.445115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:27.445936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:27.446398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:27.491130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.500630 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db4fa701-4b5a-4d6a-8794-c677274684e8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.431162 Aug 04 04:32:27.501231 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1027/2077] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:27 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:27.530184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c145f375-a113-45d7-b035-4d33b3da4c0f req-e183ccf0-376a-408c-88b7-63713c8bc581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bef516e-c91a-443f-ac0c-649449549e14", "tag": "c55b8a14-dabe-4658-8bb5-9de3d2a09a89"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:27.551648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c145f375-a113-45d7-b035-4d33b3da4c0f req-e183ccf0-376a-408c-88b7-63713c8bc581 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:27.552584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c145f375-a113-45d7-b035-4d33b3da4c0f req-e183ccf0-376a-408c-88b7-63713c8bc581 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:27.582607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c145f375-a113-45d7-b035-4d33b3da4c0f req-e183ccf0-376a-408c-88b7-63713c8bc581 service nova] Creating event network-changed:c55b8a14-dabe-4658-8bb5-9de3d2a09a89 for instance 0bef516e-c91a-443f-ac0c-649449549e14 on n-h1-851337-5 Aug 04 04:32:27.592775 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c145f375-a113-45d7-b035-4d33b3da4c0f req-e183ccf0-376a-408c-88b7-63713c8bc581 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073342 Aug 04 04:32:27.596791 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1028/2078] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:27.609935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:27.614771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:27.628126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:27.633749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:27.634756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:27.638093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:27.912747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.918532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.932657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d089cd9a-6671-4cab-90fb-36dc721757d4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.334437 Aug 04 04:32:27.940123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.944362 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1029/2079] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:27 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:27.946364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:27.951260 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ecc2fc40-322f-4e18-b5b6-14cfb6888081 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1844 microversion: 2.42 time: 0.535484 Aug 04 04:32:27.966701 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1051/2080] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:27 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1844 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:28.095556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:28.096394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:28.099372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:28.113317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.114161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.115143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.118088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.128919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:28.441550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:28.444336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:28.453033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.454375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.455377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.456027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.482465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:28.501870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:28.504991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:28.507428 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8fea09c-f29e-497f-9bf5-a25cdb15288d tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.414729 Aug 04 04:32:28.526322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1030/2081] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:28 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:28.533214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:28.534042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:28.543254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.543910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.544849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.545431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.930071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:28.938667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:28.941578 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9137242a-b0b0-4e32-b82e-eef01d031505 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.507475 Aug 04 04:32:28.942170 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1052/2082] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:28 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:28.948900 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a39970d-fc55-4d34-a74b-a3a0457ebd6e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.420037 Aug 04 04:32:28.952528 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1031/2083] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:28 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:28.967074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:28.967868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:28.975242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.975696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.976479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.976917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.977953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:28.978679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:28.991523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.992244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:28.993263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:28.994106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:29.405683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:29.420298 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a39bff04-72b3-45b2-8e2e-465b150cf1c4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.456790 Aug 04 04:32:29.420668 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1053/2084] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:28 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:29.426848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-dc516662-c9eb-4835-ab8f-91a1f9fd4050 req-1ecf8478-8470-432b-81aa-7e401bc1517b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "6207fab3-7934-47a2-9393-61682681be83"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:29.451240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-dc516662-c9eb-4835-ab8f-91a1f9fd4050 req-1ecf8478-8470-432b-81aa-7e401bc1517b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:29.462205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-dc516662-c9eb-4835-ab8f-91a1f9fd4050 req-1ecf8478-8470-432b-81aa-7e401bc1517b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:29.475190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-dc516662-c9eb-4835-ab8f-91a1f9fd4050 req-1ecf8478-8470-432b-81aa-7e401bc1517b service nova] Creating event network-changed:6207fab3-7934-47a2-9393-61682681be83 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:32:29.484519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:29.494039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:29.496247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:29.498759 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-dc516662-c9eb-4835-ab8f-91a1f9fd4050 req-1ecf8478-8470-432b-81aa-7e401bc1517b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059123 Aug 04 04:32:29.501289 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1054/2085] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:29.503386 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8c67b477-0b65-437f-9957-8800ed9d5860 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1844 microversion: 2.42 time: 0.523667 Aug 04 04:32:29.517993 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1032/2086] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:28 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1844 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:32:29.532828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:29.533541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:29.544115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:29.544573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:29.545705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:29.545813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:29.961763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:29.962395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:29.974358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:29.974815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:29.975804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:29.980163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:30.103239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:30.112819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:30.114328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:30.123441 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e93e047-9f49-409f-aefc-d1d611b033cc tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.594696 Aug 04 04:32:30.124428 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1055/2087] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:29 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:30.136897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:30.141570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:30.162054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:30.162511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:30.163330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:30.163769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:30.344493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:30.365960 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3612d39e-22c3-4166-87c1-9ad8e4c73a2f tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.408128 Aug 04 04:32:30.368944 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1033/2088] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:29 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:30.444041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:30.444892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:30.460761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:30.461223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:30.462028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:30.462468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:30.470428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:30.479196 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5173a823-366a-4194-82c9-2777589bb73f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.353500 Aug 04 04:32:30.480957 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1056/2089] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:30 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:30.531449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:30.532265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:30.534995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:30.551052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:30.552368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:30.554473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:30.555624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:31.462293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:31.474193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:31.475122 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-065561ac-bd2b-4bb8-a0f6-827ee1266cfe tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 1.035095 Aug 04 04:32:31.475956 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1034/2090] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:30 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:31.477096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:31.488037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:31.490526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:31.497426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:31.502149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:31.503698 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1465c4ab-c6f1-4747-8eaa-960b91649153 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1865 microversion: 2.42 time: 0.979734 Aug 04 04:32:31.505773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:31.506571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:31.513998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1057/2091] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:30 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1865 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:31.515381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:31.515992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:31.534484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:31.535734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:31.547232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:31.547926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:31.550832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:31.552156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:32.112277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:32.120060 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c39c370-235b-401c-b910-2474bbfd30dc tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.598072 Aug 04 04:32:32.120874 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1058/2092] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:31 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:32.144906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:32.145541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:32.175726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:32.178746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:32.181981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:32.184821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:32.407677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:32.453073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:32.462602 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6e64a808-12f5-4214-9f6f-6eb1c07c3dee tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.335108 Aug 04 04:32:32.463285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:32.466033 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1059/2093] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:32 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:32.481128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:32.482682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:32.483907 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f91301b-f359-480f-8c01-1fdb174ffdda tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 1.006926 Aug 04 04:32:32.489400 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1035/2094] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:31 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:32.503285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:32.504226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:32.504391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9f062f85-614c-4fec-b453-771752e5f0d0 req-39ef0d81-0ea9-4a9c-b3ab-2358335eebd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "b41c6896-92e5-4741-afbd-09bad08f2d4e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:32.522449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:32.523528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:32.524553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:32.527258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:32.535347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9f062f85-614c-4fec-b453-771752e5f0d0 req-39ef0d81-0ea9-4a9c-b3ab-2358335eebd6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:32.536043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9f062f85-614c-4fec-b453-771752e5f0d0 req-39ef0d81-0ea9-4a9c-b3ab-2358335eebd6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:32.552936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9f062f85-614c-4fec-b453-771752e5f0d0 req-39ef0d81-0ea9-4a9c-b3ab-2358335eebd6 service nova] Creating event network-changed:b41c6896-92e5-4741-afbd-09bad08f2d4e for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:32:32.559550 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9f062f85-614c-4fec-b453-771752e5f0d0 req-39ef0d81-0ea9-4a9c-b3ab-2358335eebd6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082903 Aug 04 04:32:32.560730 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1060/2095] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:32.584277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:32.586005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:32.601267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:32.606351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:32.607566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:32.608215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.057397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:33.075311 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48882546-c3f3-4933-9d23-930fc79b5f25 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.573741 Aug 04 04:32:33.081127 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1036/2096] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:32 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:33.249894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:33.268265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:33.274067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:33.278689 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ed490ad-2a3d-48c2-a393-397fed9fec29 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1865 microversion: 2.42 time: 0.715994 Aug 04 04:32:33.279746 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1061/2097] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:32 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1865 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:33.296405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:33.297267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:33.309816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.313364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.315152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.316512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.367739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5b56129d-0734-4d8f-853b-71eb596b6b3d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Calling method '.version_select at 0x7f1919f194c0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:33.553005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5b56129d-0734-4d8f-853b-71eb596b6b3d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7" status: 200 len: 371 microversion: 2.1 time: 0.470354 Aug 04 04:32:33.558659 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1037/2098] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 04:32:33 2022] GET /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7 => generated 371 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:33.572194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:33.580707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:33.591827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.592476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.593412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.594026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.622076 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] HTTP exception thrown: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Request method failure captured: Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d HTTP/1.1 Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sIjr9b7W7CXgtuZn8xtHss8zsxRpbcz6Sbrav_xYVlKwnX9KHNafOD-t3SdNy8NAJeGQgFS2OPElpoBUI21MxsCwDOwCUU73Uc53bnohvB4Ozfx3DhnDoCNzAdMUM2Sb0cDePcw0XDYx8OljVd3abRp0w3mPpsfCdFPX0m3YEAQkc Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 8bf94eaa7716467888b61e00d69b953f Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bf94eaa7716467888b61e00d69b953f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 8bf94eaa7716467888b61e00d69b953f Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachSCSIVolumeTestJSON-204988184-project Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d31076ca54a542d9bfdf09c52c69741f Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-204988184-project Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0c808db1-8983-4e22-8af7-874d85053f0d'} Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:32:33.624267 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:33.627243 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:33.629538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Returning 404 to user: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:33.630593 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1214381f-8772-4261-abcd-f6ed926de91a tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 404 len: 111 microversion: 2.1 time: 0.070761 Aug 04 04:32:33.631721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1038/2099] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:32:33 2022] DELETE /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:32:33.636976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:33.637821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:33.649891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:33.652224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.652871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.653976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.654830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.791720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:33.802728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fb741f9d-7e10-4b7e-a71a-3ab0362d73ab tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.521065 Aug 04 04:32:33.815895 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1062/2100] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:33 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:33.821935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:33.822658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:33.830698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.833429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:33.834280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:33.834739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.036084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:34.045551 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45c6e58f-1fd0-4c7a-bded-dc913c399aa1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.412301 Aug 04 04:32:34.046338 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1039/2101] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:33 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:34.072704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1031fe4-2140-40e6-98c8-4709bf9c7b04 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Action: 'update', calling method: .version_select at 0x7f19239b7b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:34.183416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1031fe4-2140-40e6-98c8-4709bf9c7b04 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.183879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1031fe4-2140-40e6-98c8-4709bf9c7b04 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.184702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1031fe4-2140-40e6-98c8-4709bf9c7b04 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.185147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1031fe4-2140-40e6-98c8-4709bf9c7b04 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.256064 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1031fe4-2140-40e6-98c8-4709bf9c7b04 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7" status: 200 len: 328 microversion: 2.1 time: 0.193527 Aug 04 04:32:34.263917 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1040/2102] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:32:34 2022] PUT /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7 => generated 328 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:34.268964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:34.269583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] [instance: 0c808db1-8983-4e22-8af7-874d85053f0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:34.279528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.280004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.281816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.282274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.311204 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] HTTP exception thrown: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Request method failure captured: Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d HTTP/1.1 Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sIjr9b7W7CXgtuZn8xtHss8zsxRpbcz6Sbrav_xYVlKwnX9KHNafOD-t3SdNy8NAJeGQgFS2OPElpoBUI21MxsCwDOwCUU73Uc53bnohvB4Ozfx3DhnDoCNzAdMUM2Sb0cDePcw0XDYx8OljVd3abRp0w3mPpsfCdFPX0m3YEAQkc Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 8bf94eaa7716467888b61e00d69b953f Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bf94eaa7716467888b61e00d69b953f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bf94eaa7716467888b61e00d69b953f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 8bf94eaa7716467888b61e00d69b953f Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-204988184 Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachSCSIVolumeTestJSON-204988184-project Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d31076ca54a542d9bfdf09c52c69741f Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-204988184-project Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0c808db1-8983-4e22-8af7-874d85053f0d'} Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:34.313008 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] Returning 404 to user: Instance 0c808db1-8983-4e22-8af7-874d85053f0d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad4763dc-e7ef-48e3-8002-dda8f6513d12 tempest-AttachSCSIVolumeTestJSON-204988184 tempest-AttachSCSIVolumeTestJSON-204988184-project] 10.222.0.69 "GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d" status: 404 len: 111 microversion: 2.1 time: 0.049461 Aug 04 04:32:34.317129 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1041/2103] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:34 2022] GET /compute/v2.1/servers/0c808db1-8983-4e22-8af7-874d85053f0d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:32:34.324837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:34.325473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:34.332065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.332525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.333314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.333757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.497582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:34.524483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:34.527414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:34.531310 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6d2f5e51-1ba1-41cc-90e0-6c9d9f0f4112 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.724496 Aug 04 04:32:34.533117 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1063/2104] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:33 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:34.551620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-901d3980-51dc-4705-b823-641f7f6c37d0 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:34.576768 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-901d3980-51dc-4705-b823-641f7f6c37d0 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7" status: 202 len: 0 microversion: 2.1 time: 0.041303 Aug 04 04:32:34.578746 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1064/2105] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:32:34 2022] DELETE /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:34.586632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:34.588238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:34.605704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.608501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.611019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.612395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.655390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:34.668732 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ccc4c99-9682-4b18-aaef-dc6bb60a9ce7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.352079 Aug 04 04:32:34.671798 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1042/2106] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:34 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:34.677867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-46739787-b9ea-4283-a2cd-deaf87f30dd1 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Calling method '.version_select at 0x7f1923a2a8b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:34.797204 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-46739787-b9ea-4283-a2cd-deaf87f30dd1 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7" status: 200 len: 371 microversion: 2.1 time: 0.123964 Aug 04 04:32:34.798451 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1043/2107] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 04:32:34 2022] GET /compute/v2.1/os-quota-sets/ca0a0d3f69f44909ab528c45df1df6e7 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:34.803395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c7d0e75b-fe53-4d74-8848-e6ee6056980f req-0006ced2-7325-43ed-9360-71e7550e9465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "9fb40d66-e6ad-4a8d-a857-8c35535ad0d2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:34.815633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c7d0e75b-fe53-4d74-8848-e6ee6056980f req-0006ced2-7325-43ed-9360-71e7550e9465 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.816283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c7d0e75b-fe53-4d74-8848-e6ee6056980f req-0006ced2-7325-43ed-9360-71e7550e9465 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.833008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c7d0e75b-fe53-4d74-8848-e6ee6056980f req-0006ced2-7325-43ed-9360-71e7550e9465 service nova] Creating event network-changed:9fb40d66-e6ad-4a8d-a857-8c35535ad0d2 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:32:34.842040 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c7d0e75b-fe53-4d74-8848-e6ee6056980f req-0006ced2-7325-43ed-9360-71e7550e9465 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042050 Aug 04 04:32:34.845807 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1044/2108] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:34.851126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:34.851839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:34.864515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.864978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:34.865945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:34.866397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:35.069396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.082570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.084669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.086424 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40dd4418-ea12-4336-90c0-0ee492feb5e1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1886 microversion: 2.42 time: 0.506005 Aug 04 04:32:35.108383 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1065/2109] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:34 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1886 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:35.120254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0a12512-ca17-4bf1-987b-a2783901983f tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Calling method '.version_select at 0x7f191a187af0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:35.368012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.381657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-605bd8b0-7ffc-4659-a6de-27a6501af9e9 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.534270 Aug 04 04:32:35.382969 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1045/2110] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:34 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:35.408485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:35.409658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:35.423250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:35.424098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:35.428717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:35.429475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:35.507150 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0a12512-ca17-4bf1-987b-a2783901983f tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70/defaults" status: 200 len: 371 microversion: 2.1 time: 0.396665 Aug 04 04:32:35.517750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1066/2111] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:32:35 2022] GET /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70/defaults => generated 371 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:35.561538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:35.562612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:35.570869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:35.584994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:35.585934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:35.586383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:35.860629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.872063 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-faee25b6-a50f-4c87-8aee-b0c23ed5a692 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.485343 Aug 04 04:32:35.883606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1046/2112] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:35 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:35.889407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:35.891885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:35.899837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:35.902083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:35.903026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:35.903482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:35.975988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.992662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.994490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:35.999333 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-82f76215-0b45-4f68-90fd-73bf4a6fba73 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.442008 Aug 04 04:32:36.004588 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1067/2113] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:35 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:32:36.020655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f0fdcde-c7de-439c-97a7-a4cf75f324b8 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Action: 'update', calling method: .version_select at 0x7f191a32ca60>, body: {"quota_set": {"ram": "5120"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:36.251359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f0fdcde-c7de-439c-97a7-a4cf75f324b8 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.252232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f0fdcde-c7de-439c-97a7-a4cf75f324b8 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.252686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f0fdcde-c7de-439c-97a7-a4cf75f324b8 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.253127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f0fdcde-c7de-439c-97a7-a4cf75f324b8 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.326805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:36.338401 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f0fdcde-c7de-439c-97a7-a4cf75f324b8 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8" status: 200 len: 328 microversion: 2.1 time: 0.332501 Aug 04 04:32:36.340563 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1068/2114] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:32:36 2022] PUT /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8 => generated 328 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:36.346191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:36.347038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:36.354211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.355442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.356526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.357143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.363008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ef283bb-7260-4b61-91db-dc3dbefea913 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.475809 Aug 04 04:32:36.363965 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1047/2115] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:35 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:36.382991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bc615d7-870c-4399-9ceb-fc0c8b0d807d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Calling method '.version_select at 0x7f1919f0fa60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:36.466186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc615d7-870c-4399-9ceb-fc0c8b0d807d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.466640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc615d7-870c-4399-9ceb-fc0c8b0d807d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.467632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc615d7-870c-4399-9ceb-fc0c8b0d807d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.467977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc615d7-870c-4399-9ceb-fc0c8b0d807d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.498602 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bc615d7-870c-4399-9ceb-fc0c8b0d807d tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8/detail" status: 200 len: 916 microversion: 2.1 time: 0.133609 Aug 04 04:32:36.499931 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1048/2116] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:32:36 2022] GET /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8/detail => generated 916 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:36.505230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:36.506105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:36.513938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.514633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.515854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.516436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.790198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:36.802507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:36.805127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:36.806597 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3508306a-0d3e-44a7-a1bd-5277ff6c2b5c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1886 microversion: 2.42 time: 0.464888 Aug 04 04:32:36.816752 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1069/2117] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:36 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1886 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:36.827009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Action: 'update', calling method: .version_select at 0x7f191a1ccd30>, body: {"quota_set": {"ram": "2048"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:36.854257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:36.885978 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52203e2d-b223-4eb7-b3a6-de702278aa09 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.384643 Aug 04 04:32:36.891147 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1049/2118] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:36 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:36.904582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1119cb4a-490b-4c2e-bce4-e50ff414ef44 req-9896c8ec-3f27-49b7-b565-afc9783daf71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:36.926395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1119cb4a-490b-4c2e-bce4-e50ff414ef44 req-9896c8ec-3f27-49b7-b565-afc9783daf71 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.928610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1119cb4a-490b-4c2e-bce4-e50ff414ef44 req-9896c8ec-3f27-49b7-b565-afc9783daf71 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.959317 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1119cb4a-490b-4c2e-bce4-e50ff414ef44 req-9896c8ec-3f27-49b7-b565-afc9783daf71 service nova] Creating event network-changed:9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:32:36.966804 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1119cb4a-490b-4c2e-bce4-e50ff414ef44 req-9896c8ec-3f27-49b7-b565-afc9783daf71 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072468 Aug 04 04:32:36.969965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.970315 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1050/2119] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:36.970421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.971524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:36.975156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:36.987787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:36.989574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:37.005932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.006589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.007575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.016826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.075453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.076493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.077697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.078350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.194555 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2955c9eb-e3cd-4c08-9e4f-1468da127a69 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8?user_id=974da4257d4c4c51bdbc4931017e6282" status: 200 len: 328 microversion: 2.1 time: 0.375118 Aug 04 04:32:37.202343 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1070/2120] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:32:36 2022] PUT /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8?user_id=974da4257d4c4c51bdbc4931017e6282 => generated 328 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:37.231656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:37.233163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:37.253910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.261868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.263756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.267165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.298312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:37.317789 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9060ffed-18f6-409f-ac02-709fff54736a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.343983 Aug 04 04:32:37.324563 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1051/2121] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:36 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:37.335700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96c62679-d132-425c-abf9-568f9c1a9996 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Calling method '.version_select at 0x7f1923982940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:37.485158 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96c62679-d132-425c-abf9-568f9c1a9996 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8?user_id=974da4257d4c4c51bdbc4931017e6282" status: 200 len: 370 microversion: 2.1 time: 0.156360 Aug 04 04:32:37.485783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1052/2122] 10.222.0.69 () {58 vars in 1323 bytes} [Thu Aug 4 04:32:37 2022] GET /compute/v2.1/os-quota-sets/3869025967f44aaabcf69a62f1cfd5d8?user_id=974da4257d4c4c51bdbc4931017e6282 => generated 370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:37.497696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:37.500103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:37.522762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.524012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.529208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.530694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.825807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:37.836220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:37.848699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:37.850336 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eae927e9-6859-4b25-bafd-4834c13943ae tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.644981 Aug 04 04:32:37.853892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1071/2123] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:37 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:37.870642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:37.871737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:37.891303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.891996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:37.893552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:37.894190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:38.084939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:38.089354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:38.119669 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-09b35914-c28b-4700-83c6-e193112ffb29 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.613703 Aug 04 04:32:38.122799 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1053/2124] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:37 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:38.147911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:38.148561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:38.173381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:38.173849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:38.174718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:38.175230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:38.529326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:38.559136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:38.560916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:38.562549 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c829fe6-54f5-47b9-86e5-760c4a97521b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1886 microversion: 2.42 time: 0.706872 Aug 04 04:32:38.582151 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1072/2125] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:37 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1886 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:38.587440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-aad0b83f-2fd2-42c3-8858-d3c75b040af7 req-22b8cf61-a118-44a3-b31c-8a4f27c0a420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-plugged", "status": "completed", "tag": "087ed3c0-9d5d-41c5-b873-d6a51295c4ad"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:38.603799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-aad0b83f-2fd2-42c3-8858-d3c75b040af7 req-22b8cf61-a118-44a3-b31c-8a4f27c0a420 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:38.605085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-aad0b83f-2fd2-42c3-8858-d3c75b040af7 req-22b8cf61-a118-44a3-b31c-8a4f27c0a420 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:38.636774 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-aad0b83f-2fd2-42c3-8858-d3c75b040af7 req-22b8cf61-a118-44a3-b31c-8a4f27c0a420 service nova] Creating event network-vif-plugged:087ed3c0-9d5d-41c5-b873-d6a51295c4ad for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:38.649256 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-aad0b83f-2fd2-42c3-8858-d3c75b040af7 req-22b8cf61-a118-44a3-b31c-8a4f27c0a420 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065387 Aug 04 04:32:38.654182 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1073/2126] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:38.673949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a8e423a-0dcf-4988-bcad-e015f6f4f7b6 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Calling method '.version_select at 0x7f191a19b160>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:38.980390 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a8e423a-0dcf-4988-bcad-e015f6f4f7b6 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70/defaults" status: 200 len: 371 microversion: 2.1 time: 0.324446 Aug 04 04:32:38.980987 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1074/2127] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:32:38 2022] GET /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70/defaults => generated 371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:39.009242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:39.010009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:39.024852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.025656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:39.027280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.028161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:39.126416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:39.136272 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a792aca5-5704-4174-832f-4d271eb7bb84 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 1.009430 Aug 04 04:32:39.144364 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1054/2128] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:38 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:39.149362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:39.152617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:39.172179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.172982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:39.174631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.175264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:39.629651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:39.654864 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b24cb292-ff1f-407a-a19c-4e692201e64b tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.663298 Aug 04 04:32:39.655512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1075/2129] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:38 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:39.669759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5471ff3-4c07-4232-b60a-cbdcc371ab28 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Action: 'update', calling method: .version_select at 0x7f191a1ccee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:39.785780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5471ff3-4c07-4232-b60a-cbdcc371ab28 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.786225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5471ff3-4c07-4232-b60a-cbdcc371ab28 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:39.787041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5471ff3-4c07-4232-b60a-cbdcc371ab28 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.787477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5471ff3-4c07-4232-b60a-cbdcc371ab28 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:39.823848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:39.835884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:39.851016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:39.857108 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2db8ac50-7b50-4fc5-b8dd-aa3d62f8cf8c tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.711504 Aug 04 04:32:39.870985 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1055/2130] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:39 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:39.870985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ff97ca14-4391-498c-9b62-404090866908 req-615a8f56-7e78-4d98-a481-f7af97c2565f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "43500245-7cb8-47d9-b8ab-7204efa8bd6d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:39.894748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ff97ca14-4391-498c-9b62-404090866908 req-615a8f56-7e78-4d98-a481-f7af97c2565f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.897089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ff97ca14-4391-498c-9b62-404090866908 req-615a8f56-7e78-4d98-a481-f7af97c2565f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:39.931126 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ff97ca14-4391-498c-9b62-404090866908 req-615a8f56-7e78-4d98-a481-f7af97c2565f service nova] Creating event network-changed:43500245-7cb8-47d9-b8ab-7204efa8bd6d for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:32:39.944671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ff97ca14-4391-498c-9b62-404090866908 req-615a8f56-7e78-4d98-a481-f7af97c2565f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083801 Aug 04 04:32:39.947583 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1056/2131] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:39.967634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:39.970623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:39.997212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:39.998171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:40.000347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:40.001715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:40.070432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2,nova_api:INSERT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:40.140817 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5471ff3-4c07-4232-b60a-cbdcc371ab28 tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70" status: 200 len: 329 microversion: 2.1 time: 0.481413 Aug 04 04:32:40.142118 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1076/2132] 10.222.0.69 () {60 vars in 1263 bytes} [Thu Aug 4 04:32:39 2022] PUT /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70 => generated 329 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:40.154731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:40.155663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:40.172801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:40.175776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:40.179129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:40.183356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:40.796984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:40.808803 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9eeb327e-68e2-4727-8c25-9eba60eb26aa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1657 microversion: 2.1 time: 0.856905 Aug 04 04:32:40.810012 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1057/2133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:39 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1657 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:40.816919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d0a056c-bb3b-4a0d-a6a3-aa5566a317eb tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Action: 'update', calling method: .version_select at 0x7f19239823a0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:40.898925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:40.915626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:40.924358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:40.926992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2650670a-0dbc-4cc2-b1ff-cbfeda9d5248 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1886 microversion: 2.42 time: 0.782469 Aug 04 04:32:40.931777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d0a056c-bb3b-4a0d-a6a3-aa5566a317eb tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:40.932644 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1077/2134] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:40 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1886 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:40.933400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d0a056c-bb3b-4a0d-a6a3-aa5566a317eb tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:40.935712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d0a056c-bb3b-4a0d-a6a3-aa5566a317eb tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:40.936298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d0a056c-bb3b-4a0d-a6a3-aa5566a317eb tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:40.953843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:40.954571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:40.977851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:40.980869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:40.980869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:40.980869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:41.318845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:UPDATE=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:41.486445 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4d0a056c-bb3b-4a0d-a6a3-aa5566a317eb tempest-QuotasAdminTestJSON-1605414082 tempest-QuotasAdminTestJSON-1605414082-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70" status: 200 len: 329 microversion: 2.1 time: 0.675034 Aug 04 04:32:41.487424 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1058/2135] 10.222.0.69 () {60 vars in 1263 bytes} [Thu Aug 4 04:32:40 2022] PUT /compute/v2.1/os-quota-sets/4d18d9fe193a4fa6b102db34ea020d70 => generated 329 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:41.492002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-plugged", "status": "completed", "tag": "b91f7631-35bc-4019-9c98-469955f4c3a6"}, {"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-plugged", "status": "completed", "tag": "79a80cce-aa43-459a-b8bf-02f7dc9b7e38"}, {"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-plugged", "status": "completed", "tag": "9a838a5c-abf8-4025-8590-88accc375b4d"}, {"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-plugged", "status": "completed", "tag": "603a0716-af65-4b22-943b-fc75552e52cb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:41.507378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:41.507378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:41.520660 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] Creating event network-vif-plugged:b91f7631-35bc-4019-9c98-469955f4c3a6 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:41.521324 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] Creating event network-vif-plugged:79a80cce-aa43-459a-b8bf-02f7dc9b7e38 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:41.521918 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] Creating event network-vif-plugged:9a838a5c-abf8-4025-8590-88accc375b4d for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:41.522609 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] Creating event network-vif-plugged:603a0716-af65-4b22-943b-fc75552e52cb for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:41.529217 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-750d9ae2-07e1-4049-8356-14c05a491737 req-a94a467b-79b6-4487-91c1-ea9040e6c873 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.040635 Aug 04 04:32:41.534619 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1059/2136] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:41.540633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:41.541536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:41.549954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:41.549954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:41.551162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:41.551725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:41.582171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:41.592489 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ae09abc-79ee-4163-8986-3d35e31e1be2 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.644022 Aug 04 04:32:41.593639 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1078/2137] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:40 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:41.612854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7fb90f0-d005-4334-b0ba-7bb5fd429dd3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:41.621451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7fb90f0-d005-4334-b0ba-7bb5fd429dd3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:41.621900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7fb90f0-d005-4334-b0ba-7bb5fd429dd3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:41.656523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7fb90f0-d005-4334-b0ba-7bb5fd429dd3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Going to try to start instance {{(pid=119343) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 04:32:41.711772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:41.744548 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7fb90f0-d005-4334-b0ba-7bb5fd429dd3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.133501 Aug 04 04:32:41.747014 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1079/2138] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:41 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:41.755242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:41.757261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:41.765155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:41.765967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:41.767155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:41.767829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:42.253748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:42.262282 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a2c5f3d-2761-4e12-b28d-20b4c347e7e4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.726224 Aug 04 04:32:42.267945 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1060/2139] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:41 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:42.280184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:42.280822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:42.290618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:42.291142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:42.292146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:42.292461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:42.318812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:42.333780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:42.335359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:42.336575 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1755276a-b97c-4c6f-9d7e-9b576fc25557 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.588246 Aug 04 04:32:42.352229 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1080/2140] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:41 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:42.366128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:42.366754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:42.388197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:42.389180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:42.390085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:42.390604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:42.765899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:42.775066 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8d6a0cb-a1a7-4458-98b3-4886d4c0d6b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1666 microversion: 2.1 time: 0.506159 Aug 04 04:32:42.775912 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1061/2141] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:42 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1666 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:42.782625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e16b99cf-d55c-4153-b739-acc122d56b3d req-90f85626-19dc-4037-abfa-a7301c34964f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "f55f1dcc-d5c6-4541-a7e6-6317c075bfed"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:42.799793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e16b99cf-d55c-4153-b739-acc122d56b3d req-90f85626-19dc-4037-abfa-a7301c34964f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:42.800619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e16b99cf-d55c-4153-b739-acc122d56b3d req-90f85626-19dc-4037-abfa-a7301c34964f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:42.817111 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e16b99cf-d55c-4153-b739-acc122d56b3d req-90f85626-19dc-4037-abfa-a7301c34964f service nova] Creating event network-changed:f55f1dcc-d5c6-4541-a7e6-6317c075bfed for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:32:42.823864 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e16b99cf-d55c-4153-b739-acc122d56b3d req-90f85626-19dc-4037-abfa-a7301c34964f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045345 Aug 04 04:32:42.824429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1062/2142] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:42.830923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:42.831807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:42.843998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:42.845228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:42.846334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:42.851766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:43.049841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:43.087195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:43.096277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:43.098438 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fa345cfd-a14c-4f19-ab89-08face67f9ab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1886 microversion: 2.42 time: 0.744876 Aug 04 04:32:43.111144 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1081/2143] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:42 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1886 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:43.308114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:43.309204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:43.348302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:43.352590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:43.362414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:43.364065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:43.366760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:43.370989 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fcc18f28-a1e5-4bbd-be1b-bef14c221237 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.545179 Aug 04 04:32:43.377108 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1063/2144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:42 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:43.382124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:43.387718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:43.397821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:43.399192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:43.412075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:43.412880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:44.231422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:44.259130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76dd5ab5-6c0e-4c93-a759-16c4d5e6b485 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.958239 Aug 04 04:32:44.261527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1082/2145] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:43 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:44.268032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-48c7800e-439d-4a27-9cf6-0cde5a82967b req-568bab6e-a2e6-4e6f-9731-d982a3dfa513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-plugged", "status": "completed", "tag": "dcc19c32-c8b8-456f-bd9a-701b882de6be"}, {"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-plugged", "status": "completed", "tag": "6170383e-7582-4f81-92f2-d72b1ef66d77"}, {"server_uuid": "0bef516e-c91a-443f-ac0c-649449549e14", "name": "network-vif-plugged", "status": "completed", "tag": "c55b8a14-dabe-4658-8bb5-9de3d2a09a89"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:44.312697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-48c7800e-439d-4a27-9cf6-0cde5a82967b req-568bab6e-a2e6-4e6f-9731-d982a3dfa513 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:44.313153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-48c7800e-439d-4a27-9cf6-0cde5a82967b req-568bab6e-a2e6-4e6f-9731-d982a3dfa513 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:44.315622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:44.334445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:44.339513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:44.343311 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9d250884-5ad5-4b74-8f30-bd9748f6faff tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.964048 Aug 04 04:32:44.344696 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1064/2146] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:43 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:44.352829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:44.354481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:44.364781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:44.365451 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-48c7800e-439d-4a27-9cf6-0cde5a82967b req-568bab6e-a2e6-4e6f-9731-d982a3dfa513 service nova] Creating event network-vif-plugged:dcc19c32-c8b8-456f-bd9a-701b882de6be for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:44.365971 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-48c7800e-439d-4a27-9cf6-0cde5a82967b req-568bab6e-a2e6-4e6f-9731-d982a3dfa513 service nova] Creating event network-vif-plugged:6170383e-7582-4f81-92f2-d72b1ef66d77 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:44.366229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:44.366482 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-48c7800e-439d-4a27-9cf6-0cde5a82967b req-568bab6e-a2e6-4e6f-9731-d982a3dfa513 service nova] Creating event network-vif-plugged:c55b8a14-dabe-4658-8bb5-9de3d2a09a89 for instance 0bef516e-c91a-443f-ac0c-649449549e14 on n-h1-851337-5 Aug 04 04:32:44.369322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:44.370520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:44.387095 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-48c7800e-439d-4a27-9cf6-0cde5a82967b req-568bab6e-a2e6-4e6f-9731-d982a3dfa513 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.123567 Aug 04 04:32:44.388232 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1083/2147] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:44.402111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:44.402111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:44.419409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:44.419866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:44.420923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:44.422719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.135120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:45.143600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:45.147096 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-858687b9-cf19-4db6-875f-d35a778f5248 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.801066 Aug 04 04:32:45.148185 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1065/2148] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:44 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:45.152753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:45.154268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:45.156316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:45.157435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:45.163742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fef08c2e-cbef-4e14-980a-3c536f11111c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1886 microversion: 2.42 time: 0.770267 Aug 04 04:32:45.164461 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1084/2149] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:44 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1886 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:45.166256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.167647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.168809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.169546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.174413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-691c53e1-9b61-45e9-8186-33b7d6e4a2b7 req-a5f760fd-589c-49b1-b03f-a18fc43fd13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "e394ea21-6aa5-4297-9493-7b1d332e8b50"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:45.199939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-691c53e1-9b61-45e9-8186-33b7d6e4a2b7 req-a5f760fd-589c-49b1-b03f-a18fc43fd13c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.200802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-691c53e1-9b61-45e9-8186-33b7d6e4a2b7 req-a5f760fd-589c-49b1-b03f-a18fc43fd13c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.221394 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-691c53e1-9b61-45e9-8186-33b7d6e4a2b7 req-a5f760fd-589c-49b1-b03f-a18fc43fd13c service nova] Creating event network-changed:e394ea21-6aa5-4297-9493-7b1d332e8b50 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:32:45.229174 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-691c53e1-9b61-45e9-8186-33b7d6e4a2b7 req-a5f760fd-589c-49b1-b03f-a18fc43fd13c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062813 Aug 04 04:32:45.230691 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1085/2150] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:45.236483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:45.237397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:45.244892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.245914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.247570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.248181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.684840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:45.693495 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3294b405-66d1-408a-8ac9-8892456a38a7 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1324 microversion: 2.1 time: 0.543793 Aug 04 04:32:45.693998 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1066/2151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:45 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:45.701263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:45.702052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:45.708373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.709205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.709973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.710573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.726043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:45.735805 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84534a62-042a-40f3-8392-a0f1c782df5e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.503803 Aug 04 04:32:45.737588 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1086/2152] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:45 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:45.742721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:45.743891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:45.755734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.763360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:45.764462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:45.764915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:46.220494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:46.228360 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c1d8694b-3e21-453c-b648-b2cb40eb410e tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.532998 Aug 04 04:32:46.228945 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1067/2153] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:45 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:46.235053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:46.235053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:46.240622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:46.241079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:46.241858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:46.242457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:46.284603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Unlocking {{(pid=119342) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 04:32:46.313786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:46.325235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:46.327133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:46.328532 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-16d7b9f7-7737-4d51-a517-e36df3bc2544 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1879 microversion: 2.32 time: 0.589777 Aug 04 04:32:46.329254 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1087/2154] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:45 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1879 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:46.348135 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e562338-b40c-49af-9dbd-3cf4da0ea3d1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.116928 Aug 04 04:32:46.351093 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1068/2155] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:46 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:46.362332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:46.363765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:46.372818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:46.373466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:46.374395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:46.375155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:46.508528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2119670410", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:46.567471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:32:46.884676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:46.896145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:46.898146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:46.899598 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4a8da93-5a54-4f3b-b244-2d75df2c514a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.547245 Aug 04 04:32:46.911244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1069/2156] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:46 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:46.911244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:46.911244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:46.911957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:46.912527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:46.913447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:46.913970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:47.514138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:32:47.514665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:32:47.515183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:32:47.515626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:32:47.516205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:32:47.527125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:47.527577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:47.528413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:47.528847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:47.546942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Getting quotas for project ec43cf872c50487aac4651a57983663c. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:32:47.552444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Getting quotas for user cb10a3a341b04b0ead51b623fadb103b and project ec43cf872c50487aac4651a57983663c. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:32:47.566518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:32:47.569131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:32:47.577365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:47.580132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:47.587581 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed38e718-32e4-45be-88f8-769351b27f9b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.686135 Aug 04 04:32:47.588800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1070/2157] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:46 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:47.594192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:47.595027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:47.604694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:47.605597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:47.606425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:47.606909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:47.640403 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-42c60f55-1ed8-43e0-885c-9f1d738cad55 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.309883 Aug 04 04:32:47.648881 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1088/2158] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:32:47.654544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:47.655562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:47.663173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:47.663895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:47.664834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:47.665461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.006150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.019967 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1e320c8e-0ecf-4dd8-97e9-261c9de4eed4 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1521 microversion: 2.1 time: 0.429818 Aug 04 04:32:48.037391 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1071/2159] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:47 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:48.044827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.045450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.052949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.053671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.054668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.055421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.088210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.097369 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55fee777-a34f-4c2a-9b7d-b9a1960a632c tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.447112 Aug 04 04:32:48.105484 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1089/2160] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:47 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:48.119178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.120830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.128507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.129208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.130170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.131188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.469837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.481962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.499629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e41dddb8-15f3-43e4-8b61-53c7e45856ab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.390055 Aug 04 04:32:48.515946 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1090/2161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:48.516589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.520543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.521852 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2d994d9-b349-4500-8315-1e173aa020b4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2830 microversion: 2.32 time: 0.483330 Aug 04 04:32:48.524297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.525100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.528506 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1072/2162] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2830 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:48.532358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.532809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.533592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.534026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.548402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.555293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.563563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.564442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.565582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.566205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.624793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.633191 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-663ea1ee-04b2-4231-b5cf-c0cb4403a352 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1227 microversion: 2.1 time: 0.123222 Aug 04 04:32:48.634269 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1091/2163] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1227 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:48.646717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.647575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.657004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.657729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.665053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.666172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.694872 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] HTTP exception thrown: Instance is not a member of specified network Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Request method failure captured: Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14/ips/invalid HTTP/1.1 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60vN2XJ66YBE7TpgRCsc5CLofxszIQyILF5gAhWbG403YIKleyxXTSTFPf6EHK7py7R6BWSXaqzYyKgW2cBJzgyBtZgQeomVLEYfWmOAxP87JfutFF-rVCa179GhNSNQtoNge7yAIudj0nsNRg0E1xDUEQu4JNPz-ojHI5yCCi4Cpc8 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2de51297aa8c4ad79e3c2db20dfcecbc Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2de51297aa8c4ad79e3c2db20dfcecbc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2de51297aa8c4ad79e3c2db20dfcecbc Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerAddressesNegativeTestJSON-776070105-project Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb8b6898aef4442d92533ec2f4d027be Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-776070105-project Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance is not a member of specified network Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '0bef516e-c91a-443f-ac0c-649449549e14', 'id': 'invalid'} Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 04 04:32:48.702239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.710464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:48.710464 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9731c6f-cc30-4187-b752-919a679ab15e tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.068330 Aug 04 04:32:48.710464 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1092/2164] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14/ips/invalid => generated 91 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:32:48.710464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.710464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.717241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.717860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.718808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.719289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.854873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.864433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.865944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.867287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a02188c-4e99-486e-8377-0d02322df190 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.337488 Aug 04 04:32:48.876928 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1073/2165] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:48.876928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-252b2f01-6857-46a9-b30c-b80530abbd16 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.876928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-252b2f01-6857-46a9-b30c-b80530abbd16 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.882186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-252b2f01-6857-46a9-b30c-b80530abbd16 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.883003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-252b2f01-6857-46a9-b30c-b80530abbd16 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.883785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-252b2f01-6857-46a9-b30c-b80530abbd16 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.884217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-252b2f01-6857-46a9-b30c-b80530abbd16 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.907563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:48.917976 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4b02c66c-e9bd-4f76-bcc9-2fce2354073f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.212491 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1093/2166] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ef6afd6-9de1-4fb4-a4ad-0cc528a7414c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ef6afd6-9de1-4fb4-a4ad-0cc528a7414c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Failed to fetch instance by id 999 {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3ef6afd6-9de1-4fb4-a4ad-0cc528a7414c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] HTTP exception thrown: Instance 999 could not be found. Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ef6afd6-9de1-4fb4-a4ad-0cc528a7414c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Request method failure captured: Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60vN2XJ66YBE7TpgRCsc5CLofxszIQyILF5gAhWbG403YIKleyxXTSTFPf6EHK7py7R6BWSXaqzYyKgW2cBJzgyBtZgQeomVLEYfWmOAxP87JfutFF-rVCa179GhNSNQtoNge7yAIudj0nsNRg0E1xDUEQu4JNPz-ojHI5yCCi4Cpc8 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2de51297aa8c4ad79e3c2db20dfcecbc Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2de51297aa8c4ad79e3c2db20dfcecbc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2de51297aa8c4ad79e3c2db20dfcecbc Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerAddressesNegativeTestJSON-776070105-project Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb8b6898aef4442d92533ec2f4d027be Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-776070105-project Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 999 could not be found. Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '999'} Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:48.929272 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ef6afd6-9de1-4fb4-a4ad-0cc528a7414c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ef6afd6-9de1-4fb4-a4ad-0cc528a7414c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008189 Aug 04 04:32:48.932218 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1094/2167] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:32:48.942731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:48.942731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:48.960036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.960529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:48.961354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:48.961798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.009834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:32:49.117785 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-252b2f01-6857-46a9-b30c-b80530abbd16 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.248298 Aug 04 04:32:49.118383 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1074/2168] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:32:48 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f/os-interface => generated 1829 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:49.134395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-90b939a7-2b2b-4b8d-943e-0b7fe5fa22a0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:49.139762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-90b939a7-2b2b-4b8d-943e-0b7fe5fa22a0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:49.142108 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c8f8e8c-4aa6-4843-adcf-70d306f43ae5 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 204 len: 0 microversion: 2.1 time: 0.207424 Aug 04 04:32:49.143305 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1095/2169] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:32:48 2022] DELETE /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:32:49.152676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:49.154650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:49.161956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.162412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.163231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.163669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.164223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b939a7-2b2b-4b8d-943e-0b7fe5fa22a0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.164684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b939a7-2b2b-4b8d-943e-0b7fe5fa22a0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.165482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b939a7-2b2b-4b8d-943e-0b7fe5fa22a0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.165928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b939a7-2b2b-4b8d-943e-0b7fe5fa22a0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.269701 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-90b939a7-2b2b-4b8d-943e-0b7fe5fa22a0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.148517 Aug 04 04:32:49.270855 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1075/2170] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:49 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:49.277833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:49.278707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:49.286388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.287138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.288100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.288685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.535565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:49.553745 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8898cb24-9941-4480-9557-11c991fc1b13 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1527 microversion: 2.1 time: 0.281401 Aug 04 04:32:49.555037 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1076/2171] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:49 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1527 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:49.567324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:49.568739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:49.577732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.578484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.579748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.581123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.623400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:49.633835 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23edd389-c014-4be1-a614-f914eaa7e4d2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.489521 Aug 04 04:32:49.635101 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1096/2172] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:49 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:49.664436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:49.665453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:49.674029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.674713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.675966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.676620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.733685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:49.890265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:49.898765 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43a845f6-d953-4fe6-b8dd-497b9d540a81 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1275 microversion: 2.1 time: 0.245556 Aug 04 04:32:49.901501 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1097/2173] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:49 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:49.918282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:49.922751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:49.939015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.939475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:49.940308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:49.940763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.004082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:50.027348 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-151b924a-7fd9-4de1-af60-6bf92387a88e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1675 microversion: 2.1 time: 0.470892 Aug 04 04:32:50.031532 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1077/2174] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:49 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1675 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:50.113092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-366f833e-2c93-4e4d-9048-c623aaf26df8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:50.113892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-366f833e-2c93-4e4d-9048-c623aaf26df8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:50.124994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366f833e-2c93-4e4d-9048-c623aaf26df8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.126116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366f833e-2c93-4e4d-9048-c623aaf26df8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.128542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366f833e-2c93-4e4d-9048-c623aaf26df8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.129227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366f833e-2c93-4e4d-9048-c623aaf26df8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.164228 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-366f833e-2c93-4e4d-9048-c623aaf26df8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4/ips" status: 200 len: 151 microversion: 2.1 time: 0.055123 Aug 04 04:32:50.167145 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1078/2175] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:32:50 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4/ips => generated 151 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:50.179215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "527fc694-22b9-4ab9-9a4d-24f3154e4b8b"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:50.182182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:50.189814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.190535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.191570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.192185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.306215 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Invalid volume: volume 527fc694-22b9-4ab9-9a4d-24f3154e4b8b is already attached to instances: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4/os-volume_attachments HTTP/1.1 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 74 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: {"volumeAttachment": {"volumeId": "527fc694-22b9-4ab9-9a4d-24f3154e4b8b"}} Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid volume: volume 527fc694-22b9-4ab9-9a4d-24f3154e4b8b is already attached to instances: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'server_id': '6ab3ca78-87df-46a4-a7f7-7648c150a4c4', 'body': {'volumeAttachment': {'volumeId': '527fc694-22b9-4ab9-9a4d-24f3154e4b8b'}}} Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 527fc694-22b9-4ab9-9a4d-24f3154e4b8b is already attached to instances: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:32:50.319297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 527fc694-22b9-4ab9-9a4d-24f3154e4b8b is already attached to instances: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 527fc694-22b9-4ab9-9a4d-24f3154e4b8b is already attached to instances: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 Aug 04 04:32:50.325004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:50.330716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 400 to user: Invalid volume: volume 527fc694-22b9-4ab9-9a4d-24f3154e4b8b is already attached to instances: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:50.332990 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0c7fe460-4c75-45a2-a417-9889ff37602a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157423 Aug 04 04:32:50.334989 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1079/2176] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:32:50 2022] POST /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4/os-volume_attachments => generated 174 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:32:50.345363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:50.346117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:50.353587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:50.355224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.355846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.356767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.357973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.372342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:50.373894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:50.375710 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d3905489-310f-40ce-aaf0-b18fab18cb54 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.469645 Aug 04 04:32:50.376272 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1098/2177] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:49 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:50.412159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:32:50.535633 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b37d5faa-7d5e-4e35-bd5f-7959fac09b0a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 204 len: 0 microversion: 2.1 time: 0.196135 Aug 04 04:32:50.536374 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1080/2178] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:32:50 2022] DELETE /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:32:50.550391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:50.551104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:50.560497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.561001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.562126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.562578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.583822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:50.584860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:50.598301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.599217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.600345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.601829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.883848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:50.892231 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-003aa36a-36b9-44e5-8d00-65bfbce78e67 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1684 microversion: 2.1 time: 0.351364 Aug 04 04:32:50.893362 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1099/2179] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:50 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1684 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:50.897298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:50.902872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:50.903775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:50.910724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.911453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.911781 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3abe61a0-0aef-40f1-9d2b-bcbf488d529d tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1527 microversion: 2.1 time: 0.339176 Aug 04 04:32:50.912251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.912690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.918658 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1081/2180] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:50 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1527 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:50.929007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:50.929626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:50.944841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.945301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.946105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:50.946533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:50.953890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:51.085340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:51.093432 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c328bb8b-f30f-482a-b3a5-c758f0814eba tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1281 microversion: 2.1 time: 0.173459 Aug 04 04:32:51.095074 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1082/2181] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:50 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:51.113720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:51.114345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:51.121911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.122981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.123800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.124385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.277869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:51.302722 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ebb1fa54-9be3-4387-9d3f-dca0136b1970 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.408056 Aug 04 04:32:51.303520 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1100/2182] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:50 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:51.406249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:51.406882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:51.408883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:51.416556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.418191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.420388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.421004 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-189127c5-53cc-46d0-a352-fa4200002e32 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1675 microversion: 2.1 time: 0.310970 Aug 04 04:32:51.421223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.435179 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1083/2183] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:51 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1675 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:51.520625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4a419dda-53a7-482b-87ff-c165a1a0a0f6 req-5a46dcc5-f210-4162-8daa-926cc3fc6603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb0ce6c-996d-499a-8b2c-665598ed8aaa", "name": "network-vif-unplugged", "status": "completed", "tag": "c279607f-09ae-431b-bd1d-0ade6bbcd772"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:51.528558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=52 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:51.537679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4a419dda-53a7-482b-87ff-c165a1a0a0f6 req-5a46dcc5-f210-4162-8daa-926cc3fc6603 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.538519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4a419dda-53a7-482b-87ff-c165a1a0a0f6 req-5a46dcc5-f210-4162-8daa-926cc3fc6603 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.555819 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4a419dda-53a7-482b-87ff-c165a1a0a0f6 req-5a46dcc5-f210-4162-8daa-926cc3fc6603 service nova] Creating event network-vif-unplugged:c279607f-09ae-431b-bd1d-0ade6bbcd772 for instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa on n-h1-851337-5 Aug 04 04:32:51.562389 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4a419dda-53a7-482b-87ff-c165a1a0a0f6 req-5a46dcc5-f210-4162-8daa-926cc3fc6603 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045707 Aug 04 04:32:51.563479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1084/2184] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:32:51.771631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:51.784835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:51.786470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:51.788501 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a248bc75-eade-471d-b3e4-20efd2e722fd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.388158 Aug 04 04:32:51.795012 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1101/2185] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:51 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:32:51.915528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:51.916515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:51.925756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.926654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.927650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.928274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.936699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:51.939489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:51.951510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.952058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:51.953026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:51.954225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:52.279470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:52.287519 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c06f3f3-9c65-4281-8a75-4adb1aba3c5b tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1527 microversion: 2.1 time: 0.357355 Aug 04 04:32:52.288170 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1102/2186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:51 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:52.303740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:52.304957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:52.308784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:52.315209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:52.317438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:52.319246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:52.319889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:52.325032 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-860240cb-67d1-4a9d-bad0-2ccff061d798 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1684 microversion: 2.1 time: 0.412674 Aug 04 04:32:52.338747 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1085/2187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:51 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1684 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:52.353240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:52.356086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:52.378318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:52.379330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:52.382261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:52.395086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:52.401693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:52.409174 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8e5695f-d816-4c58-aec6-44db20b7d143 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1281 microversion: 2.1 time: 0.115014 Aug 04 04:32:52.412912 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1103/2188] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:52 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:52.435576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:52.448557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:52.449323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:52.460705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:52.467366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:52.469188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:52.470736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.265995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:53.275931 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-120b6803-23c2-4b74-82c2-2e13c756589b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1655 microversion: 2.1 time: 0.833726 Aug 04 04:32:53.289718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:53.290637 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1104/2189] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:52 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1655 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:53.299114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-72edb50e-7867-4e10-808f-1e6f7bb9c43d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.957381 Aug 04 04:32:53.299712 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1086/2190] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:52 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:53.315669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:53.316637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:53.321390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8f22bbd8-0286-472d-a402-dc259b562992 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:53.321974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8f22bbd8-0286-472d-a402-dc259b562992 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:53.325768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.326438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.327441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.328007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.332645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f22bbd8-0286-472d-a402-dc259b562992 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.333107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f22bbd8-0286-472d-a402-dc259b562992 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.334248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f22bbd8-0286-472d-a402-dc259b562992 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.334689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f22bbd8-0286-472d-a402-dc259b562992 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.422336 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8f22bbd8-0286-472d-a402-dc259b562992 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.120830 Aug 04 04:32:53.423759 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1087/2191] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:32:53 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:53.429946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:53.430922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:53.438844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.440045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.441077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.441671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.775580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:53.795457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:53.797623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:53.801615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8b6898aef4442d92533ec2f4d027be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de51297aa8c4ad79e3c2db20dfcecbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:53.802306 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-035b9155-7666-4f27-a80b-6060ea2340c5 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.505329 Aug 04 04:32:53.803676 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1105/2192] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:53 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:53.812547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:53.813766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:53.814005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f3174dd9-a960-4b36-85c5-67c82b2b0600 tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 200 len: 1527 microversion: 2.1 time: 0.388513 Aug 04 04:32:53.819613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1088/2193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:53 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 1527 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:53.833015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.836378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.838120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:53.839106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:53.839578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.840745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.846711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.847503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:53.848521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:53.849300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:54.177447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:54.181768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:54.192942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f519041e-c92e-4f87-bc25-bde1cad46df0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.364224 Aug 04 04:32:54.193875 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b50ca5c-c375-4152-b537-b8589269d1a8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1684 microversion: 2.1 time: 0.388325 Aug 04 04:32:54.194908 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1089/2194] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:53 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:54.209179 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1106/2195] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:53 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1684 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:54.216373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.216566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-836cff50-13a7-4f9b-be0b-3b49c3d9ad47 req-a9cffd97-64bc-42f2-8449-508e159463d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb0ce6c-996d-499a-8b2c-665598ed8aaa", "tag": "c279607f-09ae-431b-bd1d-0ade6bbcd772"}, {"name": "network-changed", "server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "tag": "dcc19c32-c8b8-456f-bd9a-701b882de6be"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:54.217452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:54.226911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:54.228050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:54.229311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:54.230137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:54.231495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-836cff50-13a7-4f9b-be0b-3b49c3d9ad47 req-a9cffd97-64bc-42f2-8449-508e159463d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:54.231964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-836cff50-13a7-4f9b-be0b-3b49c3d9ad47 req-a9cffd97-64bc-42f2-8449-508e159463d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:54.251861 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-836cff50-13a7-4f9b-be0b-3b49c3d9ad47 req-a9cffd97-64bc-42f2-8449-508e159463d5 service nova] Creating event network-changed:c279607f-09ae-431b-bd1d-0ade6bbcd772 for instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa on n-h1-851337-5 Aug 04 04:32:54.252560 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-836cff50-13a7-4f9b-be0b-3b49c3d9ad47 req-a9cffd97-64bc-42f2-8449-508e159463d5 service nova] Creating event network-changed:dcc19c32-c8b8-456f-bd9a-701b882de6be for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:32:54.265680 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-836cff50-13a7-4f9b-be0b-3b49c3d9ad47 req-a9cffd97-64bc-42f2-8449-508e159463d5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054175 Aug 04 04:32:54.267090 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1107/2196] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:54.279351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.280151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:54.296849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:54.297716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:54.299421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:54.300102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:54.672484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:54.710857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-784c8d0a-2901-4d27-a3cf-d40dafdc2ede tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.440481 Aug 04 04:32:54.717616 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1108/2197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:54.757620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.768327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:54.793973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:54.795408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:54.797852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:54.799550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.188917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:55.202245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7ec7033-40bf-4372-b3a9-5ca46f3f1794 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.461276 Aug 04 04:32:55.202999 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1109/2198] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:55.209665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c830e27d-af28-45fa-af57-e7243e33dccf req-98a0e7a0-3323-4b43-a44c-aabd903c2cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bef516e-c91a-443f-ac0c-649449549e14", "name": "network-vif-deleted", "tag": "c55b8a14-dabe-4658-8bb5-9de3d2a09a89"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:55.221831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c830e27d-af28-45fa-af57-e7243e33dccf req-98a0e7a0-3323-4b43-a44c-aabd903c2cf4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.222606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c830e27d-af28-45fa-af57-e7243e33dccf req-98a0e7a0-3323-4b43-a44c-aabd903c2cf4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.243994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c830e27d-af28-45fa-af57-e7243e33dccf req-98a0e7a0-3323-4b43-a44c-aabd903c2cf4 service nova] Creating event network-vif-deleted:c55b8a14-dabe-4658-8bb5-9de3d2a09a89 for instance 0bef516e-c91a-443f-ac0c-649449549e14 on n-h1-851337-5 Aug 04 04:32:55.256410 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c830e27d-af28-45fa-af57-e7243e33dccf req-98a0e7a0-3323-4b43-a44c-aabd903c2cf4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051824 Aug 04 04:32:55.258608 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1110/2199] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:55.270672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:55.272260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:55.279802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.280377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.281498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.282118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.416546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:55.429992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-704a38ff-b13d-4ccb-812f-d280a73eadb0 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1323 microversion: 2.1 time: 1.218506 Aug 04 04:32:55.431770 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1090/2200] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1323 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:55.447550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:55.451578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:55.467858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.468324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.471901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.472371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.577298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:55.589241 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ca9862a7-0fb4-4d88-ba23-8f2c7d46d60f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.328661 Aug 04 04:32:55.590475 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1111/2201] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:55 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:55.596230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:55.597606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] [instance: 0bef516e-c91a-443f-ac0c-649449549e14] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:55.604164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:55.605872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.606502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.608852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.609744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.628054 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] HTTP exception thrown: Instance 0bef516e-c91a-443f-ac0c-649449549e14 could not be found. Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Request method failure captured: Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 HTTP/1.1 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60vN2XJ66YBE7TpgRCsc5CLofxszIQyILF5gAhWbG403YIKleyxXTSTFPf6EHK7py7R6BWSXaqzYyKgW2cBJzgyBtZgQeomVLEYfWmOAxP87JfutFF-rVCa179GhNSNQtoNge7yAIudj0nsNRg0E1xDUEQu4JNPz-ojHI5yCCi4Cpc8 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2de51297aa8c4ad79e3c2db20dfcecbc Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2de51297aa8c4ad79e3c2db20dfcecbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2de51297aa8c4ad79e3c2db20dfcecbc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2de51297aa8c4ad79e3c2db20dfcecbc Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-776070105 Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerAddressesNegativeTestJSON-776070105-project Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb8b6898aef4442d92533ec2f4d027be Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-776070105-project Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0bef516e-c91a-443f-ac0c-649449549e14 could not be found. Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0bef516e-c91a-443f-ac0c-649449549e14'} Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bef516e-c91a-443f-ac0c-649449549e14 could not be found. Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bef516e-c91a-443f-ac0c-649449549e14 could not be found. Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:55.630000 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bef516e-c91a-443f-ac0c-649449549e14 could not be found. Aug 04 04:32:55.633635 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:32:55.634833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] Returning 404 to user: Instance 0bef516e-c91a-443f-ac0c-649449549e14 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:55.636404 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-537fc2f9-0fff-449e-96cc-18fb8d05d74c tempest-ServerAddressesNegativeTestJSON-776070105 tempest-ServerAddressesNegativeTestJSON-776070105-project] 10.222.0.69 "GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14" status: 404 len: 111 microversion: 2.1 time: 0.044753 Aug 04 04:32:55.637139 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1112/2202] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:55 2022] GET /compute/v2.1/servers/0bef516e-c91a-443f-ac0c-649449549e14 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:32:55.647106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:55.647942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:55.672084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.672593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.673686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.678102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.928267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:55.937652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:55.939253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:55.940643 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc641061-72f3-431d-9b98-c8d51913a3dc tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.506841 Aug 04 04:32:55.941266 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1091/2203] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:55 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:55.962347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:55.964597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:55.967536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=87,nova_api:UPDATE=7 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:55.981741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.983136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:55.984136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:55.984971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:56.002863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:56.012755 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77bc14ef-0c67-4dfc-9337-dce289939d46 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1684 microversion: 2.1 time: 0.374290 Aug 04 04:32:56.015296 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1113/2204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:55 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1684 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:56.220964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:56.227836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:56.228769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:56.233009 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-353443c3-1030-4f64-bb71-34c3fffe7945 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.290421 Aug 04 04:32:56.234381 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1092/2205] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:55 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:56.239042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:56.240602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:56.243337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:56.245583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:56.260919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:56.262068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:56.299024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:56.299861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:56.301468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:56.302088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:56.615462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:56.632211 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76885e9c-481b-4907-83c0-7d4da76ecd10 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.379314 Aug 04 04:32:56.633039 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1093/2206] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:56 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:56.652347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-95a76e35-1c82-427a-a1d8-4bdbface7cd7 req-517f25dd-aac9-44f0-9a00-bebc116a83e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c77f45-6186-448d-9ab3-9ec45a8e53ac", "tag": "f0f1ab4d-a394-4467-8d00-bb8a2fb54b62"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:56.706760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-95a76e35-1c82-427a-a1d8-4bdbface7cd7 req-517f25dd-aac9-44f0-9a00-bebc116a83e3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:56.708079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-95a76e35-1c82-427a-a1d8-4bdbface7cd7 req-517f25dd-aac9-44f0-9a00-bebc116a83e3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:56.765532 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-95a76e35-1c82-427a-a1d8-4bdbface7cd7 req-517f25dd-aac9-44f0-9a00-bebc116a83e3 service nova] Creating event network-changed:f0f1ab4d-a394-4467-8d00-bb8a2fb54b62 for instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac on n-h2-851337-5 Aug 04 04:32:56.782795 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-95a76e35-1c82-427a-a1d8-4bdbface7cd7 req-517f25dd-aac9-44f0-9a00-bebc116a83e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145228 Aug 04 04:32:56.783650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1094/2207] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:56.800824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:56.805141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:56.828786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:56.830707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:56.834817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:56.837558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:57.230816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:57.247895 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41b51ca7-41a4-42cc-8b47-e839a0dd36d1 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 1.021402 Aug 04 04:32:57.249685 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1114/2208] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:56 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:57.269483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:57.270856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:57.289336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:57.290181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:57.294990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:57.297130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:57.332222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:57.342153 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c2240cf-67e2-44a3-aed5-b3dfa41afa34 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1323 microversion: 2.1 time: 0.553996 Aug 04 04:32:57.343166 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1095/2209] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:56 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:57.350871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:57.351543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:57.371658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:57.372097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:57.372881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:57.378250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:57.536661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=11 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:57.560402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=60 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:57.726781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:57.739843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-86edc476-5a41-4fd7-94dd-38a400ee6bab tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.488631 Aug 04 04:32:57.740444 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1115/2210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:57 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:57.751925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:57.752806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:57.772970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:57.773422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:57.774216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:57.774653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:57.792736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:57.834467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:57.869023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:57.876002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:57.877248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29cb5dfd-ac76-4a07-a6cd-a8744a856f30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.530969 Aug 04 04:32:57.877831 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1096/2211] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:57 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:57.928568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:57.943444 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c1bf9de-0a69-40ef-879b-259694f174b8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 200 len: 1616 microversion: 2.1 time: 0.201893 Aug 04 04:32:57.944261 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1116/2212] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:57 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 1616 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:58.273047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:58.274177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:58.288155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.292714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.293852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.295162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.371258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:58.371827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:58.384422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.385759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.386786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.388079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.605923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:58.614156 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb74bed3-c35e-4e3c-927f-f130038450d4 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.346386 Aug 04 04:32:58.631175 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1097/2213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:58 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:58.731974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:58.743904 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c492ef6e-e47e-4ec1-b192-94f5c31726b7 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1323 microversion: 2.1 time: 0.379444 Aug 04 04:32:58.747064 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1117/2214] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:58 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:58.824138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b6ef4fb6-97a7-4dce-b6f1-3beb3ed35432 req-5bc6ea25-58a1-4f27-a682-e935e7f61968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab3ca78-87df-46a4-a7f7-7648c150a4c4", "name": "network-vif-deleted", "tag": "c6089696-8361-468a-8309-c124a89e47ea"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:58.847746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b6ef4fb6-97a7-4dce-b6f1-3beb3ed35432 req-5bc6ea25-58a1-4f27-a682-e935e7f61968 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.848451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b6ef4fb6-97a7-4dce-b6f1-3beb3ed35432 req-5bc6ea25-58a1-4f27-a682-e935e7f61968 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.861449 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b6ef4fb6-97a7-4dce-b6f1-3beb3ed35432 req-5bc6ea25-58a1-4f27-a682-e935e7f61968 service nova] Creating event network-vif-deleted:c6089696-8361-468a-8309-c124a89e47ea for instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 on n-h1-851337-5 Aug 04 04:32:58.870338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b6ef4fb6-97a7-4dce-b6f1-3beb3ed35432 req-5bc6ea25-58a1-4f27-a682-e935e7f61968 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053181 Aug 04 04:32:58.871636 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1098/2215] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:32:58.918407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:58.922872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:58.952390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.954431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.955693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.956525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.967955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:58.969363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:58.990185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:58.996618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:58.998327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:59.001699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:59.045123 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 HTTP/1.1 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6ab3ca78-87df-46a4-a7f7-7648c150a4c4'} Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:59.050238 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:59.053862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:59.053862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:59.053862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:59.053862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:59.053862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:59.053862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:32:59.053862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:32:59.058155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:59.061537 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45bd242f-bfbc-42d3-95d6-1d1e12548ca8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 404 len: 111 microversion: 2.1 time: 0.098348 Aug 04 04:32:59.062547 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1099/2216] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:58 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:32:59.077544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3e35105-a2e7-446a-9874-ba2cd336f89f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '.version_select at 0x7f19239350d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:59.111074 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3e35105-a2e7-446a-9874-ba2cd336f89f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726355252" status: 202 len: 0 microversion: 2.1 time: 0.041984 Aug 04 04:32:59.112965 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1100/2217] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726355252 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:32:59.582787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:59.602305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:59.605325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:32:59.607181 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-342cd3d2-3da2-4966-966a-3513d3eddc30 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.705672 Aug 04 04:32:59.608854 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1118/2218] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:32:58 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:59.645764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:59.646392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:59.663713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:59.668221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:59.671297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:59.673195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:59.771402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:59.773216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:32:59.782712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:59.784213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:32:59.785477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:32:59.786184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:00.165105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:00.175992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1a7fa806-7b5a-4b24-81c2-2c77be5f0f97 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.535772 Aug 04 04:33:00.177531 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1101/2219] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:59 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:00.216573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:00.226437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-400a0857-9187-4a43-a434-bcc61e58808d tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1323 microversion: 2.1 time: 0.459590 Aug 04 04:33:00.227490 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1119/2220] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:32:59 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1323 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:00.638713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:00.639773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:00.649644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:00.650642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:00.652889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:00.653589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:01.154802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:01.168619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:01.172306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:01.173750 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f0abbd48-5171-42bf-b4da-0ca21ad4370f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.543097 Aug 04 04:33:01.187441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1102/2221] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:00 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:01.198652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:01.199784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:01.217114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:01.217583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:01.218405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:01.218854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:01.248438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:01.249123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:01.261497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:01.262668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:01.266195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:01.268662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:01.692031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:01.719552 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8898ffb7-3040-4d48-8ac4-8aec308ab587 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.525840 Aug 04 04:33:01.720667 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1120/2222] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:01 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:01.784840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:01.799802 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c2a6670d-6c39-4e8e-875f-a4497fe5471f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1323 microversion: 2.1 time: 0.555722 Aug 04 04:33:01.818602 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1103/2223] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:01 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1323 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:02.201210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:02.201860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:02.211328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:02.215287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:02.216230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:02.216839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:02.543236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:02.544444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:02.552563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:02.553379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:02.554193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:02.554659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:02.617780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:02.632492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:02.636875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:02.640907 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ab0e413-8d18-4cea-8251-da7ea21dc1bb tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.444184 Aug 04 04:33:02.645186 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1121/2224] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:02 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:02.744298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:02.745043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:02.760183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:02.781592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:02.783743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:02.786268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:02.786752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:02.787264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lazy-loading 'services' on Instance uuid 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:33:03.178880 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20157197-c7e3-48e8-963f-af59fdafd3cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments/527fc694-22b9-4ab9-9a4d-24f3154e4b8b" status: 202 len: 0 microversion: 2.1 time: 0.641602 Aug 04 04:33:03.186495 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1104/2225] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:33:02 2022] DELETE /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments/527fc694-22b9-4ab9-9a4d-24f3154e4b8b => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:33:03.207292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:03.212180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:03.233354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:03.235132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:03.237525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:03.239102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:03.386867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:03.398480 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3517c017-953e-49ab-b4ac-d9bf89bfb3e2 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.659462 Aug 04 04:33:03.407734 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1122/2226] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:02 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:03.425378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fdb2ee32-27d7-4e11-9602-5ce812c73b79 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:03.432804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fdb2ee32-27d7-4e11-9602-5ce812c73b79 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:03.449217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee32-27d7-4e11-9602-5ce812c73b79 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:03.450713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee32-27d7-4e11-9602-5ce812c73b79 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:03.453415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee32-27d7-4e11-9602-5ce812c73b79 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:03.453993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb2ee32-27d7-4e11-9602-5ce812c73b79 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:03.551200 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fdb2ee32-27d7-4e11-9602-5ce812c73b79 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140383 Aug 04 04:33:03.553428 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1123/2227] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:33:03 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:03.564914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2097e947-4904-4747-afa0-8a8b466eddf1 req-f9c1d1c2-ddc5-45bc-94f4-f0149dbe2d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c77f45-6186-448d-9ab3-9ec45a8e53ac", "name": "network-vif-plugged", "status": "completed", "tag": "f0f1ab4d-a394-4467-8d00-bb8a2fb54b62"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:03.593704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2097e947-4904-4747-afa0-8a8b466eddf1 req-f9c1d1c2-ddc5-45bc-94f4-f0149dbe2d2a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:03.594232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2097e947-4904-4747-afa0-8a8b466eddf1 req-f9c1d1c2-ddc5-45bc-94f4-f0149dbe2d2a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:03.622432 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2097e947-4904-4747-afa0-8a8b466eddf1 req-f9c1d1c2-ddc5-45bc-94f4-f0149dbe2d2a service nova] Creating event network-vif-plugged:f0f1ab4d-a394-4467-8d00-bb8a2fb54b62 for instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac on n-h2-851337-5 Aug 04 04:33:03.637309 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2097e947-4904-4747-afa0-8a8b466eddf1 req-f9c1d1c2-ddc5-45bc-94f4-f0149dbe2d2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082430 Aug 04 04:33:03.637950 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1124/2228] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:03.685991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:03.687370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:03.723018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:03.723740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:03.724753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:03.725345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:04.112654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:04.120281 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85cc09aa-ae5e-4de2-bfa3-88fd7812a837 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1323 microversion: 2.1 time: 0.929852 Aug 04 04:33:04.134482 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1105/2229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:03 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1323 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:04.269846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:04.281685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:04.283724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:04.286752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d69c64b6-5bfb-4e91-8867-a8749f862f73 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.617487 Aug 04 04:33:04.305260 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1125/2230] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:03 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:04.429293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:04.430460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:04.437180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:04.437626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:04.438560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:04.439250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:04.567875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe2926df-4f85-442b-b4cc-3cd3e7d272a3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:04.571293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe2926df-4f85-442b-b4cc-3cd3e7d272a3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:04.585621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe2926df-4f85-442b-b4cc-3cd3e7d272a3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:04.590322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe2926df-4f85-442b-b4cc-3cd3e7d272a3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:04.593561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe2926df-4f85-442b-b4cc-3cd3e7d272a3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:04.594366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe2926df-4f85-442b-b4cc-3cd3e7d272a3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:04.651773 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe2926df-4f85-442b-b4cc-3cd3e7d272a3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083858 Aug 04 04:33:04.653885 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1126/2231] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:33:04 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:05.143092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:05.143986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:05.153173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:05.155046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:05.156759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:05.157455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:05.238670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:05.247084 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8663fa80-3b94-4699-8147-e4e9a2f5b4fd tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1392 microversion: 2.1 time: 0.822235 Aug 04 04:33:05.250160 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1106/2232] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:04 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1392 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:05.313178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:05.314319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:05.369816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:05.383665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:05.388032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:05.388510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:06.096080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:06.108042 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-caf1f628-a134-4cc5-94ff-485bd4f9e0b9 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1323 microversion: 2.1 time: 0.969875 Aug 04 04:33:06.108611 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1127/2233] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:05 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1323 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:06.116838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c77cdbe-1770-42f6-a5e6-aa03901b22ea tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:06.124784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9c77cdbe-1770-42f6-a5e6-aa03901b22ea tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:06.140741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c77cdbe-1770-42f6-a5e6-aa03901b22ea tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:06.141510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c77cdbe-1770-42f6-a5e6-aa03901b22ea tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:06.142553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c77cdbe-1770-42f6-a5e6-aa03901b22ea tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:06.143022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c77cdbe-1770-42f6-a5e6-aa03901b22ea tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:06.220026 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c77cdbe-1770-42f6-a5e6-aa03901b22ea tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109941 Aug 04 04:33:06.237010 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1128/2234] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:33:06 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:06.273703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:06.275932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:06.290974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:06.292358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:06.293315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:06.295151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:06.324626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:06.338900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:06.340730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:06.341920 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-37edbdba-85e9-4502-b9a5-0ed9a7ad51c6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 1.033814 Aug 04 04:33:06.349289 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1107/2235] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:05 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:33:06.583677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:06.593224 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0f238688-6add-4364-8e3f-1574ecd0ec90 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1382 microversion: 2.1 time: 0.324535 Aug 04 04:33:06.595421 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1129/2236] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:06 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1382 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:06.621899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2c673106-4dd1-4f4a-91f4-36b44afbe167 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '.version_select at 0x7f1923968310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:06.636769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c673106-4dd1-4f4a-91f4-36b44afbe167 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:06.637228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c673106-4dd1-4f4a-91f4-36b44afbe167 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:06.698945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2c673106-4dd1-4f4a-91f4-36b44afbe167 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.063471 Aug 04 04:33:06.709681 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1108/2237] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:33:06 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:06.718279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e414e829-1183-4772-b443-d2579936bcb6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:06.719391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e414e829-1183-4772-b443-d2579936bcb6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:06.736738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e414e829-1183-4772-b443-d2579936bcb6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:06.737546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e414e829-1183-4772-b443-d2579936bcb6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:06.739790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e414e829-1183-4772-b443-d2579936bcb6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:06.741010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e414e829-1183-4772-b443-d2579936bcb6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.137955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:07.139038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:07.155578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.156114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.156949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.158906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.624238 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e414e829-1183-4772-b443-d2579936bcb6 tempest-LiveMigrationTest-682384819 tempest-LiveMigrationTest-682384819-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1533 microversion: 2.1 time: 0.910847 Aug 04 04:33:07.636320 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1130/2238] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:06 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1533 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:07.642664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:07.657569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98da4cb7-ebb3-4e6c-b029-413b9369cdc2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:07.658140 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e233504-1e93-49c7-87f5-8a412c59f318 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1472 microversion: 2.1 time: 0.532175 Aug 04 04:33:07.659853 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1109/2239] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:07 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:07.660759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98da4cb7-ebb3-4e6c-b029-413b9369cdc2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:07.667617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-ebb3-4e6c-b029-413b9369cdc2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.668370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-ebb3-4e6c-b029-413b9369cdc2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.669202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:07.669604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-ebb3-4e6c-b029-413b9369cdc2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.670253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-ebb3-4e6c-b029-413b9369cdc2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.672134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:07.689462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.690102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.693119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.693262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.710156 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98da4cb7-ebb3-4e6c-b029-413b9369cdc2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064948 Aug 04 04:33:07.711340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1131/2240] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:33:07 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:07.719533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:07.720257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:07.726691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.727425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.733449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.734100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.780100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:33:07.830019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:07.897013 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cac94b89-7199-4659-8eb5-ad19d0e30a9f tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 204 len: 0 microversion: 2.1 time: 0.183189 Aug 04 04:33:07.897197 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1132/2241] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:33:07 2022] DELETE /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:33:07.905509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:07.906669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:07.918448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.920805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.922945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.924004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.957034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Request method failure captured: Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac/diagnostics HTTP/1.1 Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60vt6rP3S-pTk0_CNh4Zb1rLeeo1DtOOeqtEDUoKhEyCZRTdvTnT9TQCkk25AxIp38b36d8Aen1dA6KhTqYGJy5uxOFC1mgg_GrJOX74a5-_sxQ1bIl3-fvow8gpzd1h27cCZkJwInKbwei1_zjcJnuaPjnSKQ1l7-tJKn2ct4IraBs Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ec43cf872c50487aac4651a57983663c Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-935989280 Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ec43cf872c50487aac4651a57983663c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ec43cf872c50487aac4651a57983663c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ec43cf872c50487aac4651a57983663c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ec43cf872c50487aac4651a57983663c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-935989280 Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ec43cf872c50487aac4651a57983663c Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-935989280 Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerDiagnosticsNegativeTest-935989280-project Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: cb10a3a341b04b0ead51b623fadb103b Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-935989280-project Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '47c77f45-6186-448d-9ab3-9ec45a8e53ac'} Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:07.965715 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-278e4e86-a4ed-4aec-93c8-c97d54d1c334 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.069070 Aug 04 04:33:07.973903 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1133/2242] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:33:07 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac/diagnostics => generated 117 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:07.979870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:07.980502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:07.988670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.989132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:07.989926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:07.990373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:08.101591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:08.115798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:08.117455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:08.118461 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc349c15-a398-44a2-b7f0-39bc0e1d447d tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.457461 Aug 04 04:33:08.125959 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1110/2243] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:07 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:08.132897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:08.133403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:08.163690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:08.164174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:08.165019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:08.169800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:08.230916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:08.241491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:33:08.241938 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70d48d13-dcfe-4cc9-955f-f9ff72c7caa9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1388 microversion: 2.1 time: 0.266680 Aug 04 04:33:08.243486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1134/2244] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:07 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1388 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:08.386256 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-86570ce9-22dd-4869-a791-335813ab8a9f tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "DELETE /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 204 len: 0 microversion: 2.1 time: 0.257988 Aug 04 04:33:08.387444 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1111/2245] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:33:08 2022] DELETE /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:33:08.395580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:08.397005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:08.406636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:08.407201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:08.408238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:08.408758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:08.686706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:08.695947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3950f823-84d8-4b6b-8c0c-6c004c900349 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1478 microversion: 2.1 time: 0.304395 Aug 04 04:33:08.697598 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1135/2246] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:08 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1478 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:08.725325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffea7eef-b00a-4c33-bbf2-1c16aabfd9ed tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:08.728104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ffea7eef-b00a-4c33-bbf2-1c16aabfd9ed tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:08.738517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffea7eef-b00a-4c33-bbf2-1c16aabfd9ed tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:08.739761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffea7eef-b00a-4c33-bbf2-1c16aabfd9ed tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:08.740865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffea7eef-b00a-4c33-bbf2-1c16aabfd9ed tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:08.742063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffea7eef-b00a-4c33-bbf2-1c16aabfd9ed tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:08.790468 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffea7eef-b00a-4c33-bbf2-1c16aabfd9ed tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070148 Aug 04 04:33:08.792431 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1112/2247] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:33:08 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:09.159737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:09.160809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:09.173166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:09.173765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:09.174651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:09.181376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:09.267446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:09.268205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:09.284237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:09.286938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:09.288564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:09.289393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:10.000290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:10.008604 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d048a6e3-f226-46e3-9763-66068be59b74 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1388 microversion: 2.1 time: 0.746290 Aug 04 04:33:10.015929 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1113/2248] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:09 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1388 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:10.022830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:10.031323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:10.040709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:10.058660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:10.063435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:10.064054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:10.064701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:10.066310 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-71dab773-4048-4ffb-8305-280bb8916058 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.919077 Aug 04 04:33:10.067537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:10.068134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:10.072153 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1136/2249] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:09 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:10.087542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e063266f-8637-4c53-8ea7-00e79457597f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:10.096199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e063266f-8637-4c53-8ea7-00e79457597f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:10.115521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e063266f-8637-4c53-8ea7-00e79457597f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:10.116322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e063266f-8637-4c53-8ea7-00e79457597f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:10.117352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e063266f-8637-4c53-8ea7-00e79457597f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:10.118581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e063266f-8637-4c53-8ea7-00e79457597f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:10.181485 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e063266f-8637-4c53-8ea7-00e79457597f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107328 Aug 04 04:33:10.183240 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1137/2250] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:33:10 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:10.436029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:10.453728 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-22d385c5-9e20-4ff1-ae94-a14f5a7bcd5a tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1478 microversion: 2.1 time: 0.436311 Aug 04 04:33:10.455737 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1114/2251] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:10 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1478 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:11.043661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:11.055400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:11.100255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:11.101067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:11.113086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.114575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.117907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.118702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.118903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.120467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.122632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.123151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.808079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:11.819517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:11.828234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:11.829485 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cb5db0cc-2fb4-4c49-b64f-858f22ca5707 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.733929 Aug 04 04:33:11.830062 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1115/2252] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:11 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:33:11.842268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-463956a3-efc0-474d-bee7-94cafa6b1b22 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:11.860377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-463956a3-efc0-474d-bee7-94cafa6b1b22 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:11.877111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-463956a3-efc0-474d-bee7-94cafa6b1b22 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.877877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-463956a3-efc0-474d-bee7-94cafa6b1b22 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.879712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-463956a3-efc0-474d-bee7-94cafa6b1b22 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.880327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-463956a3-efc0-474d-bee7-94cafa6b1b22 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.892209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:11.902356 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65a34624-6ad7-40d0-a47c-20ddcfab2765 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1388 microversion: 2.1 time: 0.866104 Aug 04 04:33:11.912050 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1138/2253] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:11 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1388 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:11.917294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:11.917773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:11.945206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.946349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.948570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:11.951229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:11.959730 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-463956a3-efc0-474d-bee7-94cafa6b1b22 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121904 Aug 04 04:33:11.966440 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1116/2254] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:33:11 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:33:12.097847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:12.098356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:12.112337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:12.113055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:12.113578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:12.114018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:12.174698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:33:12.342478 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2f50909-3097-4a6c-9a4f-7e8b6774e662 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 204 len: 0 microversion: 2.1 time: 0.248443 Aug 04 04:33:12.348889 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1117/2255] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:33:12 2022] DELETE /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:33:12.353132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:12.355630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:12.378510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:12.379152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:12.380062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:12.387706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:12.421081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:12.577325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:12.586729 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c8075a2b-db07-4711-9e7e-0b1ba856834e tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1478 microversion: 2.1 time: 0.673306 Aug 04 04:33:12.613053 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1139/2256] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:11 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1478 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:12.707984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-061a3f35-d0d3-4641-82e7-89c763c46430 req-fe6b7465-bc10-4b8d-9d48-fa135d2d1181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb0ce6c-996d-499a-8b2c-665598ed8aaa", "name": "network-vif-deleted", "tag": "c279607f-09ae-431b-bd1d-0ade6bbcd772"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:12.726675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-061a3f35-d0d3-4641-82e7-89c763c46430 req-fe6b7465-bc10-4b8d-9d48-fa135d2d1181 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:12.727351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-061a3f35-d0d3-4641-82e7-89c763c46430 req-fe6b7465-bc10-4b8d-9d48-fa135d2d1181 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:12.763502 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-061a3f35-d0d3-4641-82e7-89c763c46430 req-fe6b7465-bc10-4b8d-9d48-fa135d2d1181 service nova] Creating event network-vif-deleted:c279607f-09ae-431b-bd1d-0ade6bbcd772 for instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa on n-h2-851337-5 Aug 04 04:33:12.769173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-061a3f35-d0d3-4641-82e7-89c763c46430 req-fe6b7465-bc10-4b8d-9d48-fa135d2d1181 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064779 Aug 04 04:33:12.770427 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1140/2257] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:12.858610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:12.860515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:12.867562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:12.870460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:12.879900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:12.880526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:13.070173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:13.105618 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b2d0440-206f-4f0b-a7b5-720dea0afcb4 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1682 microversion: 2.1 time: 0.755860 Aug 04 04:33:13.109531 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1118/2258] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:12 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1682 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:13.139753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:13.150875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:13.184598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:13.189628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:13.193500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:13.195983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:13.413760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:13.423070 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-768afc4a-ad4c-42ec-86ec-90ec134838be tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1346 microversion: 2.1 time: 0.310891 Aug 04 04:33:13.426446 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1119/2259] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:13 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1346 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:13.437396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9a6818b8-02f7-47a1-9e39-a77ad6c33697 req-4d3cef17-ca3c-4f4a-8916-93c0747395c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c77f45-6186-448d-9ab3-9ec45a8e53ac", "name": "network-vif-deleted", "tag": "f0f1ab4d-a394-4467-8d00-bb8a2fb54b62"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:13.462410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9a6818b8-02f7-47a1-9e39-a77ad6c33697 req-4d3cef17-ca3c-4f4a-8916-93c0747395c1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:13.469048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9a6818b8-02f7-47a1-9e39-a77ad6c33697 req-4d3cef17-ca3c-4f4a-8916-93c0747395c1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:13.492311 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9a6818b8-02f7-47a1-9e39-a77ad6c33697 req-4d3cef17-ca3c-4f4a-8916-93c0747395c1 service nova] Creating event network-vif-deleted:f0f1ab4d-a394-4467-8d00-bb8a2fb54b62 for instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac on n-h2-851337-5 Aug 04 04:33:13.508673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9a6818b8-02f7-47a1-9e39-a77ad6c33697 req-4d3cef17-ca3c-4f4a-8916-93c0747395c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078230 Aug 04 04:33:13.514552 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1120/2260] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:13.622995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:13.625895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:13.646770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:13.649239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:13.651604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:13.653194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:14.675247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb10a3a341b04b0ead51b623fadb103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec43cf872c50487aac4651a57983663c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:14.687637 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e597048f-37c7-4fdd-a7b1-06e231e6d4e1 tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 200 len: 1308 microversion: 2.1 time: 1.069435 Aug 04 04:33:14.688718 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1121/2261] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:13 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 1308 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:14.702027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:14.703031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:14.719130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:14.719992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:14.728928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:14.729597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:14.867022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:14.886306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:14.887873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:14.889090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a4cde2f-52bc-4400-8922-47463d84e83c tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 2.035342 Aug 04 04:33:14.889679 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1141/2262] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:12 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:33:14.908215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:14.916011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:14.938432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:14.938993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:14.949693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:14.950210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:15.169283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:15.202658 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb07cd97-e365-40b3-ad82-23eb5e26dc8a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1184 microversion: 2.1 time: 0.309969 Aug 04 04:33:15.206861 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1142/2263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:14 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1184 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:15.709383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:15.710676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] [instance: 47c77f45-6186-448d-9ab3-9ec45a8e53ac] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:15.725952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:15.729901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:15.766002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:15.780239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:15.800418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:15.856864 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4509cf7-9591-4640-8cbe-4026c3ca13ff tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1682 microversion: 2.1 time: 1.166699 Aug 04 04:33:15.857582 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1122/2264] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:14 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1682 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:15.907682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] HTTP exception thrown: Instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac could not be found. Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Request method failure captured: Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac HTTP/1.1 Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60vt6rP3S-pTk0_CNh4Zb1rLeeo1DtOOeqtEDUoKhEyCZRTdvTnT9TQCkk25AxIp38b36d8Aen1dA6KhTqYGJy5uxOFC1mgg_GrJOX74a5-_sxQ1bIl3-fvow8gpzd1h27cCZkJwInKbwei1_zjcJnuaPjnSKQ1l7-tJKn2ct4IraBs Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ec43cf872c50487aac4651a57983663c Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-935989280 Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ec43cf872c50487aac4651a57983663c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ec43cf872c50487aac4651a57983663c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ec43cf872c50487aac4651a57983663c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ec43cf872c50487aac4651a57983663c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-935989280 Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ec43cf872c50487aac4651a57983663c Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-935989280 Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerDiagnosticsNegativeTest-935989280-project Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: cb10a3a341b04b0ead51b623fadb103b Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-935989280-project Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac could not be found. Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '47c77f45-6186-448d-9ab3-9ec45a8e53ac'} Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac could not be found. Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac could not be found. Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:15.909397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac could not be found. Aug 04 04:33:15.913998 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:15.918529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] Returning 404 to user: Instance 47c77f45-6186-448d-9ab3-9ec45a8e53ac could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:15.919976 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-893eb908-27f1-47ba-a710-3b92e4ebcfac tempest-ServerDiagnosticsNegativeTest-935989280 tempest-ServerDiagnosticsNegativeTest-935989280-project] 10.222.0.69 "GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac" status: 404 len: 111 microversion: 2.1 time: 0.214856 Aug 04 04:33:15.922806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:15.925932 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1143/2265] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:15 2022] GET /compute/v2.1/servers/47c77f45-6186-448d-9ab3-9ec45a8e53ac => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:15.931095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:15.960081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:15.961380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:15.964290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:15.964747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:16.228633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:16.235538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:16.258324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:16.258772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:16.270637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:16.271129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:17.194664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:17.212507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74cb1b91-03d2-4dc1-a24b-bc8f556e41b7 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1184 microversion: 2.1 time: 0.987686 Aug 04 04:33:17.218474 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1144/2266] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:16 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1184 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:17.226477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:17.235833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:17.251123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:17.251579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:17.252575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:17.254167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:17.435034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:17.452453 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a72dea0-e6a6-4b72-87d6-91b06816f881 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 200 len: 1615 microversion: 2.1 time: 0.231341 Aug 04 04:33:17.455269 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1145/2267] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:17 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 1615 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:17.677787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:17.691803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-654eb866-7b0b-407c-b89e-e764ab50f107 req-c71604b1-cd65-475f-b7d0-e66cd74d447e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491721d5-4a6a-44c9-bb27-3dff3ce3ae79", "name": "network-vif-deleted", "tag": "97471e22-4905-4b19-8122-e7420162ebba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:17.716618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:17.722600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:17.724417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-654eb866-7b0b-407c-b89e-e764ab50f107 req-c71604b1-cd65-475f-b7d0-e66cd74d447e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:17.724882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-654eb866-7b0b-407c-b89e-e764ab50f107 req-c71604b1-cd65-475f-b7d0-e66cd74d447e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:17.726749 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9586b9e4-6ab4-406c-9f49-d408e29dd790 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 1.811621 Aug 04 04:33:17.734334 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1123/2268] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:15 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:17.773991 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-654eb866-7b0b-407c-b89e-e764ab50f107 req-c71604b1-cd65-475f-b7d0-e66cd74d447e service nova] Creating event network-vif-deleted:97471e22-4905-4b19-8122-e7420162ebba for instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 on n-h2-851337-5 Aug 04 04:33:17.784553 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-654eb866-7b0b-407c-b89e-e764ab50f107 req-c71604b1-cd65-475f-b7d0-e66cd74d447e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097522 Aug 04 04:33:17.788224 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1146/2269] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:18.238643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:18.239539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:18.253316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:18.254051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:18.255129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:18.262117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:18.483059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:18.486206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:18.511124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:18.512623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:18.514818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:18.517146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:18.552471 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 HTTP/1.1 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '491721d5-4a6a-44c9-bb27-3dff3ce3ae79'} Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:18.554629 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:18.559431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:18.559431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:18.559431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:18.559431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:18.559431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:18.559431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:33:18.559431 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:18.560840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:18.566067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-694b3efc-a8b6-415c-8011-21c0d13f5a1c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 404 len: 111 microversion: 2.1 time: 0.095726 Aug 04 04:33:18.569974 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1147/2270] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:18 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:18.580194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f2a01ae-b79a-4aa5-aedb-95058f18ac04 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '.version_select at 0x7f191a39f430>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:18.625439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:18.634602 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e376da49-1f55-4699-9aa0-23154fe94d09 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1184 microversion: 2.1 time: 0.400535 Aug 04 04:33:18.645084 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1124/2271] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:18 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1184 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:18.657361 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f2a01ae-b79a-4aa5-aedb-95058f18ac04 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-589754822" status: 202 len: 0 microversion: 2.1 time: 0.064224 Aug 04 04:33:18.659399 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1148/2272] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:33:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-589754822 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:33:18.756710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:18.758255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:18.775145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:18.780147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:18.781320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:18.782138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:19.664113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:19.664739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:19.685536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:19.688835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:19.691676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:19.692188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:19.819357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:19.839845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:19.842614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:19.845602 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b4ea547-5d2a-4973-9e90-a23fdd99a175 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 1.093020 Aug 04 04:33:19.847628 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1125/2273] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:18 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:19.927930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:19.940286 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b028aa9-b927-4491-847c-2784f415b072 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1184 microversion: 2.1 time: 0.282243 Aug 04 04:33:19.947613 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1149/2274] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:19 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1184 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:20.205934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1138785603", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:20.361282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b35d4d9-6338-474d-ba71-da2bf02673b1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: .version_select at 0x7f191a39fa60>, body: {"keypair": {"name": "tempest-keypair-1157777321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHr7RhREjxHjMdUQL/aRwhSnokqgRAn7xGfc0Ud8lKE8KtAw6gbfCHJj8RY8N/xQk/W2lLe00Yoqh8U0t5lqgFXCXLN74/eLr+r0nInYQOJfqXTPpcSveJb1VT1wNizpw=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:20.403744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9b35d4d9-6338-474d-ba71-da2bf02673b1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:20.416922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9b35d4d9-6338-474d-ba71-da2bf02673b1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:20.426919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] validate_networks() for [('924d6080-3067-48b4-bf93-a997c13a19e8', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:33:20.474260 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b35d4d9-6338-474d-ba71-da2bf02673b1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118647 Aug 04 04:33:20.481793 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1150/2275] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:33:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:20.872788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:20.873421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:20.886245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:20.886705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:20.887587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:20.888023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:21.496006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:21.528342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:21.532835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:21.534459 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d2c807a-525e-496a-a1da-5d6c9d7ba287 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.668005 Aug 04 04:33:21.555886 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1151/2276] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:20 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:33:21.562844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:21.563893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:21.572031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:21.572963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:21.578484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:21.580249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:21.894056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:21.910547 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe7c3fc7-8988-4bda-8af2-447a29727b44 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1184 microversion: 2.1 time: 0.353433 Aug 04 04:33:21.912855 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1152/2277] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:21 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1184 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:22.145021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:33:22.145487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:33:22.146085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:33:22.146508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:33:22.146929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:33:22.170327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:22.170786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:22.176643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:22.177545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:22.226682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Getting quotas for project 472a6316385d4a12900168ff83a4b8df. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:22.241971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Getting quotas for user 4e159ad1eeda43488b40d5b8e6245d57 and project 472a6316385d4a12900168ff83a4b8df. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:22.276663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:33:22.280609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:33:22.403070 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7daae52e-2277-4122-8c6b-d5c29bcd21fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.551261 Aug 04 04:33:22.407369 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1126/2278] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:33:22.415348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa9200d1-4fbe-4fc8-a1cb-315c50bed740 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:22.416420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa9200d1-4fbe-4fc8-a1cb-315c50bed740 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:22.427897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:22.563356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:22.563979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:22.579085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:22.579579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:22.585791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:22.586514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:22.613886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aa9200d1-4fbe-4fc8-a1cb-315c50bed740 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:22.622618 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa9200d1-4fbe-4fc8-a1cb-315c50bed740 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1224 microversion: 2.1 time: 0.212018 Aug 04 04:33:22.625289 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1153/2279] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:22 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1224 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:22.933118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:22.934800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:22.969083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:22.970240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:22.972668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:22.974265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:23.040092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:23.273390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:23.281763 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2633ac7c-5254-4634-8954-26b105691ef9 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 200 len: 1184 microversion: 2.1 time: 0.353641 Aug 04 04:33:23.305719 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1154/2280] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:22 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 1184 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:23.396873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:23.410088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:23.414449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:23.416524 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d9bf1ef5-2b59-4af0-8e7c-16529d62645b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.857075 Aug 04 04:33:23.428094 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1127/2281] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:22 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:33:23.548721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1694022906", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99037335-254b-4262-8aa6-b4fe7cbe9d37"}], "security_groups": [{"name": "tempest-securitygroup--1775096284"}], "key_name": "tempest-keypair-1157777321", "user_data": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:23.650064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e1603e8-b8e7-41f0-8a57-573bb74ac126 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:23.657310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4e1603e8-b8e7-41f0-8a57-573bb74ac126 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:23.686190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:23.773911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4e1603e8-b8e7-41f0-8a57-573bb74ac126 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:23.786381 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e1603e8-b8e7-41f0-8a57-573bb74ac126 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1224 microversion: 2.1 time: 0.142256 Aug 04 04:33:23.789383 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1128/2282] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:23 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:23.842417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] validate_networks() for [('99037335-254b-4262-8aa6-b4fe7cbe9d37', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:33:23.976725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-389971778", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:24.051079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:33:24.547253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:33:24.551501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:33:24.552734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:33:24.553314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:33:24.553892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:33:24.576776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:24.577524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:24.578515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:24.579125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:24.604214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:24.611347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:24.630730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:33:24.633426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:33:24.705667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:33:24.706763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:33:24.707715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:33:24.708126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:33:24.708563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:33:24.722181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:24.724253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:24.725474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:24.727839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:24.728372 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0be461a5-d34d-460f-89f0-091f366ac26f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935782 Aug 04 04:33:24.732592 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1129/2283] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:33:24.757087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:24.763366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:24.778579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:33:24.781325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:33:24.849141 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f42ef18f-050c-4a1a-9220-4ba706b693f5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.307650 Aug 04 04:33:24.850344 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1155/2284] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:33:24.885322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:24.887084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: 7cb0ce6c-996d-499a-8b2c-665598ed8aaa] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:24.923814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:24.924406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:24.932635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:24.933185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:24.974697 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] HTTP exception thrown: Instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa could not be found. Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Request method failure captured: Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa HTTP/1.1 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60o2cdc6OqlXLlnpBsBnUPTWBe7R-aYOmIgb0tKVk_1yHKY8l0al5n5ddgecn1nZedYgtI2MJyyViaV53vk5tb5nLDatbgqC4Yr9Zn9bdCqGZd_d1Uh43gZngf9ZBMRf4Ea2XOFvX9e8aRlpIcwhvmtQXis2yuoSRE6Q7CPQ97lPZ-U Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_465a4e68c9e042c2ae95bd8c8ee07fb1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveMigrationTest-106182400 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 53377b39d2804967aa0d5b71ee57e9a8 Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa could not be found. Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '7cb0ce6c-996d-499a-8b2c-665598ed8aaa'} Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa could not be found. Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa could not be found. Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:24.976376 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa could not be found. Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:24.983091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Returning 404 to user: Instance 7cb0ce6c-996d-499a-8b2c-665598ed8aaa could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:24.986048 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2d87389-ec93-48f1-9c99-fbed0a3a5aad tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa" status: 404 len: 111 microversion: 2.1 time: 0.133709 Aug 04 04:33:24.986994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1156/2285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:24 2022] GET /compute/v2.1/servers/7cb0ce6c-996d-499a-8b2c-665598ed8aaa => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:25.010233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:25.010233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:25.036375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:25.037111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:25.048184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:25.048701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:25.057111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8952a35-47ab-4055-9107-5b83dbebe0e8 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Action: 'create', calling method: .version_select at 0x7f19239b7e50>, body: {"keypair": {"name": "tempest-keypair-25180261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsr+6nOfBbCL2I6BqBQS2jYgFo1fZXaUBltRiIiDdq/40yCrMDhCeDUW2ufvH4FJ2AyP9yPK9zldTyOg+j+wmNRqmEuZ+RaopMoSIhub6geghkZWZQq5FofJpPWPCsrg=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:25.146803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a8952a35-47ab-4055-9107-5b83dbebe0e8 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Getting quotas for project 4e35e9177fc54bae85afe4a3c477ef7b. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:25.174507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a8952a35-47ab-4055-9107-5b83dbebe0e8 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Getting quotas for user d1b140919b4d4134a71946a9f1579b9c and project 4e35e9177fc54bae85afe4a3c477ef7b. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:25.275843 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8952a35-47ab-4055-9107-5b83dbebe0e8 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.541281 Aug 04 04:33:25.279747 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1130/2286] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:33:24 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:25.286716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f06b3f51-0537-46d9-881a-d5f88e6f88d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:25.301794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f06b3f51-0537-46d9-881a-d5f88e6f88d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:25.648526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f06b3f51-0537-46d9-881a-d5f88e6f88d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:25.669864 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f06b3f51-0537-46d9-881a-d5f88e6f88d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1216 microversion: 2.1 time: 0.388034 Aug 04 04:33:25.671061 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1131/2287] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:25 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1216 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:25.683101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:25.685985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:25.704417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:25.705129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:25.710497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:25.711390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:25.934402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:25.942394 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb273047-2fe1-4de6-8cb7-1f846ec6af96 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1282 microversion: 2.1 time: 0.269909 Aug 04 04:33:25.949078 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1132/2288] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:25 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:25.962698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-54a4a460-aa17-4039-94d9-13fc1eb5fb6a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:25.970137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-54a4a460-aa17-4039-94d9-13fc1eb5fb6a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:25.973034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:25.987010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:25.988786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:25.990304 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d19d4067-1f66-4fc5-8f0a-285dce182ede tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.985807 Aug 04 04:33:26.012826 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1157/2289] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:24 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:26.165222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-54a4a460-aa17-4039-94d9-13fc1eb5fb6a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:26.172440 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-54a4a460-aa17-4039-94d9-13fc1eb5fb6a tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1242 microversion: 2.1 time: 0.218481 Aug 04 04:33:26.187678 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1133/2290] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:25 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1242 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:26.692066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:26.692999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:26.704508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:26.706382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:26.707444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:26.711858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:26.968991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:26.970491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:26.971709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:26.981478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae0c8d08-11f0-48ac-a9a9-eba4522036df tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1268 microversion: 2.1 time: 0.294013 Aug 04 04:33:26.982085 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1158/2291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:26 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:26.997512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:26.998289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:26.999357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:27.000247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:27.018590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:27.019182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:27.051200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:27.051997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:27.053007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:27.060214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:28.689756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:28.708247 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e29f929c-fa71-4d96-b28d-a238d3919e0a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 1.741562 Aug 04 04:33:28.709868 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1134/2292] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:26 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:28.720853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:28.723985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:28.741093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:28.748057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:28.750338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:28.763715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:29.051105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:29.068170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:29.083665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:29.088604 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c5319624-aaf2-4ed2-8f94-234302539796 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 2.071653 Aug 04 04:33:29.093799 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1159/2293] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:27 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:29.113060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:29.113960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:29.133377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:29.134236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:29.136606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:29.139470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:29.197537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:29.205879 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-65fc174b-3f8c-40d0-b97e-2c8877247d83 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1300 microversion: 2.1 time: 0.494670 Aug 04 04:33:29.213632 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1135/2294] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:28 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1300 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:29.356077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:29.367887 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a31fe973-9874-47db-914c-5a0d0dae10a0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1274 microversion: 2.1 time: 0.271612 Aug 04 04:33:29.368489 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1160/2295] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:29 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:29.738626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:29.739782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:29.755042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:29.756510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:29.757584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:29.759177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:30.131628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:30.134427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:30.143781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:30.164279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:30.165258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38a11ab9-80b6-48d4-8856-54f4b2fd7c48 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 0.433604 Aug 04 04:33:30.168138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:30.168569 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1136/2296] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:29 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:30.169648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:30.170320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:30.190925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ce4fa4f9-4092-4a7f-a686-8994f547fed3 req-ee0776ba-d47f-429e-b746-191c9ed667dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a26945c-64f5-48c5-b36f-5e2cf5b4d768", "tag": "6a29c4d2-579d-48cb-ac84-be43e9c0097b"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:30.234060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ce4fa4f9-4092-4a7f-a686-8994f547fed3 req-ee0776ba-d47f-429e-b746-191c9ed667dd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:30.236738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ce4fa4f9-4092-4a7f-a686-8994f547fed3 req-ee0776ba-d47f-429e-b746-191c9ed667dd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:30.280124 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ce4fa4f9-4092-4a7f-a686-8994f547fed3 req-ee0776ba-d47f-429e-b746-191c9ed667dd service nova] Creating event network-changed:6a29c4d2-579d-48cb-ac84-be43e9c0097b for instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 on n-h1-851337-5 Aug 04 04:33:30.285946 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ce4fa4f9-4092-4a7f-a686-8994f547fed3 req-ee0776ba-d47f-429e-b746-191c9ed667dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101675 Aug 04 04:33:30.287089 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1137/2297] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:30.292610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:30.294248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:30.304205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:30.305033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:30.306085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:30.307226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:30.644531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:30.661999 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc71f504-c4ff-474a-93ab-01e3fb8dd496 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1300 microversion: 2.1 time: 0.373427 Aug 04 04:33:30.662839 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1138/2298] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:30 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1300 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:30.668556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:30.669396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:30.685163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:30.686108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:30.687175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:30.690744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:31.172520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:31.186208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:31.194233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:31.196785 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0262c3f9-7d08-4e06-898f-945eece23e65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 1.082820 Aug 04 04:33:31.199580 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1161/2299] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:30 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:31.225158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:31.226318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:31.241747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:31.245203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:31.246409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:31.248838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:31.287284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:31.301313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-58e9dc33-4ffd-4083-b63e-e32e020f5a9d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.637009 Aug 04 04:33:31.327220 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1139/2300] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:30 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:31.672587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9320adc8-2c17-4259-b0b0-85dd64a341a8 req-b50de74b-599d-49d4-a1b3-e1c768aa86c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-plugged", "status": "completed", "tag": "e394ea21-6aa5-4297-9493-7b1d332e8b50"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:31.703353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9320adc8-2c17-4259-b0b0-85dd64a341a8 req-b50de74b-599d-49d4-a1b3-e1c768aa86c5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:31.703826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9320adc8-2c17-4259-b0b0-85dd64a341a8 req-b50de74b-599d-49d4-a1b3-e1c768aa86c5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:31.742602 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9320adc8-2c17-4259-b0b0-85dd64a341a8 req-b50de74b-599d-49d4-a1b3-e1c768aa86c5 service nova] Creating event network-vif-plugged:e394ea21-6aa5-4297-9493-7b1d332e8b50 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:31.760026 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9320adc8-2c17-4259-b0b0-85dd64a341a8 req-b50de74b-599d-49d4-a1b3-e1c768aa86c5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238998 Aug 04 04:33:31.761338 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1140/2301] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:31.767673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:31.768641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:31.779013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:31.779908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:31.781413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:31.782262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:32.483164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:32.506487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40b447f1-387e-4a9a-a526-96e4943026fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 1.303156 Aug 04 04:33:32.523287 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1162/2302] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:31 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:32.537375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:32.539039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:32.557212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:32.559184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:32.561660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:32.562213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:32.599595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:32.608612 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eb1bb3f1-58f2-42ce-b434-6ef56c86d09d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.845634 Aug 04 04:33:32.619551 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1141/2303] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:31 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:32.644305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:32.655165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:32.674622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:32.675112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:32.675928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:32.676372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:32.717764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:32.909008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:32.924705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:32.930037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:32.933177 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4b58407b-3108-4f68-8b55-a184fafeb84f tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.407060 Aug 04 04:33:32.935744 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1163/2304] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:32 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:32.957905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1379863339", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "729df6ea-a920-4251-a6de-1d6ac45a9f53"}], "security_groups": [{"name": "tempest-securitygroup--731110523"}], "key_name": "tempest-keypair-25180261", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:32.997712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:33.018899 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-198cbafe-b082-4091-a3f9-de9dfd6634f6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.404201 Aug 04 04:33:33.020308 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1142/2305] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:32 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:33.032861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d0fb0b35-231d-4e6c-89d0-73dfe7b0ebd0 req-74a4e159-2ddb-41e9-807c-d14c287141b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b2c557-2612-4471-bd06-0d27b9416f02", "tag": "d4a4bd6e-3d9f-421c-be81-1fd9132ea745"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:33.056172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d0fb0b35-231d-4e6c-89d0-73dfe7b0ebd0 req-74a4e159-2ddb-41e9-807c-d14c287141b9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:33.056654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d0fb0b35-231d-4e6c-89d0-73dfe7b0ebd0 req-74a4e159-2ddb-41e9-807c-d14c287141b9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:33.100294 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d0fb0b35-231d-4e6c-89d0-73dfe7b0ebd0 req-74a4e159-2ddb-41e9-807c-d14c287141b9 service nova] Creating event network-changed:d4a4bd6e-3d9f-421c-be81-1fd9132ea745 for instance 11b2c557-2612-4471-bd06-0d27b9416f02 on n-h1-851337-5 Aug 04 04:33:33.107522 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d0fb0b35-231d-4e6c-89d0-73dfe7b0ebd0 req-74a4e159-2ddb-41e9-807c-d14c287141b9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085173 Aug 04 04:33:33.115497 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1143/2306] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:33.161667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] validate_networks() for [('729df6ea-a920-4251-a6de-1d6ac45a9f53', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:33:33.179504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:33.180101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:33.191336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:33.191787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:33.194893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:33.195399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:33.254577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:33:33.426642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f62bb80d-8863-46be-8c6b-0a7b7a3fb655 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 204 len: 0 microversion: 2.1 time: 0.251403 Aug 04 04:33:33.427646 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1144/2307] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:33:33 2022] DELETE /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:33:33.437361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:33.438369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:33.446470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:33.447538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:33.448741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:33.449476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:33.769077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:33.782832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ef9a9d0-67c7-4f35-9fb8-d713ecfbaea8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1666 microversion: 2.1 time: 0.350276 Aug 04 04:33:33.784012 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1145/2308] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:33 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1666 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:33.790314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:33.791168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:33.801303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:33.802119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:33.804046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:33.804717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.029883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:34.042089 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e5cba5e3-d9a0-4954-b95e-f5eeba6bcfc9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 0.256687 Aug 04 04:33:34.042673 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1146/2309] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:33 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:34.052275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:33:34.053250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:33:34.054024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:33:34.054606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:33:34.055194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:33:34.068986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:34.071737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:34.076146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.076654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.077679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.078124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.088405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.088837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.093100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.094113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.120269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Getting quotas for project 4e35e9177fc54bae85afe4a3c477ef7b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:34.127368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Getting quotas for user d1b140919b4d4134a71946a9f1579b9c and project 4e35e9177fc54bae85afe4a3c477ef7b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:34.142788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:33:34.145236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:33:34.272256 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8a9eae20-5a08-4f39-b93f-c8c6c5331642 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.334849 Aug 04 04:33:34.272920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1164/2310] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:33:34.283375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c5fc4cbb-92e4-4589-b5cb-b837691d8743 req-0b805b4a-ec93-406d-9c83-e1d37bac7f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-plugged", "status": "completed", "tag": "b41c6896-92e5-4741-afbd-09bad08f2d4e"}, {"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-plugged", "status": "completed", "tag": "43500245-7cb8-47d9-b8ab-7204efa8bd6d"}, {"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-plugged", "status": "completed", "tag": "9fb40d66-e6ad-4a8d-a857-8c35535ad0d2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:34.301099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5fc4cbb-92e4-4589-b5cb-b837691d8743 req-0b805b4a-ec93-406d-9c83-e1d37bac7f15 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.301791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5fc4cbb-92e4-4589-b5cb-b837691d8743 req-0b805b4a-ec93-406d-9c83-e1d37bac7f15 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.318671 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c5fc4cbb-92e4-4589-b5cb-b837691d8743 req-0b805b4a-ec93-406d-9c83-e1d37bac7f15 service nova] Creating event network-vif-plugged:b41c6896-92e5-4741-afbd-09bad08f2d4e for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:34.319595 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c5fc4cbb-92e4-4589-b5cb-b837691d8743 req-0b805b4a-ec93-406d-9c83-e1d37bac7f15 service nova] Creating event network-vif-plugged:43500245-7cb8-47d9-b8ab-7204efa8bd6d for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:34.320255 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c5fc4cbb-92e4-4589-b5cb-b837691d8743 req-0b805b4a-ec93-406d-9c83-e1d37bac7f15 service nova] Creating event network-vif-plugged:9fb40d66-e6ad-4a8d-a857-8c35535ad0d2 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:34.328516 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c5fc4cbb-92e4-4589-b5cb-b837691d8743 req-0b805b4a-ec93-406d-9c83-e1d37bac7f15 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054356 Aug 04 04:33:34.329423 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1165/2311] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:34.336279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:34.337275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:34.346536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.347790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.348758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.349365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.377757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:34.386983 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ecf66994-2176-48c0-8fba-8782fd6e21fe tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.339547 Aug 04 04:33:34.401336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1147/2312] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:34 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:34.417360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:34.417992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:34.435265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.435722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.437581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.438030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.593533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:34.920569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:34.926896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:34.933501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:34.935121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:34.936241 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f74e3ad-2db8-4c70-8403-261b762571b1 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.605208 Aug 04 04:33:34.947752 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1166/2313] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:34 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:34.947933 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c9b4a6a-ce23-4a3d-93ca-7a0e6bf2baac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.534280 Aug 04 04:33:34.947933 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1148/2314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:34 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:34.947933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:34.947933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:34.954213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-436fdafc-7525-4ee6-ba59-eb8080641c55 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:34.957144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-436fdafc-7525-4ee6-ba59-eb8080641c55 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:34.965935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.967549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:34.970203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:34.970867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.171483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-436fdafc-7525-4ee6-ba59-eb8080641c55 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:35.189670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-436fdafc-7525-4ee6-ba59-eb8080641c55 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1240 microversion: 2.1 time: 0.244272 Aug 04 04:33:35.205238 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1167/2315] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:34 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1240 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:35.214897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:35.215558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:35.225537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.225996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.227131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.227453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.360992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:35.372922 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8e9c2c2-d628-46d4-acfc-736ea2c4f9c8 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 200 len: 1666 microversion: 2.1 time: 0.431502 Aug 04 04:33:35.373553 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1149/2316] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:34 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 1666 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:35.408394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:35.409904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:35.416760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.417293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.418000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.418441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.467157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:35.475909 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64a82a7c-42a0-4b22-a4d5-606b0dcf550d tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 0.268447 Aug 04 04:33:35.476944 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1168/2317] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:35 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:35.686036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:35.704708 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1a79937a-cb6d-440e-81b3-ed78c5d7cbf9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.300918 Aug 04 04:33:35.705721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1150/2318] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:35 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:35.961254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:35.962307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:35.966072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:35.966892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:35.970754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.971484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.972513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.973221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.982862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.983434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:35.984242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:35.985889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:36.172683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=22 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:36.802538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:36.811262 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-286085d6-f732-4827-a1d0-ba668ecc2929 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.854079 Aug 04 04:33:36.812176 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1169/2319] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:35 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:36.850143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:36.863150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:36.864843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:36.873720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-72a81841-a5b7-4bdb-9947-d621beb5a706 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.908380 Aug 04 04:33:36.874730 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1151/2320] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:35 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:36.879769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:36.880583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:36.895457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:36.896089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:36.897036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:36.897630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:36.916495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ff28ae02-1afd-45d1-9ff0-586fed3f6012 req-7e77667b-11be-48cd-bc89-c10dcd2d0835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a2f759-f92a-4b9f-9090-55d1bcb5e93c", "tag": "c9fb860f-4c14-48d6-baeb-38e2d6865112"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:36.935276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ff28ae02-1afd-45d1-9ff0-586fed3f6012 req-7e77667b-11be-48cd-bc89-c10dcd2d0835 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:36.936138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ff28ae02-1afd-45d1-9ff0-586fed3f6012 req-7e77667b-11be-48cd-bc89-c10dcd2d0835 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:36.953106 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ff28ae02-1afd-45d1-9ff0-586fed3f6012 req-7e77667b-11be-48cd-bc89-c10dcd2d0835 service nova] Creating event network-changed:c9fb860f-4c14-48d6-baeb-38e2d6865112 for instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c on n-h1-851337-5 Aug 04 04:33:36.960212 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ff28ae02-1afd-45d1-9ff0-586fed3f6012 req-7e77667b-11be-48cd-bc89-c10dcd2d0835 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146786 Aug 04 04:33:36.961115 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1170/2321] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:36.969145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:36.970614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:36.977830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:36.979273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:36.981102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:36.981590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.003998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] HTTP exception thrown: Instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 could not be found. Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Request method failure captured: Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 HTTP/1.1 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60o2cdc6OqlXLlnpBsBnUPTWBe7R-aYOmIgb0tKVk_1yHKY8l0al5n5ddgecn1nZedYgtI2MJyyViaV53vk5tb5nLDatbgqC4Yr9Zn9bdCqGZd_d1Uh43gZngf9ZBMRf4Ea2XOFvX9e8aRlpIcwhvmtQXis2yuoSRE6Q7CPQ97lPZ-U Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_465a4e68c9e042c2ae95bd8c8ee07fb1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveMigrationTest-106182400 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 53377b39d2804967aa0d5b71ee57e9a8 Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 could not be found. Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3'} Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 could not be found. Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 could not be found. Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:37.006188 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:37.010547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:37.010547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:37.010547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:37.010547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:37.010547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:37.010547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 could not be found. Aug 04 04:33:37.010547 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:37.016142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Returning 404 to user: Instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:37.018833 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6cd6201-fc10-4efc-b571-ff8591ebe2d5 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3" status: 404 len: 111 microversion: 2.1 time: 0.055068 Aug 04 04:33:37.020294 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1171/2322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:36 2022] GET /compute/v2.1/servers/ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:37.026274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:37.027275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e1867395-1b6d-44f1-b3d8-b457fb9440cb req-96d5fd49-5db6-4c62-830b-2c67b19cc924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3", "name": "network-vif-deleted", "tag": "d71b6231-503c-4161-8202-4ace91baf877"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:37.039716 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-972e02da-59ec-48f2-a8b0-9d2cb09df482 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1298 microversion: 2.1 time: 0.163558 Aug 04 04:33:37.041786 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1152/2323] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:36 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:37.046787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-dd6e5416-c0a7-4d38-850f-1a0635aac106 req-260cc49b-0e00-41cd-9a3f-efbb6c6314e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-plugged", "status": "completed", "tag": "f55f1dcc-d5c6-4541-a7e6-6317c075bfed"}, {"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-plugged", "status": "completed", "tag": "9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0"}, {"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-plugged", "status": "completed", "tag": "6207fab3-7934-47a2-9393-61682681be83"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:37.057388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dd6e5416-c0a7-4d38-850f-1a0635aac106 req-260cc49b-0e00-41cd-9a3f-efbb6c6314e5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.058036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e1867395-1b6d-44f1-b3d8-b457fb9440cb req-96d5fd49-5db6-4c62-830b-2c67b19cc924 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.058151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dd6e5416-c0a7-4d38-850f-1a0635aac106 req-260cc49b-0e00-41cd-9a3f-efbb6c6314e5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.058495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e1867395-1b6d-44f1-b3d8-b457fb9440cb req-96d5fd49-5db6-4c62-830b-2c67b19cc924 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.071313 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e1867395-1b6d-44f1-b3d8-b457fb9440cb req-96d5fd49-5db6-4c62-830b-2c67b19cc924 service nova] Creating event network-vif-deleted:d71b6231-503c-4161-8202-4ace91baf877 for instance ebde1d5d-fdd9-4c2f-ad5d-6977c16070f3 on n-h2-851337-5 Aug 04 04:33:37.071640 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dd6e5416-c0a7-4d38-850f-1a0635aac106 req-260cc49b-0e00-41cd-9a3f-efbb6c6314e5 service nova] Creating event network-vif-plugged:f55f1dcc-d5c6-4541-a7e6-6317c075bfed for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:37.072256 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dd6e5416-c0a7-4d38-850f-1a0635aac106 req-260cc49b-0e00-41cd-9a3f-efbb6c6314e5 service nova] Creating event network-vif-plugged:9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:37.072743 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dd6e5416-c0a7-4d38-850f-1a0635aac106 req-260cc49b-0e00-41cd-9a3f-efbb6c6314e5 service nova] Creating event network-vif-plugged:6207fab3-7934-47a2-9393-61682681be83 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:37.076453 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e1867395-1b6d-44f1-b3d8-b457fb9440cb req-96d5fd49-5db6-4c62-830b-2c67b19cc924 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054844 Aug 04 04:33:37.077070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1172/2324] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:37.082162 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-dd6e5416-c0a7-4d38-850f-1a0635aac106 req-260cc49b-0e00-41cd-9a3f-efbb6c6314e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039089 Aug 04 04:33:37.083199 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1153/2325] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:37.090798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:37.091723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:37.099937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.100533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:37.101522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:37.102148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.104997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.105636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.116205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.117694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.118660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.125003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.487524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:37.496340 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-860227a3-8475-42e1-b1b5-bb1360104e54 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.411591 Aug 04 04:33:37.496927 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1154/2326] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:37 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:37.502079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df6c94aa-3f1b-4995-85c7-b272a69af44d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '.version_select at 0x7f19239b7af0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:37.518081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:37.527682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5b99523-6186-430a-af84-a86e8747982a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 0.448738 Aug 04 04:33:37.528140 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-df6c94aa-3f1b-4995-85c7-b272a69af44d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473709371" status: 202 len: 0 microversion: 2.1 time: 0.029692 Aug 04 04:33:37.528256 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1173/2327] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:37 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:37.534012 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1155/2328] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473709371 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:33:37.837257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:37.837922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:37.845536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.846287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.847430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.848057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.899622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:37.900274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:37.917113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.917428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:37.918309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:37.918939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:38.249711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:38.257267 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-869962d0-9a6a-4b6f-ace3-fe05f9f09985 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.424826 Aug 04 04:33:38.257839 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1174/2329] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:37 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:38.274275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:38.275164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:38.281531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:38.281981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:38.282764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:38.283230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:38.348934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:38.359107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:38.360875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:38.362047 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e9322fb-54c3-4d5d-ac2b-1f9120d7e6f6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1874 microversion: 2.42 time: 0.466734 Aug 04 04:33:38.362626 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1156/2330] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:37 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1874 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:33:38.518408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:38.519099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:38.530407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:38.530762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:38.531596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:38.532038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:38.641336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:38.649671 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7391f7aa-0942-491a-af68-b0543f4c4d3c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.390619 Aug 04 04:33:38.650818 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1175/2331] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:38 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:38.655478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:38.656289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:38.663167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:38.663953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:38.664818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:38.665347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.004909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:39.013939 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-904e4441-b5c3-485e-8384-3dc4288d3106 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.499296 Aug 04 04:33:39.028272 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1157/2332] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:38 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:39.028272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:39.028272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:39.032570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.033099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.033946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.034390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.061759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:33:39.083502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:39.088603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:39.090842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:39.097939 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bba56fdf-cef5-4885-95a2-ab731377c78c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 0.445993 Aug 04 04:33:39.114836 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1176/2333] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:38 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:39.123185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1b26dc37-184d-44d2-8915-01e7a5129ca7 req-7b49c6f2-ce15-49c8-a0f3-48b2d08e48e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a26945c-64f5-48c5-b36f-5e2cf5b4d768", "name": "network-vif-plugged", "status": "completed", "tag": "6a29c4d2-579d-48cb-ac84-be43e9c0097b"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:39.137771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b26dc37-184d-44d2-8915-01e7a5129ca7 req-7b49c6f2-ce15-49c8-a0f3-48b2d08e48e3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.138813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b26dc37-184d-44d2-8915-01e7a5129ca7 req-7b49c6f2-ce15-49c8-a0f3-48b2d08e48e3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.155043 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1b26dc37-184d-44d2-8915-01e7a5129ca7 req-7b49c6f2-ce15-49c8-a0f3-48b2d08e48e3 service nova] Creating event network-vif-plugged:6a29c4d2-579d-48cb-ac84-be43e9c0097b for instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 on n-h1-851337-5 Aug 04 04:33:39.161294 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1b26dc37-184d-44d2-8915-01e7a5129ca7 req-7b49c6f2-ce15-49c8-a0f3-48b2d08e48e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044175 Aug 04 04:33:39.162603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1177/2334] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:39.182751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:39.196590 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3a9fb2ba-b5d2-4602-92f1-771a53939873 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 204 len: 0 microversion: 2.1 time: 0.175580 Aug 04 04:33:39.201469 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1158/2335] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:33:39 2022] DELETE /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:33:39.209585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:39.210427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:39.222005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.223651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.225581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.227156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.279253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:39.279974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:39.290599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.292781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.294057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.295059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.547748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:39.555716 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ccf1e5d-611c-414d-812d-255c87d9076d tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 200 len: 1483 microversion: 2.1 time: 0.352313 Aug 04 04:33:39.557202 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1178/2336] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:39 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 1483 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:39.562076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:39.562699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:39.568789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.569431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.570405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.570834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.594359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:39.605739 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e523475-a6f7-4d40-968e-c1c9e406b3d9 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.330641 Aug 04 04:33:39.619840 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1159/2337] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:39 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:39.672567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:39.673687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:39.680022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.680314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.681105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:39.682135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:39.999247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:40.014248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:40.017337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:40.019786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a04fa052-c0ad-4174-a8c9-a3bd5cb2802b tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2831 microversion: 2.42 time: 0.461281 Aug 04 04:33:40.022083 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1179/2338] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:39 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2831 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:40.033661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1ca273bf-b3fc-421c-87fc-c8512987e344 req-29458a12-2745-4f55-9d95-169fe612329a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053480ad-ee22-4a8d-afed-82851e4a1031", "tag": "cca1001f-3ae0-47cd-9aaa-5085d44709bc"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:40.070290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1ca273bf-b3fc-421c-87fc-c8512987e344 req-29458a12-2745-4f55-9d95-169fe612329a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.071556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1ca273bf-b3fc-421c-87fc-c8512987e344 req-29458a12-2745-4f55-9d95-169fe612329a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.102971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:40.106746 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1ca273bf-b3fc-421c-87fc-c8512987e344 req-29458a12-2745-4f55-9d95-169fe612329a service nova] Creating event network-changed:cca1001f-3ae0-47cd-9aaa-5085d44709bc for instance 053480ad-ee22-4a8d-afed-82851e4a1031 on n-h2-851337-5 Aug 04 04:33:40.117936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1ca273bf-b3fc-421c-87fc-c8512987e344 req-29458a12-2745-4f55-9d95-169fe612329a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092489 Aug 04 04:33:40.119994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1180/2339] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:40.132003 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-339a96af-7aab-4fcf-98fe-9e25c9f89ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.462240 Aug 04 04:33:40.132794 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1160/2340] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:39 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:40.136219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:40.137129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:40.151423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.152044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.152986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a340ad15-1af2-478e-b57f-d5f9b1c55dbf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:40.153681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.153801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a340ad15-1af2-478e-b57f-d5f9b1c55dbf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:40.154302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.162894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a340ad15-1af2-478e-b57f-d5f9b1c55dbf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.163563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a340ad15-1af2-478e-b57f-d5f9b1c55dbf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.164816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a340ad15-1af2-478e-b57f-d5f9b1c55dbf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.165409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a340ad15-1af2-478e-b57f-d5f9b1c55dbf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.717009 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a340ad15-1af2-478e-b57f-d5f9b1c55dbf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.582383 Aug 04 04:33:40.718315 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1161/2341] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:33:40 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73/os-interface => generated 1831 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:40.723491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:40.724167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:40.740360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.745380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.746186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.746629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.870118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:40.878782 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-16e2e9c7-36f0-4c7f-9a06-8b413ca42faa tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.757244 Aug 04 04:33:40.879474 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1181/2342] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:40 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:40.885317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-667aa562-5cae-4822-b143-2832061c32d1 req-0370a811-226d-4461-a975-42f16a474dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29d0be-bfe0-495b-b3dc-94a18e813093", "name": "network-vif-deleted", "tag": "a5a98ca7-52ff-4c04-a9c8-a94414acbef7"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:40.904765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-667aa562-5cae-4822-b143-2832061c32d1 req-0370a811-226d-4461-a975-42f16a474dc0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.905796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-667aa562-5cae-4822-b143-2832061c32d1 req-0370a811-226d-4461-a975-42f16a474dc0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.920063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-667aa562-5cae-4822-b143-2832061c32d1 req-0370a811-226d-4461-a975-42f16a474dc0 service nova] Creating event network-vif-deleted:a5a98ca7-52ff-4c04-a9c8-a94414acbef7 for instance fa29d0be-bfe0-495b-b3dc-94a18e813093 on n-h2-851337-5 Aug 04 04:33:40.926271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-667aa562-5cae-4822-b143-2832061c32d1 req-0370a811-226d-4461-a975-42f16a474dc0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045104 Aug 04 04:33:40.927855 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1182/2343] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:40.934393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:40.935238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: fa29d0be-bfe0-495b-b3dc-94a18e813093] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:40.941822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.942478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.943368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.943803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.959717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] HTTP exception thrown: Instance fa29d0be-bfe0-495b-b3dc-94a18e813093 could not be found. Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Request method failure captured: Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 HTTP/1.1 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60o2cdc6OqlXLlnpBsBnUPTWBe7R-aYOmIgb0tKVk_1yHKY8l0al5n5ddgecn1nZedYgtI2MJyyViaV53vk5tb5nLDatbgqC4Yr9Zn9bdCqGZd_d1Uh43gZngf9ZBMRf4Ea2XOFvX9e8aRlpIcwhvmtQXis2yuoSRE6Q7CPQ97lPZ-U Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_465a4e68c9e042c2ae95bd8c8ee07fb1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-LiveMigrationTest-106182400 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 53377b39d2804967aa0d5b71ee57e9a8 Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance fa29d0be-bfe0-495b-b3dc-94a18e813093 could not be found. Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'fa29d0be-bfe0-495b-b3dc-94a18e813093'} Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa29d0be-bfe0-495b-b3dc-94a18e813093 could not be found. Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa29d0be-bfe0-495b-b3dc-94a18e813093 could not be found. Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:40.961652 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa29d0be-bfe0-495b-b3dc-94a18e813093 could not be found. Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Returning 404 to user: Instance fa29d0be-bfe0-495b-b3dc-94a18e813093 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-194cabc2-5533-43ff-8fb2-44da342f8e6a tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093" status: 404 len: 111 microversion: 2.1 time: 0.033986 Aug 04 04:33:40.967396 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1183/2344] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:40 2022] GET /compute/v2.1/servers/fa29d0be-bfe0-495b-b3dc-94a18e813093 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:40.969508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:40.970106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:40.977214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.977673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.978533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:40.978997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:40.988461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:40.998249 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ed9ca6c-de15-4c31-a62e-70b135cb721c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 0.278804 Aug 04 04:33:41.012631 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1162/2345] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:40 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:41.019659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:41.020245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:41.045870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.046690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.047139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.047589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.076723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:33:41.183300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:41.184143 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3f90c8fd-3ce9-4218-bfe1-5f84ab87b908 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 204 len: 0 microversion: 2.1 time: 0.171485 Aug 04 04:33:41.184467 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1163/2346] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:33:41 2022] DELETE /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:33:41.192071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:41.192829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:41.199220 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8484183-6827-4d26-ac63-3151e16a93ba tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.234229 Aug 04 04:33:41.199764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.200428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.201300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.201745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.213334 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1184/2347] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:40 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:41.226318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:41.227098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:41.237019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:41.238702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.239270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.240500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.241295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.394927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:41.405774 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-998673d1-3f91-4d85-b9eb-bcf5d1db8077 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.219713 Aug 04 04:33:41.420189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1164/2348] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:41 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:41.427565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:41.435937 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7343c33-f17f-4968-b962-9ec0a502d2d0 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1500 microversion: 2.1 time: 0.221038 Aug 04 04:33:41.436572 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1185/2349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:41 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:41.648707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-08fecf78-e258-499e-a3cf-c2c535e62820 req-c9a7a96d-d4eb-4584-8332-4aeff23d45f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b2c557-2612-4471-bd06-0d27b9416f02", "name": "network-vif-plugged", "status": "completed", "tag": "d4a4bd6e-3d9f-421c-be81-1fd9132ea745"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:41.661320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-08fecf78-e258-499e-a3cf-c2c535e62820 req-c9a7a96d-d4eb-4584-8332-4aeff23d45f9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.661320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-08fecf78-e258-499e-a3cf-c2c535e62820 req-c9a7a96d-d4eb-4584-8332-4aeff23d45f9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.676930 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-08fecf78-e258-499e-a3cf-c2c535e62820 req-c9a7a96d-d4eb-4584-8332-4aeff23d45f9 service nova] Creating event network-vif-plugged:d4a4bd6e-3d9f-421c-be81-1fd9132ea745 for instance 11b2c557-2612-4471-bd06-0d27b9416f02 on n-h1-851337-5 Aug 04 04:33:41.683064 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-08fecf78-e258-499e-a3cf-c2c535e62820 req-c9a7a96d-d4eb-4584-8332-4aeff23d45f9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037999 Aug 04 04:33:41.684003 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1165/2350] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:41.904200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:41.904833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:41.912704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.913354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:41.914312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:41.914763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.021801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:42.023570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:42.030491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.031558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.032567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.033299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.202437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:42.210777 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-db7ba59e-416b-4181-9833-fbdb50b545ae tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.311627 Aug 04 04:33:42.221890 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1186/2351] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:41 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:42.236434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:42.237057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:42.246608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.247339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.249945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.250510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.461692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:42.469955 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c8ce1e6-6b3d-4049-9e8f-7400b012d1fc tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1324 microversion: 2.1 time: 0.452910 Aug 04 04:33:42.470894 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1166/2352] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:42 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:42.489040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:42.490412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:42.498549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.499399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.500396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.500993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.567027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:42.575845 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77d5c2a5-8a9f-4767-8023-ec1407fc39f1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.343473 Aug 04 04:33:42.589012 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1187/2353] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:42 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:42.594339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:42.595214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:42.601391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.601844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.602632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.603581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:42.805687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:42.814841 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f35e1a23-3cd3-4e1b-85a2-0583e9033fa7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.342694 Aug 04 04:33:42.828971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1167/2354] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:42 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:42.883850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:42.893496 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ee5bc0f-209f-4c16-b24a-c6e4b4ecd442 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1500 microversion: 2.1 time: 0.302909 Aug 04 04:33:42.894351 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1188/2355] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:42 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1500 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:42.973019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a0f60a6a-b6a7-4327-afe5-b534e5fd29f3 req-75fb0677-d5aa-42c6-9415-eb3fe44bbdbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "tag": "6207fab3-7934-47a2-9393-61682681be83"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:42.986748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a0f60a6a-b6a7-4327-afe5-b534e5fd29f3 req-75fb0677-d5aa-42c6-9415-eb3fe44bbdbb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:42.987238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a0f60a6a-b6a7-4327-afe5-b534e5fd29f3 req-75fb0677-d5aa-42c6-9415-eb3fe44bbdbb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.005073 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a0f60a6a-b6a7-4327-afe5-b534e5fd29f3 req-75fb0677-d5aa-42c6-9415-eb3fe44bbdbb service nova] Creating event network-changed:6207fab3-7934-47a2-9393-61682681be83 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:33:43.011220 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a0f60a6a-b6a7-4327-afe5-b534e5fd29f3 req-75fb0677-d5aa-42c6-9415-eb3fe44bbdbb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045128 Aug 04 04:33:43.015467 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1168/2356] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:43.237326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:43.237952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:43.245321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.245998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.246783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.247401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.499914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:43.500741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:43.528355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.528907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.529944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.530588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.536610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:43.544875 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ecf4f644-4411-4f6b-b291-8ffddaac93c0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.311883 Aug 04 04:33:43.559332 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1189/2357] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:43 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:43.595596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:43.596660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:43.604538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.604994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.605982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.606218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.933320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:43.943270 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c30d797-7094-4ebb-a8f7-50f46297e71c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1521 microversion: 2.1 time: 0.455814 Aug 04 04:33:43.943868 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1169/2358] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:43 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:43.949678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:43.950383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:43.961211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.961983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:43.962834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:43.963335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.005987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:44.015491 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2b2dd83-ef89-42b4-9b43-fe67f5afce02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.423683 Aug 04 04:33:44.016277 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1190/2359] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:43 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:44.023318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:44.023318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:44.031754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.032426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.033682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.034442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.101502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:44.216850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:44.230025 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14d6d736-83a5-42d4-9ab3-42bd93b68ccb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.281729 Aug 04 04:33:44.246679 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1170/2360] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:43 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:44.253796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:44.254657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:44.263347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.264181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.265322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.266026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.286729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:44.296041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b8c2b71-bd17-4e6c-85c5-cf7f30e92333 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1500 microversion: 2.1 time: 0.277548 Aug 04 04:33:44.298769 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1191/2361] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:44 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1500 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:44.305739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51717cbe-1438-4221-ab25-e01911eafcb9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-131936290", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51717cbe-1438-4221-ab25-e01911eafcb9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 242 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-131936290", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-131936290', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '924d6080-3067-48b4-bf93-a997c13a19e8'}]}}} Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:33:44.316997 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.327995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.330845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51717cbe-1438-4221-ab25-e01911eafcb9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:44.332480 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51717cbe-1438-4221-ab25-e01911eafcb9 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.032171 Aug 04 04:33:44.339264 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1192/2362] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:44 2022] POST /compute/v2.1/servers => generated 175 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:33:44.344946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27e4d46b-bf96-4a05-8016-6e22e79acebb tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:44.345463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27e4d46b-bf96-4a05-8016-6e22e79acebb tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 6817b561-9446-4347-b7bb-edce252c7cf6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:44.356313 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-27e4d46b-bf96-4a05-8016-6e22e79acebb tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] HTTP exception thrown: Instance 6817b561-9446-4347-b7bb-edce252c7cf6 could not be found. Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27e4d46b-bf96-4a05-8016-6e22e79acebb tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6817b561-9446-4347-b7bb-edce252c7cf6/metadata HTTP/1.1 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6817b561-9446-4347-b7bb-edce252c7cf6 could not be found. Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '6817b561-9446-4347-b7bb-edce252c7cf6'} Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6817b561-9446-4347-b7bb-edce252c7cf6 could not be found. Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6817b561-9446-4347-b7bb-edce252c7cf6 could not be found. Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.366539 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.371966 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:44.371966 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:44.371966 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6817b561-9446-4347-b7bb-edce252c7cf6 could not be found. Aug 04 04:33:44.371966 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.373133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27e4d46b-bf96-4a05-8016-6e22e79acebb tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 404 to user: Instance 6817b561-9446-4347-b7bb-edce252c7cf6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:44.374050 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27e4d46b-bf96-4a05-8016-6e22e79acebb tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/6817b561-9446-4347-b7bb-edce252c7cf6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.033256 Aug 04 04:33:44.387265 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1193/2363] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:33:44 2022] GET /compute/v2.1/servers/6817b561-9446-4347-b7bb-edce252c7cf6/metadata => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:44.441462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2f20dd5-9909-49c6-a147-5e8b54452544 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-127470655", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2f20dd5-9909-49c6-a147-5e8b54452544 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 498 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-127470655", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-127470655', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '924d6080-3067-48b4-bf93-a997c13a19e8'}]}}} Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:33:44.447702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2f20dd5-9909-49c6-a147-5e8b54452544 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:44.451081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2f20dd5-9909-49c6-a147-5e8b54452544 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.011913 Aug 04 04:33:44.458404 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1194/2364] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:44 2022] POST /compute/v2.1/servers => generated 687 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:33:44.536182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66f08a8d-5ad7-401a-b2c3-37bf14642a95 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-35064313", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:44.540740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66f08a8d-5ad7-401a-b2c3-37bf14642a95 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 498 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-35064313", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-35064313', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '924d6080-3067-48b4-bf93-a997c13a19e8'}]}}} Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:33:44.551040 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.554571 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.557294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:44.557294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:44.558568 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ac8854b5-52b3-450a-9ad4-64f584ef79e8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2948 microversion: 2.32 time: 0.309407 Aug 04 04:33:44.560732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66f08a8d-5ad7-401a-b2c3-37bf14642a95 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:44.560896 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1171/2365] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:33:44 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2948 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:44.560993 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-66f08a8d-5ad7-401a-b2c3-37bf14642a95 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.043520 Aug 04 04:33:44.569509 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1195/2366] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:44 2022] POST /compute/v2.1/servers => generated 689 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:33:44.592154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:44.593259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:44.594635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7afcd818-9071-4ff5-aac0-241487177af9 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:44.595191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7afcd818-9071-4ff5-aac0-241487177af9 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:44.603893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.604382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.604820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7afcd818-9071-4ff5-aac0-241487177af9 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.605286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.605909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.610817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7afcd818-9071-4ff5-aac0-241487177af9 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.611759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7afcd818-9071-4ff5-aac0-241487177af9 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.612288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7afcd818-9071-4ff5-aac0-241487177af9 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.801257 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7afcd818-9071-4ff5-aac0-241487177af9 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.210883 Aug 04 04:33:44.802380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1196/2367] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:33:44 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f/os-interface => generated 1829 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:33:44.812556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7bebc2a-c187-4281-a721-90fd92182e43 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1833825415", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7bebc2a-c187-4281-a721-90fd92182e43 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 754 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1833825415", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1833825415', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '924d6080-3067-48b4-bf93-a997c13a19e8'}]}}} Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:33:44.826734 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:33:44.829554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:33:44.832387 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.832387 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.832387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7bebc2a-c187-4281-a721-90fd92182e43 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:44.832387 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7bebc2a-c187-4281-a721-90fd92182e43 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024612 Aug 04 04:33:44.835745 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1197/2368] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:44 2022] POST /compute/v2.1/servers => generated 1197 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 04 04:33:44.890786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2943c23-dacc-430a-8008-01132420435c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1093830585", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2943c23-dacc-430a-8008-01132420435c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 1266 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1093830585", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "924d6080-3067-48b4-bf93-a997c13a19e8"}]}} Aug 04 04:33:44.896144 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1093830585', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '924d6080-3067-48b4-bf93-a997c13a19e8'}]}}} Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.898352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:33:44.899448 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:33:44.901294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 04:33:44.901294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.903043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2943c23-dacc-430a-8008-01132420435c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:44.903988 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2943c23-dacc-430a-8008-01132420435c tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018632 Aug 04 04:33:44.914291 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1198/2369] 10.222.0.69 () {60 vars in 1148 bytes} [Thu Aug 4 04:33:44 2022] POST /compute/v2.1/servers => generated 2221 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 04 04:33:44.921426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06585d64-8073-4794-ae98-2d2491dddc26 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:44.925271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06585d64-8073-4794-ae98-2d2491dddc26 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 648ddfcc-37dd-49cd-8a0a-788d890911b7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:44.926696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:44.936472 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1df6f988-38d6-47a9-af23-a0ebf1fde185 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.353926 Aug 04 04:33:44.938816 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-06585d64-8073-4794-ae98-2d2491dddc26 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] HTTP exception thrown: Instance 648ddfcc-37dd-49cd-8a0a-788d890911b7 could not be found. Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06585d64-8073-4794-ae98-2d2491dddc26 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/648ddfcc-37dd-49cd-8a0a-788d890911b7/metadata/test2 HTTP/1.1 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 648ddfcc-37dd-49cd-8a0a-788d890911b7 could not be found. Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '648ddfcc-37dd-49cd-8a0a-788d890911b7', 'id': 'test2'} Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 648ddfcc-37dd-49cd-8a0a-788d890911b7 could not be found. Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 648ddfcc-37dd-49cd-8a0a-788d890911b7 could not be found. Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:44.941293 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:44.944815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:44.944815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:44.944815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 648ddfcc-37dd-49cd-8a0a-788d890911b7 could not be found. Aug 04 04:33:44.944815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:33:44.944815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06585d64-8073-4794-ae98-2d2491dddc26 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 404 to user: Instance 648ddfcc-37dd-49cd-8a0a-788d890911b7 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:44.944815 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06585d64-8073-4794-ae98-2d2491dddc26 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/648ddfcc-37dd-49cd-8a0a-788d890911b7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027397 Aug 04 04:33:44.944815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1199/2370] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 04:33:44 2022] GET /compute/v2.1/servers/648ddfcc-37dd-49cd-8a0a-788d890911b7/metadata/test2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:44.951997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1172/2371] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:44 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:44.961125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:44.961642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:44.968173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.968630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:44.969416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:44.969856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.003468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:33:45.046889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ca4faf70-77e6-4741-b490-d57bdb5457ed req-0b11b8a8-69c6-45f8-b30e-0b55cbbfbcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46a93f8-4b98-41ba-bfcc-1c01a0d05309", "name": "network-vif-deleted", "tag": "a7a9350d-0ca3-41d0-b540-5018858da4aa"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:45.060510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ca4faf70-77e6-4741-b490-d57bdb5457ed req-0b11b8a8-69c6-45f8-b30e-0b55cbbfbcd9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.060951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ca4faf70-77e6-4741-b490-d57bdb5457ed req-0b11b8a8-69c6-45f8-b30e-0b55cbbfbcd9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.073151 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ca4faf70-77e6-4741-b490-d57bdb5457ed req-0b11b8a8-69c6-45f8-b30e-0b55cbbfbcd9 service nova] Creating event network-vif-deleted:a7a9350d-0ca3-41d0-b540-5018858da4aa for instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 on n-h1-851337-5 Aug 04 04:33:45.078570 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ca4faf70-77e6-4741-b490-d57bdb5457ed req-0b11b8a8-69c6-45f8-b30e-0b55cbbfbcd9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042423 Aug 04 04:33:45.079782 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1173/2372] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:45.086076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:45.086777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:45.094367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.094840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.095632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.096073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.105817 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae8f0c90-605d-4f8f-ac9d-5261b3bee67a tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 204 len: 0 microversion: 2.1 time: 0.148351 Aug 04 04:33:45.106407 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1200/2373] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:33:44 2022] DELETE /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:33:45.115041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:45.115746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:45.122717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.123194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.124009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.124423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.177807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=20 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:45.321117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:45.332532 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c10b7bc-95df-4f56-a3e5-3afbf3603c00 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.251322 Aug 04 04:33:45.334050 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1174/2374] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:45 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:45.340579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:45.341571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:45.349644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.350102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.350937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.351411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.357171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:45.358575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:45.362307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:45.369354 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ec8aca50-0d71-4761-9d49-ed1c0e7299c4 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1527 microversion: 2.1 time: 0.258074 Aug 04 04:33:45.369973 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1201/2375] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:45 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1527 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:45.383565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:45.384184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:45.391373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.391758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.392728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.393168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.428972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.429460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.429974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lazy-loading 'fault' on Instance uuid c46a93f8-4b98-41ba-bfcc-1c01a0d05309 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:33:45.482924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:45.491630 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c00a25d4-1c02-43d4-9a18-b2fefb0c1f70 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1300 microversion: 2.1 time: 0.120279 Aug 04 04:33:45.492380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1202/2376] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:45 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:45.525003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:45.534370 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1da7f0fc-188f-4220-a485-91d57bf02794 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.199070 Aug 04 04:33:45.534971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1175/2377] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:45 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:45.958296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:45.958922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:45.966508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.966973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:45.967923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:45.968368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.112215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:46.120392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da43a435-a84b-47f2-842d-2ab54201880c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.166347 Aug 04 04:33:46.120979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1203/2378] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:45 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:46.197898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-99794dbe-8d66-4179-a6b1-8e617adaa364 req-b11c76a2-35c4-45eb-baf5-2b0ff45bd62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a2f759-f92a-4b9f-9090-55d1bcb5e93c", "name": "network-vif-plugged", "status": "completed", "tag": "c9fb860f-4c14-48d6-baeb-38e2d6865112"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:46.208452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-99794dbe-8d66-4179-a6b1-8e617adaa364 req-b11c76a2-35c4-45eb-baf5-2b0ff45bd62c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.209034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-99794dbe-8d66-4179-a6b1-8e617adaa364 req-b11c76a2-35c4-45eb-baf5-2b0ff45bd62c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.221136 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-99794dbe-8d66-4179-a6b1-8e617adaa364 req-b11c76a2-35c4-45eb-baf5-2b0ff45bd62c service nova] Creating event network-vif-plugged:c9fb860f-4c14-48d6-baeb-38e2d6865112 for instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c on n-h1-851337-5 Aug 04 04:33:46.226187 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-99794dbe-8d66-4179-a6b1-8e617adaa364 req-b11c76a2-35c4-45eb-baf5-2b0ff45bd62c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Aug 04 04:33:46.226835 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1176/2379] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:46.357670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:46.358329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:46.365366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.365970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.366644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.367106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.395586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:46.396705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:46.409817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.413536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.413536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.413536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.575885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:46.584323 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fafbeffa-2b9c-4ed9-a50a-1a261de08c8b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1316 microversion: 2.1 time: 0.231067 Aug 04 04:33:46.585124 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1204/2380] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:46 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:46.589840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:46.590621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:46.596829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.597277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.598061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.598503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.618387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:46.626838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-516ef253-f0f8-4552-9d24-5a0d0d186ba2 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1527 microversion: 2.1 time: 0.235971 Aug 04 04:33:46.639012 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1177/2381] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:46 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1527 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:46.639012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:46.639012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:46.640168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.640862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.642680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.643401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.651681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:46.652163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:46.652986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lazy-loading 'fault' on Instance uuid c46a93f8-4b98-41ba-bfcc-1c01a0d05309 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:33:46.717674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53377b39d2804967aa0d5b71ee57e9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465a4e68c9e042c2ae95bd8c8ee07fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:46.725543 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91f4d5db-20ae-4ca8-90a7-a6813e47c787 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 200 len: 1300 microversion: 2.1 time: 0.139144 Aug 04 04:33:46.739959 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1205/2382] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:46 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 1300 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:46.880988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:46.889911 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44baf306-bc0b-4b56-9f5a-b2bf64c757ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.260506 Aug 04 04:33:46.890879 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1178/2383] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:46 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:47.145914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:47.146716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:47.154324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.154908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.156234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.157080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.469067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:47.476748 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c28d6da3-d64b-4295-93b7-68954862235c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.334861 Aug 04 04:33:47.477331 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1206/2384] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:47 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:47.605647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:47.606283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:47.613756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.614234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.615283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.615730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.649549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:47.650239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:47.656671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.657392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.658199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.664542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.879291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:47.887905 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f1f6b98-4ad4-48fb-9e45-57a998fdf0e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1466 microversion: 2.1 time: 0.286230 Aug 04 04:33:47.888171 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1179/2385] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:47 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1466 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:47.894351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:47.894985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] [instance: c46a93f8-4b98-41ba-bfcc-1c01a0d05309] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:47.901009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.901459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.902233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.902837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.918069 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] HTTP exception thrown: Instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 could not be found. Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Request method failure captured: Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 HTTP/1.1 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60o2cdc6OqlXLlnpBsBnUPTWBe7R-aYOmIgb0tKVk_1yHKY8l0al5n5ddgecn1nZedYgtI2MJyyViaV53vk5tb5nLDatbgqC4Yr9Zn9bdCqGZd_d1Uh43gZngf9ZBMRf4Ea2XOFvX9e8aRlpIcwhvmtQXis2yuoSRE6Q7CPQ97lPZ-U Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/465a4e68c9e042c2ae95bd8c8ee07fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_465a4e68c9e042c2ae95bd8c8ee07fb1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-LiveMigrationTest-106182400 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 465a4e68c9e042c2ae95bd8c8ee07fb1 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-LiveMigrationTest-106182400 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 53377b39d2804967aa0d5b71ee57e9a8 Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-LiveMigrationTest-106182400-project Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 could not be found. Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'c46a93f8-4b98-41ba-bfcc-1c01a0d05309'} Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 could not be found. Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 could not be found. Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:47.919782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 could not be found. Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] Returning 404 to user: Instance c46a93f8-4b98-41ba-bfcc-1c01a0d05309 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d93e805-0bd3-4e81-b2b3-44852f14dc66 tempest-LiveMigrationTest-106182400 tempest-LiveMigrationTest-106182400-project] 10.222.0.69 "GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309" status: 404 len: 111 microversion: 2.1 time: 0.031162 Aug 04 04:33:47.928684 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1180/2386] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:47 2022] GET /compute/v2.1/servers/c46a93f8-4b98-41ba-bfcc-1c01a0d05309 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:33:47.939513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:47.964196 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56cc15e4-d871-446f-991d-3bc2be6fc13b tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1527 microversion: 2.1 time: 0.318348 Aug 04 04:33:47.967016 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1207/2387] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:47 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1527 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:47.976967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:47.977651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:47.985823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.986344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:47.987271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:47.987876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:48.017187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c41f2e47-c436-4b69-9964-cbda72c7c687 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:48.017922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c41f2e47-c436-4b69-9964-cbda72c7c687 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:48.026102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c41f2e47-c436-4b69-9964-cbda72c7c687 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:48.026565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c41f2e47-c436-4b69-9964-cbda72c7c687 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:48.027539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c41f2e47-c436-4b69-9964-cbda72c7c687 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:48.028340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c41f2e47-c436-4b69-9964-cbda72c7c687 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:48.527955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:48.543427 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9efa06a0-e1fe-459e-9608-b0bd73e0cd11 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.573902 Aug 04 04:33:48.544841 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1208/2388] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:47 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:48.552654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-163600fb-d35d-4446-9857-e223157d1c7b req-77688c31-18d6-481c-a897-dc49e0ee0a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a26945c-64f5-48c5-b36f-5e2cf5b4d768", "name": "network-vif-deleted", "tag": "6a29c4d2-579d-48cb-ac84-be43e9c0097b"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:48.568028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-163600fb-d35d-4446-9857-e223157d1c7b req-77688c31-18d6-481c-a897-dc49e0ee0a12 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:48.569193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-163600fb-d35d-4446-9857-e223157d1c7b req-77688c31-18d6-481c-a897-dc49e0ee0a12 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:48.593352 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-163600fb-d35d-4446-9857-e223157d1c7b req-77688c31-18d6-481c-a897-dc49e0ee0a12 service nova] Creating event network-vif-deleted:6a29c4d2-579d-48cb-ac84-be43e9c0097b for instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 on n-h1-851337-5 Aug 04 04:33:48.602510 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-163600fb-d35d-4446-9857-e223157d1c7b req-77688c31-18d6-481c-a897-dc49e0ee0a12 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055312 Aug 04 04:33:48.605094 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1209/2389] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:48.615561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-115407bb-3b1d-456c-a019-fb9bdda80385 req-667f6d18-612b-4f71-8bd7-53d9f216b003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053480ad-ee22-4a8d-afed-82851e4a1031", "name": "network-vif-plugged", "status": "completed", "tag": "cca1001f-3ae0-47cd-9aaa-5085d44709bc"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:48.635579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-115407bb-3b1d-456c-a019-fb9bdda80385 req-667f6d18-612b-4f71-8bd7-53d9f216b003 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:48.637137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-115407bb-3b1d-456c-a019-fb9bdda80385 req-667f6d18-612b-4f71-8bd7-53d9f216b003 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:48.664677 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-115407bb-3b1d-456c-a019-fb9bdda80385 req-667f6d18-612b-4f71-8bd7-53d9f216b003 service nova] Creating event network-vif-plugged:cca1001f-3ae0-47cd-9aaa-5085d44709bc for instance 053480ad-ee22-4a8d-afed-82851e4a1031 on n-h2-851337-5 Aug 04 04:33:48.684482 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-115407bb-3b1d-456c-a019-fb9bdda80385 req-667f6d18-612b-4f71-8bd7-53d9f216b003 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077093 Aug 04 04:33:48.685608 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1210/2390] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:48.691286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:48.692003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:48.699593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:48.699813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:48.700554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:48.701135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:48.702383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c41f2e47-c436-4b69-9964-cbda72c7c687 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1617 microversion: 2.1 time: 0.779207 Aug 04 04:33:48.716076 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1181/2391] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:47 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1617 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:48.727923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-715276d7-c784-4c27-abb1-86f05b7c978e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: .version_select at 0x7f1923acaca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-917074884", "policies": ["affinity"]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:48.752762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-715276d7-c784-4c27-abb1-86f05b7c978e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:48.759735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-715276d7-c784-4c27-abb1-86f05b7c978e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:48.827811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-715276d7-c784-4c27-abb1-86f05b7c978e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:48.835392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-715276d7-c784-4c27-abb1-86f05b7c978e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:48.860935 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-715276d7-c784-4c27-abb1-86f05b7c978e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.137652 Aug 04 04:33:48.870990 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1182/2392] 10.222.0.69 () {60 vars in 1174 bytes} [Thu Aug 4 04:33:48 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:48.929336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:48.933839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-970452605", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "562feb62-c0fd-48ba-ae01-05a37d8f321b"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:48.939800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00058187-f297-4fc8-aaf3-9a627c890f6d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1368 microversion: 2.1 time: 0.253114 Aug 04 04:33:48.940737 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1211/2393] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:48 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:48.992455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:48.993547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:48.999329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:33:49.000393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.000956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.001919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.002438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.049198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.049646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.050099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lazy-loading 'fault' on Instance uuid 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:33:49.126512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e159ad1eeda43488b40d5b8e6245d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472a6316385d4a12900168ff83a4b8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:49.137571 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b49b1cc7-6e2b-424c-9210-524229fa9316 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 200 len: 1314 microversion: 2.1 time: 0.148960 Aug 04 04:33:49.148540 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1212/2394] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:48 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:49.259135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:33:49.260032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:33:49.260857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:33:49.261381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:33:49.261890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:33:49.289131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.289689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.290675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.291209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.312273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:49.318695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:49.333072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Going to run 2 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:33:49.335566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:33:49.363403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:49.377417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119342) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 04 04:33:49.400209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:49.409716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:49.457207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:49.462637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:49.479475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=3a8fd1c8-1f4c-4432-b1a9-f40552373469,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:33:49.535352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:49.541249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:49.565534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:49.567030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:49.574745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.575229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.576022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.576639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.584385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:33:49.591749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:33:49.645429 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26ce4bff-1750-436d-9620-93f15a0ddd77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.712151 Aug 04 04:33:49.645429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1183/2395] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:33:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:33:49.654685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:49.660485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:49.661417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Searching by: {'deleted': False, 'project_id': '4eeb2c9400144655abd2a6fc111690a1'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:33:49.682683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.683421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.684339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.685016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.713267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:33:49.747104 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2ec326f-1a52-45ab-ba20-991b5252bc7b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.099323 Aug 04 04:33:49.748411 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1184/2396] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:33:49 2022] GET /compute/v2.1/servers => generated 1001 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:49.769783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ccc7d904-aa52-4665-a5b3-3a30c3558ad6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:49.771142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ccc7d904-aa52-4665-a5b3-3a30c3558ad6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:49.797770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:49.809458 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-34e6a25e-337d-471f-97e6-04d8a8b93cbb tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1365 microversion: 2.1 time: 0.247624 Aug 04 04:33:49.811113 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1213/2397] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:49 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:49.846063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ccc7d904-aa52-4665-a5b3-3a30c3558ad6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:49.856162 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ccc7d904-aa52-4665-a5b3-3a30c3558ad6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1218 microversion: 2.1 time: 0.091367 Aug 04 04:33:49.858101 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1185/2398] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:49 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:49.963190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:49.964023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:49.977146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.978512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:49.982030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:49.983086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.163580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:50.164218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] [instance: 9a26945c-64f5-48c5-b36f-5e2cf5b4d768] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:50.179559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.180036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.183583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.184063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.213206 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] HTTP exception thrown: Instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 could not be found. Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Request method failure captured: Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 HTTP/1.1 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60wPb2LfFzSEFtjWpTx6BqI3tYTUn05I1iFWt8OEKL5rtEFVac_LNpZq7lORXAhd8oqlQGV8TJqRaWsVSJCx6DDqg3Z0h5yfCQaD8cFVPhiRaRAn7yEYNTaQnwrqnxWj_MgCzShzyT6QMghBzn0wo2H4afaAVu8SysE4GdEXJUNAgH0 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/472a6316385d4a12900168ff83a4b8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_472a6316385d4a12900168ff83a4b8df", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 472a6316385d4a12900168ff83a4b8df Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-801878090 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4e159ad1eeda43488b40d5b8e6245d57 Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-801878090-project Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 could not be found. Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '9a26945c-64f5-48c5-b36f-5e2cf5b4d768'} Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 could not be found. Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 could not be found. Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:50.215028 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 could not be found. Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] Returning 404 to user: Instance 9a26945c-64f5-48c5-b36f-5e2cf5b4d768 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35547fad-1972-4de9-9617-d2ccab85dd46 tempest-ServerMetadataNegativeTestJSON-801878090 tempest-ServerMetadataNegativeTestJSON-801878090-project] 10.222.0.69 "GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768" status: 404 len: 111 microversion: 2.1 time: 0.059862 Aug 04 04:33:50.219992 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1186/2399] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:50 2022] GET /compute/v2.1/servers/9a26945c-64f5-48c5-b36f-5e2cf5b4d768 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:33:50.308203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:50.320997 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c23a3c79-8659-4c7f-883f-a5b6ed73ff36 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1558 microversion: 2.1 time: 0.363873 Aug 04 04:33:50.323603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1214/2400] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:49 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1558 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:50.346872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-952b22eb-e206-448a-9ed5-0d5ac062f659 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:50.347442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-952b22eb-e206-448a-9ed5-0d5ac062f659 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:50.360721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-952b22eb-e206-448a-9ed5-0d5ac062f659 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.361308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-952b22eb-e206-448a-9ed5-0d5ac062f659 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.362133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-952b22eb-e206-448a-9ed5-0d5ac062f659 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.362607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-952b22eb-e206-448a-9ed5-0d5ac062f659 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.451476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d1bc4a8f-f120-4f5d-9b3b-fb6576f8bea1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:50.453886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d1bc4a8f-f120-4f5d-9b3b-fb6576f8bea1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:50.467001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1bc4a8f-f120-4f5d-9b3b-fb6576f8bea1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.467474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1bc4a8f-f120-4f5d-9b3b-fb6576f8bea1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.468277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1bc4a8f-f120-4f5d-9b3b-fb6576f8bea1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.468720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1bc4a8f-f120-4f5d-9b3b-fb6576f8bea1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.508994 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-952b22eb-e206-448a-9ed5-0d5ac062f659 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166512 Aug 04 04:33:50.517535 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1187/2401] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:33:50 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:50.594994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d1bc4a8f-f120-4f5d-9b3b-fb6576f8bea1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.147600 Aug 04 04:33:50.596437 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1215/2402] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:33:50 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:33:50.605196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:50.605415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:50.617019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.617657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.618351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.619346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.835618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:50.846170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:50.861335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.862327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:50.863710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:50.864556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:51.017796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:51.036980 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f3965b6-d6d9-458a-883f-87fc8d66fd1b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1672 microversion: 2.1 time: 0.436087 Aug 04 04:33:51.038992 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1188/2403] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:50 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1672 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:51.046000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:51.047011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:51.060321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:51.061256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:51.062608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:51.063423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:51.245346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:51.261013 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7e1870b-e781-40c9-86fa-be6d99d856be tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1214 microversion: 2.1 time: 0.220630 Aug 04 04:33:51.261776 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1189/2404] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:51 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:51.379460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:51.407951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-86e6c6a1-35cf-4a43-8013-c7f7e6ca9e68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1554 microversion: 2.1 time: 0.569941 Aug 04 04:33:51.409507 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1216/2405] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:50 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1554 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:51.430393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d9a2705b-ecf2-4777-9235-57ecc9d16af5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:51.430913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d9a2705b-ecf2-4777-9235-57ecc9d16af5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:51.438489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9a2705b-ecf2-4777-9235-57ecc9d16af5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:51.439665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9a2705b-ecf2-4777-9235-57ecc9d16af5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:51.440662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9a2705b-ecf2-4777-9235-57ecc9d16af5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:51.441264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9a2705b-ecf2-4777-9235-57ecc9d16af5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:51.563759 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d9a2705b-ecf2-4777-9235-57ecc9d16af5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137334 Aug 04 04:33:51.564713 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1190/2406] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:33:51 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:52.066019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:52.066642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:52.074609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:52.075201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:52.075897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:52.076555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:52.283947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:52.284689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:52.291725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:52.292357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:52.293243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:52.294039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:52.425721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:52.434092 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f09d331-f305-4a6a-9a9f-ce82d2373661 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1276 microversion: 2.1 time: 0.155790 Aug 04 04:33:52.440921 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1191/2407] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:52 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:52.616541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:52.621531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:52.627796 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a9035e7-bef6-4b10-bbce-bf6e1227bb8d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1672 microversion: 2.1 time: 0.565659 Aug 04 04:33:52.629029 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1217/2408] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:52 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1672 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:53.458991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:53.461568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:53.471789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:53.472473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:53.473786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:53.474379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:53.577274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:53.616352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a3f433c-5626-4c1d-a38c-6fcef98890d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1276 microversion: 2.1 time: 0.162834 Aug 04 04:33:53.617271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1192/2409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:53 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:53.653535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:53.655144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:53.680403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:53.681617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:53.682875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:53.683537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:53.938162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-30aab1c7-42e0-42be-a993-4d9ef63aa10e req-af3b5e5f-e042-4f34-9db1-148e3f59167d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a2f759-f92a-4b9f-9090-55d1bcb5e93c", "tag": "c9fb860f-4c14-48d6-baeb-38e2d6865112"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:53.953867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-30aab1c7-42e0-42be-a993-4d9ef63aa10e req-af3b5e5f-e042-4f34-9db1-148e3f59167d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:53.956030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-30aab1c7-42e0-42be-a993-4d9ef63aa10e req-af3b5e5f-e042-4f34-9db1-148e3f59167d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:53.969782 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-30aab1c7-42e0-42be-a993-4d9ef63aa10e req-af3b5e5f-e042-4f34-9db1-148e3f59167d service nova] Creating event network-changed:c9fb860f-4c14-48d6-baeb-38e2d6865112 for instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c on n-h1-851337-5 Aug 04 04:33:53.976526 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-30aab1c7-42e0-42be-a993-4d9ef63aa10e req-af3b5e5f-e042-4f34-9db1-148e3f59167d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199151 Aug 04 04:33:53.977847 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1193/2410] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:54.325510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:54.341025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb0ff0ef-e262-4e04-a37d-839eb15ee655 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1677 microversion: 2.1 time: 0.692605 Aug 04 04:33:54.343036 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1218/2411] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:53 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1677 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:54.638100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:54.640921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:54.654824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:54.655601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:54.656891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:54.657487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:54.843246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-72bb01a2-4587-4e85-87a0-574ec6481f9c req-20b71567-1577-455d-8a53-f7b00969b887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053480ad-ee22-4a8d-afed-82851e4a1031", "tag": "cca1001f-3ae0-47cd-9aaa-5085d44709bc"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:54.872702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-72bb01a2-4587-4e85-87a0-574ec6481f9c req-20b71567-1577-455d-8a53-f7b00969b887 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:54.873334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-72bb01a2-4587-4e85-87a0-574ec6481f9c req-20b71567-1577-455d-8a53-f7b00969b887 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:54.902188 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-72bb01a2-4587-4e85-87a0-574ec6481f9c req-20b71567-1577-455d-8a53-f7b00969b887 service nova] Creating event network-changed:cca1001f-3ae0-47cd-9aaa-5085d44709bc for instance 053480ad-ee22-4a8d-afed-82851e4a1031 on n-h2-851337-5 Aug 04 04:33:54.911536 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-72bb01a2-4587-4e85-87a0-574ec6481f9c req-20b71567-1577-455d-8a53-f7b00969b887 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072332 Aug 04 04:33:54.912287 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1219/2412] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:54.924661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:54.960250 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8240270d-4319-4ff4-afd7-5c6a8036b428 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1276 microversion: 2.1 time: 0.325008 Aug 04 04:33:54.964264 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1194/2413] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:54 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:55.368497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:55.369136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:55.385527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:55.385981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:55.390924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:55.391384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:55.988433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:55.989123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:56.006035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:56.006503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:56.008120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:56.008766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:56.285365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:56.294554 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-681dd5da-e9ef-424b-a286-0f5a307da779 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.930825 Aug 04 04:33:56.295640 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1220/2414] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:55 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:56.311244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d4f8736a-281e-464f-a6b9-b24c78931761 req-2355ecb0-6159-4960-8cae-90c6e2bd825a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8fd1c8-1f4c-4432-b1a9-f40552373469", "tag": "25cb0cbd-d68d-4fc3-8c68-fd4a5db49437"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:56.330931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d4f8736a-281e-464f-a6b9-b24c78931761 req-2355ecb0-6159-4960-8cae-90c6e2bd825a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:56.331419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d4f8736a-281e-464f-a6b9-b24c78931761 req-2355ecb0-6159-4960-8cae-90c6e2bd825a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:56.345763 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d4f8736a-281e-464f-a6b9-b24c78931761 req-2355ecb0-6159-4960-8cae-90c6e2bd825a service nova] Creating event network-changed:25cb0cbd-d68d-4fc3-8c68-fd4a5db49437 for instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 on n-h1-851337-5 Aug 04 04:33:56.360862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d4f8736a-281e-464f-a6b9-b24c78931761 req-2355ecb0-6159-4960-8cae-90c6e2bd825a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061957 Aug 04 04:33:56.363400 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1221/2415] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:56.661052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:56.681459 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b18e8f57-e204-41db-959d-36cfea05e583 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.692463 Aug 04 04:33:56.699429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1195/2416] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:55 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:57.707804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:57.708559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:57.714986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:57.715603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:57.716381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:57.716815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:58.020274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:58.042634 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-47c946ae-4f34-420d-b4dd-2219a6652a65 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.340428 Aug 04 04:33:58.043676 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1222/2417] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:57 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:58.386088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b3451f8b-8f3e-4a06-821e-c69a5f666a91 req-9d716055-4ff1-4d04-ab73-9fd4ae728d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201bbcd7-9bff-44bc-89a5-27960b085fa5", "tag": "11dc6ef6-c275-46de-970c-e3b58ce829d2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:58.431615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b3451f8b-8f3e-4a06-821e-c69a5f666a91 req-9d716055-4ff1-4d04-ab73-9fd4ae728d98 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:58.431615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b3451f8b-8f3e-4a06-821e-c69a5f666a91 req-9d716055-4ff1-4d04-ab73-9fd4ae728d98 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:58.448936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b3451f8b-8f3e-4a06-821e-c69a5f666a91 req-9d716055-4ff1-4d04-ab73-9fd4ae728d98 service nova] Creating event network-changed:11dc6ef6-c275-46de-970c-e3b58ce829d2 for instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 on n-h1-851337-5 Aug 04 04:33:58.455314 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b3451f8b-8f3e-4a06-821e-c69a5f666a91 req-9d716055-4ff1-4d04-ab73-9fd4ae728d98 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073305 Aug 04 04:33:58.456257 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1196/2418] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:59.067373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:59.074112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:33:59.084072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:59.084532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:59.085796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:33:59.086243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:33:59.374579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:33:59.418680 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6c69ae8-9365-4f26-be6b-eeff3fdd47fc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.355953 Aug 04 04:33:59.423633 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1223/2419] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:33:59 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:00.444680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:00.445520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:00.448918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:00.449642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=32 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:00.457894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:00.458387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:00.459307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:00.459960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:00.742620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:00.753689 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e2098505-131a-4b01-a9f1-df5396017574 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.313813 Aug 04 04:34:00.755455 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1197/2420] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:00 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:01.777914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:01.779361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:01.793120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:01.793853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:01.794931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:01.795534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:02.037794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:02.046415 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e32a7b97-a15e-43f8-80cc-b6c8b7097841 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.273301 Aug 04 04:34:02.047400 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1224/2421] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:01 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:03.068234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:03.069569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:03.078584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:03.079077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:03.079970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:03.080544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:03.085165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:03.140667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-90349af0-7206-4d60-b7ae-c4a2ce3c5f91 req-0cb4c7df-56c5-4a0d-9dcc-a42d4f783524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8fd1c8-1f4c-4432-b1a9-f40552373469", "name": "network-vif-plugged", "status": "completed", "tag": "25cb0cbd-d68d-4fc3-8c68-fd4a5db49437"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:03.155108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90349af0-7206-4d60-b7ae-c4a2ce3c5f91 req-0cb4c7df-56c5-4a0d-9dcc-a42d4f783524 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:03.156131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90349af0-7206-4d60-b7ae-c4a2ce3c5f91 req-0cb4c7df-56c5-4a0d-9dcc-a42d4f783524 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:03.168026 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-90349af0-7206-4d60-b7ae-c4a2ce3c5f91 req-0cb4c7df-56c5-4a0d-9dcc-a42d4f783524 service nova] Creating event network-vif-plugged:25cb0cbd-d68d-4fc3-8c68-fd4a5db49437 for instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 on n-h1-851337-5 Aug 04 04:34:03.173811 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-90349af0-7206-4d60-b7ae-c4a2ce3c5f91 req-0cb4c7df-56c5-4a0d-9dcc-a42d4f783524 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037878 Aug 04 04:34:03.174667 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1225/2422] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:03.419711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:03.433013 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a3dab50a-d5fe-4ef9-a904-0fd2955c96a8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.368771 Aug 04 04:34:03.433617 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1198/2423] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:03 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:04.458662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:04.460082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:04.473240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:04.474617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:04.475708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:04.476318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:04.499212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-172ca451-fc60-4850-a97b-ab01f30a077f tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] Calling method '.version_select at 0x7f191ab65160>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:04.499841 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:34:04.499841 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:34:04.554717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-172ca451-fc60-4850-a97b-ab01f30a077f tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.235473 Aug 04 04:34:04.563894 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1226/2424] 10.222.0.69 () {60 vars in 1226 bytes} [Thu Aug 4 04:34:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:34:04.581939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-950ff255-7f6d-41a3-9def-723e615e9471 tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] Action: 'update', calling method: .version_select at 0x7f191a853700>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:04.589184 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:34:04.589184 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:34:04.714655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=7,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:04.782814 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-950ff255-7f6d-41a3-9def-723e615e9471 tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.208873 Aug 04 04:34:04.783845 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1227/2425] 10.222.0.69 () {62 vars in 1247 bytes} [Thu Aug 4 04:34:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:34:04.789321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:04.795693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-69da0560-cc2e-4a25-82a8-4be1c3b28e0b tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] Calling method '.version_select at 0x7f191a1905e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:04.796415 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21526b4f-33fb-4d7b-ba8e-0266baf843a4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.345424 Aug 04 04:34:04.810256 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1199/2426] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:04 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:04.822535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-69da0560-cc2e-4a25-82a8-4be1c3b28e0b tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.031158 Aug 04 04:34:04.823354 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1228/2427] 10.222.0.69 () {60 vars in 1226 bytes} [Thu Aug 4 04:34:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:34:04.834582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-61251594-88f3-49dc-84c1-82f5eb6a4b4f tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] Action: 'update', calling method: .version_select at 0x7f19239b7670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:04.837667 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:34:04.837667 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:34:04.883927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=88,nova_api:UPDATE=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:04.920682 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-61251594-88f3-49dc-84c1-82f5eb6a4b4f tempest-QuotaClassesAdmin257Test-174225995 tempest-QuotaClassesAdmin257Test-174225995-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.089840 Aug 04 04:34:04.929826 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1200/2428] 10.222.0.69 () {62 vars in 1247 bytes} [Thu Aug 4 04:34:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:34:05.823122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:05.824025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:05.838995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:05.840176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:05.846030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:05.846511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:06.064077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:06.074126 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-26cf5689-8ea3-4c18-adb7-403e93d40a20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.258040 Aug 04 04:34:06.077585 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1229/2429] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:05 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:06.501491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1504313012", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:06.568541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] validate_networks() for [('355f85b0-0313-4831-9b8a-d67cb7fdd943', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:07.096969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:07.097581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:07.105761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:07.107863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:07.110470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:07.112216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:07.254721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:07.255373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:07.257458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:07.257972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:07.258341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:07.272604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:07.273066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:07.274077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:07.275369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:07.300717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Getting quotas for project b25dc421755047c9b6379791a2a726ed. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:07.307866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Getting quotas for user 5ba43983f86b4419aa7326e9c74e4457 and project b25dc421755047c9b6379791a2a726ed. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:07.312504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:07.321828 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-58b8e993-0633-4037-941c-9edb294871b4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.228591 Aug 04 04:34:07.327883 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1230/2430] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:07 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:07.334624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:07.338227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:07.387255 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-31665625-0042-43c7-8248-e358711e230e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.040327 Aug 04 04:34:07.388150 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1201/2431] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:34:07.400110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c6717cd-fcc7-4571-9df7-9ea1121146f1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:07.401019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c6717cd-fcc7-4571-9df7-9ea1121146f1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:07.469085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6c6717cd-fcc7-4571-9df7-9ea1121146f1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:07.480997 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c6717cd-fcc7-4571-9df7-9ea1121146f1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1223 microversion: 2.1 time: 0.084964 Aug 04 04:34:07.481967 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1231/2432] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:07 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:08.197566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9c147669-8d6a-4d93-9227-773fed7a3aa5 req-856a4a17-b243-4eb1-9daf-9b058850d03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201bbcd7-9bff-44bc-89a5-27960b085fa5", "name": "network-vif-plugged", "status": "completed", "tag": "11dc6ef6-c275-46de-970c-e3b58ce829d2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:08.217528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9c147669-8d6a-4d93-9227-773fed7a3aa5 req-856a4a17-b243-4eb1-9daf-9b058850d03d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:08.218512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9c147669-8d6a-4d93-9227-773fed7a3aa5 req-856a4a17-b243-4eb1-9daf-9b058850d03d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:08.238789 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9c147669-8d6a-4d93-9227-773fed7a3aa5 req-856a4a17-b243-4eb1-9daf-9b058850d03d service nova] Creating event network-vif-plugged:11dc6ef6-c275-46de-970c-e3b58ce829d2 for instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 on n-h1-851337-5 Aug 04 04:34:08.247879 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9c147669-8d6a-4d93-9227-773fed7a3aa5 req-856a4a17-b243-4eb1-9daf-9b058850d03d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066148 Aug 04 04:34:08.248888 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1202/2433] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:08.348557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:08.349355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:08.357927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:08.358622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:08.360927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:08.361561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:08.508428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:08.510516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:08.525632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:08.527257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:08.530581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:08.531237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:08.565837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:08.580312 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cde96fd9-a951-4786-aa86-4474a9d9adfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.237930 Aug 04 04:34:08.594551 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1232/2434] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:08 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:08.646270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:08.655642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fed482d0-96e1-4f3d-9cb7-e9ac4cea245e tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1275 microversion: 2.1 time: 0.157553 Aug 04 04:34:08.674489 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1203/2435] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:08 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:09.024003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-933557880", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:09.087041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:09.400974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:09.401546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:09.401880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:09.402298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:09.402721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:09.412807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:09.413826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:09.415142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:09.416304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:09.436337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Getting quotas for project 7f160af08e0c453ebcaba72e90fd959d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:09.455675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Getting quotas for user ffcedb7d0446478fb0290b06bc66ea0a and project 7f160af08e0c453ebcaba72e90fd959d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:09.480799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:09.484836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:09.557262 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ad9bcb9-7822-4f00-87e4-b93a2e30c1bd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689011 Aug 04 04:34:09.557935 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1233/2436] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:34:09.604090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:09.604752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:09.612436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:09.614093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:09.614941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:09.615405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:09.644714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1307735608", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:09.739310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:10.113043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:10.123267 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9275c3d6-c235-4dc1-84fe-8e4b3c28619d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1318 microversion: 2.1 time: 0.525448 Aug 04 04:34:10.140198 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1204/2437] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:09 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:10.146543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:10.147598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:10.157958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:10.158908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:10.160682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:10.161400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:10.358749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:10.359801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:10.361507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:10.362216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:10.362842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:10.383479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:10.385407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:10.386779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:10.387470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:10.419706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Getting quotas for project 7f160af08e0c453ebcaba72e90fd959d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:10.435206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Getting quotas for user ffcedb7d0446478fb0290b06bc66ea0a and project 7f160af08e0c453ebcaba72e90fd959d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:10.438205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:10.448928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec0e85d8-9682-4812-82bc-11fa9e457ab9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1323 microversion: 2.1 time: 0.306490 Aug 04 04:34:10.454062 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1205/2438] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:10 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1323 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:10.470210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:10.474147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:10.574146 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73afab76-4327-4ca8-bb5e-2ab93636f740 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934978 Aug 04 04:34:10.575449 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1234/2439] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:34:10.596680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6ab85ab4-467d-48af-b88c-9a9905a070ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:10.597308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6ab85ab4-467d-48af-b88c-9a9905a070ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:10.705929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6ab85ab4-467d-48af-b88c-9a9905a070ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:10.717636 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6ab85ab4-467d-48af-b88c-9a9905a070ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1214 microversion: 2.1 time: 0.134642 Aug 04 04:34:10.718992 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1206/2440] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:10 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:10.836702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ba149e2a-5d21-4889-803d-ce56fbd7b27d req-d919fed4-5fd9-4077-96fd-671a7aaebcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a898849-6e47-44e9-a1db-f703d55ab0ca", "tag": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:10.852236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ba149e2a-5d21-4889-803d-ce56fbd7b27d req-d919fed4-5fd9-4077-96fd-671a7aaebcc8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:10.852966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ba149e2a-5d21-4889-803d-ce56fbd7b27d req-d919fed4-5fd9-4077-96fd-671a7aaebcc8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:10.868759 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ba149e2a-5d21-4889-803d-ce56fbd7b27d req-d919fed4-5fd9-4077-96fd-671a7aaebcc8 service nova] Creating event network-changed:9f67df9f-df80-4ce6-9b68-b9a15fb4db15 for instance 6a898849-6e47-44e9-a1db-f703d55ab0ca on n-h2-851337-5 Aug 04 04:34:10.878621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ba149e2a-5d21-4889-803d-ce56fbd7b27d req-d919fed4-5fd9-4077-96fd-671a7aaebcc8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046201 Aug 04 04:34:10.880317 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1235/2441] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:11.146870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:11.147781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:11.157787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.158826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.159655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.160100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.471433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:11.475044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:11.476652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:11.482574 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f771fe5d-8cf0-48c5-9db2-f6264d5b5c77 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1467 microversion: 2.1 time: 0.340660 Aug 04 04:34:11.485263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.486888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.487945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.488630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.495650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1207/2442] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:11 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1467 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:11.512950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:11.516520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:11.525352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.527055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.528020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.528616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.766443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:11.777066 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8401444b-31cd-4ee3-ab8c-4ba550319454 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1323 microversion: 2.1 time: 0.307279 Aug 04 04:34:11.778542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1236/2443] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:11 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1323 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:11.783614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:11.784724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:11.792221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.792878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.793841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.794425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.799567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:11.807689 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91d8b2be-8976-4914-955f-1dbdf459f653 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1467 microversion: 2.1 time: 0.306742 Aug 04 04:34:11.808284 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1208/2444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:11 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1467 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:11.829713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:11.835459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:11.836622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Searching by: {'reservation_id': 'r-04xr5swx', 'deleted': False, 'project_id': '4eeb2c9400144655abd2a6fc111690a1'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:11.843042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.843745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.844751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:11.845411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:11.869746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:11.879295 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19db210a-fc0a-478f-80a2-4f0691ae822d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1274 microversion: 2.1 time: 0.099279 Aug 04 04:34:11.880005 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1237/2445] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:11 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:11.997079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:34:12.077991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:12.085162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.085621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.224008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4f83cee9-6d44-42c3-aec8-cff0cc75ab37 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?reservation_id=r-04xr5swx" status: 200 len: 2927 microversion: 2.1 time: 0.398328 Aug 04 04:34:12.224648 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1209/2446] 10.222.0.69 () {58 vars in 1197 bytes} [Thu Aug 4 04:34:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-04xr5swx => generated 2927 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:12.247135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8802e868-830b-41c4-b49a-889b0368013d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:12.273197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.server_groups [None req-8802e868-830b-41c4-b49a-889b0368013d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Querying cell 252fd515-9666-4464-b81b-0a319b17989b(cell1) for 2 instances {{(pid=119343) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 04:34:12.274000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8802e868-830b-41c4-b49a-889b0368013d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.274478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8802e868-830b-41c4-b49a-889b0368013d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.308089 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8802e868-830b-41c4-b49a-889b0368013d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/562feb62-c0fd-48ba-ae01-05a37d8f321b" status: 200 len: 265 microversion: 2.1 time: 0.065223 Aug 04 04:34:12.314078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1238/2447] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:34:12 2022] GET /compute/v2.1/os-server-groups/562feb62-c0fd-48ba-ae01-05a37d8f321b => generated 265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:12.319543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-839dfdcc-38c5-46af-9aff-452365b93dc5 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:12.320176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-839dfdcc-38c5-46af-9aff-452365b93dc5 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:12.327511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-839dfdcc-38c5-46af-9aff-452365b93dc5 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.327993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-839dfdcc-38c5-46af-9aff-452365b93dc5 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.328767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-839dfdcc-38c5-46af-9aff-452365b93dc5 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.329203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-839dfdcc-38c5-46af-9aff-452365b93dc5 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.488083 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-839dfdcc-38c5-46af-9aff-452365b93dc5 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 200 len: 1618 microversion: 2.1 time: 0.172121 Aug 04 04:34:12.491198 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1210/2448] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:12 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 1618 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:12.508207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02e83557-5404-44ee-b801-9e2de408b1db tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:12.509578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02e83557-5404-44ee-b801-9e2de408b1db tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:12.517835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02e83557-5404-44ee-b801-9e2de408b1db tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.518289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02e83557-5404-44ee-b801-9e2de408b1db tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.519112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02e83557-5404-44ee-b801-9e2de408b1db tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.519603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02e83557-5404-44ee-b801-9e2de408b1db tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.647300 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02e83557-5404-44ee-b801-9e2de408b1db tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1618 microversion: 2.1 time: 0.142799 Aug 04 04:34:12.647877 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1239/2449] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:12 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1618 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:12.670610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04bd1b3d-c4e9-4b15-bc43-eabdba921f86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: .version_select at 0x7f192398d4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1641914661", "policies": ["anti-affinity"]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:12.688934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-04bd1b3d-c4e9-4b15-bc43-eabdba921f86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:12.694751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-04bd1b3d-c4e9-4b15-bc43-eabdba921f86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:12.741554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-04bd1b3d-c4e9-4b15-bc43-eabdba921f86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:12.755567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-04bd1b3d-c4e9-4b15-bc43-eabdba921f86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_groups'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:12.777615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04bd1b3d-c4e9-4b15-bc43-eabdba921f86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.110825 Aug 04 04:34:12.790549 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1211/2450] 10.222.0.69 () {60 vars in 1174 bytes} [Thu Aug 4 04:34:12 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:12.806880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:12.807816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:12.818583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.819413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.822592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.823563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.904966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:12.906538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:12.916624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.917085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:12.917880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:12.918321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:13.015485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:13.024814 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6afbe95-43eb-4f86-b322-52221578084b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1272 microversion: 2.1 time: 0.126010 Aug 04 04:34:13.025426 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1212/2451] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:12 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:13.030273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1628715758", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f4c066ee-7b13-425c-a0f7-73b7afe79f5b"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:13.085494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:13.177095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:13.184926 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3259d8f9-2aa3-4b15-a723-2e6fc6b919de tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1323 microversion: 2.1 time: 0.386517 Aug 04 04:34:13.185878 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1240/2452] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:12 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:13.493839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:13.496451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:13.496981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:13.498208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:13.498659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:13.526785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:13.527960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:13.528857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:13.529649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:13.549506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:13.555060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:13.568682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Going to run 2 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:13.571771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:13.624755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:13.630461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:13.640785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:13.671319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:13.677781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:13.693771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=befaf1fe-e808-4131-9095-62f7f88d7fcf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:13.741791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:13.747879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:13.784245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:13.790318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:13.827300 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1abe8595-fe2e-474d-9818-074fb6ec1ce8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.800337 Aug 04 04:34:13.828262 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1213/2453] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:34:13.836032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:13.841467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:13.842275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Searching by: {'deleted': False, 'project_id': '4eeb2c9400144655abd2a6fc111690a1'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:13.860738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:13.861448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:13.862258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:13.862694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:13.892707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:34:13.960857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c66ff8ad-79ef-4034-a5f3-e2a9befa6eb5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.128592 Aug 04 04:34:13.961649 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1241/2454] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:34:13 2022] GET /compute/v2.1/servers => generated 1663 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:13.975708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5911027e-c2b5-4a81-9e61-8376fa03ef47 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:13.976338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5911027e-c2b5-4a81-9e61-8376fa03ef47 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:14.036935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5911027e-c2b5-4a81-9e61-8376fa03ef47 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:14.047656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:14.048523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:14.054773 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5911027e-c2b5-4a81-9e61-8376fa03ef47 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1219 microversion: 2.1 time: 0.083687 Aug 04 04:34:14.055737 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1214/2455] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:13 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:14.063006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:14.063491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:14.064340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:14.064777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:14.084106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:14.136772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:14.146625 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-884f319c-57b4-43cd-804e-4e04a2b14590 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1272 microversion: 2.1 time: 0.102952 Aug 04 04:34:14.147578 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1242/2456] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:14 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:14.205575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:14.206417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:14.207752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9b740fd0-711d-4cf1-9581-7ce665552215 req-5d4d03e6-99b8-425a-8644-7a63e9a4486c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5633ea-df6b-404c-90e8-611d4a40f753", "tag": "a1864dde-7a45-41ae-93e7-81d73b54d4ad"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:14.216760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:14.224915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:14.226201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:14.226621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:14.241678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b740fd0-711d-4cf1-9581-7ce665552215 req-5d4d03e6-99b8-425a-8644-7a63e9a4486c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:14.242613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b740fd0-711d-4cf1-9581-7ce665552215 req-5d4d03e6-99b8-425a-8644-7a63e9a4486c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:14.266577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9b740fd0-711d-4cf1-9581-7ce665552215 req-5d4d03e6-99b8-425a-8644-7a63e9a4486c service nova] Creating event network-changed:a1864dde-7a45-41ae-93e7-81d73b54d4ad for instance 3b5633ea-df6b-404c-90e8-611d4a40f753 on n-h2-851337-5 Aug 04 04:34:14.277499 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9b740fd0-711d-4cf1-9581-7ce665552215 req-5d4d03e6-99b8-425a-8644-7a63e9a4486c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072345 Aug 04 04:34:14.279316 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1243/2457] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:14.416254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:14.426548 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e39f9164-c3f2-4b10-929d-2928f4de06b9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1323 microversion: 2.1 time: 0.224677 Aug 04 04:34:14.427960 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1215/2458] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:14 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:15.079983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:15.080982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:15.108176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:15.109094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:15.110220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:15.113596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:15.180603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:15.181555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:15.206477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:15.206932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:15.207748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:15.208966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:15.236984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:15.246175 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e2b93a6a-bc48-4b8f-9f25-b957bf6d40d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1271 microversion: 2.1 time: 0.173060 Aug 04 04:34:15.247347 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1244/2459] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:15 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:15.380208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:15.389952 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-383b2375-16bc-44cc-ab2b-a275ccf37d96 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.223642 Aug 04 04:34:15.390774 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1216/2460] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:15 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:15.452137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:15.453249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:15.463183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:15.464019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:15.465240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:15.466116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:15.662881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:15.682775 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9cd1567d-66ab-4465-a67d-a68770dedd8b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1323 microversion: 2.1 time: 0.236426 Aug 04 04:34:15.685238 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1245/2461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:15 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:16.269362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:16.270601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:16.279458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.280230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:16.281213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.281622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:16.325945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e68339d9-b551-4dee-a214-640074339f18 req-a85f56bc-da8e-4a72-a605-73e48693afd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43008e9e-a99a-4c9e-8b02-cd63ed953c92", "tag": "a3ba4f75-0fb7-4263-a888-2feea399279a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:16.344023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e68339d9-b551-4dee-a214-640074339f18 req-a85f56bc-da8e-4a72-a605-73e48693afd4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.344462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e68339d9-b551-4dee-a214-640074339f18 req-a85f56bc-da8e-4a72-a605-73e48693afd4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:16.361225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e68339d9-b551-4dee-a214-640074339f18 req-a85f56bc-da8e-4a72-a605-73e48693afd4 service nova] Creating event network-changed:a3ba4f75-0fb7-4263-a888-2feea399279a for instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 on n-h2-851337-5 Aug 04 04:34:16.366647 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e68339d9-b551-4dee-a214-640074339f18 req-a85f56bc-da8e-4a72-a605-73e48693afd4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044957 Aug 04 04:34:16.367724 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1246/2462] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:16.414004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:16.414787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:16.425707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.427237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:16.428292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.429640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:16.456645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:16.468836 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6ba1cae-e2e7-4d51-b6e1-c5446ad16c9c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1277 microversion: 2.1 time: 0.203152 Aug 04 04:34:16.482066 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1217/2463] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:16 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:16.490910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8b896c88-4952-45c4-830c-49b5b309a4f8 req-f0fe8624-4fc5-42d8-aa68-f0858598a8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a898849-6e47-44e9-a1db-f703d55ab0ca", "name": "network-vif-plugged", "status": "completed", "tag": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:16.506270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8b896c88-4952-45c4-830c-49b5b309a4f8 req-f0fe8624-4fc5-42d8-aa68-f0858598a8d1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.506993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8b896c88-4952-45c4-830c-49b5b309a4f8 req-f0fe8624-4fc5-42d8-aa68-f0858598a8d1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:16.526890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8b896c88-4952-45c4-830c-49b5b309a4f8 req-f0fe8624-4fc5-42d8-aa68-f0858598a8d1 service nova] Creating event network-vif-plugged:9f67df9f-df80-4ce6-9b68-b9a15fb4db15 for instance 6a898849-6e47-44e9-a1db-f703d55ab0ca on n-h2-851337-5 Aug 04 04:34:16.534056 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8b896c88-4952-45c4-830c-49b5b309a4f8 req-f0fe8624-4fc5-42d8-aa68-f0858598a8d1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049397 Aug 04 04:34:16.534874 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1218/2464] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:16.704696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:16.705528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:16.719185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.719899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:16.720895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:16.721573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:17.297607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:17.320938 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb0bf446-242d-414a-a4fe-ca5424e9f073 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.911913 Aug 04 04:34:17.338468 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1247/2465] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:16 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:17.488295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:17.491556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:17.492444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:17.497034 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2825c2f3-efaa-49b8-b5ff-eb81cd19d867 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1323 microversion: 2.1 time: 0.796998 Aug 04 04:34:17.500284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:17.500991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:17.502056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:17.502707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:17.507602 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1219/2466] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:16 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1323 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:17.741725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:17.751445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b50dbb37-9561-4bcd-8889-0441b511a0e4 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.263693 Aug 04 04:34:17.752194 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1248/2467] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:17 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:18.367977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:18.369627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:18.398400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:18.399991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:18.400982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:18.404148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:18.416674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-cfb8c39f-7f47-49ec-8fcb-c8f2d7f5c7a8 req-d2997d90-4972-4a91-8a8d-379d19a5aebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d1e5ff-6a76-4261-9402-1b9ffc757620", "tag": "e8e9d2cb-05e5-4275-9352-a62a980231d9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:18.443318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cfb8c39f-7f47-49ec-8fcb-c8f2d7f5c7a8 req-d2997d90-4972-4a91-8a8d-379d19a5aebd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:18.443800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cfb8c39f-7f47-49ec-8fcb-c8f2d7f5c7a8 req-d2997d90-4972-4a91-8a8d-379d19a5aebd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:18.488919 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-cfb8c39f-7f47-49ec-8fcb-c8f2d7f5c7a8 req-d2997d90-4972-4a91-8a8d-379d19a5aebd service nova] Creating event network-changed:e8e9d2cb-05e5-4275-9352-a62a980231d9 for instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 on n-h1-851337-5 Aug 04 04:34:18.498392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-cfb8c39f-7f47-49ec-8fcb-c8f2d7f5c7a8 req-d2997d90-4972-4a91-8a8d-379d19a5aebd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090587 Aug 04 04:34:18.501807 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1249/2468] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 04:34:18.522798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:18.523872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:18.531162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:18.531620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:18.532412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:18.532854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:18.706224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:18.712462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:18.720885 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e146c400-fb6f-4d52-a399-05ff5ee99384 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.375629 Aug 04 04:34:18.722746 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1220/2469] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:18 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:18.770550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:18.774142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:18.775683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:18.783924 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cca2f2c3-0839-4d70-bc2b-e646ee2f33e7 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1323 microversion: 2.1 time: 0.265340 Aug 04 04:34:18.784284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:18.784894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:18.785891 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1250/2470] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:18 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:18.794686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:18.795566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:18.980601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:18.990363 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f34e4062-038f-4320-bd71-ac9229bb5201 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.220996 Aug 04 04:34:18.991042 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1221/2471] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:18 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:19.742207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:19.742983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:19.750607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:19.751137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:19.751941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:19.752542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:19.807733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:19.808578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:19.817397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:19.818259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:19.819464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:19.820099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.047079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:20.055171 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dcb85fd5-24fd-4c1d-a9ff-ad470ace24d8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.316801 Aug 04 04:34:20.056419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1251/2472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:19 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:20.073937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:20.074639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:20.080767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.081293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.082140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.082654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.103519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:20.111432 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e7ba3eac-f4b7-4f1c-b7e2-275ca48d44bf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1517 microversion: 2.1 time: 0.309098 Aug 04 04:34:20.112797 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1222/2473] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:19 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1517 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:20.132818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:20.135278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:20.143190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.143664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.144427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.144869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.170467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lazy-loading 'flavor' on Instance uuid 6a898849-6e47-44e9-a1db-f703d55ab0ca {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:34:20.284680 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-06f8fe54-f0ce-4e89-8d63-19d0a85ea178 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action" status: 200 len: 32 microversion: 2.1 time: 0.155820 Aug 04 04:34:20.285632 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1223/2474] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:34:20 2022] POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:34:20.297033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:20.297752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:20.306603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.307149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.307949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.308622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.331992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:20.342873 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c96e24d2-b96f-4029-8b45-26dbbdfbab20 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.273235 Aug 04 04:34:20.344636 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1252/2475] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:20 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:20.533634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:20.548703 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b01508f-c63f-4585-8734-fadecf2c819b tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.256486 Aug 04 04:34:20.549620 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1224/2476] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:20 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:20.604599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c46df3fa-5896-494e-a856-5c831066791a req-58340521-be13-4f05-8837-d540992ae473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befaf1fe-e808-4131-9095-62f7f88d7fcf", "tag": "a3079d91-bcf9-440c-ae65-3ceed02eeeba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:20.620987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:20.631158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ce3eecba-62fc-484e-b2d9-e78d0ad82dc7 req-cad260ca-0dd6-457c-988e-a2d02ff2ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5633ea-df6b-404c-90e8-611d4a40f753", "name": "network-vif-plugged", "status": "completed", "tag": "a1864dde-7a45-41ae-93e7-81d73b54d4ad"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:20.636413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c46df3fa-5896-494e-a856-5c831066791a req-58340521-be13-4f05-8837-d540992ae473 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.644102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c46df3fa-5896-494e-a856-5c831066791a req-58340521-be13-4f05-8837-d540992ae473 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.650904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ce3eecba-62fc-484e-b2d9-e78d0ad82dc7 req-cad260ca-0dd6-457c-988e-a2d02ff2ede7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:20.651487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ce3eecba-62fc-484e-b2d9-e78d0ad82dc7 req-cad260ca-0dd6-457c-988e-a2d02ff2ede7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:20.673723 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c46df3fa-5896-494e-a856-5c831066791a req-58340521-be13-4f05-8837-d540992ae473 service nova] Creating event network-changed:a3079d91-bcf9-440c-ae65-3ceed02eeeba for instance befaf1fe-e808-4131-9095-62f7f88d7fcf on n-h2-851337-5 Aug 04 04:34:20.678145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ce3eecba-62fc-484e-b2d9-e78d0ad82dc7 req-cad260ca-0dd6-457c-988e-a2d02ff2ede7 service nova] Creating event network-vif-plugged:a1864dde-7a45-41ae-93e7-81d73b54d4ad for instance 3b5633ea-df6b-404c-90e8-611d4a40f753 on n-h2-851337-5 Aug 04 04:34:20.681595 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c46df3fa-5896-494e-a856-5c831066791a req-58340521-be13-4f05-8837-d540992ae473 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079461 Aug 04 04:34:20.682788 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1253/2477] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:20.697484 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ce3eecba-62fc-484e-b2d9-e78d0ad82dc7 req-cad260ca-0dd6-457c-988e-a2d02ff2ede7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070411 Aug 04 04:34:20.698274 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1225/2478] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:21.077358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:21.078285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:21.087454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:21.088164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:21.089235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:21.089683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:21.303023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:21.310827 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ca163dba-04f7-4ca7-9d8b-74b9d426cb88 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.238091 Aug 04 04:34:21.311477 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1254/2479] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:21 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:21.366506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:21.367233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:21.373540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:21.373991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:21.374761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:21.375228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:21.516753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:21.524842 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd805011-e71c-4347-93ea-43462daac792 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.163352 Aug 04 04:34:21.525428 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1226/2480] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:21 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:21.569273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:21.569888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:21.576062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:21.576511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:21.577278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:21.577715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:21.715523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:21.723069 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4fd8cbfa-e87b-44ad-af0b-1d9a135bc3f4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.157680 Aug 04 04:34:21.723643 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1255/2481] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:21 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:22.331915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:22.332538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:22.339291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:22.339749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:22.340534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:22.340975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:22.474528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:22.482690 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9780f48f-aa28-4f63-a61d-8fbeb053dc9e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.154692 Aug 04 04:34:22.483315 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1227/2482] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:22 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:22.545792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:22.546538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:22.553733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:22.554175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:22.554971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:22.555414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:22.699040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:22.707251 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4439f886-7d59-4c67-8928-9e64c0d89745 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.165318 Aug 04 04:34:22.708036 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1256/2483] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:22 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:22.724999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f5bd1a8a-cc17-48a8-8c74-1170a719bb4b req-a28a6002-0824-4f6a-8b8f-fde56a7e6b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43008e9e-a99a-4c9e-8b02-cd63ed953c92", "name": "network-vif-plugged", "status": "completed", "tag": "a3ba4f75-0fb7-4263-a888-2feea399279a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:22.734803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f5bd1a8a-cc17-48a8-8c74-1170a719bb4b req-a28a6002-0824-4f6a-8b8f-fde56a7e6b6b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:22.735297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f5bd1a8a-cc17-48a8-8c74-1170a719bb4b req-a28a6002-0824-4f6a-8b8f-fde56a7e6b6b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:22.744783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:22.745411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:22.747911 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f5bd1a8a-cc17-48a8-8c74-1170a719bb4b req-a28a6002-0824-4f6a-8b8f-fde56a7e6b6b service nova] Creating event network-vif-plugged:a3ba4f75-0fb7-4263-a888-2feea399279a for instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 on n-h2-851337-5 Aug 04 04:34:22.751702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:22.752203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:22.752994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:22.753433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:22.760914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f5bd1a8a-cc17-48a8-8c74-1170a719bb4b req-a28a6002-0824-4f6a-8b8f-fde56a7e6b6b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040206 Aug 04 04:34:22.761571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1228/2484] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:22.889857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:22.897541 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ac68ee7-b06b-4727-8fce-5d1ae425fbee tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.157389 Aug 04 04:34:22.898119 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1257/2485] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:22 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:23.505847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:23.507175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:23.515788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:23.516240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:23.517019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:23.517460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:23.539100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:23.729357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:23.730063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:23.734294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:23.737586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:23.744203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:23.744965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:23.746268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:23.747026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:23.751659 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd525569-840b-4303-a4eb-2f72e21a22df tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.251184 Aug 04 04:34:23.752997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1229/2486] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:23 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:23.875052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:23.906751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:23.914606 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c614157b-cbc9-434e-9c94-b38ca0334b02 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.190789 Aug 04 04:34:23.915295 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1258/2487] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:23 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:23.917710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:23.918318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:23.924817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:23.925141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:23.925915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:23.926386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:24.051167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=44 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:24.059085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:24.066438 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7feefc7-5aa9-4284-a282-7178321ac34c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.152513 Aug 04 04:34:24.067099 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1230/2488] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:23 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:24.788073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:24.788693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:24.797302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:24.797761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:24.798549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:24.799014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:24.937356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:24.937990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:24.948357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:24.948995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:24.950719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:24.951958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:24.960386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:24.975295 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e3541149-9c2e-4507-b8fd-0dc47e6ba05b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1314 microversion: 2.1 time: 0.190901 Aug 04 04:34:24.976337 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1259/2489] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:24 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:25.088269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:25.089076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:25.095808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:25.096273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:25.097062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:25.097506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:25.101832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:25.110133 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b2fc00e-95a0-4ae7-8697-bbcb9f33932b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.177682 Aug 04 04:34:25.110856 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1231/2490] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:24 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:25.235422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:25.243708 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95ac253a-5f11-45d1-b3e2-6300f6b6b154 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.159864 Aug 04 04:34:25.244313 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1260/2491] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:25 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:25.998385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:25.999025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:26.005666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.006149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.006919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.007399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.131391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:26.132028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:26.138947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.139426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.140208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.140646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.149391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:26.156987 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-533dde1d-728c-4d65-924f-55066a0a4260 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1464 microversion: 2.1 time: 0.162682 Aug 04 04:34:26.157567 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1232/2492] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:25 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:26.177211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:26.177823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:26.184562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.185014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.185799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.186232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.325391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:26.328825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:26.333670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36fa7317-ee03-4380-8053-9b08ddbe63e3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.206295 Aug 04 04:34:26.334408 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1261/2493] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:26 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:26.339299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:26.339905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:26.345849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.346615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.347426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.347864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.357091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:26.365242 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a925716b-1dc5-492a-be49-2ac1dbe8713b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1463 microversion: 2.1 time: 0.191821 Aug 04 04:34:26.365914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1233/2494] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:26 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1463 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:26.427402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-887277034", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3b5633ea-df6b-404c-90e8-611d4a40f753"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:26.479531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:26.507676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:26.516212 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-581ea3ee-3090-48c7-936e-aea84019dff4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.180616 Aug 04 04:34:26.516607 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1262/2495] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:26 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:26.716009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:26.716465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:26.717020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:26.717536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:26.718055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:26.728145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.728604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.729444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.729883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.755380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Getting quotas for project 7f160af08e0c453ebcaba72e90fd959d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:26.761290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Getting quotas for user ffcedb7d0446478fb0290b06bc66ea0a and project 7f160af08e0c453ebcaba72e90fd959d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:26.776962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:26.779315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:26.790850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-711d512b-2792-47a3-a76a-9fb536814efd req-6b258a68-4fd3-4b94-aae3-1550c60c3ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befaf1fe-e808-4131-9095-62f7f88d7fcf", "name": "network-vif-plugged", "status": "completed", "tag": "a3079d91-bcf9-440c-ae65-3ceed02eeeba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:26.801863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-711d512b-2792-47a3-a76a-9fb536814efd req-6b258a68-4fd3-4b94-aae3-1550c60c3ab2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:26.802678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-711d512b-2792-47a3-a76a-9fb536814efd req-6b258a68-4fd3-4b94-aae3-1550c60c3ab2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:26.818983 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-711d512b-2792-47a3-a76a-9fb536814efd req-6b258a68-4fd3-4b94-aae3-1550c60c3ab2 service nova] Creating event network-vif-plugged:a3079d91-bcf9-440c-ae65-3ceed02eeeba for instance befaf1fe-e808-4131-9095-62f7f88d7fcf on n-h2-851337-5 Aug 04 04:34:26.824018 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-711d512b-2792-47a3-a76a-9fb536814efd req-6b258a68-4fd3-4b94-aae3-1550c60c3ab2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037766 Aug 04 04:34:26.824817 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1263/2496] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:26.831589 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c905b0fd-16bf-48cb-9e96-03fcbb85a679 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.407872 Aug 04 04:34:26.839384 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1234/2497] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:34:26.854295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27a082ea-ace5-4129-b67d-396e18cba0f7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:26.855373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27a082ea-ace5-4129-b67d-396e18cba0f7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:26.957139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-27a082ea-ace5-4129-b67d-396e18cba0f7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:26.965821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27a082ea-ace5-4129-b67d-396e18cba0f7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1213 microversion: 2.1 time: 0.117052 Aug 04 04:34:26.966419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1264/2498] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:26 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:27.355824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:27.356575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:27.358802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:27.365394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:27.366167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:27.367394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:27.368481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:27.516767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:27.524764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e7dc2fc-4031-46a8-be43-3233b83fe6d0 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.174170 Aug 04 04:34:27.525345 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1235/2499] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:27 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:27.537491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:27.538214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:27.546048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:27.546497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:27.547303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:27.547742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:27.680116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:27.688230 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3445d8ce-1774-4d90-b940-59f83fc372c3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.154593 Aug 04 04:34:27.688796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1265/2500] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:27 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:27.986510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:27.987271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:27.994023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:27.994551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:27.995364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:27.995855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:28.061770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:28.069265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5333a51-200a-4831-99f7-e209e0b66068 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1265 microversion: 2.1 time: 0.087268 Aug 04 04:34:28.069837 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1236/2501] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:27 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:28.546608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:28.547724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:28.556409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:28.556957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:28.558195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:28.558706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:28.713784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:28.714400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:28.722997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:28.723720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:28.724619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:28.725145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:28.745178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:28.832501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:28.842239 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ef35bda-2613-44d6-ad99-3d3858133dfa tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.299755 Aug 04 04:34:28.843133 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1266/2502] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:28 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:28.859706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-517a479c-c262-4c64-928b-4ce0036a33e7 req-bd961c9d-2035-4136-a9b3-2fef83100313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d1e5ff-6a76-4261-9402-1b9ffc757620", "name": "network-vif-plugged", "status": "completed", "tag": "e8e9d2cb-05e5-4275-9352-a62a980231d9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:28.872407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-517a479c-c262-4c64-928b-4ce0036a33e7 req-bd961c9d-2035-4136-a9b3-2fef83100313 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:28.872857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-517a479c-c262-4c64-928b-4ce0036a33e7 req-bd961c9d-2035-4136-a9b3-2fef83100313 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:28.885931 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-517a479c-c262-4c64-928b-4ce0036a33e7 req-bd961c9d-2035-4136-a9b3-2fef83100313 service nova] Creating event network-vif-plugged:e8e9d2cb-05e5-4275-9352-a62a980231d9 for instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 on n-h1-851337-5 Aug 04 04:34:28.892255 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-517a479c-c262-4c64-928b-4ce0036a33e7 req-bd961c9d-2035-4136-a9b3-2fef83100313 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035654 Aug 04 04:34:28.893349 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1267/2503] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:29.002347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:29.011728 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9820f429-1316-4a76-a2a0-6dc1d09303ec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.302795 Aug 04 04:34:29.012827 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1237/2504] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:28 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:29.091160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:29.091878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:29.098221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:29.098681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:29.099490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:29.099937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:29.191879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:29.199637 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87008c35-232f-495c-a8c5-4de755c921e9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1271 microversion: 2.1 time: 0.113170 Aug 04 04:34:29.200201 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1268/2505] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:29 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:29.863953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:29.865343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:29.875124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:29.875574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:29.876720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:29.877191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:30.032549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:30.033216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:30.041344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:30.041799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:30.043834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:30.047458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:30.121364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:30.129698 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f36389cd-a6a7-4688-88a7-b21c9c7b05a6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1319 microversion: 2.1 time: 0.270009 Aug 04 04:34:30.130453 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1238/2506] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:29 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:30.220977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:30.221503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:30.228423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:30.228965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:30.229815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:30.230314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:30.316568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:30.325214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0b84afb-26bf-4c10-9d10-8d67fb35d8dc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.296534 Aug 04 04:34:30.325933 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1269/2507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:30 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:30.445426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2b7a28f5-f130-4478-9662-90f28d2322d4 req-9705522d-5661-4e9b-98cb-b72816fc7993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29", "tag": "0409f697-2f76-477a-88e2-8a9c7ee33e38"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:30.458073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2b7a28f5-f130-4478-9662-90f28d2322d4 req-9705522d-5661-4e9b-98cb-b72816fc7993 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:30.458909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2b7a28f5-f130-4478-9662-90f28d2322d4 req-9705522d-5661-4e9b-98cb-b72816fc7993 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:30.472728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2b7a28f5-f130-4478-9662-90f28d2322d4 req-9705522d-5661-4e9b-98cb-b72816fc7993 service nova] Creating event network-changed:0409f697-2f76-477a-88e2-8a9c7ee33e38 for instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 on n-h2-851337-5 Aug 04 04:34:30.476410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:30.478747 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2b7a28f5-f130-4478-9662-90f28d2322d4 req-9705522d-5661-4e9b-98cb-b72816fc7993 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039367 Aug 04 04:34:30.479796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1270/2508] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:30.486016 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b4d241f-4d7d-49da-b5e0-372e74b0b80a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.268970 Aug 04 04:34:30.487052 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1239/2509] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:30 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:31.136530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a71cb946-2e8c-4f22-9a92-98d81e5a5984 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "299933fb-faf1-47b6-b92a-86bd06b0d872"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:31.138947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a71cb946-2e8c-4f22-9a92-98d81e5a5984 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:31.145200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a71cb946-2e8c-4f22-9a92-98d81e5a5984 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.145648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a71cb946-2e8c-4f22-9a92-98d81e5a5984 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.146414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a71cb946-2e8c-4f22-9a92-98d81e5a5984 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.146944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a71cb946-2e8c-4f22-9a92-98d81e5a5984 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.152886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:31.154047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:31.161437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.161437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.162181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.162622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.345412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:31.355023 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6870b559-50d2-4e07-82e5-6832ea9463d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1469 microversion: 2.1 time: 0.206438 Aug 04 04:34:31.356015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1240/2510] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:31 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:31.360791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:31.361652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:31.368430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.369149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.369937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.370383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.427837 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a71cb946-2e8c-4f22-9a92-98d81e5a5984 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "POST /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296868 Aug 04 04:34:31.428494 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1271/2511] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:34:31 2022] POST /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:31.433957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:31.434831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:31.441655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.442110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.442894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.443368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.565645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:31.573896 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8d4f121-5eba-430b-8a0c-1205719eee2d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.216722 Aug 04 04:34:31.574476 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1241/2512] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:31 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:31.579897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:31.580500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:31.586395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.587402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.588169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.588600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.614884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:31.623737 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b42f5be7-f5df-4fea-ae02-a732eafa5519 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf" status: 200 len: 1467 microversion: 2.1 time: 0.193774 Aug 04 04:34:31.624480 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1272/2513] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:31 2022] GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf => generated 1467 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:31.647255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:31.652977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:31.653919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Searching by: {'reservation_id': 'r-zqnh3l47', 'deleted': False, 'project_id': '4eeb2c9400144655abd2a6fc111690a1'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:31.659324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.659773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.660566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.660999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.725058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:31.733412 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f892dd95-1d2c-40a5-9f23-481b65a17de9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.157904 Aug 04 04:34:31.733994 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1242/2514] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:31 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:31.754157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:34:31.820792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:31.828107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:31.828478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:31.972470 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-255957d7-4819-4498-889e-d72d48f31a2e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?reservation_id=r-zqnh3l47" status: 200 len: 2929 microversion: 2.1 time: 0.328887 Aug 04 04:34:31.973325 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1273/2515] 10.222.0.69 () {58 vars in 1197 bytes} [Thu Aug 4 04:34:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-zqnh3l47 => generated 2929 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:31.996005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3bfc662d-80b5-431b-bedf-5e8b7ded9b1a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:32.013387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.compute.server_groups [None req-3bfc662d-80b5-431b-bedf-5e8b7ded9b1a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Querying cell 252fd515-9666-4464-b81b-0a319b17989b(cell1) for 2 instances {{(pid=119342) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 04:34:32.014282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bfc662d-80b5-431b-bedf-5e8b7ded9b1a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.014735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3bfc662d-80b5-431b-bedf-5e8b7ded9b1a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.046087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3bfc662d-80b5-431b-bedf-5e8b7ded9b1a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/f4c066ee-7b13-425c-a0f7-73b7afe79f5b" status: 200 len: 271 microversion: 2.1 time: 0.054466 Aug 04 04:34:32.046843 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1243/2516] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:34:31 2022] GET /compute/v2.1/os-server-groups/f4c066ee-7b13-425c-a0f7-73b7afe79f5b => generated 271 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:32.057490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f154a97e-6ec1-44c5-a39a-5e18463c40ca tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:32.058123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f154a97e-6ec1-44c5-a39a-5e18463c40ca tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:32.064439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f154a97e-6ec1-44c5-a39a-5e18463c40ca tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.064887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f154a97e-6ec1-44c5-a39a-5e18463c40ca tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.065649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f154a97e-6ec1-44c5-a39a-5e18463c40ca tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.066085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f154a97e-6ec1-44c5-a39a-5e18463c40ca tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.197224 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f154a97e-6ec1-44c5-a39a-5e18463c40ca tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1620 microversion: 2.1 time: 0.143836 Aug 04 04:34:32.198121 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1274/2517] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:32 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1620 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:32.218414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57a27b1a-cd15-40b5-9a80-acf319c127e4 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:32.219686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57a27b1a-cd15-40b5-9a80-acf319c127e4 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:32.226681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57a27b1a-cd15-40b5-9a80-acf319c127e4 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.227609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57a27b1a-cd15-40b5-9a80-acf319c127e4 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.228374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57a27b1a-cd15-40b5-9a80-acf319c127e4 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.228809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57a27b1a-cd15-40b5-9a80-acf319c127e4 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.361636 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57a27b1a-cd15-40b5-9a80-acf319c127e4 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf" status: 200 len: 1618 microversion: 2.1 time: 0.146760 Aug 04 04:34:32.362218 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1244/2518] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:32 2022] GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf => generated 1618 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:32.421693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2120812206", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "11b2c557-2612-4471-bd06-0d27b9416f02"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:32.475492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:32.598641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:32.599551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:32.608095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.608768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.609702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.610456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.730419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:32.730932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:32.731496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:32.731920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:32.732408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:32.742286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.742739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.743603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.744110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.762551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:32.768432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:32.782353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:32.784696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:32.792996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:32.804164 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2f3b3a8-36f7-409f-8f66-c0af61ae9bb8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.211598 Aug 04 04:34:32.813298 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1245/2519] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:32 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:32.813298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:32.813298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:32.818577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.819103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.820460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:32.821543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:32.845276 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35ee0c4a-a0c8-4c8b-aa03-b22838b4130f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.427143 Aug 04 04:34:32.846368 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1275/2520] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:34:32.863290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cfbcbd57-e544-490f-b099-0b4498ede432 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:32.864044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cfbcbd57-e544-490f-b099-0b4498ede432 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:33.002614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cfbcbd57-e544-490f-b099-0b4498ede432 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:33.016081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cfbcbd57-e544-490f-b099-0b4498ede432 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1217 microversion: 2.1 time: 0.157744 Aug 04 04:34:33.018128 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1276/2521] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:32 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:33.133014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:33.154355 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5751b779-55be-4fa4-a504-6ccaecbbfb0c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.346836 Aug 04 04:34:33.164005 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1246/2522] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:32 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:33.825679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:33.826254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:33.833484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:33.833935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:33.834720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:33.835205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:33.975074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:33.983770 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f1127874-5e82-457e-8040-1e27d4899ce0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.162585 Aug 04 04:34:33.984476 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1277/2523] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:33 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:34.042945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:34.044015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:34.051995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.054435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:34.056741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.057439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:34.177174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:34.178211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:34.186612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:34.187314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.187876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:34.188892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.189575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:34.202257 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1b92181-3941-4ac3-874e-5fef74af6907 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1277 microversion: 2.1 time: 0.166222 Aug 04 04:34:34.215095 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1247/2524] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:34 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:34.412439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:34.421348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2f5f1fbf-0204-4ab1-985d-40ab601c977a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.248028 Aug 04 04:34:34.422355 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1278/2525] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:34 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:34.574581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:34.575620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:34.585882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.586441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:34.587784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.588238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:34.917576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:34.935730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:34.937374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:34.938906 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f407925-4a73-4bb5-b49e-61aa1bd03e66 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2950 microversion: 2.42 time: 0.369468 Aug 04 04:34:34.939642 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1248/2526] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:34:34 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2950 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:34:34.965999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25f886ce-ef89-41aa-a1e2-093453d80253 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:34.967294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-25f886ce-ef89-41aa-a1e2-093453d80253 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:34.978716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25f886ce-ef89-41aa-a1e2-093453d80253 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.979427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25f886ce-ef89-41aa-a1e2-093453d80253 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:34.980412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25f886ce-ef89-41aa-a1e2-093453d80253 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:34.981047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25f886ce-ef89-41aa-a1e2-093453d80253 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:35.005478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:35.006167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:35.018104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:35.019072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:35.019530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:35.020054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:35.229816 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-25f886ce-ef89-41aa-a1e2-093453d80253 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.268563 Aug 04 04:34:35.239371 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1279/2527] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:34:34 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73/os-interface => generated 1831 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:34:35.239371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:35.239371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:35.256072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:35.261884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:35.262941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:35.263567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:35.452465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:35.464845 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c1e0d22-24b0-4142-af5b-83d725a85549 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.462820 Aug 04 04:34:35.466126 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1249/2528] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:35 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:35.491643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:35.492744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:35.502729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:35.504261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:35.505757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:35.506501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:35.713063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:35.731573 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ecb1d75b-4189-4c95-8362-44ad858b14d3 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1317 microversion: 2.1 time: 0.499686 Aug 04 04:34:35.744959 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1280/2529] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:35 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:35.863581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:35.873271 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ae3cf923-9f30-44eb-9688-1076d21a7b40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.391159 Aug 04 04:34:35.887116 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1250/2530] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:35 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:36.204255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ae3137aa-e9ee-4aae-9a4b-a575bc69678f req-c7c4c83c-70c2-4f95-addb-32b6f74635f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b953f27e-a41f-4a8b-b936-092ea3bb771c", "tag": "01104e2a-6f63-4f00-8454-73a4a97db797"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:36.215247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ae3137aa-e9ee-4aae-9a4b-a575bc69678f req-c7c4c83c-70c2-4f95-addb-32b6f74635f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:36.215964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ae3137aa-e9ee-4aae-9a4b-a575bc69678f req-c7c4c83c-70c2-4f95-addb-32b6f74635f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:36.231586 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ae3137aa-e9ee-4aae-9a4b-a575bc69678f req-c7c4c83c-70c2-4f95-addb-32b6f74635f5 service nova] Creating event network-changed:01104e2a-6f63-4f00-8454-73a4a97db797 for instance b953f27e-a41f-4a8b-b936-092ea3bb771c on n-h2-851337-5 Aug 04 04:34:36.236786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ae3137aa-e9ee-4aae-9a4b-a575bc69678f req-c7c4c83c-70c2-4f95-addb-32b6f74635f5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035868 Aug 04 04:34:36.237549 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1281/2531] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:36.494083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:36.494814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:36.502213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:36.502924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:36.504070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:36.504739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:36.732609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:36.745374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:36.751364 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-64999916-53a9-4ac8-a49c-bb05ad6095f3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.261170 Aug 04 04:34:36.753216 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1251/2532] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:36 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:36.767414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:36.768436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:36.776703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:36.777453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:36.778764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:36.779240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:36.785269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:36.895761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:36.896397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:36.903020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:36.906020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:36.906586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:36.907427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:36.908102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:37.021620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:37.035578 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a4068bbb-eec6-412a-8ba5-ed4a3d777b8d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1317 microversion: 2.1 time: 0.280594 Aug 04 04:34:37.039274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1282/2533] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:36 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:37.094053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:37.111517 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-772d06ac-f40f-406c-bd5c-2c09a8347f32 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.220782 Aug 04 04:34:37.112359 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1252/2534] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:36 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:37.625885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3b61cf52-6d9f-4f45-abfd-f51d4ce7d937 req-2abd5749-f406-4f05-b5e4-7b271d09172c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29", "name": "network-vif-plugged", "status": "completed", "tag": "0409f697-2f76-477a-88e2-8a9c7ee33e38"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:37.647676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3b61cf52-6d9f-4f45-abfd-f51d4ce7d937 req-2abd5749-f406-4f05-b5e4-7b271d09172c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:37.648129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3b61cf52-6d9f-4f45-abfd-f51d4ce7d937 req-2abd5749-f406-4f05-b5e4-7b271d09172c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:37.661012 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3b61cf52-6d9f-4f45-abfd-f51d4ce7d937 req-2abd5749-f406-4f05-b5e4-7b271d09172c service nova] Creating event network-vif-plugged:0409f697-2f76-477a-88e2-8a9c7ee33e38 for instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 on n-h2-851337-5 Aug 04 04:34:37.667929 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3b61cf52-6d9f-4f45-abfd-f51d4ce7d937 req-2abd5749-f406-4f05-b5e4-7b271d09172c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048879 Aug 04 04:34:37.668714 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1283/2535] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:37.773310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:37.774442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:37.781811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:37.782106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:37.782881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:37.783972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:37.920947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:37.929081 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fc4100b4-c243-4920-8fc7-59ce578e1a40 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.160047 Aug 04 04:34:37.930090 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1253/2536] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:37 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:38.060234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:38.060859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:38.067598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:38.068054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:38.068830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:38.069264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:38.132919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:38.134030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:38.140950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:38.140950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:38.141679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:38.142116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:38.158645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:38.249353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:38.257650 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-04aec6d0-7264-4d9d-88c7-5658c4f4d0bd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1317 microversion: 2.1 time: 0.201604 Aug 04 04:34:38.259198 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1284/2537] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:38 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:38.312623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:38.320335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d60edf24-2e10-40b0-8e35-dea6fed08dd4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.191283 Aug 04 04:34:38.321721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1254/2538] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:38 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:38.949928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:38.952566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:38.961724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:38.962264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:38.963169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:38.963772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:39.099701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:39.107703 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-99a6b7eb-5f7d-4a8e-8cb7-36f54e55541a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.161987 Aug 04 04:34:39.108287 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1285/2539] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:38 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:39.279625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:39.280158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:39.287098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:39.287555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:39.288367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:39.288807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:39.342287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:39.342904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:39.349234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:39.349711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:39.350475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:39.350916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:39.482818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:39.497923 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8030cf16-0197-4ca8-b675-2bc21d7bb8ee tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1317 microversion: 2.1 time: 0.221791 Aug 04 04:34:39.503441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1255/2540] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:39 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:39.551070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:39.559866 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55d68ed2-87de-4b7b-87f3-7eb11871bdcb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1313 microversion: 2.1 time: 0.221325 Aug 04 04:34:39.560464 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1286/2541] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:39 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:40.129462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:40.130081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:40.138155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.138613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.139418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.139852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.276217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:40.283808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-65dccd6d-d04a-406c-b329-b7a7d8aae25c tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.158213 Aug 04 04:34:40.284404 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1256/2542] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:40 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:40.530763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:40.531309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:40.538250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.538702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.539551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.540016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.579877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:40.580787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:40.588229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.588685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.589466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.589910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.735031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:40.743997 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95128edd-09ba-42ed-86d2-fb2ea925514c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1317 microversion: 2.1 time: 0.217273 Aug 04 04:34:40.744584 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1287/2543] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:40 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:40.763105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:40.770871 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-226f8f44-6965-4966-aa2e-67a9b8ab8443 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1462 microversion: 2.1 time: 0.194898 Aug 04 04:34:40.771482 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1257/2544] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:40 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1462 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:40.838849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2084da0e-d479-4e7b-97cc-0aba9524dd6c tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:40.843909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2084da0e-d479-4e7b-97cc-0aba9524dd6c tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Searching by: {'deleted': False, 'project_id': 'db6e78b623f74ab19a98164d06a3c8ab'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:40.849836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2084da0e-d479-4e7b-97cc-0aba9524dd6c tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.850305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2084da0e-d479-4e7b-97cc-0aba9524dd6c tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.851111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2084da0e-d479-4e7b-97cc-0aba9524dd6c tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.851549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2084da0e-d479-4e7b-97cc-0aba9524dd6c tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.880228 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2084da0e-d479-4e7b-97cc-0aba9524dd6c tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.091701 Aug 04 04:34:40.880796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1288/2545] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:34:40 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:34:40.900258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:40.906938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Searching by: {'deleted': False} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:40.912832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.913281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:40.914091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:40.914586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.040894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Listed batch of 17 results from cell out of 1000 limit. Returned 17 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:34:41.124273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.124738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.305888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:41.306573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:41.312785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.313271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.314049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.314493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.531993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:41.541313 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-053b08b6-f0a1-4164-8613-b73046ed8aaf tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.239872 Aug 04 04:34:41.541997 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1289/2546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:41 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:41.594225 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d173e60-2c5c-4e63-8297-90e782a4d4ed tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 30637 microversion: 2.1 time: 0.697591 Aug 04 04:34:41.594854 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1258/2547] 10.222.0.69 () {58 vars in 1171 bytes} [Thu Aug 4 04:34:40 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 30637 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:34:41.644383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78bbc5ab-edcc-4f51-917c-97e9de4be4e3 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:41.649880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-78bbc5ab-edcc-4f51-917c-97e9de4be4e3 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Searching by: {'deleted': False, 'project_id': 'db6e78b623f74ab19a98164d06a3c8ab'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:41.654767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78bbc5ab-edcc-4f51-917c-97e9de4be4e3 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.655263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78bbc5ab-edcc-4f51-917c-97e9de4be4e3 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.656055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78bbc5ab-edcc-4f51-917c-97e9de4be4e3 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.656495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78bbc5ab-edcc-4f51-917c-97e9de4be4e3 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.685181 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78bbc5ab-edcc-4f51-917c-97e9de4be4e3 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?tenant_id=7f160af08e0c453ebcaba72e90fd959d" status: 200 len: 15 microversion: 2.1 time: 0.044396 Aug 04 04:34:41.685742 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1290/2548] 10.222.0.69 () {58 vars in 1231 bytes} [Thu Aug 4 04:34:41 2022] GET /compute/v2.1/servers/detail?tenant_id=7f160af08e0c453ebcaba72e90fd959d => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:34:41.703897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:41.709981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Searching by: {'tenant_id': '7f160af08e0c453ebcaba72e90fd959d', 'deleted': False} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:41.715704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.716146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.716930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.717356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.765463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:41.766085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:41.772462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.772915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.774176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.774818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.812355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:34:41.897469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.897942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.933881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:41.941986 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-206e24ed-4feb-4692-9853-88e3178a5b9e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1317 microversion: 2.1 time: 0.181828 Aug 04 04:34:41.947344 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1291/2549] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:41 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:41.970649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4228395e-2c9d-43f2-8a42-aeabd8663a05 req-cd78808d-331d-416e-b129-2e21f824ea66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b953f27e-a41f-4a8b-b936-092ea3bb771c", "name": "network-vif-plugged", "status": "completed", "tag": "01104e2a-6f63-4f00-8454-73a4a97db797"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:41.982702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4228395e-2c9d-43f2-8a42-aeabd8663a05 req-cd78808d-331d-416e-b129-2e21f824ea66 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:41.983314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4228395e-2c9d-43f2-8a42-aeabd8663a05 req-cd78808d-331d-416e-b129-2e21f824ea66 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:41.996093 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4228395e-2c9d-43f2-8a42-aeabd8663a05 req-cd78808d-331d-416e-b129-2e21f824ea66 service nova] Creating event network-vif-plugged:01104e2a-6f63-4f00-8454-73a4a97db797 for instance b953f27e-a41f-4a8b-b936-092ea3bb771c on n-h2-851337-5 Aug 04 04:34:42.001698 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4228395e-2c9d-43f2-8a42-aeabd8663a05 req-cd78808d-331d-416e-b129-2e21f824ea66 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036124 Aug 04 04:34:42.002744 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1292/2550] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:42.036196 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d58f8f9b-0348-44ec-8101-00242394cd56 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7f160af08e0c453ebcaba72e90fd959d" status: 200 len: 4825 microversion: 2.1 time: 0.335839 Aug 04 04:34:42.037050 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1259/2551] 10.222.0.69 () {58 vars in 1257 bytes} [Thu Aug 4 04:34:41 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7f160af08e0c453ebcaba72e90fd959d => generated 4825 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:42.061278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3732034c-5d8a-47cd-84db-6340ccb7fd32 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:42.067397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3732034c-5d8a-47cd-84db-6340ccb7fd32 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Searching by: {'tenant_id': 'db6e78b623f74ab19a98164d06a3c8ab', 'deleted': False} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:42.073121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3732034c-5d8a-47cd-84db-6340ccb7fd32 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.073568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3732034c-5d8a-47cd-84db-6340ccb7fd32 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.074362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3732034c-5d8a-47cd-84db-6340ccb7fd32 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.074806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3732034c-5d8a-47cd-84db-6340ccb7fd32 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.104138 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3732034c-5d8a-47cd-84db-6340ccb7fd32 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=db6e78b623f74ab19a98164d06a3c8ab" status: 200 len: 15 microversion: 2.1 time: 0.046908 Aug 04 04:34:42.104730 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1293/2552] 10.222.0.69 () {58 vars in 1257 bytes} [Thu Aug 4 04:34:42 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=db6e78b623f74ab19a98164d06a3c8ab => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:34:42.124372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5387cbca-7ab6-42a8-9af2-5389a5aa7549 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:42.129574 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5387cbca-7ab6-42a8-9af2-5389a5aa7549 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008975 Aug 04 04:34:42.130947 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1260/2553] 10.222.0.69 () {58 vars in 1189 bytes} [Thu Aug 4 04:34:42 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:34:42.151117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bac43a4b-2591-4d45-8c0c-e5de7505a9a5 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:42.153427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bac43a4b-2591-4d45-8c0c-e5de7505a9a5 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:42.159728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac43a4b-2591-4d45-8c0c-e5de7505a9a5 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.160361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac43a4b-2591-4d45-8c0c-e5de7505a9a5 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.160958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac43a4b-2591-4d45-8c0c-e5de7505a9a5 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.161739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bac43a4b-2591-4d45-8c0c-e5de7505a9a5 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.255237 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bac43a4b-2591-4d45-8c0c-e5de7505a9a5 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action" status: 202 len: 0 microversion: 2.1 time: 0.108444 Aug 04 04:34:42.255935 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1294/2554] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:34:42 2022] POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:34:42.264851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:42.269444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:42.270168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '7f160af08e0c453ebcaba72e90fd959d'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:42.275562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.276015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.276808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.277322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.365572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:34:42.422138 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6fc54e64-1546-4a09-8f6c-693fd930788e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.161062 Aug 04 04:34:42.422722 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1261/2555] 10.222.0.69 () {58 vars in 1150 bytes} [Thu Aug 4 04:34:42 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:42.434385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-18417fea-d998-4c11-8993-a07dde9940d0 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:42.436625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-18417fea-d998-4c11-8993-a07dde9940d0 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:42.438627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:42.444868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18417fea-d998-4c11-8993-a07dde9940d0 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.445323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18417fea-d998-4c11-8993-a07dde9940d0 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.446673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18417fea-d998-4c11-8993-a07dde9940d0 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.447151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18417fea-d998-4c11-8993-a07dde9940d0 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.528077 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-18417fea-d998-4c11-8993-a07dde9940d0 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action" status: 202 len: 0 microversion: 2.1 time: 0.097870 Aug 04 04:34:42.528771 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1295/2556] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:34:42 2022] POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:34:42.537147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5b136a90-828f-47ac-bcf9-58bcbad1689f tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:42.537768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5b136a90-828f-47ac-bcf9-58bcbad1689f tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:42.546738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b136a90-828f-47ac-bcf9-58bcbad1689f tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.547449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b136a90-828f-47ac-bcf9-58bcbad1689f tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.548707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b136a90-828f-47ac-bcf9-58bcbad1689f tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.549387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b136a90-828f-47ac-bcf9-58bcbad1689f tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.564351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:42.565234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:42.575226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.575857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.576972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.577599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.724776 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5b136a90-828f-47ac-bcf9-58bcbad1689f tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1614 microversion: 2.1 time: 0.191335 Aug 04 04:34:42.734984 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1262/2557] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:42 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1614 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:42.747128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4cbc59e-a9a3-45b1-be58-632f12560de2 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:42.747762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e4cbc59e-a9a3-45b1-be58-632f12560de2 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:42.754235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cbc59e-a9a3-45b1-be58-632f12560de2 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.754685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cbc59e-a9a3-45b1-be58-632f12560de2 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:42.755489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cbc59e-a9a3-45b1-be58-632f12560de2 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:42.755921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cbc59e-a9a3-45b1-be58-632f12560de2 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.008928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:43.084907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:43.096920 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8435c3e1-bcce-4a6e-b7c5-f375825bb675 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.538127 Aug 04 04:34:43.097635 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1296/2558] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:42 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:43.103449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:43.104529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:43.112999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.113673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.114745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.115470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.134071 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4cbc59e-a9a3-45b1-be58-632f12560de2 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1614 microversion: 2.1 time: 0.391107 Aug 04 04:34:43.134657 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1263/2559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:42 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1614 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:43.160114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:43.166902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Searching by: {'host': 'n-h2-851337-5', 'deleted': False} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:43.171948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.172510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.173310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.173754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.263617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:43.271371 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bfa7d69a-a7a4-4d0e-9192-9e18d707133b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1317 microversion: 2.1 time: 0.172668 Aug 04 04:34:43.272121 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1297/2560] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:43 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:43.272224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:34:43.341337 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f9e7490-57a8-46cf-90f3-c26da4389f07 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers?host=n-h2-851337-5&all_tenants=1" status: 200 len: 3285 microversion: 2.1 time: 0.184956 Aug 04 04:34:43.341946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1264/2561] 10.222.0.69 () {58 vars in 1190 bytes} [Thu Aug 4 04:34:43 2022] GET /compute/v2.1/servers?host=n-h2-851337-5&all_tenants=1 => generated 3285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:43.356653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60619b27-deef-4915-a1f5-7ba4849ff0b6 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:43.363076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-60619b27-deef-4915-a1f5-7ba4849ff0b6 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:34:43.368630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60619b27-deef-4915-a1f5-7ba4849ff0b6 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.369099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60619b27-deef-4915-a1f5-7ba4849ff0b6 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.369920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60619b27-deef-4915-a1f5-7ba4849ff0b6 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.370362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60619b27-deef-4915-a1f5-7ba4849ff0b6 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.451804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60619b27-deef-4915-a1f5-7ba4849ff0b6 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.098790 Aug 04 04:34:43.452476 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1298/2562] 10.222.0.69 () {58 vars in 1196 bytes} [Thu Aug 4 04:34:43 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:34:43.466560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44322e19-8ed3-4236-82f9-6204ef3cf979 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:43.469056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-44322e19-8ed3-4236-82f9-6204ef3cf979 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:43.475287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44322e19-8ed3-4236-82f9-6204ef3cf979 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.475742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44322e19-8ed3-4236-82f9-6204ef3cf979 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.476509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44322e19-8ed3-4236-82f9-6204ef3cf979 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.477590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44322e19-8ed3-4236-82f9-6204ef3cf979 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.554293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44322e19-8ed3-4236-82f9-6204ef3cf979 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action" status: 202 len: 0 microversion: 2.1 time: 0.093360 Aug 04 04:34:43.554879 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1265/2563] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:34:43 2022] POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:34:43.567147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:43.570874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:43.578180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.578633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.579436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.579877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.658076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:43.675488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:43.675914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:43.676386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:43.676791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:43.677205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:43.745183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:43.751321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.751786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.752564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.753004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.781367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2d0e331-d66e-466e-8fad-0733abbf3d1c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action" status: 202 len: 1067 microversion: 2.1 time: 0.221140 Aug 04 04:34:43.782011 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1299/2564] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:34:43 2022] POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action => generated 1067 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 04:34:43.800333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:43.800871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:43.808368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.808751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.809512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:43.809954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:43.953359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:43.961035 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-19726bad-5a1a-45b3-a2a4-b9684aa77474 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.164801 Aug 04 04:34:43.962244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1266/2565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:43 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:44.118520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:44.119104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:44.125201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.125650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:44.126405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.126838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:44.271441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:44.279993 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0403ecba-7dd3-4878-884b-083245c19335 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.165461 Aug 04 04:34:44.280570 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1300/2566] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:44 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:44.294023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:44.295072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:44.301004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.301524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:44.302216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.302652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:44.449413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:44.456975 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4bce9845-c471-41c5-b792-22428e7da361 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1466 microversion: 2.1 time: 0.167196 Aug 04 04:34:44.457558 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1267/2567] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:44 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:44.482693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0df80cfa-d8b3-4572-bff2-85fc45d05167 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:44.483750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0df80cfa-d8b3-4572-bff2-85fc45d05167 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:44.490434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0df80cfa-d8b3-4572-bff2-85fc45d05167 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.490934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0df80cfa-d8b3-4572-bff2-85fc45d05167 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:44.491726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0df80cfa-d8b3-4572-bff2-85fc45d05167 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.492162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0df80cfa-d8b3-4572-bff2-85fc45d05167 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:44.642663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0df80cfa-d8b3-4572-bff2-85fc45d05167 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1617 microversion: 2.1 time: 0.169006 Aug 04 04:34:44.644070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1301/2568] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:44 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1617 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:44.713697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1752276795", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["11b2c557-2612-4471-bd06-0d27b9416f02"]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:44.769923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:44.982990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:44.983664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:44.990148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.990595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:44.991383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:44.991826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.004386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:45.004976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:45.005463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:45.005882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:45.006300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:45.016200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.016654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.017467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.017912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.036456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:45.042514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:45.056004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:45.058218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:45.106698 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-573dd502-3231-4285-8dbe-10ba2d0357fe tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.396799 Aug 04 04:34:45.107651 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1268/2569] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:34:45.120498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bf93ac4e-7102-4f97-b5a7-7fefc676f900 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:45.121180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bf93ac4e-7102-4f97-b5a7-7fefc676f900 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:45.149297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:45.158760 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0da07ff-4a13-4fb9-a09e-885a9cd9d35f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.179577 Aug 04 04:34:45.160397 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1302/2570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:44 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:45.181316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf93ac4e-7102-4f97-b5a7-7fefc676f900 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:45.188788 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bf93ac4e-7102-4f97-b5a7-7fefc676f900 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1217 microversion: 2.1 time: 0.073919 Aug 04 04:34:45.189757 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1269/2571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:45 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:45.300747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:45.301394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:45.308036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.308487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.309248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.309682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.459169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:45.469235 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0f1a025-d87a-4a39-a2ff-bf8718c33f57 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.172204 Aug 04 04:34:45.483244 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1303/2572] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:45 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:45.608376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "eb872ad1-7d5f-44e6-8d2c-052231d6466d"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:45.610930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:45.618851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.619335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.620116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.620552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.625979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:45.726395 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] HTTP exception thrown: Volume eb872ad1-7d5f-44e6-8d2c-052231d6466d could not be found. Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Request method failure captured: Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments/299933fb-faf1-47b6-b92a-86bd06b0d872 HTTP/1.1 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 74 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60wTprUXApBdO9IuaqNkSvoMKmqBZ3anoHJUpObBYtnyiiOusmsWtKtLicm5QacEkLaN_ZpnyOON2cfywzyDPhnxFMKzQqO1GYBk2S9s8UW27Ui080LgBGEmO-w_8aXoJimbjPvRvc9BhYe1N6ofhUqJKOv6GV-MZKsqIZTdceWmnA0 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 74730632130b4f3eb25b1947ba4d7a45 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesAdminNegativeTest-173154609 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/74730632130b4f3eb25b1947ba4d7a45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/74730632130b4f3eb25b1947ba4d7a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/74730632130b4f3eb25b1947ba4d7a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_74730632130b4f3eb25b1947ba4d7a45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesAdminNegativeTest-173154609 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 74730632130b4f3eb25b1947ba4d7a45 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-173154609 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesAdminNegativeTest-173154609-project-admin Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 60a501daebaa43d887b3aa165b11ad75 Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesAdminNegativeTest-173154609-project-admin Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: {"volumeAttachment": {"volumeId": "eb872ad1-7d5f-44e6-8d2c-052231d6466d"}} Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: exception: Volume eb872ad1-7d5f-44e6-8d2c-052231d6466d could not be found. Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'server_id': '053480ad-ee22-4a8d-afed-82851e4a1031', 'id': '299933fb-faf1-47b6-b92a-86bd06b0d872', 'body': {'volumeAttachment': {'volumeId': 'eb872ad1-7d5f-44e6-8d2c-052231d6466d'}}} Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb872ad1-7d5f-44e6-8d2c-052231d6466d could not be found. (HTTP 404) (Request-ID: req-835baa10-beec-44fa-9fbc-16128a76f673) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:34:45.749522 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb872ad1-7d5f-44e6-8d2c-052231d6466d could not be found. Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume eb872ad1-7d5f-44e6-8d2c-052231d6466d could not be found. Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb872ad1-7d5f-44e6-8d2c-052231d6466d could not be found. Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Returning 400 to user: Volume eb872ad1-7d5f-44e6-8d2c-052231d6466d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:34:45.753481 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e00af04-5a72-4f6e-bb05-806bcf15dfa1 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] 10.222.0.69 "PUT /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments/299933fb-faf1-47b6-b92a-86bd06b0d872" status: 400 len: 107 microversion: 2.1 time: 0.274434 Aug 04 04:34:45.756832 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1270/2573] 10.222.0.69 () {60 vars in 1433 bytes} [Thu Aug 4 04:34:45 2022] PUT /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments/299933fb-faf1-47b6-b92a-86bd06b0d872 => generated 107 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:34:45.823971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:45.824572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:45.831340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.831875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.832989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:45.833540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:45.922442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lazy-loading 'services' on Instance uuid 053480ad-ee22-4a8d-afed-82851e4a1031 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:34:45.997713 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6df54eb1-d351-4a44-851c-acf4c4dd4f68 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "DELETE /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments/299933fb-faf1-47b6-b92a-86bd06b0d872" status: 202 len: 0 microversion: 2.1 time: 0.179245 Aug 04 04:34:45.998292 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1304/2574] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:34:45 2022] DELETE /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments/299933fb-faf1-47b6-b92a-86bd06b0d872 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:34:46.007747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7720e5eb-1cd1-453b-ac0e-5a87de7bf41b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:46.010792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7720e5eb-1cd1-453b-ac0e-5a87de7bf41b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:46.016947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7720e5eb-1cd1-453b-ac0e-5a87de7bf41b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.017396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7720e5eb-1cd1-453b-ac0e-5a87de7bf41b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.018159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7720e5eb-1cd1-453b-ac0e-5a87de7bf41b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.018597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7720e5eb-1cd1-453b-ac0e-5a87de7bf41b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.048055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7720e5eb-1cd1-453b-ac0e-5a87de7bf41b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Aug 04 04:34:46.048608 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1271/2575] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:34:46 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:46.182266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:46.183092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:46.190339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.190788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.191604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.192044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.216738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:46.217957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:46.226398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.228069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.229054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.229652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.324291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:46.332831 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e5d4bbe2-3668-4230-9a00-7c6ba04e88f8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1269 microversion: 2.1 time: 0.125772 Aug 04 04:34:46.333461 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1272/2576] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:46 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:46.400782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:46.410159 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48078267-00bb-4fa9-997c-ae65f34c96c3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.232172 Aug 04 04:34:46.421688 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1305/2577] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:46 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:46.491742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:46.492382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:46.498347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.498793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.499571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:46.500001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:46.627653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:46.636445 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57af3fe7-dcf7-4c50-95a1-f989a3774609 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.148478 Aug 04 04:34:46.637035 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1273/2578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:46 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:47.062169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b642b757-8f57-491e-b63d-859b4e799a09 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:47.065353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b642b757-8f57-491e-b63d-859b4e799a09 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:47.073298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b642b757-8f57-491e-b63d-859b4e799a09 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.073744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b642b757-8f57-491e-b63d-859b4e799a09 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.074695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b642b757-8f57-491e-b63d-859b4e799a09 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.075470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b642b757-8f57-491e-b63d-859b4e799a09 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.112566 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b642b757-8f57-491e-b63d-859b4e799a09 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055260 Aug 04 04:34:47.113429 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1306/2579] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:34:47 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:47.355778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:47.357942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:47.368811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.369539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.370827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.371522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.438307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:47.444136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:47.454760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.455627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.456720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.457543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.810350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:47.825692 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f377625-46ec-4dc2-882a-ca117a3d7b26 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.392460 Aug 04 04:34:47.831109 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1307/2580] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:47 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:47.837444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:47.839568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:47.848262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.849158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.850130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:47.851007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:47.892923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:47.909356 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8857971-a44e-4813-82df-1befb673cd1b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1317 microversion: 2.1 time: 0.557990 Aug 04 04:34:47.911878 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1274/2581] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:47 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:48.125721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8bb7882-f911-47bd-8e14-dc408bec472f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:48.128533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d8bb7882-f911-47bd-8e14-dc408bec472f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:48.131285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:48.137384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bb7882-f911-47bd-8e14-dc408bec472f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:48.138131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bb7882-f911-47bd-8e14-dc408bec472f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:48.139450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bb7882-f911-47bd-8e14-dc408bec472f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:48.140176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bb7882-f911-47bd-8e14-dc408bec472f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:48.182049 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8bb7882-f911-47bd-8e14-dc408bec472f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059842 Aug 04 04:34:48.187741 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1275/2582] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:34:48 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:48.214786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:48.224365 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7b7c6a6-342a-495d-b740-ab2b8c5885eb tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.391868 Aug 04 04:34:48.236882 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1308/2583] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:47 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:48.583342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-27a97c9a-1891-4e47-bc9e-9d33bee03c74 req-47fea6e7-4e52-4583-ad49-70b6eff38341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa1a11a-6833-45a3-a045-82019d25c985", "tag": "6369f92b-2592-4faa-bb9f-ed4c21d3ae2d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:48.596089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-27a97c9a-1891-4e47-bc9e-9d33bee03c74 req-47fea6e7-4e52-4583-ad49-70b6eff38341 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:48.596953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-27a97c9a-1891-4e47-bc9e-9d33bee03c74 req-47fea6e7-4e52-4583-ad49-70b6eff38341 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:48.618021 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-27a97c9a-1891-4e47-bc9e-9d33bee03c74 req-47fea6e7-4e52-4583-ad49-70b6eff38341 service nova] Creating event network-changed:6369f92b-2592-4faa-bb9f-ed4c21d3ae2d for instance dfa1a11a-6833-45a3-a045-82019d25c985 on n-h2-851337-5 Aug 04 04:34:48.624860 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-27a97c9a-1891-4e47-bc9e-9d33bee03c74 req-47fea6e7-4e52-4583-ad49-70b6eff38341 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047781 Aug 04 04:34:48.625766 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1276/2584] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:48.855554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:48.856184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:48.863158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:48.863625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:48.864493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:48.864971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:48.936403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:48.937153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:48.943671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:48.944126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:48.945091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:48.946247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:49.130778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:49.139422 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c60a69a9-3bd2-4bfe-9131-783474a8af75 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.287566 Aug 04 04:34:49.140133 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1309/2585] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:48 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:49.194676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ad4515d-ab0b-43c1-8204-1fc9647c5af2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:49.197826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ad4515d-ab0b-43c1-8204-1fc9647c5af2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:49.205848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ad4515d-ab0b-43c1-8204-1fc9647c5af2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:49.206507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ad4515d-ab0b-43c1-8204-1fc9647c5af2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:49.207620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:49.207797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ad4515d-ab0b-43c1-8204-1fc9647c5af2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:49.208308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ad4515d-ab0b-43c1-8204-1fc9647c5af2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:49.220400 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-784c2013-c82f-4362-9ba0-3bef7a240ea8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1317 microversion: 2.1 time: 0.288247 Aug 04 04:34:49.221317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1277/2586] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:48 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:49.240983 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ad4515d-ab0b-43c1-8204-1fc9647c5af2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050637 Aug 04 04:34:49.242227 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1310/2587] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:34:49 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:49.246479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:49.247133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:49.255211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:49.255673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:49.256515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:49.256957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:49.400012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:49.407800 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-46cc419b-e56b-4ac1-8f82-e8f28371a653 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.165675 Aug 04 04:34:49.408367 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1278/2588] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:49 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:50.161135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:50.161897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:50.170145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.170942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.172171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.172933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.243050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:50.243613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:50.250377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.250831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.251957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.252409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.366309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:50.375228 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8e635ec-cbdb-4763-b10b-682bd13f260f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.218168 Aug 04 04:34:50.376168 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1311/2589] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:50 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:50.380879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb1b1a25-f756-49c4-a9f3-65a8998802ff tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:50.383116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb1b1a25-f756-49c4-a9f3-65a8998802ff tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:50.389133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb1b1a25-f756-49c4-a9f3-65a8998802ff tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.389599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb1b1a25-f756-49c4-a9f3-65a8998802ff tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.390374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb1b1a25-f756-49c4-a9f3-65a8998802ff tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.390812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb1b1a25-f756-49c4-a9f3-65a8998802ff tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.419546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:50.421413 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb1b1a25-f756-49c4-a9f3-65a8998802ff tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 04 04:34:50.422244 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1312/2590] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:34:50 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:50.429192 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a10e08bb-2425-4488-ba9f-f35260c867d6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1317 microversion: 2.1 time: 0.191329 Aug 04 04:34:50.429511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:50.442850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:50.443104 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1279/2591] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:50 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:50.443202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.443202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.443202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:50.443202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:50.584554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:50.588215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:50.593270 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d78e9cd9-578a-448b-9ff6-8eb38f20f500 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.167688 Aug 04 04:34:50.593915 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1313/2592] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:50 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:51.397117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:51.397837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:51.407522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.408717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.409855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.409967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.433776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e48ba920-1bee-4ad2-8c16-76cf1084a7a6 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:51.437496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e48ba920-1bee-4ad2-8c16-76cf1084a7a6 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:51.446419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e48ba920-1bee-4ad2-8c16-76cf1084a7a6 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.447050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e48ba920-1bee-4ad2-8c16-76cf1084a7a6 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.447820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e48ba920-1bee-4ad2-8c16-76cf1084a7a6 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.448433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e48ba920-1bee-4ad2-8c16-76cf1084a7a6 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.485214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e48ba920-1bee-4ad2-8c16-76cf1084a7a6 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055516 Aug 04 04:34:51.485797 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1314/2593] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:34:51 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:51.492268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:51.492881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:51.499416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.499872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.500659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.501104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.687937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:51.695646 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5716d7f6-f5d2-40e1-a537-d61daacc1218 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.302541 Aug 04 04:34:51.696227 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1280/2594] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:51 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:51.700758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:51.701351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:51.707412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.707839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.708601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:51.709035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:51.717049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:51.724922 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f93b73b3-583f-466b-ab4c-1486f2be705e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1317 microversion: 2.1 time: 0.237492 Aug 04 04:34:51.725506 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1315/2595] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:51 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:51.841397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:51.849065 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7849340c-ed7a-45fc-b42a-fc3eab068abc tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.151847 Aug 04 04:34:51.849658 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1281/2596] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:51 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:52.498016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9506e9d-9ac6-4432-8174-8c717647f6d0 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:52.500299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9506e9d-9ac6-4432-8174-8c717647f6d0 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:52.508570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9506e9d-9ac6-4432-8174-8c717647f6d0 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:52.509026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9506e9d-9ac6-4432-8174-8c717647f6d0 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:52.509877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9506e9d-9ac6-4432-8174-8c717647f6d0 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:52.510350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9506e9d-9ac6-4432-8174-8c717647f6d0 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:52.544053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9506e9d-9ac6-4432-8174-8c717647f6d0 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050061 Aug 04 04:34:52.544628 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1316/2597] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:34:52 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:34:52.710993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-307899881", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "729df6ea-a920-4251-a6de-1d6ac45a9f53"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:52.717638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:52.718231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:52.724621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:52.725075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:52.725853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:52.726297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:52.774157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] validate_networks() for [('729df6ea-a920-4251-a6de-1d6ac45a9f53', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:52.950546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:52.958801 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-150babd4-4f36-4b40-b20a-4e60ea15960e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.245031 Aug 04 04:34:52.959479 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1317/2598] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:52 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:52.964030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:52.964714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:52.970702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:52.971271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:52.972111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:52.972612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:53.183991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:53.191844 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c03df70d-0690-4d6d-b0c1-83733f9edf38 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1317 microversion: 2.1 time: 0.231292 Aug 04 04:34:53.192427 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1318/2599] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:52 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:53.197407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:53.197571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:53.203568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:53.204025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:53.204797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:53.205242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:53.332066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:53.332495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:53.333007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:53.333423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:53.333868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:53.343230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:53.343682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:53.344572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:53.345006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:53.362565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:53.362970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Getting quotas for project 4e35e9177fc54bae85afe4a3c477ef7b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:53.369356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Getting quotas for user d1b140919b4d4134a71946a9f1579b9c and project 4e35e9177fc54bae85afe4a3c477ef7b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:53.371344 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8e15847-d206-438e-97c1-4a7f4c65b19a tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.177886 Aug 04 04:34:53.371942 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1319/2600] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:53 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:53.382565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:53.384957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:53.429531 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4b109380-eb1e-428a-92cb-1027faa5c8af tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722640 Aug 04 04:34:53.430745 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1282/2601] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:34:53.441578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-710b1c53-0f95-445e-b5c6-e3a127c73dbd tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:53.442224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-710b1c53-0f95-445e-b5c6-e3a127c73dbd tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:53.444164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:53.496774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-710b1c53-0f95-445e-b5c6-e3a127c73dbd tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:53.503493 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-710b1c53-0f95-445e-b5c6-e3a127c73dbd tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1217 microversion: 2.1 time: 0.065809 Aug 04 04:34:53.504979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1320/2602] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:53 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:53.980660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:53.981282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:53.989238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:53.989689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:53.990452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:53.990889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.124946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:54.132667 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c26b1be3-d3b3-4209-917d-6cc511715d71 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.156363 Aug 04 04:34:54.133301 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1283/2603] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:53 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:54.213704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:54.214330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:54.222269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:54.222725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.223540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:54.223986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.355739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:54.363464 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c98a811e-0612-4a4f-9776-b8f55b494a0d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1317 microversion: 2.1 time: 0.154819 Aug 04 04:34:54.364038 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1321/2604] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:54 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:54.392011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:54.392717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:54.399595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:54.400039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.400803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:54.401234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.526147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:54.527773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:54.553724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:54.554196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.556878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:54.559699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.561554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:54.571889 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85aa0bdd-40ef-4155-b004-098c5fbc3849 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.182799 Aug 04 04:34:54.574325 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1284/2605] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:54 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:54.608804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c6765245-294e-4355-bbc4-d3fa31209a0c req-cca9d5ce-c3ab-4aa1-9cce-678c45ef1ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa1a11a-6833-45a3-a045-82019d25c985", "name": "network-vif-plugged", "status": "completed", "tag": "6369f92b-2592-4faa-bb9f-ed4c21d3ae2d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:54.622478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c6765245-294e-4355-bbc4-d3fa31209a0c req-cca9d5ce-c3ab-4aa1-9cce-678c45ef1ef5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:54.623155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c6765245-294e-4355-bbc4-d3fa31209a0c req-cca9d5ce-c3ab-4aa1-9cce-678c45ef1ef5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:54.639724 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c6765245-294e-4355-bbc4-d3fa31209a0c req-cca9d5ce-c3ab-4aa1-9cce-678c45ef1ef5 service nova] Creating event network-vif-plugged:6369f92b-2592-4faa-bb9f-ed4c21d3ae2d for instance dfa1a11a-6833-45a3-a045-82019d25c985 on n-h2-851337-5 Aug 04 04:34:54.645253 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c6765245-294e-4355-bbc4-d3fa31209a0c req-cca9d5ce-c3ab-4aa1-9cce-678c45ef1ef5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040289 Aug 04 04:34:54.646178 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1285/2606] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:34:54.659710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:54.670792 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-adb5f95b-d674-439d-ba0d-e959433f5ffe tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1277 microversion: 2.1 time: 0.149108 Aug 04 04:34:54.674649 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1322/2607] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:54 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:55.154924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:55.155658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:55.161857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.162310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.163110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.163552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.311192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:55.319061 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aecf32ee-58bf-4b9b-9a57-56f3d2742400 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.169175 Aug 04 04:34:55.319655 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1286/2608] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:55 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:55.385313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:55.386076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:55.396095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.396548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.397563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.398007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.560129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:55.567884 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3dd4f06d-194e-46b2-bfbd-06b8a15cdc0e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1317 microversion: 2.1 time: 0.186914 Aug 04 04:34:55.568602 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1323/2609] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:55 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:55.594684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:55.595443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:55.602207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.602658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.603465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.603896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.694011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:55.694923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:55.702240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.702722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.703639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.704280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.759380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:55.768339 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cbb99e2c-2396-4261-9ffc-4d294521b9e5 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.177305 Aug 04 04:34:55.771104 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1287/2610] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:55 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:55.862521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:55.870779 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46499e47-40cf-4d15-b580-3a86847fc5f4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.180590 Aug 04 04:34:55.871411 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1324/2611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:55 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:55.952402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8db57335-d3df-44d3-8195-2bbfbc82d119 req-17152611-3ed3-4d37-90bc-2daf0016e8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8709f3-65aa-40b4-aff6-ed03574b7754", "tag": "74478227-a879-427d-b2cd-c4ebb331fec5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:55.963089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8db57335-d3df-44d3-8195-2bbfbc82d119 req-17152611-3ed3-4d37-90bc-2daf0016e8d3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:55.964181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8db57335-d3df-44d3-8195-2bbfbc82d119 req-17152611-3ed3-4d37-90bc-2daf0016e8d3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:55.975780 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8db57335-d3df-44d3-8195-2bbfbc82d119 req-17152611-3ed3-4d37-90bc-2daf0016e8d3 service nova] Creating event network-changed:74478227-a879-427d-b2cd-c4ebb331fec5 for instance fd8709f3-65aa-40b4-aff6-ed03574b7754 on n-h1-851337-5 Aug 04 04:34:55.991297 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8db57335-d3df-44d3-8195-2bbfbc82d119 req-17152611-3ed3-4d37-90bc-2daf0016e8d3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032932 Aug 04 04:34:55.992837 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1288/2612] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:34:56.341531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:56.342396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:56.348879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.349460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:56.350415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.350934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:56.501198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:56.509549 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c00e6b0-b027-4e79-b0c8-34256cba3914 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.171985 Aug 04 04:34:56.510167 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1325/2613] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:56 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:56.591146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:56.592034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:56.598564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.599214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:56.599901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.600336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:56.777601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:56.781938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:56.789788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:56.790414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:56.791361 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ece8d1f-6a1b-4768-b7e0-793554bcf0f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1466 microversion: 2.1 time: 0.205458 Aug 04 04:34:56.802524 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1289/2614] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:56 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1466 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:56.802737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.802737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:56.802737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.802737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:56.822241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7450779-f2a4-4e53-93b2-c9afdc5a523e tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:56.822846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7450779-f2a4-4e53-93b2-c9afdc5a523e tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:56.837049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7450779-f2a4-4e53-93b2-c9afdc5a523e tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.837493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7450779-f2a4-4e53-93b2-c9afdc5a523e tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:56.838261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7450779-f2a4-4e53-93b2-c9afdc5a523e tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:56.838689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7450779-f2a4-4e53-93b2-c9afdc5a523e tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:57.106225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:57.108564 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7450779-f2a4-4e53-93b2-c9afdc5a523e tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1617 microversion: 2.1 time: 0.298843 Aug 04 04:34:57.122182 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1290/2615] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:56 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1617 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:57.122182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:57.122182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:57.123231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:57.123859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:57.125324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:57.125919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:57.128767 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-30a53001-2120-47f9-9a0c-979b65711b53 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.343096 Aug 04 04:34:57.142072 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1326/2616] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:56 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:57.180909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1226110166", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "11b2c557-2612-4471-bd06-0d27b9416f02"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:34:57.234445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:34:57.652302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:57.660083 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0cbcdaf1-d000-460d-9c0a-7a396b9511b1 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.549445 Aug 04 04:34:57.660680 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1291/2617] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:57 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:57.665269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:57.665877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:57.671981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:57.672431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:57.673201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:57.673632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:57.792586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:34:57.793079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:34:57.793490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:34:57.793897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:34:57.794337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:34:57.804035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:57.804481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:57.805355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:57.805793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:57.823434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:34:57.828725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Getting quotas for user 141b4b3608034e2b9284abb81b8079ba and project 4eeb2c9400144655abd2a6fc111690a1. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:34:57.841852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:34:57.844163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:34:57.852620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:57.860706 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a3ade3f-b6d7-4b06-a6d5-745df6cf1ed5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.199026 Aug 04 04:34:57.861290 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1292/2618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:57 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:57.892785 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3379ce8d-3144-43d4-8239-f33803952bcd tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716322 Aug 04 04:34:57.893447 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1327/2619] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:34:57.904930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a7c635d5-ee81-4c0a-b0e1-78db940d5881 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:57.905708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a7c635d5-ee81-4c0a-b0e1-78db940d5881 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:57.959200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a7c635d5-ee81-4c0a-b0e1-78db940d5881 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:57.967277 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a7c635d5-ee81-4c0a-b0e1-78db940d5881 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1217 microversion: 2.1 time: 0.066304 Aug 04 04:34:57.979025 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1293/2620] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:57 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:58.150465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:58.151126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:58.157873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.158328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:58.159145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.159585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:58.298350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:58.306470 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d5ccfe8-4418-488a-bb92-ec1177f8aac8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.160558 Aug 04 04:34:58.307041 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1328/2621] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:58 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:58.682190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:58.683115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:58.692353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.692828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:58.693571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.694019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:58.831184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:58.839228 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c08b952b-ae2f-4a66-8d1a-35fb6f4bd82f tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.162040 Aug 04 04:34:58.839798 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1294/2622] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:58 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:58.881691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:58.882315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:58.889377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.889828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:58.890600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.891143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:58.988180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:58.988800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:58.995118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.995586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:58.996371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:58.996814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.020573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:59.028668 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-703e590b-2a9c-4153-9e3e-f57b9d16e89f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.150842 Aug 04 04:34:59.029249 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1329/2623] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:58 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:59.058268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:59.065744 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c5f6c6fd-1b65-4847-8f2e-e84194dfcff2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1221 microversion: 2.1 time: 0.082058 Aug 04 04:34:59.066318 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1295/2624] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:58 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:34:59.327523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:59.328055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:59.334113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.334589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.335383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.335851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.470443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:59.477925 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae429f85-c730-4b47-976e-3a5b42d15706 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.154439 Aug 04 04:34:59.478498 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1330/2625] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:59 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:59.641024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:59.641840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:59.648425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.649132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.650097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.650692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.798229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:34:59.806366 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-431f52c3-77b4-4152-b474-c8fd93f8899a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.170153 Aug 04 04:34:59.806936 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1296/2626] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:59 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:34:59.828403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:59.829064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:59.835086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.835534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.836297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.836732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.860478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:34:59.861095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:34:59.868543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.868997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:34:59.869967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:34:59.870402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.029501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:00.040894 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-801c45fd-2bc6-4100-ae21-2591f481ed4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.216198 Aug 04 04:35:00.042442 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1331/2627] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:59 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:00.049558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:00.050455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:00.057370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:00.058237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.058755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.059778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.060420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.065324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:00.069696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c30da9fd-9d89-42ee-82f6-12b543d23c65 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.212906 Aug 04 04:35:00.083036 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1297/2628] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:34:59 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:00.083036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:00.083036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:00.083346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.083753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.084532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.084966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.416733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:00.421934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:00.425761 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4167fa10-e79d-4fa0-9899-c9323c579707 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.354473 Aug 04 04:35:00.426422 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1298/2629] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:00 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:00.431581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:00.432529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:00.436347 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37be68db-3eb7-47bc-8743-5db87f664ddb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.390331 Aug 04 04:35:00.439330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.440024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.441558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.442004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.447343 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1332/2630] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:00 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:00.453671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:00.454930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:00.464571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.465169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.466397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.466851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.557891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:00.565268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1bf3858-8cf1-47e5-8732-91abb96be396 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1275 microversion: 2.1 time: 0.137525 Aug 04 04:35:00.565843 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1299/2631] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:00 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:00.571046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:00.571649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:00.577808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.578251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.579378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:00.579815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:00.760918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:00.768663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-68516ffd-7760-4e23-8700-d0bb21361f27 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.320051 Aug 04 04:35:00.769246 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1333/2632] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:00 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:00.840301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:00.848791 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f2ab891b-49b7-4f04-a694-5586234b63e4 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.281916 Aug 04 04:35:00.850023 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1300/2633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:00 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:00.900299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1684909071", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "fcf37719-691e-4ce4-8b13-247de9c8f621"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:00.954727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] validate_networks() for [('fcf37719-691e-4ce4-8b13-247de9c8f621', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:35:01.090731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:01.092393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:01.099001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.099590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.100644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.101183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.393527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:01.402448 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-40f6becf-e9f6-42f5-bb4d-60a309d7c05c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.315669 Aug 04 04:35:01.403206 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1301/2634] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:01 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:01.457453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:01.458069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:01.464589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.465118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.466553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.467163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.723453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:35:01.724004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:35:01.725201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:35:01.725755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:35:01.726270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:35:01.729590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:01.741651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.742230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.743254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.743893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.749478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:01.765671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fec5baed-23e8-4aef-b38a-99af1b879fcd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.312361 Aug 04 04:35:01.766300 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1302/2635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:01 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:01.767508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:35:01.774637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for user d51068c4cce544e38ad1b23996efdec3 and project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:35:01.784566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:01.785197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:01.794765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.795560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.796492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:01.796776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:01.798521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:35:01.800702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:35:01.853396 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-32480b3a-d511-45b2-b4d8-24cace9397da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957543 Aug 04 04:35:01.854262 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1334/2636] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:35:01.866288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5703ab03-0a95-4b09-a797-63d915e247c2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:01.868140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5703ab03-0a95-4b09-a797-63d915e247c2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:02.005799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5703ab03-0a95-4b09-a797-63d915e247c2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:02.015084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5703ab03-0a95-4b09-a797-63d915e247c2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1215 microversion: 2.1 time: 0.153278 Aug 04 04:35:02.016626 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1335/2637] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:01 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:02.024000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:02.024479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:02.036207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:02.037163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:02.038092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:02.038673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:02.133484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:02.142030 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-941031e2-b76e-43a0-b380-afac4f34e234 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.374719 Aug 04 04:35:02.143800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1303/2638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:01 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:02.270575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:02.278580 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c44d33f-9d7a-4ce6-94d6-10f54eaa8637 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.259917 Aug 04 04:35:02.279409 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1336/2639] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:02 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:02.423863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:02.424474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:02.431764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:02.432281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:02.433320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:02.433967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:02.654122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:02.669712 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-945ceccc-7d95-495f-b397-dec05f6c9da7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.249614 Aug 04 04:35:02.670652 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1304/2640] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:02 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:02.707084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-73666ee6-a8e8-4a6c-bee3-0fa768452401 req-6c410c5c-7a54-4d51-a0e4-4f81adbad141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87982710-35b2-4150-826e-b9677f43716b", "tag": "bcb34fad-749a-4fb6-844b-124022943498"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:02.722761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-73666ee6-a8e8-4a6c-bee3-0fa768452401 req-6c410c5c-7a54-4d51-a0e4-4f81adbad141 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:02.723574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-73666ee6-a8e8-4a6c-bee3-0fa768452401 req-6c410c5c-7a54-4d51-a0e4-4f81adbad141 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:02.740397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-73666ee6-a8e8-4a6c-bee3-0fa768452401 req-6c410c5c-7a54-4d51-a0e4-4f81adbad141 service nova] Creating event network-changed:bcb34fad-749a-4fb6-844b-124022943498 for instance 87982710-35b2-4150-826e-b9677f43716b on n-h1-851337-5 Aug 04 04:35:02.747998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-73666ee6-a8e8-4a6c-bee3-0fa768452401 req-6c410c5c-7a54-4d51-a0e4-4f81adbad141 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046067 Aug 04 04:35:02.748879 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1337/2641] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:02.787642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:02.788385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:02.795870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:02.796649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:02.797339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:02.798474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:02.998415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:03.009761 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-181a73ca-78d9-4de2-9cb3-68fe4cb57f08 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.226035 Aug 04 04:35:03.010687 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1305/2642] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:02 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:03.017146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-22d91385-d18e-4a66-8951-b0493f2d5402 req-8e0b796f-53c8-4021-9459-c20e4da8cac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8709f3-65aa-40b4-aff6-ed03574b7754", "name": "network-vif-plugged", "status": "completed", "tag": "74478227-a879-427d-b2cd-c4ebb331fec5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:03.041228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:03.042289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:03.049576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22d91385-d18e-4a66-8951-b0493f2d5402 req-8e0b796f-53c8-4021-9459-c20e4da8cac0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.050356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22d91385-d18e-4a66-8951-b0493f2d5402 req-8e0b796f-53c8-4021-9459-c20e4da8cac0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.051312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.052007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.053119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.053763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.072681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-22d91385-d18e-4a66-8951-b0493f2d5402 req-8e0b796f-53c8-4021-9459-c20e4da8cac0 service nova] Creating event network-vif-plugged:74478227-a879-427d-b2cd-c4ebb331fec5 for instance fd8709f3-65aa-40b4-aff6-ed03574b7754 on n-h1-851337-5 Aug 04 04:35:03.089697 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-22d91385-d18e-4a66-8951-b0493f2d5402 req-8e0b796f-53c8-4021-9459-c20e4da8cac0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076324 Aug 04 04:35:03.090675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1338/2643] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:03.164089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:03.165121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:03.177574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.178033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.180567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.183232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.231260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:03.241314 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5eb56920-cbfd-4c22-90ca-a7d73e9576a6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1275 microversion: 2.1 time: 0.207481 Aug 04 04:35:03.242472 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1306/2644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:03 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:03.300753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:03.301757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:03.309095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.309770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.311026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.311728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.332121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:03.353083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:03.502565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:03.512869 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73ed8c64-c8de-4e71-8c00-30d19e65985d tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.352972 Aug 04 04:35:03.513485 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1339/2645] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:03 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:03.595015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:03.603219 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-09876f43-c4ff-40af-a014-5cee4afd135d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.306227 Aug 04 04:35:03.603804 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1307/2646] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:03 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:03.694216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:03.694864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:03.701757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.702314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.703370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:03.703815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:03.870598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:03.880607 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fdd78b7a-5f78-478e-9dd1-942ebbb22006 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.192986 Aug 04 04:35:03.881389 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1340/2647] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:03 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:04.033015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:04.033795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:04.043492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.043949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.044743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.045182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.191803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:04.200268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fe874a88-ae3d-4bb6-9cee-19248b920b23 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.171971 Aug 04 04:35:04.200866 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1308/2648] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:04 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:04.263502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:04.264159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:04.271178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.271628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.272402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.272841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.402465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:04.409954 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1c067ca-3ce0-4ae2-b4ae-41becee6834d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.150443 Aug 04 04:35:04.410521 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1341/2649] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:04 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:04.533821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:04.534471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:04.542134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.542511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.543361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.543865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.624234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:04.624937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:04.631193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.631638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.632398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.633324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.685404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:04.693413 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-70a47098-2bbb-42ba-bd22-c417590597f5 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.163428 Aug 04 04:35:04.694022 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1309/2650] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:04 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:04.805941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:04.814800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1321a902-e7db-434b-b824-dde543efb1df tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1523 microversion: 2.1 time: 0.194361 Aug 04 04:35:04.815779 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1342/2651] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:04 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:04.901838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:04.902453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:04.908924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.909374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:04.910148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:04.910582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.133833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:05.142033 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26665ac3-a799-4dce-aa1c-2f4c7173d375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1317 microversion: 2.1 time: 0.244120 Aug 04 04:35:05.142791 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1310/2652] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:04 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:05.221591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:05.222313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:05.229099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.229569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.230343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.230903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.362062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e82aa436-3328-4904-8b4e-4a511bbaf9b6 req-3e487833-ad04-4ffe-a217-f3aa257b0dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee7160e-6b36-4d4f-a709-35df0bf04698", "tag": "239fe2be-b8f3-4876-b7d3-4a295e71cd25"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:05.372921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e82aa436-3328-4904-8b4e-4a511bbaf9b6 req-3e487833-ad04-4ffe-a217-f3aa257b0dd4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.373368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e82aa436-3328-4904-8b4e-4a511bbaf9b6 req-3e487833-ad04-4ffe-a217-f3aa257b0dd4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.384737 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e82aa436-3328-4904-8b4e-4a511bbaf9b6 req-3e487833-ad04-4ffe-a217-f3aa257b0dd4 service nova] Creating event network-changed:239fe2be-b8f3-4876-b7d3-4a295e71cd25 for instance eee7160e-6b36-4d4f-a709-35df0bf04698 on n-h1-851337-5 Aug 04 04:35:05.394304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:05.398878 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e82aa436-3328-4904-8b4e-4a511bbaf9b6 req-3e487833-ad04-4ffe-a217-f3aa257b0dd4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032552 Aug 04 04:35:05.403419 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9b09b4f-827a-4ba2-8b73-6afd0fc0c4a8 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.185771 Aug 04 04:35:05.404314 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1311/2653] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:35:05.405131 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1343/2654] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:05 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:05.433641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:05.434408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:05.440662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.441103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.441848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.442277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.580723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:05.588893 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44535bb5-034c-4509-a62b-60470340f752 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.160052 Aug 04 04:35:05.589470 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1312/2655] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:05 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:05.715005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:05.715616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:05.721781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.722230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.723022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.723476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.839840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:05.840460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:05.846548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.847039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.847813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:05.848254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:05.853647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:05.861229 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d90c3d3-e198-43b7-8c24-5e407e4d6757 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.150708 Aug 04 04:35:05.862155 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1344/2656] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:05 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:05.989229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:05.997005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93353a85-8a53-4a5b-94a4-fcdc7e5506e3 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1503 microversion: 2.1 time: 0.161598 Aug 04 04:35:05.997785 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1313/2657] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:05 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:06.019135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a23394f3-6030-4c3e-afc1-a5bd8efe46d9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'create', calling method: .version_select at 0x7f191a5cd9d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1409637793", "description": "tempest-description-861093496"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:06.164516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:06.165346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:06.165472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a23394f3-6030-4c3e-afc1-a5bd8efe46d9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.149718 Aug 04 04:35:06.166632 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1345/2658] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:35:06 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:06.173827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.174306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:06.175186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.175625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:06.178625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1409637793"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:06.179275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:06.185457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.186043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:06.186830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.187364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:06.368029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:06.375538 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eeb7f822-ee0d-432b-a02d-1f80f976fae4 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1507 microversion: 2.1 time: 0.215976 Aug 04 04:35:06.376117 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1314/2659] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:06 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:06.381862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Adding security group cc2f0240-106b-48b1-b321-6a3cb2040abb to port 9f67df9f-df80-4ce6-9b68-b9a15fb4db15 Aug 04 04:35:06.436963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:06.440938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:06.450106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.450552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:06.451645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.452141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:06.682503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:06.692588 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ca1afa9-c740-4005-a0ff-464496b8c5c1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.264112 Aug 04 04:35:06.693294 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1315/2660] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:06 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:06.699362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:06.700257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:06.707947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.708577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:06.709793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:06.710334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.181834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:07.190226 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-23114eef-368e-4eac-8614-b62491b014f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.495674 Aug 04 04:35:07.191014 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1316/2661] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:06 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:07.196478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:07.197315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:07.199476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:07.205071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:07.205814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.206588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:07.207059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.226155 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-165bbedd-8b46-4ecc-9d44-a3658c64fbf9 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action" status: 202 len: 0 microversion: 2.1 time: 1.051239 Aug 04 04:35:07.226905 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1346/2662] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:06 2022] POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:35:07.235658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1409637793"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:07.236448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:07.244635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:07.245379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.246436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:07.248693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.505970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:07.515037 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-873158d8-b364-43dd-8d65-ce41337519a2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.322293 Aug 04 04:35:07.528577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Removing security group cc2f0240-106b-48b1-b321-6a3cb2040abb from port 9f67df9f-df80-4ce6-9b68-b9a15fb4db15 Aug 04 04:35:07.530096 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1317/2663] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:07 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:07.535686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e004fb16-089d-4cb3-89ea-0a5d92d1fe00 req-24a26795-86e0-4d06-89c4-33393f70ab45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a898849-6e47-44e9-a1db-f703d55ab0ca", "tag": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:07.546737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e004fb16-089d-4cb3-89ea-0a5d92d1fe00 req-24a26795-86e0-4d06-89c4-33393f70ab45 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:07.547477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e004fb16-089d-4cb3-89ea-0a5d92d1fe00 req-24a26795-86e0-4d06-89c4-33393f70ab45 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.562416 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e004fb16-089d-4cb3-89ea-0a5d92d1fe00 req-24a26795-86e0-4d06-89c4-33393f70ab45 service nova] Creating event network-changed:9f67df9f-df80-4ce6-9b68-b9a15fb4db15 for instance 6a898849-6e47-44e9-a1db-f703d55ab0ca on n-h2-851337-5 Aug 04 04:35:07.568491 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e004fb16-089d-4cb3-89ea-0a5d92d1fe00 req-24a26795-86e0-4d06-89c4-33393f70ab45 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036565 Aug 04 04:35:07.569665 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1318/2664] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:07.715034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:07.715826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:07.722434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:07.723226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.724138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:07.724788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:07.964424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=20 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:08.037995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:08.046155 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4714feec-7e5d-4f48-9578-247cdd19cc40 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.335841 Aug 04 04:35:08.046935 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1319/2665] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:07 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:08.064017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8fecee5b-006b-4e78-b956-b01e13f5ce59"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:08.066386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:08.072646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:08.073103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:08.073881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:08.074349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:08.124686 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] HTTP exception thrown: Volume f6ce304f-8a51-403b-8aa5-bd3e965d94fe could not be found. Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Request method failure captured: Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754/os-volume_attachments/f6ce304f-8a51-403b-8aa5-bd3e965d94fe HTTP/1.1 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 74 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60wTprUXApBdO9IuaqNkSvoMKmqBZ3anoHJUpObBYtnyiiOusmsWtKtLicm5QacEkLaN_ZpnyOON2cfywzyDPhnxFMKzQqO1GYBk2S9s8UW27Ui080LgBGEmO-w_8aXoJimbjPvRvc9BhYe1N6ofhUqJKOv6GV-MZKsqIZTdceWmnA0 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 74730632130b4f3eb25b1947ba4d7a45 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesAdminNegativeTest-173154609 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/74730632130b4f3eb25b1947ba4d7a45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/74730632130b4f3eb25b1947ba4d7a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/74730632130b4f3eb25b1947ba4d7a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_74730632130b4f3eb25b1947ba4d7a45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesAdminNegativeTest-173154609 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 74730632130b4f3eb25b1947ba4d7a45 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-173154609 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesAdminNegativeTest-173154609-project-admin Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 60a501daebaa43d887b3aa165b11ad75 Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesAdminNegativeTest-173154609-project-admin Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: {"volumeAttachment": {"volumeId": "8fecee5b-006b-4e78-b956-b01e13f5ce59"}} Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: exception: Volume f6ce304f-8a51-403b-8aa5-bd3e965d94fe could not be found. Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'server_id': 'fd8709f3-65aa-40b4-aff6-ed03574b7754', 'id': 'f6ce304f-8a51-403b-8aa5-bd3e965d94fe', 'body': {'volumeAttachment': {'volumeId': '8fecee5b-006b-4e78-b956-b01e13f5ce59'}}} Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6ce304f-8a51-403b-8aa5-bd3e965d94fe could not be found. (HTTP 404) (Request-ID: req-0b6996a4-94bb-4730-8c99-49682c65e78b) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:35:08.126840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6ce304f-8a51-403b-8aa5-bd3e965d94fe could not be found. Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6ce304f-8a51-403b-8aa5-bd3e965d94fe could not be found. Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6ce304f-8a51-403b-8aa5-bd3e965d94fe could not be found. Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] Returning 404 to user: Volume f6ce304f-8a51-403b-8aa5-bd3e965d94fe could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b6aefe3-29bb-49af-9dea-785005311a87 tempest-VolumesAdminNegativeTest-173154609 tempest-VolumesAdminNegativeTest-173154609-project-admin] 10.222.0.69 "PUT /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754/os-volume_attachments/f6ce304f-8a51-403b-8aa5-bd3e965d94fe" status: 404 len: 109 microversion: 2.1 time: 0.068295 Aug 04 04:35:08.130712 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1320/2666] 10.222.0.69 () {60 vars in 1433 bytes} [Thu Aug 4 04:35:08 2022] PUT /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754/os-volume_attachments/f6ce304f-8a51-403b-8aa5-bd3e965d94fe => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:08.213871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:08.214421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:08.228331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:08.228808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:08.229612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:08.230048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:08.243986 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-668af8ae-16dd-47d8-a4ed-634d6d590c8f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action" status: 202 len: 0 microversion: 2.1 time: 1.012003 Aug 04 04:35:08.250262 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1347/2667] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:07 2022] POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:08.256355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37ce1e61-2884-47ba-b24c-8d26a268b1c0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'create', calling method: .version_select at 0x7f191a229160>, body: {"pool": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:08.603882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:08.615304 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a223a9bb-9261-4139-9ff9-7eb3994bb9ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.407326 Aug 04 04:35:08.617957 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1321/2668] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:08 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:08.623729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:08.624527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:08.635296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:08.635766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:08.636956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:08.637499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:08.911927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:08.925253 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff39b6ec-483e-4a4b-b681-9a4861a90b88 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.305905 Aug 04 04:35:08.927219 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1322/2669] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:08 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:09.067082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:09.068191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:09.076044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:09.076569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:09.077445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:09.078095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:09.327107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:09.342622 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d309d989-524b-4cef-8b39-77c49299c7b5 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.278751 Aug 04 04:35:09.344047 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1323/2670] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:09 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:09.583597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4a2e3d4b-9954-4c69-be49-fa4f620e83a3 req-551d5d1f-28b2-439b-92c0-245c61cd1f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a898849-6e47-44e9-a1db-f703d55ab0ca", "tag": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:09.595432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4a2e3d4b-9954-4c69-be49-fa4f620e83a3 req-551d5d1f-28b2-439b-92c0-245c61cd1f5f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:09.595885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4a2e3d4b-9954-4c69-be49-fa4f620e83a3 req-551d5d1f-28b2-439b-92c0-245c61cd1f5f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:09.608301 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4a2e3d4b-9954-4c69-be49-fa4f620e83a3 req-551d5d1f-28b2-439b-92c0-245c61cd1f5f service nova] Creating event network-changed:9f67df9f-df80-4ce6-9b68-b9a15fb4db15 for instance 6a898849-6e47-44e9-a1db-f703d55ab0ca on n-h2-851337-5 Aug 04 04:35:09.613608 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4a2e3d4b-9954-4c69-be49-fa4f620e83a3 req-551d5d1f-28b2-439b-92c0-245c61cd1f5f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033717 Aug 04 04:35:09.614213 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1324/2671] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:35:09.643202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:09.644246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:09.652416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:09.653650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:09.654770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:09.655397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.030390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:10.039814 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-873ed103-95de-41da-b001-cad16d5b511a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.402600 Aug 04 04:35:10.040698 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1325/2672] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:09 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:10.047367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:10.047367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:10.057071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.057757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.058927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.060153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.080324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:10.197574 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37ce1e61-2884-47ba-b24c-8d26a268b1c0 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.945262 Aug 04 04:35:10.205620 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1348/2673] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:35:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:10.211998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'action', calling method: .version_select at 0x7f192151b0d0>, body: {"addFloatingIp": {"address": "172.25.2.193"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:10.215716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:10.223738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.223738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.224436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.224875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.301847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Acquired lock "refresh_cache-6a898849-6e47-44e9-a1db-f703d55ab0ca" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:35:10.425716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:10.437165 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8c1b81fc-94a2-405c-bfc6-946b982c6241 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.394383 Aug 04 04:35:10.443545 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1326/2674] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:10 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:10.461259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:10.462134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:10.472317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.472939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.474144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.474144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.775694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:10.785268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24fec337-363c-4adc-b07c-78e6dd01f122 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.338794 Aug 04 04:35:10.786089 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1327/2675] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:10 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:10.799446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:10.801240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:10.810686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.811435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.814298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.815334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.848455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:10.950800 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c3fe56c8-2b7b-44f6-af06-39c18e08ccc5 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 204 len: 0 microversion: 2.1 time: 0.163192 Aug 04 04:35:10.951552 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1328/2676] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:10 2022] DELETE /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:10.960651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:10.961374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:10.968216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.968672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:10.969465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:10.969905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:11.193070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:11.201477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24f35376-c369-42eb-8155-18b88e619d90 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1513 microversion: 2.1 time: 0.245576 Aug 04 04:35:11.202201 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1329/2677] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:10 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:11.206676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:11.207518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:11.213943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:11.214404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:11.215209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:11.215651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:11.439721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:11.463941 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fde89a33-d739-4575-92e2-813a2a0d78e2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.260873 Aug 04 04:35:11.465586 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1330/2678] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:11 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:11.472008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:11.472962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:11.479762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:11.480213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:11.481088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:11.481526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:11.758208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:12.015010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=16 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:12.026754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:12.034397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-47fbbe7e-496b-4770-9ccf-eab768a66833 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.566725 Aug 04 04:35:12.035007 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1331/2679] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:11 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:12.039581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:12.040193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:12.046165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:12.046590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:12.047400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:12.047835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:12.345947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:12.348470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Building network info cache for instance {{(pid=119343) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:35:12.373168 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-769084b8-a2cf-488b-b8cc-e4eada9098be tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1471 microversion: 2.1 time: 0.337011 Aug 04 04:35:12.373976 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1332/2680] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:12 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1471 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:12.386840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:12.387751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:12.396063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:12.396517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:12.397296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:12.397736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:12.623768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:12.632820 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0942ad77-d3e1-449c-bce5-ebd42d0ecf82 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1513 microversion: 2.1 time: 0.257082 Aug 04 04:35:12.633571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1333/2681] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:12 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:12.651819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f250f519-e9d9-47f4-b461-3a5512ebf4e7 req-fc790afd-f420-45e4-9af0-9717ce591916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a898849-6e47-44e9-a1db-f703d55ab0ca", "tag": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:12.665544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f250f519-e9d9-47f4-b461-3a5512ebf4e7 req-fc790afd-f420-45e4-9af0-9717ce591916 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:12.665992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f250f519-e9d9-47f4-b461-3a5512ebf4e7 req-fc790afd-f420-45e4-9af0-9717ce591916 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:12.680438 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f250f519-e9d9-47f4-b461-3a5512ebf4e7 req-fc790afd-f420-45e4-9af0-9717ce591916 service nova] Creating event network-changed:9f67df9f-df80-4ce6-9b68-b9a15fb4db15 for instance 6a898849-6e47-44e9-a1db-f703d55ab0ca on n-h2-851337-5 Aug 04 04:35:12.685619 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f250f519-e9d9-47f4-b461-3a5512ebf4e7 req-fc790afd-f420-45e4-9af0-9717ce591916 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050540 Aug 04 04:35:12.686229 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1334/2682] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:12.691699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:12.692392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:12.699262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:12.699966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:12.700736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:12.701169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:12.937079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:12.946636 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c666397d-00f0-46b3-8dff-5d4bb13db756 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.257349 Aug 04 04:35:12.947250 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1335/2683] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:12 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:13.055967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:13.056705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:13.064578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.065463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.065830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.066272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.075334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Updating instance_info_cache with network_info: [{"id": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15", "address": "fa:16:3e:bb:c3:d8", "network": {"id": "355f85b0-0313-4831-9b8a-d67cb7fdd943", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-742171830-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b25dc421755047c9b6379791a2a726ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f67df9f-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119343) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:35:13.092252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Releasing lock "refresh_cache-6a898849-6e47-44e9-a1db-f703d55ab0ca" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:35:13.094079 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c92795d-08c8-48b0-973f-df6e39a1aba8 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action" status: 202 len: 0 microversion: 2.1 time: 2.886496 Aug 04 04:35:13.098831 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1349/2684] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:10 2022] POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action => generated 0 bytes in 2892 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:35:13.104924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Action: 'action', calling method: .version_select at 0x7f192151bf70>, body: {"removeFloatingIp": {"address": "172.25.2.193"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:13.334847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:13.345218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:13.350610 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1441eaa4-5122-4bf9-9631-cc57cdb2d18e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.299008 Aug 04 04:35:13.352376 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1336/2685] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:13 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:13.354676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.355216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.356010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.356451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.357502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-881defc6-682b-43e5-8308-8f48fb539ad3 req-1e37bc09-4524-4e72-9549-7bfb6126e984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87982710-35b2-4150-826e-b9677f43716b", "name": "network-vif-plugged", "status": "completed", "tag": "bcb34fad-749a-4fb6-844b-124022943498"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:13.368964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-881defc6-682b-43e5-8308-8f48fb539ad3 req-1e37bc09-4524-4e72-9549-7bfb6126e984 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.369482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-881defc6-682b-43e5-8308-8f48fb539ad3 req-1e37bc09-4524-4e72-9549-7bfb6126e984 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.381370 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-881defc6-682b-43e5-8308-8f48fb539ad3 req-1e37bc09-4524-4e72-9549-7bfb6126e984 service nova] Creating event network-vif-plugged:bcb34fad-749a-4fb6-844b-124022943498 for instance 87982710-35b2-4150-826e-b9677f43716b on n-h1-851337-5 Aug 04 04:35:13.386885 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-881defc6-682b-43e5-8308-8f48fb539ad3 req-1e37bc09-4524-4e72-9549-7bfb6126e984 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 Aug 04 04:35:13.387530 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1337/2686] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:13.396809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:13.397518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:13.406413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.407019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.407896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.408416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.638124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:13.646042 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6c8f80b7-a095-483d-9ed3-7d1caab8f209 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.253252 Aug 04 04:35:13.647298 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1338/2687] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:13 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:13.665960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:13.667377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:13.667805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Acquired lock "refresh_cache-6a898849-6e47-44e9-a1db-f703d55ab0ca" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:35:13.673641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.674091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.674869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.675338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.936020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:13.943814 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7ad5cae-3567-47bf-9644-1a3e7ca0c68c tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1513 microversion: 2.1 time: 0.281708 Aug 04 04:35:13.948710 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1339/2688] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:13 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:13.968454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:13.969086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:13.975951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.975951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:13.976762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:13.977199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:14.452774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:14.460905 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6c187fd9-b6e9-45db-8ec6-16d440a4ed20 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.495914 Aug 04 04:35:14.461738 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1340/2689] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:13 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:14.466382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:14.467084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:14.473421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:14.474055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:14.475037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:14.475478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:14.818009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:14.830862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2456a772-6266-425e-854e-2b7dc35cbf86 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1317 microversion: 2.1 time: 0.367890 Aug 04 04:35:14.848824 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1341/2690] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:14 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:14.857112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:14.858743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:14.865584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:14.866385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:14.867472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:14.868692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:15.563801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:15.571446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:15.574549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Building network info cache for instance {{(pid=119343) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:35:15.577255 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0335045c-f35e-4002-9b24-b4e9c6c46520 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.724740 Aug 04 04:35:15.583267 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1342/2691] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:14 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:15.588422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:15.592072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:15.609106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:15.609775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:15.611396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:15.612279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.041877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:16.051238 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-acba17c6-8f72-4527-bc83-c42a257167ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 200 len: 1513 microversion: 2.1 time: 0.466653 Aug 04 04:35:16.054008 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1343/2692] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:15 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 1513 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:16.064396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:16.065295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:16.075734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:16.076545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.078112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:16.078719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.457605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:16.466938 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9456f2c2-b5ef-48f5-a659-6b02bd5d80c8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.410789 Aug 04 04:35:16.471133 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1344/2693] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:16 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:16.478387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-81c73de4-27b7-4a43-b911-b41f876be8a2 req-45d3677f-aae6-4b5e-bb10-1300e7a86520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a898849-6e47-44e9-a1db-f703d55ab0ca", "tag": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:16.500757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-81c73de4-27b7-4a43-b911-b41f876be8a2 req-45d3677f-aae6-4b5e-bb10-1300e7a86520 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:16.501206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-81c73de4-27b7-4a43-b911-b41f876be8a2 req-45d3677f-aae6-4b5e-bb10-1300e7a86520 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.516747 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-81c73de4-27b7-4a43-b911-b41f876be8a2 req-45d3677f-aae6-4b5e-bb10-1300e7a86520 service nova] Creating event network-changed:9f67df9f-df80-4ce6-9b68-b9a15fb4db15 for instance 6a898849-6e47-44e9-a1db-f703d55ab0ca on n-h2-851337-5 Aug 04 04:35:16.528049 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-81c73de4-27b7-4a43-b911-b41f876be8a2 req-45d3677f-aae6-4b5e-bb10-1300e7a86520 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055618 Aug 04 04:35:16.530511 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1345/2694] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:16.547709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:16.548523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:16.556840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:16.557292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.558370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:16.559109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.937607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:16.940664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Updating instance_info_cache with network_info: [{"id": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15", "address": "fa:16:3e:bb:c3:d8", "network": {"id": "355f85b0-0313-4831-9b8a-d67cb7fdd943", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-742171830-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b25dc421755047c9b6379791a2a726ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f67df9f-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119343) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:35:16.951656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Releasing lock "refresh_cache-6a898849-6e47-44e9-a1db-f703d55ab0ca" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:35:16.952838 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9e7c9c7-6214-4ed6-973a-5d0e80f50c4f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action" status: 202 len: 0 microversion: 2.1 time: 3.852714 Aug 04 04:35:16.953909 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1350/2695] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:13 2022] POST /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca/action => generated 0 bytes in 3854 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:35:16.959887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-90a929c2-0e57-4245-96c2-61913ae93172 req-9cdf21ec-a283-4d0c-83d0-65532d3ff21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5633ea-df6b-404c-90e8-611d4a40f753", "name": "network-vif-unplugged", "status": "completed", "tag": "a1864dde-7a45-41ae-93e7-81d73b54d4ad"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:16.960787 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-508e7ae0-6d91-4e16-abf2-92492783a335 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1467 microversion: 2.1 time: 0.428914 Aug 04 04:35:16.961422 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1346/2696] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:16 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1467 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:16.969426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4da30525-a7fd-4f6c-a18f-420d481e3dfa req-b8d5c945-4bdf-4785-b18e-244d6e28d549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8709f3-65aa-40b4-aff6-ed03574b7754", "name": "network-vif-deleted", "tag": "74478227-a879-427d-b2cd-c4ebb331fec5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:16.978459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90a929c2-0e57-4245-96c2-61913ae93172 req-9cdf21ec-a283-4d0c-83d0-65532d3ff21a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:16.979086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90a929c2-0e57-4245-96c2-61913ae93172 req-9cdf21ec-a283-4d0c-83d0-65532d3ff21a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.984616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4da30525-a7fd-4f6c-a18f-420d481e3dfa req-b8d5c945-4bdf-4785-b18e-244d6e28d549 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:16.985314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4da30525-a7fd-4f6c-a18f-420d481e3dfa req-b8d5c945-4bdf-4785-b18e-244d6e28d549 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:16.998163 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-90a929c2-0e57-4245-96c2-61913ae93172 req-9cdf21ec-a283-4d0c-83d0-65532d3ff21a service nova] Creating event network-vif-unplugged:a1864dde-7a45-41ae-93e7-81d73b54d4ad for instance 3b5633ea-df6b-404c-90e8-611d4a40f753 on n-h2-851337-5 Aug 04 04:35:16.999965 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4da30525-a7fd-4f6c-a18f-420d481e3dfa req-b8d5c945-4bdf-4785-b18e-244d6e28d549 service nova] Creating event network-vif-deleted:74478227-a879-427d-b2cd-c4ebb331fec5 for instance fd8709f3-65aa-40b4-aff6-ed03574b7754 on n-h1-851337-5 Aug 04 04:35:17.004576 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-90a929c2-0e57-4245-96c2-61913ae93172 req-9cdf21ec-a283-4d0c-83d0-65532d3ff21a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049240 Aug 04 04:35:17.005744 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1351/2697] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:17.006212 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4da30525-a7fd-4f6c-a18f-420d481e3dfa req-b8d5c945-4bdf-4785-b18e-244d6e28d549 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042814 Aug 04 04:35:17.011388 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1347/2698] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:17.013908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:17.014816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:17.017875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99ae5f91-7712-47c7-924a-7d1e3562ddec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '.version_select at 0x7f191a829310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:17.024485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:17.025025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:17.026008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:17.026469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:17.764980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:17.781211 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a13a1a1-5399-42a3-bfe4-187aba580490 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.773795 Aug 04 04:35:17.781887 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1352/2699] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:17 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:17.789819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82123671-3148-40fd-afde-c7d3f77c3e69 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:17.792826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-82123671-3148-40fd-afde-c7d3f77c3e69 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:17.800859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82123671-3148-40fd-afde-c7d3f77c3e69 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:17.801591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82123671-3148-40fd-afde-c7d3f77c3e69 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:17.802582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82123671-3148-40fd-afde-c7d3f77c3e69 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:17.803250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82123671-3148-40fd-afde-c7d3f77c3e69 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.244508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:18.252025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-82123671-3148-40fd-afde-c7d3f77c3e69 tempest-ServersOnMultiNodesTest-239113299 tempest-ServersOnMultiNodesTest-239113299-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1618 microversion: 2.1 time: 0.469025 Aug 04 04:35:18.252609 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1353/2700] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:17 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1618 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:18.258323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:18.259244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: fd8709f3-65aa-40b4-aff6-ed03574b7754] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:18.267017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.267746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.268587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.269178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.288115 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] HTTP exception thrown: Instance fd8709f3-65aa-40b4-aff6-ed03574b7754 could not be found. Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Request method failure captured: Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 HTTP/1.1 Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wDZRl_LrM76gJGNsrv0SmZGCXRMq93kbIkBRYUf1NlsRqJW-L0HEI0bLm3wlfyujMl-TQtO9hTGGmCZsWfYKS5RbaMISvzJ9p8W83MxuMh3H9-s71Oyf37h-LPhw8BU7mbWN4oDnQFt5NmkfIthIYxZL8g-5EzOMTjl5JLGk36Jdk Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4e35e9177fc54bae85afe4a3c477ef7b Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesAdminNegativeTest-143947730 Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e35e9177fc54bae85afe4a3c477ef7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4e35e9177fc54bae85afe4a3c477ef7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e35e9177fc54bae85afe4a3c477ef7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4e35e9177fc54bae85afe4a3c477ef7b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesAdminNegativeTest-143947730 Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4e35e9177fc54bae85afe4a3c477ef7b Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-143947730 Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesAdminNegativeTest-143947730-project Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d1b140919b4d4134a71946a9f1579b9c Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesAdminNegativeTest-143947730-project Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance fd8709f3-65aa-40b4-aff6-ed03574b7754 could not be found. Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'fd8709f3-65aa-40b4-aff6-ed03574b7754'} Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8709f3-65aa-40b4-aff6-ed03574b7754 could not be found. Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8709f3-65aa-40b4-aff6-ed03574b7754 could not be found. Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:18.289939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8709f3-65aa-40b4-aff6-ed03574b7754 could not be found. Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Returning 404 to user: Instance fd8709f3-65aa-40b4-aff6-ed03574b7754 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0409366f-6bd0-46cd-b791-2ee37bf09592 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754" status: 404 len: 111 microversion: 2.1 time: 0.037924 Aug 04 04:35:18.294242 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1354/2701] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:18 2022] GET /compute/v2.1/servers/fd8709f3-65aa-40b4-aff6-ed03574b7754 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:18.296905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:18.297977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:18.304965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.305433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.306212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.306908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.680956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:18.688809 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f47d13a-ed13-4a50-830e-a6e4920cac07 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.395838 Aug 04 04:35:18.689647 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1355/2702] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:18 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:18.694225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:18.694710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:18.700753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.701196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.701949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.702409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.728392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:18.852136 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5822037b-c5fa-4c6b-9580-d2532bd89f41 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 204 len: 0 microversion: 2.1 time: 0.160078 Aug 04 04:35:18.853274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1356/2703] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:18 2022] DELETE /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:18.861177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:18.862884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:18.872279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.873374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:18.874763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:18.876064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.059738 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99ae5f91-7712-47c7-924a-7d1e3562ddec tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/a3b1da56-71ff-4ca1-93ab-03326d3275d6" status: 202 len: 0 microversion: 2.1 time: 2.046419 Aug 04 04:35:19.061581 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1348/2704] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:35:17 2022] DELETE /compute/v2.1/os-floating-ips/a3b1da56-71ff-4ca1-93ab-03326d3275d6 => generated 0 bytes in 2049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:19.070164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:19.071626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:19.079364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.080128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.081448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.082522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.098827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:19.108848 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7719ada7-ee9c-4915-a894-79bf8a08e65e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.253505 Aug 04 04:35:19.110192 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1357/2705] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:18 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:19.115516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0998fd4b-62cd-4e3f-a587-bda0292886b9 req-16c0a6b5-7573-44eb-8d82-3bc772540175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee7160e-6b36-4d4f-a709-35df0bf04698", "name": "network-vif-plugged", "status": "completed", "tag": "239fe2be-b8f3-4876-b7d3-4a295e71cd25"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:19.127119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0998fd4b-62cd-4e3f-a587-bda0292886b9 req-16c0a6b5-7573-44eb-8d82-3bc772540175 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.127576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0998fd4b-62cd-4e3f-a587-bda0292886b9 req-16c0a6b5-7573-44eb-8d82-3bc772540175 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.139722 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0998fd4b-62cd-4e3f-a587-bda0292886b9 req-16c0a6b5-7573-44eb-8d82-3bc772540175 service nova] Creating event network-vif-plugged:239fe2be-b8f3-4876-b7d3-4a295e71cd25 for instance eee7160e-6b36-4d4f-a709-35df0bf04698 on n-h1-851337-5 Aug 04 04:35:19.144742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0998fd4b-62cd-4e3f-a587-bda0292886b9 req-16c0a6b5-7573-44eb-8d82-3bc772540175 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Aug 04 04:35:19.145576 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1358/2706] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:19.151561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8270cb2-4647-41ab-9902-ebfc4b830329 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '.version_select at 0x7f191a4f3790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:19.297943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:19.307971 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd0d10e3-d7be-4589-8cc8-9afc75390ea1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1473 microversion: 2.1 time: 0.244565 Aug 04 04:35:19.308787 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1349/2707] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:19 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1473 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:19.415055 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8270cb2-4647-41ab-9902-ebfc4b830329 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/cc2f0240-106b-48b1-b321-6a3cb2040abb" status: 202 len: 0 microversion: 2.1 time: 0.268011 Aug 04 04:35:19.420282 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1359/2708] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:35:19 2022] DELETE /compute/v2.1/os-security-groups/cc2f0240-106b-48b1-b321-6a3cb2040abb => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:19.433419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:19.433926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:19.442890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.451040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.452137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.452583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.486414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:19.574210 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc4b5db7-10b9-41fc-8517-70257780638d tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 204 len: 0 microversion: 2.1 time: 0.152768 Aug 04 04:35:19.574782 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1350/2709] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:19 2022] DELETE /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:19.583904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:19.584715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:19.591936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.592456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.593289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.593790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.711125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:19.712127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:19.718457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.718911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.719708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:19.720147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:19.738985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:19.747781 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0a29b4b-6d27-4e0b-ac6d-beb746cda132 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1509 microversion: 2.1 time: 0.168718 Aug 04 04:35:19.750998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1360/2710] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:19 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:19.853862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:19.864210 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6a43340-ca9a-4a73-b101-ce4e74f0c56b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.157976 Aug 04 04:35:19.864987 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1351/2711] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:19 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:20.131228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:20.132102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:20.140928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.141695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:20.143165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.143804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:20.299176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:20.307650 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27a0d986-c95c-4264-87b8-a2419117202a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.180358 Aug 04 04:35:20.308235 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1361/2712] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:20 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:20.328647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:20.329293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:20.339229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.339826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:20.340710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.341251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:20.482082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:20.490275 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-927992e9-86c6-4abd-af49-daeb420e1807 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1473 microversion: 2.1 time: 0.165334 Aug 04 04:35:20.490871 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1352/2713] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:20 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:20.769183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:20.769738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:20.776866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.777318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:20.778090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.778526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:20.886349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:20.887441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:20.894815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.895545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:20.896431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:20.897037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:21.034674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:21.044767 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab93ff7b-4458-49ce-9877-52a151f13b7f tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1509 microversion: 2.1 time: 0.279274 Aug 04 04:35:21.045393 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1362/2714] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:20 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:21.088076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:21.096156 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d0c26f7e-b928-4b50-b790-8fec613f41ea tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1315 microversion: 2.1 time: 0.214289 Aug 04 04:35:21.096749 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1353/2715] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:20 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:21.160886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-38cda8e5-edf3-4b74-9219-06d540046fc7 req-f88c78b2-908c-4872-a72d-9105cb6b02f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5633ea-df6b-404c-90e8-611d4a40f753", "name": "network-vif-plugged", "status": "completed", "tag": "a1864dde-7a45-41ae-93e7-81d73b54d4ad"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:21.170722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-38cda8e5-edf3-4b74-9219-06d540046fc7 req-f88c78b2-908c-4872-a72d-9105cb6b02f8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:21.171197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-38cda8e5-edf3-4b74-9219-06d540046fc7 req-f88c78b2-908c-4872-a72d-9105cb6b02f8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:21.182962 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-38cda8e5-edf3-4b74-9219-06d540046fc7 req-f88c78b2-908c-4872-a72d-9105cb6b02f8 service nova] Creating event network-vif-plugged:a1864dde-7a45-41ae-93e7-81d73b54d4ad for instance 3b5633ea-df6b-404c-90e8-611d4a40f753 on n-h2-851337-5 Aug 04 04:35:21.188524 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-38cda8e5-edf3-4b74-9219-06d540046fc7 req-f88c78b2-908c-4872-a72d-9105cb6b02f8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Aug 04 04:35:21.189132 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1363/2716] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:21.328929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:21.330120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:21.336981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:21.337423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:21.338192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:21.338621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:21.374542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7d944d7-2c56-481d-98f1-6fcccdce2fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:21.375177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7d944d7-2c56-481d-98f1-6fcccdce2fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:21.381952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d944d7-2c56-481d-98f1-6fcccdce2fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:21.382979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d944d7-2c56-481d-98f1-6fcccdce2fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:21.383912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d944d7-2c56-481d-98f1-6fcccdce2fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:21.384441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d944d7-2c56-481d-98f1-6fcccdce2fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:21.412406 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7d944d7-2c56-481d-98f1-6fcccdce2fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/ips" status: 200 len: 150 microversion: 2.1 time: 0.150969 Aug 04 04:35:21.413000 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1354/2717] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:35:21 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/ips => generated 150 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:21.512742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:21.514153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:21.533179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:21.533642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:21.534516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:21.535100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.057014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:22.071148 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb12e72b-de90-4c05-b3cc-ee48cd9ddc10 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.746223 Aug 04 04:35:22.075235 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1364/2718] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:21 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:22.079770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:22.097422 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-838d18ec-5504-48e0-b112-236c03159e8e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 200 len: 1473 microversion: 2.1 time: 0.586625 Aug 04 04:35:22.101843 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1355/2719] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:21 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 1473 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:22.115693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:22.116325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:22.119425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:22.120320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:22.131063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.131847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.136533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.138314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.144732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.145537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.146536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.147258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.244954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:22.434117 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e59d1e0-7372-46ec-8aa3-083d919db6cc tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "DELETE /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 204 len: 0 microversion: 2.1 time: 0.356711 Aug 04 04:35:22.436141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1365/2720] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:22 2022] DELETE /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:22.451732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-80437048-0317-413a-8500-e54076bb0811 req-839be63f-9e4f-4d77-b481-9ecff69025c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87982710-35b2-4150-826e-b9677f43716b", "name": "network-vif-deleted", "tag": "bcb34fad-749a-4fb6-844b-124022943498"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:22.490349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-80437048-0317-413a-8500-e54076bb0811 req-839be63f-9e4f-4d77-b481-9ecff69025c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.492963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-80437048-0317-413a-8500-e54076bb0811 req-839be63f-9e4f-4d77-b481-9ecff69025c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.512473 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-80437048-0317-413a-8500-e54076bb0811 req-839be63f-9e4f-4d77-b481-9ecff69025c4 service nova] Creating event network-vif-deleted:bcb34fad-749a-4fb6-844b-124022943498 for instance 87982710-35b2-4150-826e-b9677f43716b on n-h1-851337-5 Aug 04 04:35:22.518864 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-80437048-0317-413a-8500-e54076bb0811 req-839be63f-9e4f-4d77-b481-9ecff69025c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079481 Aug 04 04:35:22.519901 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1366/2721] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:22.529072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:22.529800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:22.542644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.543143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.543942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.544387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.660659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:22.686398 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8e22ad3-b343-4f85-9a9b-6900f0532eac tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1509 microversion: 2.1 time: 0.582592 Aug 04 04:35:22.700436 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1356/2722] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:22 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1509 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:22.707323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:22.708304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:22.716006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.716677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.717619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.718246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.793890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:22.803431 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92452ffc-0a3f-4e02-90ff-407ff29ac825 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1503 microversion: 2.1 time: 0.280514 Aug 04 04:35:22.804640 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1367/2723] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:22 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:22.829738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:22.830308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:22.842488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.842946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:22.850623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:22.851755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.129783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:23.141352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6184f18-5bb2-47a9-9a26-1341817a3375 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1679 microversion: 2.1 time: 0.438269 Aug 04 04:35:23.154650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1357/2724] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:22 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1679 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:23.159729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:23.160365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:23.174752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.175873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.176892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.177518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.304000 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Removing security group acaf19b5-00bd-4aef-95fb-266bf91666e1 from port 239fe2be-b8f3-4876-b7d3-4a295e71cd25 Aug 04 04:35:23.505489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:23.513938 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-78711e9f-5ab8-46ec-bbdc-1f187da2df78 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.357919 Aug 04 04:35:23.514457 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1358/2725] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:23 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:23.519816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:23.520715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 87982710-35b2-4150-826e-b9677f43716b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:23.527309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.527763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.528770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.529252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.544048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance 87982710-35b2-4150-826e-b9677f43716b could not be found. Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b HTTP/1.1 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 87982710-35b2-4150-826e-b9677f43716b could not be found. Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '87982710-35b2-4150-826e-b9677f43716b'} Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87982710-35b2-4150-826e-b9677f43716b could not be found. Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87982710-35b2-4150-826e-b9677f43716b could not be found. Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:23.545750 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87982710-35b2-4150-826e-b9677f43716b could not be found. Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance 87982710-35b2-4150-826e-b9677f43716b could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4ce0722-f3e8-4e96-8fbf-bf8bd97b571f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b" status: 404 len: 111 microversion: 2.1 time: 0.031740 Aug 04 04:35:23.550182 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1359/2726] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:23 2022] GET /compute/v2.1/servers/87982710-35b2-4150-826e-b9677f43716b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:23.556870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:23.557521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:23.563469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.563914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.564672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.565566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.591357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:23.605939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:23.670337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:23.682030 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc0588f0-d548-4389-be2f-a41d12a2e2d8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 204 len: 0 microversion: 2.1 time: 0.129307 Aug 04 04:35:23.682606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1360/2727] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:23 2022] DELETE /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:35:23.691303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:23.692020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:23.698648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.699153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:23.699929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:23.700367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.013870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:24.021877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-beab1e21-6896-4d28-bb73-f43cf97b929b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1472 microversion: 2.1 time: 0.334768 Aug 04 04:35:24.022137 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a1dfd1b-eaf4-4a41-8212-8cc1df34b88c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698/action" status: 202 len: 0 microversion: 2.1 time: 1.200808 Aug 04 04:35:24.026436 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1361/2728] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:23 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:24.027247 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1368/2729] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:22 2022] POST /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698/action => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:24.032287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5c8a2716-8733-448e-8055-c0a7f3fa54eb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b758bbc6-9385-4236-8692-d019da218689"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:24.034867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5c8a2716-8733-448e-8055-c0a7f3fa54eb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:24.040827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:24.041378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c8a2716-8733-448e-8055-c0a7f3fa54eb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.041828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c8a2716-8733-448e-8055-c0a7f3fa54eb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.041973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:24.042603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c8a2716-8733-448e-8055-c0a7f3fa54eb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.043235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c8a2716-8733-448e-8055-c0a7f3fa54eb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.049535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.049983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.051414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.052180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.295167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:24.305509 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aaeb62a7-1e8f-4c21-bc36-a512e6ea7a05 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1509 microversion: 2.1 time: 0.280670 Aug 04 04:35:24.306091 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1362/2730] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:24 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:24.323711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:24.326133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:24.326692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:24.339169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5c8a2716-8733-448e-8055-c0a7f3fa54eb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310537 Aug 04 04:35:24.339801 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1369/2731] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:35:24 2022] POST /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:24.352834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-64eb9a81-25b5-42f8-a57d-d3789228a46c req-67665937-7700-4c71-9dc6-af0584ec415a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee7160e-6b36-4d4f-a709-35df0bf04698", "tag": "239fe2be-b8f3-4876-b7d3-4a295e71cd25"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:24.356647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.358654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.359671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.365370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.372131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-64eb9a81-25b5-42f8-a57d-d3789228a46c req-67665937-7700-4c71-9dc6-af0584ec415a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.373800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-64eb9a81-25b5-42f8-a57d-d3789228a46c req-67665937-7700-4c71-9dc6-af0584ec415a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.389234 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-64eb9a81-25b5-42f8-a57d-d3789228a46c req-67665937-7700-4c71-9dc6-af0584ec415a service nova] Creating event network-changed:239fe2be-b8f3-4876-b7d3-4a295e71cd25 for instance eee7160e-6b36-4d4f-a709-35df0bf04698 on n-h1-851337-5 Aug 04 04:35:24.406886 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-64eb9a81-25b5-42f8-a57d-d3789228a46c req-67665937-7700-4c71-9dc6-af0584ec415a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065489 Aug 04 04:35:24.408070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1370/2732] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:24.419541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:24.421093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:24.435861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.436575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.437520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.438186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.641968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:24.657826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-561cce88-4667-4e31-be42-2d69bccad3de tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1461 microversion: 2.1 time: 0.344072 Aug 04 04:35:24.672594 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1363/2733] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:24 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1461 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:24.683061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:24.683967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:24.694145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.695416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.700533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.701200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.706805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:24.718912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d134e63-c3f9-4777-922c-c5bceebc62ae tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1679 microversion: 2.1 time: 0.309082 Aug 04 04:35:24.720275 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1371/2734] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:24 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1679 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:24.740696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:24.741323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:24.761289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.761738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:24.762521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:24.762971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.016163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.024639 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-72beece7-621b-4d05-befd-20bb162a1702 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.350143 Aug 04 04:35:25.025540 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1364/2735] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:24 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:25.045129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:25.046159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:25.049791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.053381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.054142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.055182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.055813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.059400 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-21353213-f04e-44e8-a7be-6fb048af2f2c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.337994 Aug 04 04:35:25.076151 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1372/2736] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:24 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:25.087311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:25.087932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:25.096820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.097378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.099117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.099657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.266020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.273989 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9c136954-e84b-4542-b196-ade005e59c0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1472 microversion: 2.1 time: 0.233433 Aug 04 04:35:25.274941 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1365/2737] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:25 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:25.304803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.313081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8f70f7a-0b68-477a-a2c1-2cfdce8edf7a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.231541 Aug 04 04:35:25.313671 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1373/2738] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:25 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:25.330226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:25.331183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:25.338883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.339395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.340080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:25.340543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.340637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.340870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:25.343290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:25.358864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.359821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.361025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.361681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.580022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.588849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.592339 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4be6cf1-c889-4826-b549-ee9292a554ab tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1509 microversion: 2.1 time: 0.266111 Aug 04 04:35:25.594037 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1366/2739] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:25 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:25.598691 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-475c01d7-5d5e-4df7-ad66-6ae60fc2b901 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.263314 Aug 04 04:35:25.599502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1374/2740] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:25 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:25.630412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:25.631220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:25.640452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.640907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.641708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.642151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.745346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:25.746119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:25.753146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.753610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.754402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:25.754845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:25.811929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.820235 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b59e8a3-554d-4804-b20c-4ac0e29fa218 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.204012 Aug 04 04:35:25.826755 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1367/2741] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:25 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:25.890934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1482968519", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "fcf37719-691e-4ce4-8b13-247de9c8f621"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:25.925256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:25.934154 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb3af967-1cd8-4810-aee2-55da8712cbb2 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1679 microversion: 2.1 time: 0.192577 Aug 04 04:35:25.934977 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1375/2742] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:25 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:25.960797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] validate_networks() for [('fcf37719-691e-4ce4-8b13-247de9c8f621', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:35:26.044675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:26.045528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:26.061157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:26.061694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:26.062572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:26.063166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:26.693379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:26.704860 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a5256b74-b504-4fa1-b8ef-21cbfd0d2473 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1477 microversion: 2.1 time: 0.663920 Aug 04 04:35:26.708342 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1376/2743] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:26 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1477 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:26.713485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:26.714391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:26.721628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:26.722452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:26.723640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:26.724225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.204748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:27.228615 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa5ca97c-3490-48c7-9bb6-c8b46a37f53a tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1472 microversion: 2.1 time: 0.518819 Aug 04 04:35:27.248529 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1377/2744] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:26 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1472 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:27.253874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:27.255652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:27.263148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.263671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.265486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.265952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.476355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:35:27.476957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:35:27.477448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:35:27.477863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:35:27.478466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:35:27.499550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.500009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.500826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.501271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.565588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:35:27.580958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Getting quotas for user d51068c4cce544e38ad1b23996efdec3 and project 85353a54064c4117bfedd41efcde07db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:35:27.628080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:35:27.649974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:35:27.769319 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-72e2ddfa-914a-411c-b190-20231fddb5ac tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882573 Aug 04 04:35:27.773747 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1368/2745] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:35:27.781636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:27.795443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:27.804669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.819202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.825897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.826366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.841479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:27.856703 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5ca8253-7da6-4ccc-b48a-5400ee4d0493 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1509 microversion: 2.1 time: 0.606725 Aug 04 04:35:27.857705 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1378/2746] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:27 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:27.862855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9bc2bbcd-4fc4-4887-8fcc-f2e8c132d187 req-8e1e7852-8f5c-4073-99ac-b7fcbef7efe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053480ad-ee22-4a8d-afed-82851e4a1031", "name": "network-vif-deleted", "tag": "cca1001f-3ae0-47cd-9aaa-5085d44709bc"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:27.890180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9bc2bbcd-4fc4-4887-8fcc-f2e8c132d187 req-8e1e7852-8f5c-4073-99ac-b7fcbef7efe3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.890917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9bc2bbcd-4fc4-4887-8fcc-f2e8c132d187 req-8e1e7852-8f5c-4073-99ac-b7fcbef7efe3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.914109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.914577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.915077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lazy-loading 'fault' on Instance uuid 053480ad-ee22-4a8d-afed-82851e4a1031 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:27.919747 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9bc2bbcd-4fc4-4887-8fcc-f2e8c132d187 req-8e1e7852-8f5c-4073-99ac-b7fcbef7efe3 service nova] Creating event network-vif-deleted:cca1001f-3ae0-47cd-9aaa-5085d44709bc for instance 053480ad-ee22-4a8d-afed-82851e4a1031 on n-h2-851337-5 Aug 04 04:35:27.934584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9bc2bbcd-4fc4-4887-8fcc-f2e8c132d187 req-8e1e7852-8f5c-4073-99ac-b7fcbef7efe3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075538 Aug 04 04:35:27.937744 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1379/2747] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:27.948858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:27.956296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:27.977814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.981018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:27.986549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:27.987521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.010125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b140919b4d4134a71946a9f1579b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e35e9177fc54bae85afe4a3c477ef7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:28.025151 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4197a3e2-cc0b-4816-af7b-312d44b3879b tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 200 len: 1330 microversion: 2.1 time: 0.244632 Aug 04 04:35:28.039332 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1369/2748] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:27 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 1330 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:28.044375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-814de198-1129-4641-ba4a-a2e20cd3bf1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:28.052374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-814de198-1129-4641-ba4a-a2e20cd3bf1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:28.262652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-814de198-1129-4641-ba4a-a2e20cd3bf1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:28.271922 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-814de198-1129-4641-ba4a-a2e20cd3bf1a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1215 microversion: 2.1 time: 0.231273 Aug 04 04:35:28.272522 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1370/2749] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:28 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:28.290194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-aaa8d61a-b4eb-433d-8818-3724af1df5b5 req-9c31f7f5-8c30-4584-9d89-15c82315ef6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a898849-6e47-44e9-a1db-f703d55ab0ca", "name": "network-vif-deleted", "tag": "9f67df9f-df80-4ce6-9b68-b9a15fb4db15"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:28.329255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aaa8d61a-b4eb-433d-8818-3724af1df5b5 req-9c31f7f5-8c30-4584-9d89-15c82315ef6d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.329725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aaa8d61a-b4eb-433d-8818-3724af1df5b5 req-9c31f7f5-8c30-4584-9d89-15c82315ef6d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.538329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:28.547548 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67a9d6c5-ff22-4077-9e85-33cbda9e7b45 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1463 microversion: 2.1 time: 0.607754 Aug 04 04:35:28.553452 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1380/2750] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:27 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1463 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:28.563767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:28.565887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:28.584150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.584909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.586485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.589418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.673738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.674193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.674656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lazy-loading 'fault' on Instance uuid dfa1a11a-6833-45a3-a045-82019d25c985 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:28.741008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:28.754466 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b94c71e3-9ad2-45be-9dfb-a0808523d939 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 200 len: 1307 microversion: 2.1 time: 0.199486 Aug 04 04:35:28.755417 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1381/2751] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:28 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:28.765200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:28.771507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:28.787186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.787925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.789256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.789869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.848918 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-aaa8d61a-b4eb-433d-8818-3724af1df5b5 req-9c31f7f5-8c30-4584-9d89-15c82315ef6d service nova] Creating event network-vif-deleted:9f67df9f-df80-4ce6-9b68-b9a15fb4db15 for instance 6a898849-6e47-44e9-a1db-f703d55ab0ca on n-h2-851337-5 Aug 04 04:35:28.891135 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-aaa8d61a-b4eb-433d-8818-3724af1df5b5 req-9c31f7f5-8c30-4584-9d89-15c82315ef6d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.612290 Aug 04 04:35:28.892314 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1371/2752] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:28.899804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:28.900355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:28.913006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.922123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:28.939107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:28.939720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.001942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.002678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.003441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lazy-loading 'fault' on Instance uuid 6a898849-6e47-44e9-a1db-f703d55ab0ca {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:29.049486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:29.059105 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2883fc3b-741f-40e1-b465-2a0943165a1f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1463 microversion: 2.1 time: 0.301424 Aug 04 04:35:29.060162 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1382/2753] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:28 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:29.065838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:29.067015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] [instance: 053480ad-ee22-4a8d-afed-82851e4a1031] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:29.079584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba43983f86b4419aa7326e9c74e4457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25dc421755047c9b6379791a2a726ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:29.083524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.084229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.085576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.086049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.088596 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d42b6908-0698-46f0-be04-d97897c424c1 tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 200 len: 1313 microversion: 2.1 time: 0.194741 Aug 04 04:35:29.089886 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1372/2754] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:28 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:29.095466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:29.098556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:29.108172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.108863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.109821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.110412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.119025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] HTTP exception thrown: Instance 053480ad-ee22-4a8d-afed-82851e4a1031 could not be found. Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Request method failure captured: Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 HTTP/1.1 Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wDZRl_LrM76gJGNsrv0SmZGCXRMq93kbIkBRYUf1NlsRqJW-L0HEI0bLm3wlfyujMl-TQtO9hTGGmCZsWfYKS5RbaMISvzJ9p8W83MxuMh3H9-s71Oyf37h-LPhw8BU7mbWN4oDnQFt5NmkfIthIYxZL8g-5EzOMTjl5JLGk36Jdk Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4e35e9177fc54bae85afe4a3c477ef7b Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesAdminNegativeTest-143947730 Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e35e9177fc54bae85afe4a3c477ef7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4e35e9177fc54bae85afe4a3c477ef7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e35e9177fc54bae85afe4a3c477ef7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4e35e9177fc54bae85afe4a3c477ef7b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesAdminNegativeTest-143947730 Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4e35e9177fc54bae85afe4a3c477ef7b Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-143947730 Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesAdminNegativeTest-143947730-project Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d1b140919b4d4134a71946a9f1579b9c Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesAdminNegativeTest-143947730-project Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 053480ad-ee22-4a8d-afed-82851e4a1031 could not be found. Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '053480ad-ee22-4a8d-afed-82851e4a1031'} Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 053480ad-ee22-4a8d-afed-82851e4a1031 could not be found. Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 053480ad-ee22-4a8d-afed-82851e4a1031 could not be found. Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:29.129915 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.134944 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:29.134944 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:29.134944 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:29.134944 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:29.134944 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:29.134944 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 053480ad-ee22-4a8d-afed-82851e4a1031 could not be found. Aug 04 04:35:29.134944 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.136256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Returning 404 to user: Instance 053480ad-ee22-4a8d-afed-82851e4a1031 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:29.141569 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aab9c943-a3d0-4ad3-87b8-ee7fb5eb57f7 tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031" status: 404 len: 111 microversion: 2.1 time: 0.077219 Aug 04 04:35:29.142393 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1383/2755] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:29 2022] GET /compute/v2.1/servers/053480ad-ee22-4a8d-afed-82851e4a1031 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:29.151522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5e94f270-7ed9-4e7a-b460-a28b4df852ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] Calling method '.version_select at 0x7f1923a57b80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:29.190854 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5e94f270-7ed9-4e7a-b460-a28b4df852ed tempest-VolumesAdminNegativeTest-143947730 tempest-VolumesAdminNegativeTest-143947730-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-25180261" status: 202 len: 0 microversion: 2.1 time: 0.043497 Aug 04 04:35:29.191515 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1384/2756] 10.222.0.69 () {58 vars in 1215 bytes} [Thu Aug 4 04:35:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-25180261 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:29.243646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:35:29.247369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:35:29.250170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:35:29.250863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:35:29.251525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:35:29.296708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:29.298130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:29.317423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.318070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.319060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.331782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.436600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:29.458820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.464871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.465767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.466220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.477518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:29.489776 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6bb0e04d-6538-46ed-aca8-4394baaf031c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1267 microversion: 2.1 time: 0.199985 Aug 04 04:35:29.490734 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1385/2757] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:29 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:29.570800 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e210c8ae-282e-4548-bb5b-fb0b4bf2489d tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action" status: 202 len: 1067 microversion: 2.1 time: 0.477203 Aug 04 04:35:29.585541 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1373/2758] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:29 2022] POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action => generated 1067 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 04:35:29.589869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:29.591098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:29.597464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.597956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.598746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.604453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.780199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:29.781255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: dfa1a11a-6833-45a3-a045-82019d25c985] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:29.790798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.792289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.793780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.794494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.826883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance dfa1a11a-6833-45a3-a045-82019d25c985 could not be found. Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 HTTP/1.1 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance dfa1a11a-6833-45a3-a045-82019d25c985 could not be found. Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'dfa1a11a-6833-45a3-a045-82019d25c985'} Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa1a11a-6833-45a3-a045-82019d25c985 could not be found. Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa1a11a-6833-45a3-a045-82019d25c985 could not be found. Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:29.831865 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.836791 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:29.836791 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:29.836791 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:29.836791 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:29.836791 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:29.836791 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa1a11a-6833-45a3-a045-82019d25c985 could not be found. Aug 04 04:35:29.836791 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:29.839686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance dfa1a11a-6833-45a3-a045-82019d25c985 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:29.842143 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-df706123-0afc-400f-9e1d-3776d0b4957f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985" status: 404 len: 111 microversion: 2.1 time: 0.066461 Aug 04 04:35:29.846432 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1374/2759] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:29 2022] GET /compute/v2.1/servers/dfa1a11a-6833-45a3-a045-82019d25c985 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:29.856197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:29.856828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:29.863205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:29.866815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.867418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.868393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:29.868848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:29.884843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ee4d9b2-9ad1-4093-a3ba-959cf0de2c58 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.298924 Aug 04 04:35:29.887752 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1386/2760] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:29 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:29.905947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:29.950031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:30.025446 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-225cf198-9095-4281-afea-8323a2f8b19e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 204 len: 0 microversion: 2.1 time: 0.175207 Aug 04 04:35:30.026691 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1375/2761] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:29 2022] DELETE /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:30.036622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:30.038982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:30.049981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.050625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.052035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.052558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.114587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:30.115439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] [instance: 6a898849-6e47-44e9-a1db-f703d55ab0ca] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:30.125529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.125991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.126779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.127770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.147332 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] HTTP exception thrown: Instance 6a898849-6e47-44e9-a1db-f703d55ab0ca could not be found. Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Request method failure captured: Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca HTTP/1.1 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60w--3qnaoXhLpLuk236cHusKtxY59nsDrI5NdRAfY4Uj1wK_usKPPtSGNS9K5Higti48kh1Ez0uDigy5oxd_mvuz9OlRe_JtdehxR8YpW9m8A79CZl37tx07oJBStQ0qQhnU-C3SEc1yCM6qXY7QM4WSYVeJ2Rf1QR4ySG3O-pT6Wo Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: b25dc421755047c9b6379791a2a726ed Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1606633468 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b25dc421755047c9b6379791a2a726ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b25dc421755047c9b6379791a2a726ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b25dc421755047c9b6379791a2a726ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b25dc421755047c9b6379791a2a726ed", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1606633468 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: b25dc421755047c9b6379791a2a726ed Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1606633468 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueTestJSONUnderV235-1606633468-project Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5ba43983f86b4419aa7326e9c74e4457 Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1606633468-project Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6a898849-6e47-44e9-a1db-f703d55ab0ca could not be found. Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6a898849-6e47-44e9-a1db-f703d55ab0ca'} Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a898849-6e47-44e9-a1db-f703d55ab0ca could not be found. Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a898849-6e47-44e9-a1db-f703d55ab0ca could not be found. Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:30.149599 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a898849-6e47-44e9-a1db-f703d55ab0ca could not be found. Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] Returning 404 to user: Instance 6a898849-6e47-44e9-a1db-f703d55ab0ca could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:30.154785 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-790b6107-0768-4336-9190-697f3b331cef tempest-ServerRescueTestJSONUnderV235-1606633468 tempest-ServerRescueTestJSONUnderV235-1606633468-project] 10.222.0.69 "GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca" status: 404 len: 111 microversion: 2.1 time: 0.043283 Aug 04 04:35:30.156605 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1376/2762] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:30 2022] GET /compute/v2.1/servers/6a898849-6e47-44e9-a1db-f703d55ab0ca => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:35:30.320883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:30.341440 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b5f8ab4-c7b1-416e-8b6d-3dc73a48a7f2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1472 microversion: 2.1 time: 0.310177 Aug 04 04:35:30.343204 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1387/2763] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:30 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:30.516228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:30.516902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:30.529262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.530193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.531973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.532512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.666599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:30.675052 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38ba1cf3-6341-44b0-9e8e-531778b05cbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1273 microversion: 2.1 time: 0.162732 Aug 04 04:35:30.675995 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1377/2764] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:30 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:30.909793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:30.910819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:30.921763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.922531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.923355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.923789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:30.968953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-acb08343-7986-4bfe-9ccd-a27d218a4f3c req-89df74a8-3fd4-4dfb-9661-1efd201040a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa1a11a-6833-45a3-a045-82019d25c985", "name": "network-vif-deleted", "tag": "6369f92b-2592-4faa-bb9f-ed4c21d3ae2d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:30.982995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-acb08343-7986-4bfe-9ccd-a27d218a4f3c req-89df74a8-3fd4-4dfb-9661-1efd201040a2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:30.987490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-acb08343-7986-4bfe-9ccd-a27d218a4f3c req-89df74a8-3fd4-4dfb-9661-1efd201040a2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:31.003657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-acb08343-7986-4bfe-9ccd-a27d218a4f3c req-89df74a8-3fd4-4dfb-9661-1efd201040a2 service nova] Creating event network-vif-deleted:6369f92b-2592-4faa-bb9f-ed4c21d3ae2d for instance dfa1a11a-6833-45a3-a045-82019d25c985 on n-h2-851337-5 Aug 04 04:35:31.010809 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-acb08343-7986-4bfe-9ccd-a27d218a4f3c req-89df74a8-3fd4-4dfb-9661-1efd201040a2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046346 Aug 04 04:35:31.012455 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1378/2765] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:31.363285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:31.364010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:31.384245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:31.384697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:31.388536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:31.389014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:31.398580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:31.410201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8172c83d-ba76-4d17-94ad-9323f877fed3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.503619 Aug 04 04:35:31.411604 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1388/2766] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:30 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:31.676628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:31.695351 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9577b751-61ba-433f-929f-303a66bc5386 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1472 microversion: 2.1 time: 0.329195 Aug 04 04:35:31.708753 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1379/2767] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:31 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:31.709204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:31.709204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:31.711157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:31.711607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:31.714079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:31.714563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:31.745525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:32.164004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:32.174557 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffc4402b-0a5b-4707-9e7e-54e97ddb11e5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.480494 Aug 04 04:35:32.175658 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1389/2768] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:31 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:32.433413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:32.436232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:32.447596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:32.448835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:32.454908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:32.455614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:32.717307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:32.717919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:32.743147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:32.744071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:32.745019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:32.745630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:32.875102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:32.902942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6de43f7-4a10-4ec5-9227-1ea0bf7f5607 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.474257 Aug 04 04:35:32.909019 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1380/2769] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:32 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:32.946854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:32.963457 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70a22b64-d278-4a63-9709-2c004997e0d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 200 len: 1430 microversion: 2.1 time: 0.246578 Aug 04 04:35:32.979659 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1390/2770] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:32 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 1430 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:33.110167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9fee2ba1-62b6-43c9-bb0e-650bfdb43f49 req-b10007b8-5aa3-47f7-863f-efbadbdd8276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899c55a9-4b61-4a7a-8732-e0162c1ca354", "tag": "9655202c-3dc5-4bcb-ad7e-8a55e1d57459"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:33.145920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9fee2ba1-62b6-43c9-bb0e-650bfdb43f49 req-b10007b8-5aa3-47f7-863f-efbadbdd8276 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:33.147387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9fee2ba1-62b6-43c9-bb0e-650bfdb43f49 req-b10007b8-5aa3-47f7-863f-efbadbdd8276 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:33.173584 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9fee2ba1-62b6-43c9-bb0e-650bfdb43f49 req-b10007b8-5aa3-47f7-863f-efbadbdd8276 service nova] Creating event network-changed:9655202c-3dc5-4bcb-ad7e-8a55e1d57459 for instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 on n-h1-851337-5 Aug 04 04:35:33.187464 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9fee2ba1-62b6-43c9-bb0e-650bfdb43f49 req-b10007b8-5aa3-47f7-863f-efbadbdd8276 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093200 Aug 04 04:35:33.188911 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1381/2771] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:33.198289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:33.198943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:33.214800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:33.215734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:33.216283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:33.216884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:33.354323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c27259bc-e25c-43fb-8b83-b5ddfe38a264 req-0abb0446-7728-4d0a-8298-82f7641d2a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b953f27e-a41f-4a8b-b936-092ea3bb771c", "name": "network-vif-deleted", "tag": "01104e2a-6f63-4f00-8454-73a4a97db797"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:33.375729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c27259bc-e25c-43fb-8b83-b5ddfe38a264 req-0abb0446-7728-4d0a-8298-82f7641d2a8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:33.376184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c27259bc-e25c-43fb-8b83-b5ddfe38a264 req-0abb0446-7728-4d0a-8298-82f7641d2a8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:33.388480 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c27259bc-e25c-43fb-8b83-b5ddfe38a264 req-0abb0446-7728-4d0a-8298-82f7641d2a8a service nova] Creating event network-vif-deleted:01104e2a-6f63-4f00-8454-73a4a97db797 for instance b953f27e-a41f-4a8b-b936-092ea3bb771c on n-h2-851337-5 Aug 04 04:35:33.394258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c27259bc-e25c-43fb-8b83-b5ddfe38a264 req-0abb0446-7728-4d0a-8298-82f7641d2a8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049483 Aug 04 04:35:33.396351 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1382/2772] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:33.641461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:33.656490 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8986f6a9-bf25-434d-83c0-7b7a7787e1a9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.463796 Aug 04 04:35:33.669778 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1391/2773] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:33 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:33.929694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:33.931031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:33.940921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:33.947790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:33.949002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:33.953395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:33.987348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:33.988566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: b953f27e-a41f-4a8b-b936-092ea3bb771c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:34.001982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.002680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.003694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.005295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.052153 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance b953f27e-a41f-4a8b-b936-092ea3bb771c could not be found. Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c HTTP/1.1 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b953f27e-a41f-4a8b-b936-092ea3bb771c could not be found. Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b953f27e-a41f-4a8b-b936-092ea3bb771c'} Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b953f27e-a41f-4a8b-b936-092ea3bb771c could not be found. Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b953f27e-a41f-4a8b-b936-092ea3bb771c could not be found. Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:34.057937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:34.062446 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:34.062446 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:34.062446 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:34.062446 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:34.062446 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:34.062446 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b953f27e-a41f-4a8b-b936-092ea3bb771c could not be found. Aug 04 04:35:34.062446 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:34.066292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance b953f27e-a41f-4a8b-b936-092ea3bb771c could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:34.069629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-89fc0c7a-93ed-40ce-a469-fadf64c45e40 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c" status: 404 len: 111 microversion: 2.1 time: 0.086307 Aug 04 04:35:34.072363 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1392/2774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:33 2022] GET /compute/v2.1/servers/b953f27e-a41f-4a8b-b936-092ea3bb771c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:34.084842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:34.086131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:34.109589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.110395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.111415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.112269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.143324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:34.236413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:34.245444 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a614c9b4-9d54-4b82-bc5f-3d753f9878b3 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.320195 Aug 04 04:35:34.253607 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-830cb90e-833f-4fd8-839b-78238763ed56 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf" status: 204 len: 0 microversion: 2.1 time: 0.173915 Aug 04 04:35:34.254910 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1393/2775] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:34 2022] DELETE /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:34.264663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:34.265499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:34.267705 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1383/2776] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:33 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:34.298135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.301155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.302229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.302675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.360555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:34.474107 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a2b52c0a-9da3-4f3f-b6db-75c4920e50d1 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 204 len: 0 microversion: 2.1 time: 0.213765 Aug 04 04:35:34.475931 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1394/2777] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:34 2022] DELETE /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:34.493226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:34.494062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:34.500732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.501427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.502552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.503244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.688935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:34.690738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:34.706920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.709397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.711659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:34.715837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:34.817381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:34.826699 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4147a2a-1ee7-4663-9bb0-cbdee0ab99c6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf" status: 200 len: 1473 microversion: 2.1 time: 0.337357 Aug 04 04:35:34.827505 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1384/2778] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:34 2022] GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf => generated 1473 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:35.020693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:35.033065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-066e75de-e0dc-45ba-9949-afc24287d9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.359325 Aug 04 04:35:35.034289 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1395/2779] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:34 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:35.278520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:35.279803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:35.287719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:35.288322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:35.289220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:35.289804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:35.588888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:35.596764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc91d317-fb77-4719-b74f-a4048fab9f57 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.326930 Aug 04 04:35:35.614656 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1385/2780] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:35 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:35.848289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:35.849369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:35.856495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:35.856943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:35.857904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:35.858495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:36.057114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:36.061720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:36.084693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:36.087705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:36.088946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:36.089540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:36.261724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:36.275057 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-294cc3f3-1d8a-4224-8a1e-7107415f5f0b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf" status: 200 len: 1473 microversion: 2.1 time: 0.430552 Aug 04 04:35:36.276313 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1396/2781] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:35 2022] GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:36.476881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:36.502860 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41791197-b712-47b5-9804-37a5584f72c6 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.448485 Aug 04 04:35:36.506184 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1386/2782] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:36 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:36.632982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:36.633725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:36.641597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:36.642433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:36.643349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:36.643882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:36.845330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-7aea18d1-7cbd-432d-b345-b6bcd2dbc83b req-e6d8149d-1959-474c-8692-e32763f1eee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befaf1fe-e808-4131-9095-62f7f88d7fcf", "name": "network-vif-deleted", "tag": "a3079d91-bcf9-440c-ae65-3ceed02eeeba"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:36.880285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7aea18d1-7cbd-432d-b345-b6bcd2dbc83b req-e6d8149d-1959-474c-8692-e32763f1eee5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:36.881269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7aea18d1-7cbd-432d-b345-b6bcd2dbc83b req-e6d8149d-1959-474c-8692-e32763f1eee5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:36.925945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-7aea18d1-7cbd-432d-b345-b6bcd2dbc83b req-e6d8149d-1959-474c-8692-e32763f1eee5 service nova] Creating event network-vif-deleted:a3079d91-bcf9-440c-ae65-3ceed02eeeba for instance befaf1fe-e808-4131-9095-62f7f88d7fcf on n-h2-851337-5 Aug 04 04:35:36.936144 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-7aea18d1-7cbd-432d-b345-b6bcd2dbc83b req-e6d8149d-1959-474c-8692-e32763f1eee5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094811 Aug 04 04:35:36.939882 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1387/2783] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:35:36.952607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:36.966016 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd257b3a-2411-41ed-93f2-b9ed4c3df37e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.345347 Aug 04 04:35:36.967042 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1397/2784] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:36 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:37.297176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:37.298337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:37.309847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:37.310445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:37.311538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:37.312228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:37.373901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:37.374570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:37.375215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lazy-loading 'fault' on Instance uuid befaf1fe-e808-4131-9095-62f7f88d7fcf {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:37.441444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:37.454824 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b427314-069b-4d3e-96a9-2940e3e057bc tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf" status: 200 len: 1309 microversion: 2.1 time: 0.160693 Aug 04 04:35:37.456365 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1388/2785] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:37 2022] GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:37.532169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:37.532860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:37.540389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:37.540853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:37.541621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:37.542063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:37.718113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:37.727518 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f1f88018-22a6-4bc6-86b8-139eb38751d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.199010 Aug 04 04:35:37.728566 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1398/2786] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:37 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:37.892796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:37.988199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:37.989023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:37.995870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:37.996876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:37.997676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:37.998117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.030553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1531148126", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": "none"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:38.092881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:35:38.093313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:35:38.093914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:35:38.094351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:35:38.094823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:35:38.106343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.106878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.107961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.108314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.130913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Getting quotas for project e79771f9f8c241ca9539460249e813fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:35:38.138605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Getting quotas for user bc22e60d2f734b209ba479d4e4d9e293 and project e79771f9f8c241ca9539460249e813fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:35:38.141368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:38.159171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:35:38.161781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:35:38.164726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:38.173405 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-75dfd6a6-eac9-403e-97a7-f904bd197f04 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.188685 Aug 04 04:35:38.177315 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1399/2787] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:37 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:38.211687 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f6d609a-41ab-42e1-84cd-7d5c26e068dc tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.319695 Aug 04 04:35:38.219146 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1389/2788] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:35:38.226640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e748bfe-d9c7-4e8c-aa1a-7d5784724736 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:38.227316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2e748bfe-d9c7-4e8c-aa1a-7d5784724736 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:38.296195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e748bfe-d9c7-4e8c-aa1a-7d5784724736 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:38.306244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e748bfe-d9c7-4e8c-aa1a-7d5784724736 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:38.308469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e748bfe-d9c7-4e8c-aa1a-7d5784724736 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:38.310326 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2e748bfe-d9c7-4e8c-aa1a-7d5784724736 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b" status: 200 len: 1278 microversion: 2.47 time: 0.089455 Aug 04 04:35:38.315119 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1400/2789] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:38 2022] GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:38.387694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-826795024", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": "none"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:38.470785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:35:38.472332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:35:38.473231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:35:38.474534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:35:38.475287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:35:38.479599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:38.480200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: befaf1fe-e808-4131-9095-62f7f88d7fcf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:38.488951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.490277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.491390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.493233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.493411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.493798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.494605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.495093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.515946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Getting quotas for project e79771f9f8c241ca9539460249e813fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:35:38.526428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Getting quotas for user bc22e60d2f734b209ba479d4e4d9e293 and project e79771f9f8c241ca9539460249e813fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:35:38.535875 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance befaf1fe-e808-4131-9095-62f7f88d7fcf could not be found. Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf HTTP/1.1 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance befaf1fe-e808-4131-9095-62f7f88d7fcf could not be found. Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'befaf1fe-e808-4131-9095-62f7f88d7fcf'} Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance befaf1fe-e808-4131-9095-62f7f88d7fcf could not be found. Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance befaf1fe-e808-4131-9095-62f7f88d7fcf could not be found. Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:38.537681 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance befaf1fe-e808-4131-9095-62f7f88d7fcf could not be found. Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:38.542059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance befaf1fe-e808-4131-9095-62f7f88d7fcf could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:38.544259 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fa098510-38c5-42cc-8ec2-216cec3301e2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf" status: 404 len: 111 microversion: 2.1 time: 0.069578 Aug 04 04:35:38.548347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:35:38.549968 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1401/2790] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:38 2022] GET /compute/v2.1/servers/befaf1fe-e808-4131-9095-62f7f88d7fcf => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:38.551270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:35:38.558851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:38.560103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:38.573175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.573636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.574660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.575188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.642927 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f31c264a-8c49-434c-b93a-290f85b6c2ed tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.261155 Aug 04 04:35:38.651383 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1390/2791] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 263 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 04:35:38.661810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b39afd77-000a-4b5b-8614-ee80c36fc499 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:38.665461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b39afd77-000a-4b5b-8614-ee80c36fc499 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:38.751853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b39afd77-000a-4b5b-8614-ee80c36fc499 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "PUT /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 991 microversion: 2.47 time: 0.098822 Aug 04 04:35:38.754145 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1391/2792] 10.222.0.69 () {62 vars in 1297 bytes} [Thu Aug 4 04:35:38 2022] PUT /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:35:38.771304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:38.773047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:38.793132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.794215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:38.795802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:38.799968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:39.122258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:39.136058 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5581866-179c-4d45-98cb-5fa32cbab5d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.376901 Aug 04 04:35:39.148565 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1392/2793] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:38 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:39.148772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:39.154585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-197727d0-3022-47e8-a939-aa73e909c9fb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:39.161621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-782c94a4-64f4-410d-a0c7-a5700ac5c49c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1475 microversion: 2.1 time: 0.610484 Aug 04 04:35:39.164402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-197727d0-3022-47e8-a939-aa73e909c9fb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:39.182227 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1402/2794] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:38 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:39.193915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:39.195150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:39.209522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:39.210777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:39.214080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:39.222319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:39.323393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-197727d0-3022-47e8-a939-aa73e909c9fb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:39.331889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-197727d0-3022-47e8-a939-aa73e909c9fb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:39.333904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-197727d0-3022-47e8-a939-aa73e909c9fb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:39.335944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-197727d0-3022-47e8-a939-aa73e909c9fb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1277 microversion: 2.47 time: 0.198553 Aug 04 04:35:39.336549 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1393/2795] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:39 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:39.483415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:39.492355 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fdb4ff43-2ec8-4781-809e-2b2c11395bd7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.302407 Aug 04 04:35:39.493103 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1403/2796] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:39 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:40.132894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b758bbc6-9385-4236-8692-d019da218689"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:40.137489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:40.166017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:40.166759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:40.181563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:40.187649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:40.189077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:40.189963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:40.190413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:40.191804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:40.192987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:40.193675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:40.285849 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Invalid volume: volume b758bbc6-9385-4236-8692-d019da218689 is already attached to instances: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments HTTP/1.1 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 74 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: {"volumeAttachment": {"volumeId": "b758bbc6-9385-4236-8692-d019da218689"}} Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid volume: volume b758bbc6-9385-4236-8692-d019da218689 is already attached to instances: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'server_id': 'b9a2f759-f92a-4b9f-9090-55d1bcb5e93c', 'body': {'volumeAttachment': {'volumeId': 'b758bbc6-9385-4236-8692-d019da218689'}}} Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b758bbc6-9385-4236-8692-d019da218689 is already attached to instances: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:35:40.289507 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b758bbc6-9385-4236-8692-d019da218689 is already attached to instances: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b758bbc6-9385-4236-8692-d019da218689 is already attached to instances: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 400 to user: Invalid volume: volume b758bbc6-9385-4236-8692-d019da218689 is already attached to instances: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-360f5d1e-7522-4ac9-bda0-0fbd6ccf9bfd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.164917 Aug 04 04:35:40.293252 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1394/2797] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:35:40 2022] POST /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 174 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:35:40.299342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:40.301110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:40.309115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:40.309981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:40.310931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:40.311574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:40.968271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:40.970702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:40.978490 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ef8d971-99a8-4857-8b12-5e07534ece4d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.818516 Aug 04 04:35:40.993590 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1404/2798] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:40 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:40.993685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:40.995572 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d0d01285-c539-482f-afbc-be0cd63c0a5f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1475 microversion: 2.1 time: 0.702985 Aug 04 04:35:40.997907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:40.998541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:41.004728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.005242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.006287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.006613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1395/2799] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:40 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:41.007946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.015165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:41.015767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:41.022531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.023023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.023875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.024322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.122725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lazy-loading 'services' on Instance uuid b9a2f759-f92a-4b9f-9090-55d1bcb5e93c {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:41.155268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:41.168299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:41.170636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:41.172416 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4326d702-97f3-42c7-8efb-0b8e3ceb70a4 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1337 microversion: 2.47 time: 0.192033 Aug 04 04:35:41.174101 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1405/2800] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:40 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1337 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:41.179572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:41.180589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:41.199967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.201238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.203205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.204503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.210862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0dd14386-dbbe-4074-a232-15ac4e0d31d3 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments/b758bbc6-9385-4236-8692-d019da218689" status: 202 len: 0 microversion: 2.1 time: 0.201434 Aug 04 04:35:41.212206 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1396/2801] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:35:41 2022] DELETE /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments/b758bbc6-9385-4236-8692-d019da218689 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:41.223820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2bda602b-3d27-43fc-819c-d6a09fed19a7 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:41.227529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2bda602b-3d27-43fc-819c-d6a09fed19a7 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:41.235265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bda602b-3d27-43fc-819c-d6a09fed19a7 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.235901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bda602b-3d27-43fc-819c-d6a09fed19a7 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.236902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bda602b-3d27-43fc-819c-d6a09fed19a7 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.237830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2bda602b-3d27-43fc-819c-d6a09fed19a7 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.242998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:41.277687 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2bda602b-3d27-43fc-819c-d6a09fed19a7 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058409 Aug 04 04:35:41.279031 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1397/2802] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:35:41 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:41.443592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-96cdbea6-bf96-41e0-9d86-1052a112b601 req-b4ba579a-e954-4647-b515-1d3b284d7f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d1e5ff-6a76-4261-9402-1b9ffc757620", "name": "network-vif-deleted", "tag": "e8e9d2cb-05e5-4275-9352-a62a980231d9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:41.458990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-96cdbea6-bf96-41e0-9d86-1052a112b601 req-b4ba579a-e954-4647-b515-1d3b284d7f86 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:41.460421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-96cdbea6-bf96-41e0-9d86-1052a112b601 req-b4ba579a-e954-4647-b515-1d3b284d7f86 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:41.476858 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-96cdbea6-bf96-41e0-9d86-1052a112b601 req-b4ba579a-e954-4647-b515-1d3b284d7f86 service nova] Creating event network-vif-deleted:e8e9d2cb-05e5-4275-9352-a62a980231d9 for instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 on n-h1-851337-5 Aug 04 04:35:41.482274 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-96cdbea6-bf96-41e0-9d86-1052a112b601 req-b4ba579a-e954-4647-b515-1d3b284d7f86 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042940 Aug 04 04:35:41.483103 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1398/2803] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:35:41.562251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:41.572741 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4788e36d-fd23-4164-b10b-a0f4de1e3475 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.396850 Aug 04 04:35:41.573325 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1406/2804] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:41 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:42.003299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:42.004095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:42.012305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.014341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.014341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.014341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.019793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:42.020592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:42.028356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.028809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.029582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.030211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.128943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:42.141686 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-acc06071-6f8f-4fe9-ae9a-f6c6f427076e tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 200 len: 1304 microversion: 2.1 time: 0.126010 Aug 04 04:35:42.145672 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1407/2805] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:42 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:42.205043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:42.206923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:42.221640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.223360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.225291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.226268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.259343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:42.266997 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bfcbc587-07b0-4b38-bfd4-7c15ef935a75 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.270007 Aug 04 04:35:42.282260 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1399/2806] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:41 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:42.290335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00ac39a3-1f36-4240-9e8f-924b004435cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:42.294863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-00ac39a3-1f36-4240-9e8f-924b004435cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:42.301384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00ac39a3-1f36-4240-9e8f-924b004435cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.304936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00ac39a3-1f36-4240-9e8f-924b004435cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.306653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00ac39a3-1f36-4240-9e8f-924b004435cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.309097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00ac39a3-1f36-4240-9e8f-924b004435cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.322930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:42.333910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:42.336423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:42.338912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03dea8fe-ed4e-4d88-a442-3bcc6cedb87a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1335 microversion: 2.47 time: 0.143195 Aug 04 04:35:42.340582 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1408/2807] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:42 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:35:42.378346 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00ac39a3-1f36-4240-9e8f-924b004435cb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092358 Aug 04 04:35:42.379637 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1400/2808] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:35:42 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:35:42.595188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:42.596160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:42.613566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.614030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.614838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.615316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.730153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-11c40236-0f24-43a5-949f-e53973778577 req-b0a6bc24-c552-43a2-9427-882d0cdc291e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c55a9-4b61-4a7a-8732-e0162c1ca354", "name": "network-vif-plugged", "status": "completed", "tag": "9655202c-3dc5-4bcb-ad7e-8a55e1d57459"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:42.744288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-11c40236-0f24-43a5-949f-e53973778577 req-b0a6bc24-c552-43a2-9427-882d0cdc291e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:42.745062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-11c40236-0f24-43a5-949f-e53973778577 req-b0a6bc24-c552-43a2-9427-882d0cdc291e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:42.762526 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-11c40236-0f24-43a5-949f-e53973778577 req-b0a6bc24-c552-43a2-9427-882d0cdc291e service nova] Creating event network-vif-plugged:9655202c-3dc5-4bcb-ad7e-8a55e1d57459 for instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 on n-h1-851337-5 Aug 04 04:35:42.771865 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-11c40236-0f24-43a5-949f-e53973778577 req-b0a6bc24-c552-43a2-9427-882d0cdc291e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047051 Aug 04 04:35:42.774164 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1401/2809] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:42.858517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:42.872055 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5f3a7f0-e87e-4a48-9be6-9e87caeb09d2 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.280174 Aug 04 04:35:42.873258 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1409/2810] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:42 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:43.166369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.167205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 60d1e5ff-6a76-4261-9402-1b9ffc757620] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.173780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.174512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.175392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.175963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.193558 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 could not be found. Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 HTTP/1.1 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 could not be found. Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '60d1e5ff-6a76-4261-9402-1b9ffc757620'} Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 could not be found. Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 could not be found. Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:43.195782 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 could not be found. Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance 60d1e5ff-6a76-4261-9402-1b9ffc757620 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8986b17a-c352-4edd-acc0-044b5605c281 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620" status: 404 len: 111 microversion: 2.1 time: 0.036827 Aug 04 04:35:43.199720 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1402/2811] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:43 2022] GET /compute/v2.1/servers/60d1e5ff-6a76-4261-9402-1b9ffc757620 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:35:43.207701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-675376ae-daaf-4ecc-8cf4-a67d6963eaac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.244523 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-675376ae-daaf-4ecc-8cf4-a67d6963eaac tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/f4c066ee-7b13-425c-a0f7-73b7afe79f5b" status: 204 len: 0 microversion: 2.1 time: 0.040550 Aug 04 04:35:43.245692 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1410/2812] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:35:43 2022] DELETE /compute/v2.1/os-server-groups/f4c066ee-7b13-425c-a0f7-73b7afe79f5b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:35:43.255524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.256032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.263933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.264439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.270988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.278476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.290910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.291685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.298742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.299561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.300459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.301117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.311811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:43.431433 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f812b281-e3ac-4d04-bec4-cedef1590d98 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 204 len: 0 microversion: 2.1 time: 0.180685 Aug 04 04:35:43.432085 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1403/2813] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:43 2022] DELETE /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:43.440300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.441331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.448202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.448857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.449636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.450890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.549922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:43.561114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:43.563197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:43.565114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f1717135-8033-491b-8027-b21b624c29b6 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1335 microversion: 2.47 time: 0.128704 Aug 04 04:35:43.566645 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1404/2814] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:43 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:43.572728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8007efa-4368-4cbe-8bea-f594d857bb84 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.574829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:43.575263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f8007efa-4368-4cbe-8bea-f594d857bb84 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.582087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8007efa-4368-4cbe-8bea-f594d857bb84 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.582659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8007efa-4368-4cbe-8bea-f594d857bb84 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.583748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8007efa-4368-4cbe-8bea-f594d857bb84 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.584286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8007efa-4368-4cbe-8bea-f594d857bb84 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.584957 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a2125c4f-8f4a-48a3-9a74-7bd56ba50585 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.299066 Aug 04 04:35:43.586026 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1411/2815] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:43 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:43.590765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.591318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.593159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:43.603835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.604582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.605582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.606332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.633145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8007efa-4368-4cbe-8bea-f594d857bb84 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064717 Aug 04 04:35:43.633954 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1405/2816] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:35:43 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:43.641620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:43.733323 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93d866a7-e578-4bcd-8ff8-f2d5036defff tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 204 len: 0 microversion: 2.1 time: 0.145893 Aug 04 04:35:43.734129 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1412/2817] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:43 2022] DELETE /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:43.742698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.743353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.749488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.749940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.750745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.751205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.895538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:43.896651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:43.904113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.904520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.905943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:43.905943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:43.927093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:43.944146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-023266b8-d2c7-41de-b266-0d0c50ec96b6 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1473 microversion: 2.1 time: 0.205762 Aug 04 04:35:43.945229 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1406/2818] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:43 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1473 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:44.091855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:44.100021 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c9b02cf-f4f6-419d-8858-ce6c286e5a3a tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.209827 Aug 04 04:35:44.103100 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1413/2819] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:43 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:44.591160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:44.592111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:44.598799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.599401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:44.600315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.600893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:44.606259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:44.607688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:44.617971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.618668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:44.619639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.620215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:44.735596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:44.749419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:44.752593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:44.754018 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f234661-4751-48f5-939d-84eed50676ab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1335 microversion: 2.47 time: 0.168225 Aug 04 04:35:44.754914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1407/2820] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:44 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1335 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:44.782733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cebd6fa6-db59-451a-8e20-7fb43ce628ad tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:44.786008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cebd6fa6-db59-451a-8e20-7fb43ce628ad tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:44.794272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebd6fa6-db59-451a-8e20-7fb43ce628ad tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.795188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebd6fa6-db59-451a-8e20-7fb43ce628ad tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:44.797002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebd6fa6-db59-451a-8e20-7fb43ce628ad tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.797607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cebd6fa6-db59-451a-8e20-7fb43ce628ad tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:44.866116 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cebd6fa6-db59-451a-8e20-7fb43ce628ad tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083435 Aug 04 04:35:44.867853 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1408/2821] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:35:44 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:44.877407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:44.886063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7df193f0-981d-4497-a27a-acf1807aa068 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1315 microversion: 2.1 time: 0.283952 Aug 04 04:35:44.899945 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1414/2822] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:44 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:44.967604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:44.968329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:44.987682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.988656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:44.990256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:44.990982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.121926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:45.122616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:45.131019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.132194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.133771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.134401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.201070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:45.211629 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cf7f1e9-a9cb-4eab-9681-9b55a4876646 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1473 microversion: 2.1 time: 0.248832 Aug 04 04:35:45.212997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1409/2823] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:44 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1473 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:45.441077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:45.454500 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ef75e61d-336f-4c9b-a69f-7b5146e7fc9b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.336081 Aug 04 04:35:45.469575 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1415/2824] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:45 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:45.782110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:45.784059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:45.795361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.795794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.796590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.797066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.880600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-236c6e2a-20c9-4ca0-b846-0e1f01e96271 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:45.884465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-236c6e2a-20c9-4ca0-b846-0e1f01e96271 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:45.893023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-236c6e2a-20c9-4ca0-b846-0e1f01e96271 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.893857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-236c6e2a-20c9-4ca0-b846-0e1f01e96271 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.894849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-236c6e2a-20c9-4ca0-b846-0e1f01e96271 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.895651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-236c6e2a-20c9-4ca0-b846-0e1f01e96271 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.939250 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-236c6e2a-20c9-4ca0-b846-0e1f01e96271 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062564 Aug 04 04:35:45.940408 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1416/2825] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:35:45 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:45.946270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:45.946895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:45.953099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:45.956706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.960447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.963204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:45.963895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:45.967641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:45.969519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:45.972889 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a435970c-51e6-4d03-a2ad-b105cc0c0ce3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1356 microversion: 2.47 time: 0.194040 Aug 04 04:35:45.983006 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1410/2826] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:45 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:46.000376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:46.005297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:46.017036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.017846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.018851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.019482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.155378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:35:46.155807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:35:46.156284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:35:46.156798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:35:46.157219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:35:46.236415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:46.252544 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3a49ee23-15f3-43cd-a38a-fd59ce575f9d tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1503 microversion: 2.1 time: 0.308774 Aug 04 04:35:46.254317 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1417/2827] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:45 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:46.260520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:46.261401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:46.267465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:46.282622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.283123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.284089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.284551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.302182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.303007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.304858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.306439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.320890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc4d62d3-5018-4c80-83e1-2ff2741bf958 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "POST /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796/action" status: 202 len: 1078 microversion: 2.47 time: 0.325792 Aug 04 04:35:46.323171 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1411/2828] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:35:45 2022] POST /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796/action => generated 1078 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 04 04:35:46.330139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7551412-3d5b-42c5-a51a-97815aa1025e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:46.330621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7551412-3d5b-42c5-a51a-97815aa1025e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:46.338627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7551412-3d5b-42c5-a51a-97815aa1025e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.339251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7551412-3d5b-42c5-a51a-97815aa1025e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.340148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7551412-3d5b-42c5-a51a-97815aa1025e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.340745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7551412-3d5b-42c5-a51a-97815aa1025e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.345997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:46.435752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7551412-3d5b-42c5-a51a-97815aa1025e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354/action" status: 202 len: 0 microversion: 2.1 time: 0.110601 Aug 04 04:35:46.437308 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1412/2829] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:46 2022] POST /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:46.443078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:46.443913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:46.451394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.451965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.452839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.453428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.554467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:46.564582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:46.566266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:46.567826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-faddfc3f-3142-4d56-9ed1-1fa1f54f414e tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.129941 Aug 04 04:35:46.568710 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1413/2830] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:46 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:46.574249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:46.575187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:46.582008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.582722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.583622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.584262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.610103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:46.622876 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c07a2b09-acf4-4eea-9ef0-419e41d30e67 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1473 microversion: 2.1 time: 0.367246 Aug 04 04:35:46.639118 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1418/2831] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:46 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1473 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:46.644614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:46.647864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:46.655764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.656347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.657395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:46.657956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:46.980188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:46.996393 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a24f7c38-fb43-4e74-a7de-559e9a2a043b tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.349764 Aug 04 04:35:46.997053 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1419/2832] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:46 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:47.015293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10dedbb5-3741-456a-a3f3-d90cc85f5ccd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:47.017891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-10dedbb5-3741-456a-a3f3-d90cc85f5ccd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:47.025520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10dedbb5-3741-456a-a3f3-d90cc85f5ccd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:47.026287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10dedbb5-3741-456a-a3f3-d90cc85f5ccd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:47.027099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:47.028056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10dedbb5-3741-456a-a3f3-d90cc85f5ccd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:47.028748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10dedbb5-3741-456a-a3f3-d90cc85f5ccd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:47.039397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5693f92e-f391-4dce-875e-a822b690bd84 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1508 microversion: 2.1 time: 0.469633 Aug 04 04:35:47.040998 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1414/2833] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:46 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:47.075817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:47.087507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-10dedbb5-3741-456a-a3f3-d90cc85f5ccd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076134 Aug 04 04:35:47.088584 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1420/2834] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:35:47 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:47.590821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:47.591486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:47.611569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:47.612575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:47.613920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:47.614546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:47.658341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:47.665934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:47.679819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:47.680771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:47.681976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:47.682785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:47.792839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:47.800848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:47.802532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:47.803913 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7229a466-394a-4d4a-bb82-b5c41a723f73 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.217095 Aug 04 04:35:47.804586 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1415/2835] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:47 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:48.017424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:48.018657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:48.026212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.027076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.028210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.029250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.152977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:48.165023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5d29293a-0454-47ab-8c2f-268bc1a63139 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1473 microversion: 2.1 time: 0.513793 Aug 04 04:35:48.178527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1421/2836] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:47 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1473 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:48.192076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:48.196354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:48.208695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.210931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.212033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.216916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.301621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:48.397925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:48.415809 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50cf7a63-a3dd-4caa-88ae-fc35c31e5583 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.402087 Aug 04 04:35:48.416406 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1416/2837] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:48 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:48.421498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33054bbe-4858-4083-b50d-a9c20272cac8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:48.433844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33054bbe-4858-4083-b50d-a9c20272cac8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:48.440204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33054bbe-4858-4083-b50d-a9c20272cac8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.440662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33054bbe-4858-4083-b50d-a9c20272cac8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.441465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33054bbe-4858-4083-b50d-a9c20272cac8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.441899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33054bbe-4858-4083-b50d-a9c20272cac8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.505622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:48.516451 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33054bbe-4858-4083-b50d-a9c20272cac8 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094079 Aug 04 04:35:48.517726 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1417/2838] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:35:48 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:35:48.527437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2d87b6f4-1d0d-40b7-a7e3-5076db5f1b4f req-b33361bf-e04d-428b-9013-62b1c5dafca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201bbcd7-9bff-44bc-89a5-27960b085fa5", "name": "network-vif-deleted", "tag": "11dc6ef6-c275-46de-970c-e3b58ce829d2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:48.548520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2d87b6f4-1d0d-40b7-a7e3-5076db5f1b4f req-b33361bf-e04d-428b-9013-62b1c5dafca9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.548975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2d87b6f4-1d0d-40b7-a7e3-5076db5f1b4f req-b33361bf-e04d-428b-9013-62b1c5dafca9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.570633 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2d87b6f4-1d0d-40b7-a7e3-5076db5f1b4f req-b33361bf-e04d-428b-9013-62b1c5dafca9 service nova] Creating event network-vif-deleted:11dc6ef6-c275-46de-970c-e3b58ce829d2 for instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 on n-h1-851337-5 Aug 04 04:35:48.598220 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2d87b6f4-1d0d-40b7-a7e3-5076db5f1b4f req-b33361bf-e04d-428b-9013-62b1c5dafca9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079032 Aug 04 04:35:48.608125 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1418/2839] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:48.618886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:48.627167 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9a195b3-aff5-4e8f-b529-adf9e1274d01 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1488 microversion: 2.1 time: 0.458700 Aug 04 04:35:48.632265 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1422/2840] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:48 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1488 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:48.661647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:48.662108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:48.663021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:48.667661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:48.680382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.683611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.685945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.687037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.689802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.691888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.693076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:48.693234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:48.789110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lazy-loading 'flavor' on Instance uuid 899c55a9-4b61-4a7a-8732-e0162c1ca354 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:48.798621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:48.999257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:49.029692 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-035d306e-8d62-4d67-bdb0-2ba8889de81e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 204 len: 0 microversion: 2.1 time: 0.381048 Aug 04 04:35:49.034217 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1419/2841] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:48 2022] DELETE /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:49.045608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:49.046543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:49.066036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.066747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.067726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.068316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.156897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:49.168754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e16e9af2-40d5-4408-9205-e3404eb7e911 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354/action" status: 202 len: 0 microversion: 2.1 time: 0.515666 Aug 04 04:35:49.169947 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1423/2842] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:35:48 2022] POST /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:35:49.175041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:49.176610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:49.177181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-49c35286-f8c4-42ee-a3f6-024f07309768 req-88099d07-fe37-46bf-b2fd-3d3c046cdd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8fd1c8-1f4c-4432-b1a9-f40552373469", "name": "network-vif-deleted", "tag": "25cb0cbd-d68d-4fc3-8c68-fd4a5db49437"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:49.178136 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c16c61d7-503b-499e-9dd7-e75e49462028 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.144123 Aug 04 04:35:49.179479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1420/2843] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:49 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:49.184908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:49.185734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:49.189931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-49c35286-f8c4-42ee-a3f6-024f07309768 req-88099d07-fe37-46bf-b2fd-3d3c046cdd59 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.190372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-49c35286-f8c4-42ee-a3f6-024f07309768 req-88099d07-fe37-46bf-b2fd-3d3c046cdd59 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.201757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.202472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-49c35286-f8c4-42ee-a3f6-024f07309768 req-88099d07-fe37-46bf-b2fd-3d3c046cdd59 service nova] Creating event network-vif-deleted:25cb0cbd-d68d-4fc3-8c68-fd4a5db49437 for instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 on n-h1-851337-5 Aug 04 04:35:49.204321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.206682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.207235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.208321 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-49c35286-f8c4-42ee-a3f6-024f07309768 req-88099d07-fe37-46bf-b2fd-3d3c046cdd59 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036473 Aug 04 04:35:49.209116 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1424/2844] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:49.218755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:49.221501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:49.246325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.247185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.248381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.249010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.328510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=22 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:49.575250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:49.586022 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab49435e-af82-46c9-be16-2c0547d14fa6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1683 microversion: 2.1 time: 0.403855 Aug 04 04:35:49.586832 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1421/2845] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:49 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1683 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:49.603773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:49.614092 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17775a4f-c6d7-4aa3-9886-13e101ffecc9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1494 microversion: 2.1 time: 0.402957 Aug 04 04:35:49.615268 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1425/2846] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:49 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1494 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:49.622712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:49.623908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:49.626252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:49.627318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:49.641159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.642016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.643005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.644027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.644645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.648579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.649580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.650172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.709029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:49.715097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:49.716808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lazy-loading 'fault' on Instance uuid 3a8fd1c8-1f4c-4432-b1a9-f40552373469 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:49.830920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:49.846567 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-928cfcfa-ad24-46ed-8c12-37ce3629d1cf tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1308 microversion: 2.1 time: 0.255862 Aug 04 04:35:49.848189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1422/2847] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:49 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:49.908361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:49.919880 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ef9741df-408f-4c22-aa0c-e5789d23f757 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.303243 Aug 04 04:35:49.933299 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1426/2848] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:49 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:50.081752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:50.082338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:50.089362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.089894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.090866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.091330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.119753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:50.203086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:50.204427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:50.214007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.215167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.216219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.217065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.219480 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bddaeecc-0841-4472-9e01-06cd5df16d33 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 204 len: 0 microversion: 2.32 time: 0.369441 Aug 04 04:35:50.220212 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1423/2849] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:35:49 2022] DELETE /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:35:50.229369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:50.230388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:50.237525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.237906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.238721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.239197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.558172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.565805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:50.571187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.572726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.574239 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-389aed6c-4f46-4b8a-9c86-4a3e7ba3f274 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2954 microversion: 2.32 time: 0.349175 Aug 04 04:35:50.575304 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1424/2850] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:50 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2954 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:35:50.610315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:50.611997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:50.621137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.621592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.622824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.623819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.643400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.652196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.654988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.654988 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ec07942-336a-4159-a549-6d8678ff9e0d tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.455969 Aug 04 04:35:50.657180 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1427/2851] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:50 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:35:50.662320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:50.663030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:50.673684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.674143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.674928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.675427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.869500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.878385 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2d7dbfb6-084c-4512-88ae-29d32194fa52 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1683 microversion: 2.1 time: 0.273356 Aug 04 04:35:50.888215 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1425/2852] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:50 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1683 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:35:50.888215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:50.888215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:50.892130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.892767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.893551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.893995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.963446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:50.963446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:50.963446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lazy-loading 'fault' on Instance uuid 3a8fd1c8-1f4c-4432-b1a9-f40552373469 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:50.971440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:50.981585 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0971e20c-bc1b-4bd4-9962-a5cfbf2af3b0 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1494 microversion: 2.1 time: 0.324772 Aug 04 04:35:50.982363 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1428/2853] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:50 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1494 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:50.989993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:50.990621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:51.000938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:51.001445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:51.002170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:51.002606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:51.020562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:51.030792 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b3c81b9-cdb8-4737-bf77-08a8c41e79a7 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1308 microversion: 2.1 time: 0.150179 Aug 04 04:35:51.031927 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1426/2854] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:50 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:51.173766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:51.185590 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03426f29-5f40-46db-9fef-ff2ec67c3d16 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.202339 Aug 04 04:35:51.186177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1429/2855] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:50 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:51.188071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b28d7956-e59c-4612-8d3f-792c05976f2d tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Action: 'create', calling method: .version_select at 0x7f1919daf4c0>, body: {"pool": null} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:51.601690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:51.602314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:51.609150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:51.609601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:51.610383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:51.611456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:51.878411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:51.903111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:51.904907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:51.906233 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b04f71bc-e7aa-4258-8d01-bbe9a0f78136 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2954 microversion: 2.32 time: 0.308981 Aug 04 04:35:51.907154 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1430/2856] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:51 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2954 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:35:51.912942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:51.913710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:51.921062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:51.921527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:51.922322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:51.922766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.018668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:52.029223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:52.031034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:52.032313 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0eb6ef09-4fbe-45c3-9ef5-dfe3d86ea978 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.123991 Aug 04 04:35:52.033076 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1431/2857] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:51 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:52.038081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:52.038845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:52.059611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.060076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.061086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.061535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.298521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:52.307290 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2834b651-48aa-4bf3-ab79-ff019f895a7e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1683 microversion: 2.1 time: 0.273081 Aug 04 04:35:52.312417 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1432/2858] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:52 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1683 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:52.317144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:52.318015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:52.325917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.326505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.327569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.328116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.568855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:52.577806 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d1b832d8-fd16-467c-80dd-459508ebd0fa tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1494 microversion: 2.1 time: 0.268193 Aug 04 04:35:52.578602 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1433/2859] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:52 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1494 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:52.584022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:52.584845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:52.596672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.597641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.598344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.598890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.633620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.634796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.635290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lazy-loading 'fault' on Instance uuid 3a8fd1c8-1f4c-4432-b1a9-f40552373469 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:35:52.694973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:52.703240 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c63fbd1-5c4a-47d1-a3e0-9dc4c3d4d93f tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 200 len: 1308 microversion: 2.1 time: 0.123756 Aug 04 04:35:52.703827 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1434/2860] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:52 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 1308 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:52.708906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:52.710052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:52.720132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.720958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.723626 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b28d7956-e59c-4612-8d3f-792c05976f2d tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.597107 Aug 04 04:35:52.724080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.724080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.732531 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1427/2861] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:35:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:35:52.737938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-94c6c8ec-86d3-4911-ace5-87130af97d40 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Action: 'create', calling method: .version_select at 0x7f191ab311f0>, body: {"pool": null} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:52.950819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:52.953959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:52.962005 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1cab17d0-0c3c-4051-9680-cb076c0d9a5e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.256938 Aug 04 04:35:52.962660 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1435/2862] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:52 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:52.968035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:52.968651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:52.975822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.976272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:52.977059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:52.977508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:53.255437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:53.265879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:53.267433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:53.268722 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5938c877-54c3-4e6b-bc02-d2ef986dbfde tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2954 microversion: 2.32 time: 0.304709 Aug 04 04:35:53.269486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1436/2863] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:52 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2954 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:53.305379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:53.305733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:53.312519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:53.312821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:53.313592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:53.314028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:53.416492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:53.426051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:53.427619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:53.429581 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-231f0d32-bd5d-43ca-9f42-8b477b626e6a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.145134 Aug 04 04:35:53.440240 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1437/2864] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:53 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:53.440240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:53.440240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:53.443364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:53.444023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:53.445408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:53.446031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:53.786800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:53.798779 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d29553ba-a29c-486b-8444-9f9c2a758c9b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1683 microversion: 2.1 time: 0.367428 Aug 04 04:35:53.800244 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1438/2865] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:53 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1683 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:53.820310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:53.821968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:53.830373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:53.831059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:53.832003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:53.832607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:54.415457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:54.423262 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dff060db-e9ab-463a-8b49-816fd7f1ad02 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1494 microversion: 2.1 time: 0.621561 Aug 04 04:35:54.423850 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1439/2866] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:53 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1494 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:54.437649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:54.438198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 3a8fd1c8-1f4c-4432-b1a9-f40552373469] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:54.455085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:54.455506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:54.456317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:54.459311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:54.486256 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 could not be found. Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 HTTP/1.1 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 could not be found. Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '3a8fd1c8-1f4c-4432-b1a9-f40552373469'} Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 could not be found. Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 could not be found. Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:54.489141 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 could not be found. Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance 3a8fd1c8-1f4c-4432-b1a9-f40552373469 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d192bb5-d8ce-412d-a0d2-b5f7d0cf584c tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469" status: 404 len: 111 microversion: 2.1 time: 0.065936 Aug 04 04:35:54.494162 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1440/2867] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:54 2022] GET /compute/v2.1/servers/3a8fd1c8-1f4c-4432-b1a9-f40552373469 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:54.495964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:54.496586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:54.515291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:54.515865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:54.516672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:54.517123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:54.871654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:54.885527 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-07e27dce-e0b3-4cd9-84a9-3a02866151e6 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.392141 Aug 04 04:35:54.904095 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1441/2868] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:54 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:54.909926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:54.910898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:54.919288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:54.920032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:54.921074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:54.921727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.341243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:55.355596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:55.358441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:55.360139 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e29a9bef-73d0-4bfd-857a-4abba1c100c1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2933 microversion: 2.32 time: 0.454631 Aug 04 04:35:55.361194 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1442/2869] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:54 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2933 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:55.366714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:55.367091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:55.376886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.377779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.379443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.380297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.497132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:55.505085 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-94c6c8ec-86d3-4911-ace5-87130af97d40 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.771050 Aug 04 04:35:55.505776 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1428/2870] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:35:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:55.508495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:55.510291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:55.511754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e0da8176-6f16-46f8-b782-df1aae7f6487 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.149616 Aug 04 04:35:55.513132 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1443/2871] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:55 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:55.513926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:55.514576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 201bbcd7-9bff-44bc-89a5-27960b085fa5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:55.523429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.523931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.525068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.525752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.528759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:55.530507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:55.539339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.540108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.541220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.542027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.544496 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 could not be found. Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 HTTP/1.1 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 could not be found. Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '201bbcd7-9bff-44bc-89a5-27960b085fa5'} Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 could not be found. Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 could not be found. Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:55.546448 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 could not be found. Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance 201bbcd7-9bff-44bc-89a5-27960b085fa5 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9bffa1f9-e721-4e89-876d-804945c4f52b tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5" status: 404 len: 111 microversion: 2.1 time: 0.040466 Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1429/2872] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:55 2022] GET /compute/v2.1/servers/201bbcd7-9bff-44bc-89a5-27960b085fa5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:55.555605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:55.556311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:55.562526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.563016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.563815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:55.564439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:55.640858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:55.653179 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d1f6a80-0f76-48ea-9da7-2525842f9334 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 200 len: 1615 microversion: 2.1 time: 0.138137 Aug 04 04:35:55.655749 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1444/2873] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:55 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 1615 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:55.670211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8d091ab-ac6d-43be-9f19-f22439a64f77 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Action: 'create', calling method: .version_select at 0x7f191a32c160>, body: {"pool": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:55.968715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:56.009305 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-592f2342-efbb-455e-8106-24296e744e6f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1515 microversion: 2.1 time: 0.458482 Aug 04 04:35:56.011895 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1430/2874] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:55 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1515 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:56.073691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bf482cac-2944-4fca-bcca-45c3ba9a85b8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:56.153354 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bf482cac-2944-4fca-bcca-45c3ba9a85b8 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/562feb62-c0fd-48ba-ae01-05a37d8f321b" status: 204 len: 0 microversion: 2.1 time: 0.139856 Aug 04 04:35:56.159224 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1431/2875] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:35:56 2022] DELETE /compute/v2.1/os-server-groups/562feb62-c0fd-48ba-ae01-05a37d8f321b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:56.165692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:56.166574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:56.180283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.181498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:56.182909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.183618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:56.509714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:56.523355 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c9e73b09-0a2a-49d1-845d-d1bb1fe390ea tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.365140 Aug 04 04:35:56.524275 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1432/2876] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:56 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:56.544258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-53a60eba-c0b1-4738-aa36-fdea9715ba88 req-679fbfd3-b4b0-44fe-8daf-18f2afab5de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a2f759-f92a-4b9f-9090-55d1bcb5e93c", "name": "network-vif-deleted", "tag": "c9fb860f-4c14-48d6-baeb-38e2d6865112"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:56.555367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-53a60eba-c0b1-4738-aa36-fdea9715ba88 req-679fbfd3-b4b0-44fe-8daf-18f2afab5de8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.555816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-53a60eba-c0b1-4738-aa36-fdea9715ba88 req-679fbfd3-b4b0-44fe-8daf-18f2afab5de8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:56.581991 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-53a60eba-c0b1-4738-aa36-fdea9715ba88 req-679fbfd3-b4b0-44fe-8daf-18f2afab5de8 service nova] Creating event network-vif-deleted:c9fb860f-4c14-48d6-baeb-38e2d6865112 for instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c on n-h1-851337-5 Aug 04 04:35:56.595535 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-53a60eba-c0b1-4738-aa36-fdea9715ba88 req-679fbfd3-b4b0-44fe-8daf-18f2afab5de8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057509 Aug 04 04:35:56.604464 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1433/2877] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:56.620370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-45eb75e6-5431-4c9d-a431-5966166758a5 req-3a14997b-6395-441d-8be6-9569b7343a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-deleted", "tag": "b91f7631-35bc-4019-9c98-469955f4c3a6"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:56.636295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45eb75e6-5431-4c9d-a431-5966166758a5 req-3a14997b-6395-441d-8be6-9569b7343a09 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.637283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45eb75e6-5431-4c9d-a431-5966166758a5 req-3a14997b-6395-441d-8be6-9569b7343a09 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:56.661146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-45eb75e6-5431-4c9d-a431-5966166758a5 req-3a14997b-6395-441d-8be6-9569b7343a09 service nova] Creating event network-vif-deleted:b91f7631-35bc-4019-9c98-469955f4c3a6 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:35:56.671768 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-45eb75e6-5431-4c9d-a431-5966166758a5 req-3a14997b-6395-441d-8be6-9569b7343a09 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065722 Aug 04 04:35:56.680264 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1434/2878] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:56.686523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:56.687581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:56.702580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.708440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:56.709568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.711142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:56.765056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:35:56.903992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c50adac-4475-4547-9cfc-0482faa88625 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 204 len: 0 microversion: 2.1 time: 0.221778 Aug 04 04:35:56.910364 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1435/2879] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:35:56 2022] DELETE /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:35:56.926873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:56.927790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:56.943658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.947926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:56.951343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:56.952060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:57.677213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:57.689789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:57.692037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:57.693874 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2196d09e-3e12-4e66-8d49-a08d5537d302 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2705 microversion: 2.32 time: 0.781491 Aug 04 04:35:57.699543 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1436/2880] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:56 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2705 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:57.706156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:57.707247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:57.738703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:57.739188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:57.739969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:57.740407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:57.870872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:57.885023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:57.886643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:57.888185 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-766f47d6-018d-42f3-a093-fe3d24d43ef3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.186707 Aug 04 04:35:57.903315 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1437/2881] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:57 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:57.903315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:57.903315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:57.905464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:57.905926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:57.906830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:57.907474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:57.922515 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c HTTP/1.1 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b9a2f759-f92a-4b9f-9090-55d1bcb5e93c'} Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:35:57.924424 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-457f5383-ad56-4aa9-8d77-fa5339c0b775 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 404 len: 111 microversion: 2.1 time: 0.036183 Aug 04 04:35:57.928807 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1438/2882] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:57 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:35:57.931455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:57.932001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:57.939059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:57.939522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:57.940308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:57.940787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:58.304775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:58.317289 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3579c9ac-61c3-4ed3-9bc6-6dfd14d60934 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1472 microversion: 2.1 time: 0.389345 Aug 04 04:35:58.318444 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1439/2883] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:57 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:58.323655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:58.331870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:58.360846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:58.362856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:58.364843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:58.365703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:58.670319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:58.678226 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8d091ab-ac6d-43be-9f19-f22439a64f77 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.021111 Aug 04 04:35:58.678841 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1445/2884] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:35:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:58.687349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-23756651-7b6f-4b4d-b160-25e9fcab8e6a req-c833edd3-b24f-4bf3-a129-89c0efc289f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-unplugged", "status": "completed", "tag": "79a80cce-aa43-459a-b8bf-02f7dc9b7e38"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:58.698494 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6bf7f565-f0ea-4428-b73f-922cdffd15ed tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1515 microversion: 2.1 time: 0.378636 Aug 04 04:35:58.699744 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1440/2885] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:58 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1515 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:58.705139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:58.705945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-23756651-7b6f-4b4d-b160-25e9fcab8e6a req-c833edd3-b24f-4bf3-a129-89c0efc289f2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:58.706156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:58.706400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-23756651-7b6f-4b4d-b160-25e9fcab8e6a req-c833edd3-b24f-4bf3-a129-89c0efc289f2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:58.715295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:58.715749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:58.716726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:58.717327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:58.725619 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-23756651-7b6f-4b4d-b160-25e9fcab8e6a req-c833edd3-b24f-4bf3-a129-89c0efc289f2 service nova] Creating event network-vif-unplugged:79a80cce-aa43-459a-b8bf-02f7dc9b7e38 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:35:58.731916 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-23756651-7b6f-4b4d-b160-25e9fcab8e6a req-c833edd3-b24f-4bf3-a129-89c0efc289f2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051342 Aug 04 04:35:58.733212 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1446/2886] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:58.739638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e440c1e-33d1-434f-9df7-1f965d00bfc9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '.version_select at 0x7f191a1cc5e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:58.770608 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e440c1e-33d1-434f-9df7-1f965d00bfc9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157777321" status: 202 len: 0 microversion: 2.1 time: 0.035941 Aug 04 04:35:58.771403 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1447/2887] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:35:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157777321 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:35:58.776422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf652c8a-8bd6-492b-a352-edae6f400a8f tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Action: 'create', calling method: .version_select at 0x7f1923999ca0>, body: {"pool": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:59.062338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:59.072697 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6811ed0-3188-4cad-b724-62e86780a183 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.371691 Aug 04 04:35:59.079338 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1441/2888] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:58 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:35:59.087421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:59.089554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:59.101845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:59.102719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:59.103704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:59.104312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:59.527928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:59.542652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:59.547483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:59.550030 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-13c8ea13-ca34-49f2-bff0-59ac2834cfc2 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 2611 microversion: 2.32 time: 0.469395 Aug 04 04:35:59.557316 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1442/2889] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:59 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 2611 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:59.562826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-27304b96-8b97-4867-8f6d-321fd48e02c4 req-ebd4a51c-2019-4330-97be-497e8954e4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-deleted", "tag": "dcc19c32-c8b8-456f-bd9a-701b882de6be"}, {"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-deleted", "tag": "79a80cce-aa43-459a-b8bf-02f7dc9b7e38"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:35:59.603380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-27304b96-8b97-4867-8f6d-321fd48e02c4 req-ebd4a51c-2019-4330-97be-497e8954e4f8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:59.603914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-27304b96-8b97-4867-8f6d-321fd48e02c4 req-ebd4a51c-2019-4330-97be-497e8954e4f8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:59.634761 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-27304b96-8b97-4867-8f6d-321fd48e02c4 req-ebd4a51c-2019-4330-97be-497e8954e4f8 service nova] Creating event network-vif-deleted:dcc19c32-c8b8-456f-bd9a-701b882de6be for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:35:59.646346 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-27304b96-8b97-4867-8f6d-321fd48e02c4 req-ebd4a51c-2019-4330-97be-497e8954e4f8 service nova] Creating event network-vif-deleted:79a80cce-aa43-459a-b8bf-02f7dc9b7e38 for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:35:59.679017 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-27304b96-8b97-4867-8f6d-321fd48e02c4 req-ebd4a51c-2019-4330-97be-497e8954e4f8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119824 Aug 04 04:35:59.682066 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1443/2890] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:35:59.693370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:59.699293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:59.718113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:59.719050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:59.720458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:59.721157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:59.888374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:59.899697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:59.902104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:35:59.907379 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbd49a58-a2e0-4808-a390-1adde02f6794 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.223487 Aug 04 04:35:59.908675 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1444/2891] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:35:59 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:35:59.914738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:35:59.915584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:35:59.923235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:59.923918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:35:59.924879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:35:59.925483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:00.305960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b4b3608034e2b9284abb81b8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeb2c9400144655abd2a6fc111690a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:00.314234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:00.331008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a9a8109-7a57-472c-96b9-e5b57708db81 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 200 len: 1472 microversion: 2.1 time: 0.420885 Aug 04 04:36:00.343006 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1445/2892] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:35:59 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:00.343006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:00.343006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:00.348180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:00.348837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:00.349797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:00.351516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:00.663141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:00.673256 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0379252c-e742-40c5-9315-72df3442283a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.340087 Aug 04 04:36:00.691330 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1446/2893] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:00 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:00.701715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:00.705429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:00.733081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:00.733550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:00.734365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:00.735023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.137393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:01.146557 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-095fa21f-be29-49d1-8da3-0c39c116e39e tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1472 microversion: 2.1 time: 0.453450 Aug 04 04:36:01.160415 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1447/2894] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:00 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:01.166087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a715564-5e23-41ca-a029-1caf73817692 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: .version_select at 0x7f1923b719d0>, body: {"keypair": {"name": "tempest-keypair-836478969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5uFhOiF31gWrIB2OAtxUEP/3hI3cZrtQUt5gMk2uVwJKAkh5h45a6Y0AgJH3vCh5ykXfr0sFOAOeUSGV3gEarg/F3UYQxhV+fbp37gq8GtloQmjjLtJJeq2gZxlo4aZQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:01.185617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2a715564-5e23-41ca-a029-1caf73817692 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:36:01.192192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2a715564-5e23-41ca-a029-1caf73817692 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:36:01.224632 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a715564-5e23-41ca-a029-1caf73817692 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062714 Aug 04 04:36:01.226392 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1448/2895] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:36:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:01.231424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b7169ed0-ef9d-4ed7-afc9-59e93817ea6f req-4360c0ee-3918-49a5-80ff-e8223b7ef7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b2c557-2612-4471-bd06-0d27b9416f02", "name": "network-vif-deleted", "tag": "d4a4bd6e-3d9f-421c-be81-1fd9132ea745"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:01.243658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b7169ed0-ef9d-4ed7-afc9-59e93817ea6f req-4360c0ee-3918-49a5-80ff-e8223b7ef7a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.244921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b7169ed0-ef9d-4ed7-afc9-59e93817ea6f req-4360c0ee-3918-49a5-80ff-e8223b7ef7a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.269853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b7169ed0-ef9d-4ed7-afc9-59e93817ea6f req-4360c0ee-3918-49a5-80ff-e8223b7ef7a4 service nova] Creating event network-vif-deleted:d4a4bd6e-3d9f-421c-be81-1fd9132ea745 for instance 11b2c557-2612-4471-bd06-0d27b9416f02 on n-h1-851337-5 Aug 04 04:36:01.278525 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b7169ed0-ef9d-4ed7-afc9-59e93817ea6f req-4360c0ee-3918-49a5-80ff-e8223b7ef7a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050096 Aug 04 04:36:01.279825 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1449/2896] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:01.300998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:01.302596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:01.323524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.325691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.326772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.328353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.654592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:01.673060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:01.688861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:01.695044 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8af8fbe6-c5bc-47d2-9098-1fec7ea21701 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.412890 Aug 04 04:36:01.700871 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1450/2897] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:01 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:01.719052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-45def1d1-bf47-49aa-a2f2-5496d08743cf req-28a07d1f-4314-4d03-96a8-1e88481881ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-unplugged", "status": "completed", "tag": "9a838a5c-abf8-4025-8590-88accc375b4d"}, {"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-unplugged", "status": "completed", "tag": "087ed3c0-9d5d-41c5-b873-d6a51295c4ad"}, {"server_uuid": "899c55a9-4b61-4a7a-8732-e0162c1ca354", "name": "network-vif-plugged", "status": "completed", "tag": "9655202c-3dc5-4bcb-ad7e-8a55e1d57459"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:01.755703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45def1d1-bf47-49aa-a2f2-5496d08743cf req-28a07d1f-4314-4d03-96a8-1e88481881ba service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.756765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45def1d1-bf47-49aa-a2f2-5496d08743cf req-28a07d1f-4314-4d03-96a8-1e88481881ba service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.796611 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-45def1d1-bf47-49aa-a2f2-5496d08743cf req-28a07d1f-4314-4d03-96a8-1e88481881ba service nova] Creating event network-vif-unplugged:9a838a5c-abf8-4025-8590-88accc375b4d for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:36:01.797418 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-45def1d1-bf47-49aa-a2f2-5496d08743cf req-28a07d1f-4314-4d03-96a8-1e88481881ba service nova] Creating event network-vif-unplugged:087ed3c0-9d5d-41c5-b873-d6a51295c4ad for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:36:01.798172 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-45def1d1-bf47-49aa-a2f2-5496d08743cf req-28a07d1f-4314-4d03-96a8-1e88481881ba service nova] Creating event network-vif-plugged:9655202c-3dc5-4bcb-ad7e-8a55e1d57459 for instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 on n-h1-851337-5 Aug 04 04:36:01.810123 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-45def1d1-bf47-49aa-a2f2-5496d08743cf req-28a07d1f-4314-4d03-96a8-1e88481881ba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.105261 Aug 04 04:36:01.833811 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1451/2898] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:01.852050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:01.852775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:01.863595 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf652c8a-8bd6-492b-a352-edae6f400a8f tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.090836 Aug 04 04:36:01.864321 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1448/2899] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:35:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:01.868795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.869299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.870038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.870474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.871177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:01.875256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] [instance: 11b2c557-2612-4471-bd06-0d27b9416f02] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:01.891317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.893095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.896253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.897597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.925440 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] HTTP exception thrown: Instance 11b2c557-2612-4471-bd06-0d27b9416f02 could not be found. Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Request method failure captured: Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 HTTP/1.1 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60wSvlNpQsFO2KOSXE6LV8bputzRjF9pv3RyF0a4Hbz02O2csqYfoQPsBwej5jDmltThtiYKNxcXffNdstZe2D4t1Z8453aGtTVTSXmd4rOIysoAsGXFf5nTfPlulzCAyeq5LXIT_m0aQm5jm8K-7DPMxfeTmZAbXtVyzYE_Z6keBWg Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4eeb2c9400144655abd2a6fc111690a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4eeb2c9400144655abd2a6fc111690a1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4eeb2c9400144655abd2a6fc111690a1 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1262637750 Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 141b4b3608034e2b9284abb81b8079ba Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersOnMultiNodesTest-1262637750-project Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 11b2c557-2612-4471-bd06-0d27b9416f02 could not be found. Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '11b2c557-2612-4471-bd06-0d27b9416f02'} Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b2c557-2612-4471-bd06-0d27b9416f02 could not be found. Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b2c557-2612-4471-bd06-0d27b9416f02 could not be found. Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:01.929185 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:01.934069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:01.934069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:01.934069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:01.934069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:01.934069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:01.934069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b2c557-2612-4471-bd06-0d27b9416f02 could not be found. Aug 04 04:36:01.934069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:01.936393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] Returning 404 to user: Instance 11b2c557-2612-4471-bd06-0d27b9416f02 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:01.937533 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd3352d2-71c9-41ab-af63-d4d6c9a098d2 tempest-ServersOnMultiNodesTest-1262637750 tempest-ServersOnMultiNodesTest-1262637750-project] 10.222.0.69 "GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02" status: 404 len: 111 microversion: 2.1 time: 0.072053 Aug 04 04:36:01.938646 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1449/2900] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:01 2022] GET /compute/v2.1/servers/11b2c557-2612-4471-bd06-0d27b9416f02 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:36:01.945262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:01.946250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:01.954906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.955746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:01.956771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:01.957439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:02.064487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:02.075176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:02.076712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:02.077920 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-56f0b27b-127b-45fa-b719-ef55e3607427 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.236057 Aug 04 04:36:02.090172 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1452/2901] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:01 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:02.095862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-91797177-1e04-4c53-b819-236a81fef0cb req-625361f5-5ebc-4b04-ac31-92bcb331be84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-deleted", "tag": "9a838a5c-abf8-4025-8590-88accc375b4d"}, {"server_uuid": "8213be83-56ba-4a4c-9e70-a9b5116d6b5f", "name": "network-vif-deleted", "tag": "087ed3c0-9d5d-41c5-b873-d6a51295c4ad"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:02.121638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:02.135148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-91797177-1e04-4c53-b819-236a81fef0cb req-625361f5-5ebc-4b04-ac31-92bcb331be84 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:02.135619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-91797177-1e04-4c53-b819-236a81fef0cb req-625361f5-5ebc-4b04-ac31-92bcb331be84 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:02.185256 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-91797177-1e04-4c53-b819-236a81fef0cb req-625361f5-5ebc-4b04-ac31-92bcb331be84 service nova] Creating event network-vif-deleted:9a838a5c-abf8-4025-8590-88accc375b4d for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:36:02.185785 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-91797177-1e04-4c53-b819-236a81fef0cb req-625361f5-5ebc-4b04-ac31-92bcb331be84 service nova] Creating event network-vif-deleted:087ed3c0-9d5d-41c5-b873-d6a51295c4ad for instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f on n-h1-851337-5 Aug 04 04:36:02.202192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:02.206413 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-91797177-1e04-4c53-b819-236a81fef0cb req-625361f5-5ebc-4b04-ac31-92bcb331be84 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114859 Aug 04 04:36:02.214374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-939257da-33cd-4d19-8d6b-09a4b21d5fdb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.274302 Aug 04 04:36:02.215663 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1453/2902] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:02.216721 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1450/2903] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:01 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:02.222997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-485dd0ee-a7b4-4ad9-8d91-986404b2020f tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Calling method '.version_select at 0x7f1923b71f70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:02.227341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:02.230782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:02.246294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:02.247196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:02.248390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:02.249061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:02.963223 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-485dd0ee-a7b4-4ad9-8d91-986404b2020f tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/3e79c859-7473-4486-9c41-cad56da2a2b9" status: 200 len: 142 microversion: 2.1 time: 0.744333 Aug 04 04:36:02.963950 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1454/2904] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:36:02 2022] GET /compute/v2.1/os-floating-ips/3e79c859-7473-4486-9c41-cad56da2a2b9 => generated 142 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:02.970222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:02.971778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:02.997064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:02.997523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:02.998335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:02.998782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:03.086639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:03.099459 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-71e2ddbc-ea36-4deb-9f70-5ec09daf3ce7 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1478 microversion: 2.1 time: 0.879564 Aug 04 04:36:03.102117 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1451/2905] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:02 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1478 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:03.110873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11354a2e-b44c-4a7b-aa8d-84da21d933a3 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Calling method '.version_select at 0x7f191a8f91f0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:03.302755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:03.321467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:03.332701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:03.334075 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd682984-4659-4536-87d2-d44d393b8cc0 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.368796 Aug 04 04:36:03.347524 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1455/2906] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:02 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:03.367678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:03.368334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:03.380976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:03.381582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:03.382391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:03.382839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:03.592165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:03.605342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:03.609769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:03.615916 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-08ba008e-458a-4e3f-92e3-fa14985652cd tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.265975 Aug 04 04:36:03.618732 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1456/2907] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:03 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:03.644955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:03.647694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:03.666804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:03.668902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:03.669854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:03.670605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:04.073720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:04.083829 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a79b19c-814d-47a3-872b-d9c1ec7f0a0e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.463016 Aug 04 04:36:04.094493 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1457/2908] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:03 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:04.125127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:04.126032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:04.140652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:04.143782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:04.145205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:04.145961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:04.670545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:04.682598 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34a16ca8-574d-4291-ab43-944e4f5b1ee1 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1478 microversion: 2.1 time: 0.561482 Aug 04 04:36:04.683647 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1458/2909] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:04 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1478 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:04.713432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:04.719029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:04.736614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:04.736831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:04.737828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:04.738276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:04.932333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:04.942503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:04.948846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:04.955114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-acab3a01-a675-477f-a2f8-0a6909a402eb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.250437 Aug 04 04:36:04.955880 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1459/2910] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:04 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:04.980741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:04.981522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:04.998519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:04.998519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:04.999351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:04.999806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:05.121636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:05.130436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:05.135477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:05.145753 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03e300d9-0216-4f8d-9a77-274dab2d1898 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.184658 Aug 04 04:36:05.147541 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1460/2911] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:04 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:05.156011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1561672126", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99037335-254b-4262-8aa6-b4fe7cbe9d37"}], "security_groups": [{"name": "tempest-securitygroup--328945985"}], "key_name": "tempest-keypair-836478969", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:05.204465 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11354a2e-b44c-4a7b-aa8d-84da21d933a3 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/3e79c859-7473-4486-9c41-cad56da2a2b9" status: 202 len: 0 microversion: 2.1 time: 2.100090 Aug 04 04:36:05.206506 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1452/2912] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:36:03 2022] DELETE /compute/v2.1/os-floating-ips/3e79c859-7473-4486-9c41-cad56da2a2b9 => generated 0 bytes in 2104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:05.214325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:05.215020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:05.241460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:05.244103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:05.244967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:05.247418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:05.400007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] validate_networks() for [('99037335-254b-4262-8aa6-b4fe7cbe9d37', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:36:05.651041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:05.720153 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9195eb11-4c42-4920-9c07-1ad742f045b9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.511568 Aug 04 04:36:05.721545 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1453/2913] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:05 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:05.731742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ce5399b5-6c76-45ab-b911-f71793b09906 req-b699ca85-9352-4203-8204-a7486a0b1f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5633ea-df6b-404c-90e8-611d4a40f753", "name": "network-vif-unplugged", "status": "completed", "tag": "a1864dde-7a45-41ae-93e7-81d73b54d4ad"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:05.778414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ce5399b5-6c76-45ab-b911-f71793b09906 req-b699ca85-9352-4203-8204-a7486a0b1f4d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:05.779359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ce5399b5-6c76-45ab-b911-f71793b09906 req-b699ca85-9352-4203-8204-a7486a0b1f4d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:05.820846 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ce5399b5-6c76-45ab-b911-f71793b09906 req-b699ca85-9352-4203-8204-a7486a0b1f4d service nova] Creating event network-vif-unplugged:a1864dde-7a45-41ae-93e7-81d73b54d4ad for instance 3b5633ea-df6b-404c-90e8-611d4a40f753 on n-h2-851337-5 Aug 04 04:36:05.831364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ce5399b5-6c76-45ab-b911-f71793b09906 req-b699ca85-9352-4203-8204-a7486a0b1f4d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107295 Aug 04 04:36:05.837342 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1454/2914] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:05.843739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3949f0d7-9141-4929-9c8a-cf07f39c33df tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Calling method '.version_select at 0x7f191a5cd790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:06.210083 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3949f0d7-9141-4929-9c8a-cf07f39c33df tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.370662 Aug 04 04:36:06.212570 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1455/2915] 10.222.0.69 () {58 vars in 1164 bytes} [Thu Aug 4 04:36:05 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:36:06.220006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:06.228733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:06.242859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.245215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.247059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.247771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.337291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:36:06.338250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:36:06.338885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:36:06.339515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:36:06.340084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:36:06.357592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.358300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.361708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.362606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.417923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:36:06.435341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Getting quotas for user b2588a591dfc42549c0a98fd40f97d58 and project ad357c5189504aba9361110360005bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:36:06.465265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:36:06.471758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:36:06.602827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:06.605285 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec70e8dc-cd05-495a-a715-521e34dccfa1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.456112 Aug 04 04:36:06.609231 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1461/2916] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:36:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:36:06.625394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:06.627963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:06.631662 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-12330dbd-4d56-4e54-95e4-5d89c3487e91 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1478 microversion: 2.1 time: 0.416268 Aug 04 04:36:06.641470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.642326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.643333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.643951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.649624 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1456/2917] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:06 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1478 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:06.684037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:06.685926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:06.695565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.696027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.696824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:06.697272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:06.798497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:06.815578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:06.817559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:06.821826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c22cb6aa-ea1c-4457-950c-f289abd58444 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.209953 Aug 04 04:36:06.841309 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1462/2918] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:06 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:06.847503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1723e5fa-7f77-4bfb-9231-2d20e34eb13a tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Calling method '.version_select at 0x7f191a3ab820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:07.009936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:07.081169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:07.081169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:07.081169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-729b3f2e-1db3-4ee1-97e2-e6f20ca073ad tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.390489 Aug 04 04:36:07.081169 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1457/2919] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:06 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:07.081169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0b95a0a-7430-49cd-b686-ab48da46473e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:07.081169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0b95a0a-7430-49cd-b686-ab48da46473e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:07.299331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0b95a0a-7430-49cd-b686-ab48da46473e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:07.310110 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0b95a0a-7430-49cd-b686-ab48da46473e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1241 microversion: 2.1 time: 0.265612 Aug 04 04:36:07.310653 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1458/2920] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:07 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1241 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:07.318379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:07.319946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:07.353614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:07.354074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:07.354868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:07.364025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:07.512211 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1723e5fa-7f77-4bfb-9231-2d20e34eb13a tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.669384 Aug 04 04:36:07.512847 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1463/2921] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:36:06 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:07.528446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4a454f7-cb4b-421f-a4be-89a630c35ad8 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Calling method '.version_select at 0x7f191a03bd30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:08.091417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:08.105083 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c3d1b2d3-b7fa-41a4-8e5e-d191effd23bd tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.787748 Aug 04 04:36:08.106268 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1459/2922] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:07 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:08.113777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:08.120002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:08.130170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:08.143490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:08.144687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:08.145694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:08.146298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:08.944661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:08.953414 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-447a8204-e7b3-4c04-8b8c-fa405a0ba621 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1478 microversion: 2.1 time: 0.845791 Aug 04 04:36:08.977091 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1460/2923] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:08 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1478 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:08.977091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:08.977091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:08.981152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:08.991462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:08.992533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:08.993077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:08.996868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:09.114654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:09.130028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:09.137823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:09.139445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98d81212-abda-42d9-8cdf-aa7dfe5f1ea4 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.174404 Aug 04 04:36:09.140207 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1461/2924] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:08 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:09.145187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:09.154432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:09.164105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.164565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.165408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.165794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.298871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:09.310224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:09.315933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:09.323736 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62f51e9b-7f66-4609-8239-efdfe2832b50 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.182201 Aug 04 04:36:09.324994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1462/2925] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:09 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:09.522420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92eefc29-bc57-455b-8560-59169b6eec77 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:09.525689 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:09.525689 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:36:09.531693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92eefc29-bc57-455b-8560-59169b6eec77 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.532448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92eefc29-bc57-455b-8560-59169b6eec77 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.533543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92eefc29-bc57-455b-8560-59169b6eec77 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.534281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92eefc29-bc57-455b-8560-59169b6eec77 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.576787 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92eefc29-bc57-455b-8560-59169b6eec77 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.250530 Aug 04 04:36:09.585907 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1463/2926] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:36:09 2022] GET /compute/v2.1/os-services => generated 944 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:09.591359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:09.592151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:09.601298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.602033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.603176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.603823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.752080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:09.768906 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb1cf1e4-17f8-4a71-942d-4a389c073712 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1299 microversion: 2.1 time: 0.175731 Aug 04 04:36:09.771335 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1464/2927] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:09 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:09.789933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:09.795095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:09.811391 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4a454f7-cb4b-421f-a4be-89a630c35ad8 tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/757c6abc-a9dd-4619-a81d-15934a8399bc" status: 202 len: 0 microversion: 2.1 time: 2.287511 Aug 04 04:36:09.812368 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1464/2928] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:36:07 2022] DELETE /compute/v2.1/os-floating-ips/757c6abc-a9dd-4619-a81d-15934a8399bc => generated 0 bytes in 2289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:09.816675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.817137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.817320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f82ae4d2-4906-4abf-b595-d990054d6dea req-7658f04b-7c49-4304-a6d6-cc560a9383cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5633ea-df6b-404c-90e8-611d4a40f753", "name": "network-vif-plugged", "status": "completed", "tag": "a1864dde-7a45-41ae-93e7-81d73b54d4ad"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:09.817927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.818907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.832586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f82ae4d2-4906-4abf-b595-d990054d6dea req-7658f04b-7c49-4304-a6d6-cc560a9383cc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.833378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f82ae4d2-4906-4abf-b595-d990054d6dea req-7658f04b-7c49-4304-a6d6-cc560a9383cc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.848970 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f82ae4d2-4906-4abf-b595-d990054d6dea req-7658f04b-7c49-4304-a6d6-cc560a9383cc service nova] Creating event network-vif-plugged:a1864dde-7a45-41ae-93e7-81d73b54d4ad for instance 3b5633ea-df6b-404c-90e8-611d4a40f753 on n-h2-851337-5 Aug 04 04:36:09.854853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f82ae4d2-4906-4abf-b595-d990054d6dea req-7658f04b-7c49-4304-a6d6-cc560a9383cc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041068 Aug 04 04:36:09.855813 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1465/2929] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:09.864226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72301de0-665d-46d2-88f9-0ce68065091c tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:09.867600 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:09.867600 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:36:09.869631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72301de0-665d-46d2-88f9-0ce68065091c tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.870330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72301de0-665d-46d2-88f9-0ce68065091c tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.872137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72301de0-665d-46d2-88f9-0ce68065091c tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:09.872703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72301de0-665d-46d2-88f9-0ce68065091c tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:09.908510 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-72301de0-665d-46d2-88f9-0ce68065091c tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051190 Aug 04 04:36:09.918060 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1466/2930] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Aug 4 04:36:09 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:09.923553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e8340fa-4663-41b5-8254-ae0748816eae tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Calling method '.version_select at 0x7f1923b6e5e0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:10.367552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:10.382011 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c8f254b-a880-4a86-8cfd-3cb6aec25a3e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.606544 Aug 04 04:36:10.384141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1465/2931] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:09 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:10.395039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-21628dc3-bbde-44ef-a0e3-326e86a0062d tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:10.400070 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:10.400070 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:36:10.402936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21628dc3-bbde-44ef-a0e3-326e86a0062d tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:10.404549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21628dc3-bbde-44ef-a0e3-326e86a0062d tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:10.406199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21628dc3-bbde-44ef-a0e3-326e86a0062d tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:10.407368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21628dc3-bbde-44ef-a0e3-326e86a0062d tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:10.442193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-21628dc3-bbde-44ef-a0e3-326e86a0062d tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.056380 Aug 04 04:36:10.443801 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1466/2932] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:36:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:10.450678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:10.451678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:10.464166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:10.465195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:10.466687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:10.467470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:10.932058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:10.942223 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd5ae65d-6e92-44b7-acd9-7ff345365602 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1478 microversion: 2.1 time: 0.497099 Aug 04 04:36:10.942825 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1467/2933] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:10 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1478 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:10.960861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:10.961712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:10.969714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:10.970481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:10.971643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:10.972254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.188238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:11.204314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:11.206038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:11.207472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1d3ff53-e0e8-439d-8b6f-4877776f3642 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.257411 Aug 04 04:36:11.219571 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1468/2934] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:10 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:11.230141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:11.230894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:11.238081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.238719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.239757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.240375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.442623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:11.460271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:11.465255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:11.466693 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-878b5352-c1d1-4479-9835-7a563ef5a5b3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.245918 Aug 04 04:36:11.467925 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1469/2935] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:11 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:11.475395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-29332d82-de67-4532-920b-ff2362ea3da0 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:11.479967 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:11.479967 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:36:11.486065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29332d82-de67-4532-920b-ff2362ea3da0 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.486659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29332d82-de67-4532-920b-ff2362ea3da0 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.488010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29332d82-de67-4532-920b-ff2362ea3da0 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.488561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29332d82-de67-4532-920b-ff2362ea3da0 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.521970 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-29332d82-de67-4532-920b-ff2362ea3da0 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=n-d-851337-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.051765 Aug 04 04:36:11.522869 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1470/2936] 10.222.0.69 () {58 vars in 1194 bytes} [Thu Aug 4 04:36:11 2022] GET /compute/v2.1/os-services?host=n-d-851337-5&binary=xxx => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:36:11.535201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:11.535987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:11.543103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.543688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.545171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.545765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.804244 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e8340fa-4663-41b5-8254-ae0748816eae tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/d3e3be0c-2aeb-421a-ad1c-7f4a4db7759f" status: 202 len: 0 microversion: 2.1 time: 1.884584 Aug 04 04:36:11.805507 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1467/2937] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:36:09 2022] DELETE /compute/v2.1/os-floating-ips/d3e3be0c-2aeb-421a-ad1c-7f4a4db7759f => generated 0 bytes in 1886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:11.811876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:11.812624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:11.833354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.833950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:11.850657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:11.851627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:12.053643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:12.067460 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ab04c46-a83b-4308-8be2-71a8c4489cc1 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1366 microversion: 2.1 time: 0.536386 Aug 04 04:36:12.068170 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1471/2938] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:11 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1366 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:12.073229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a6a495a-f425-4b4b-af4d-4e7f862c6ed8 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:12.077613 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:12.077613 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 04:36:12.079085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6a495a-f425-4b4b-af4d-4e7f862c6ed8 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:12.081368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6a495a-f425-4b4b-af4d-4e7f862c6ed8 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:12.082204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6a495a-f425-4b4b-af4d-4e7f862c6ed8 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:12.082655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6a495a-f425-4b4b-af4d-4e7f862c6ed8 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:12.110756 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a6a495a-f425-4b4b-af4d-4e7f862c6ed8 tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.040926 Aug 04 04:36:12.111768 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1472/2939] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:36:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:12.116768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c7162c18-5cfc-4424-8014-dcfef1c7ad3e tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] Calling method '.version_select at 0x7f191a2dc820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:12.180311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:12.205764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6541cb8-a245-4b00-a805-c5baf9d9ab7f tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.399052 Aug 04 04:36:12.213688 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1468/2940] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:11 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:12.239193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:12.248187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:12.257521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:12.257975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:12.259010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:12.260081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:12.856763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:12.897850 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ebdb1fe1-d589-4bf4-b6e0-81850341f356 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1463 microversion: 2.1 time: 0.673924 Aug 04 04:36:12.902046 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1469/2941] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:12 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1463 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:12.922637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a97b436b-97d7-46f2-977e-26561ce5d6ca tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:12.934726 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:12.934726 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:36:12.948640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a97b436b-97d7-46f2-977e-26561ce5d6ca tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:12.954431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a97b436b-97d7-46f2-977e-26561ce5d6ca tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:12.955556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a97b436b-97d7-46f2-977e-26561ce5d6ca tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:12.956475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a97b436b-97d7-46f2-977e-26561ce5d6ca tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:12.998100 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a97b436b-97d7-46f2-977e-26561ce5d6ca tempest-ServicesAdminNegativeTestJSON-936923091 tempest-ServicesAdminNegativeTestJSON-936923091-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.092869 Aug 04 04:36:12.999015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1470/2942] 10.222.0.69 () {58 vars in 1198 bytes} [Thu Aug 4 04:36:12 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:36:13.010401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:13.015986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:13.029959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.030817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:13.031803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.032407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:13.186850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:13.197136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:13.210331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:13.211877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1314814-0556-4bfd-a7c5-22f112412f15 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.211768 Aug 04 04:36:13.212605 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1471/2943] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:12 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:13.217311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:13.223879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:13.243803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.244509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:13.245449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.246046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:13.293783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:13.362418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:13.371534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:13.378242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:13.383720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67122adb-99fd-4c39-ba05-09b533f7f62a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.169916 Aug 04 04:36:13.400244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1472/2944] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:13 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:13.406359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02bcab4d-e952-4448-bae1-4cf32a297e18 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:13.409646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02bcab4d-e952-4448-bae1-4cf32a297e18 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:13.416659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02bcab4d-e952-4448-bae1-4cf32a297e18 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.417369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02bcab4d-e952-4448-bae1-4cf32a297e18 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:13.418499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02bcab4d-e952-4448-bae1-4cf32a297e18 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.419135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02bcab4d-e952-4448-bae1-4cf32a297e18 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:13.568202 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02bcab4d-e952-4448-bae1-4cf32a297e18 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action" status: 202 len: 0 microversion: 2.1 time: 0.166623 Aug 04 04:36:13.569094 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1473/2945] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:36:13 2022] POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:13.771551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e76022ab-ff06-4f8f-9db0-2be78fdbc3b3 tempest-ServicesAdminNegativeTestJSON-706042650 tempest-ServicesAdminNegativeTestJSON-706042650-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:13.780308 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:13.780308 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:36:13.781716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e76022ab-ff06-4f8f-9db0-2be78fdbc3b3 tempest-ServicesAdminNegativeTestJSON-706042650 tempest-ServicesAdminNegativeTestJSON-706042650-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '884a0fa0eab343cf8e1af45b5ca80bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18019f266d5d4204a75d8c0f6aa19097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e76022ab-ff06-4f8f-9db0-2be78fdbc3b3 tempest-ServicesAdminNegativeTestJSON-706042650 tempest-ServicesAdminNegativeTestJSON-706042650-project] Request method failure captured: Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60y24ZVOChw1qyRwzhH-CfKNG2BDY_PXZDpjUkV3LEM4rjsK9oZyW1Sc-Li7PxEXZFJuhp5lyZH6XsHB-6vLxigGXMS67Km4zKsp_ak7a2LQyGHGrUMnv2IL1C-jY2SWm3_6-LGfIZedf4v8ooaH9R2DIKqko9iRP1EFqUDsK7_16IM Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 18019f266d5d4204a75d8c0f6aa19097 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-706042650 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/18019f266d5d4204a75d8c0f6aa19097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/18019f266d5d4204a75d8c0f6aa19097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/18019f266d5d4204a75d8c0f6aa19097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_18019f266d5d4204a75d8c0f6aa19097", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-706042650 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 18019f266d5d4204a75d8c0f6aa19097 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-706042650 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServicesAdminNegativeTestJSON-706042650-project Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 884a0fa0eab343cf8e1af45b5ca80bb4 Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-706042650-project Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: action_args: {} Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 04:36:13.783592 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e76022ab-ff06-4f8f-9db0-2be78fdbc3b3 tempest-ServicesAdminNegativeTestJSON-706042650 tempest-ServicesAdminNegativeTestJSON-706042650-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:13.788057 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e76022ab-ff06-4f8f-9db0-2be78fdbc3b3 tempest-ServicesAdminNegativeTestJSON-706042650 tempest-ServicesAdminNegativeTestJSON-706042650-project] 10.222.0.69 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.213985 Aug 04 04:36:13.790664 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1474/2946] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:36:13 2022] GET /compute/v2.1/os-services => generated 112 bytes in 221 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:36:13.797198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:13.799182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:13.809529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.809899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:13.811721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:13.812877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:14.224442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:14.239859 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-22c67ab5-0e46-43de-bac5-d132179546bd tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1366 microversion: 2.1 time: 0.447995 Aug 04 04:36:14.247808 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1475/2947] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:13 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:14.258886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:14.259783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:14.275511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:14.281182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:14.283310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:14.286882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:14.799498 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c7162c18-5cfc-4424-8014-dcfef1c7ad3e tempest-FloatingIPDetailsTestJSON-239997570 tempest-FloatingIPDetailsTestJSON-239997570-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/c28bb890-e11a-46ca-abe7-6d24f4c70de6" status: 202 len: 0 microversion: 2.1 time: 2.686503 Aug 04 04:36:14.800101 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1473/2948] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:36:12 2022] DELETE /compute/v2.1/os-floating-ips/c28bb890-e11a-46ca-abe7-6d24f4c70de6 => generated 0 bytes in 2688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:14.804892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:14.805722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:14.831425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:14.832324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:14.833372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:14.834630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:14.935429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:14.936140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:14.936757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lazy-loading 'fault' on Instance uuid 3b5633ea-df6b-404c-90e8-611d4a40f753 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:36:15.181045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.195711 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ae22839-90ae-4f00-9534-cac70b9b08d3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.946119 Aug 04 04:36:15.196763 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1476/2949] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:14 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:15.208214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-02e986d5-5df1-472e-b291-221131a6e242 req-32e6c6c1-86d5-4295-b714-e49325d592dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060e05e8-d3cb-4ab4-83a1-bd584fb1a508", "tag": "deebc500-b800-45b5-aacd-422a65dded92"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:15.233068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-02e986d5-5df1-472e-b291-221131a6e242 req-32e6c6c1-86d5-4295-b714-e49325d592dd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.233908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-02e986d5-5df1-472e-b291-221131a6e242 req-32e6c6c1-86d5-4295-b714-e49325d592dd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.270890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-02e986d5-5df1-472e-b291-221131a6e242 req-32e6c6c1-86d5-4295-b714-e49325d592dd service nova] Creating event network-changed:deebc500-b800-45b5-aacd-422a65dded92 for instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 on n-h1-851337-5 Aug 04 04:36:15.286196 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-02e986d5-5df1-472e-b291-221131a6e242 req-32e6c6c1-86d5-4295-b714-e49325d592dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087981 Aug 04 04:36:15.287278 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1477/2950] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:15.298159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:15.298892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:15.317219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.317715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.319158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.319672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.350333 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3190ebec-f4d6-40af-9127-ef10aeadf3f1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1597 microversion: 2.1 time: 0.548378 Aug 04 04:36:15.363490 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1474/2951] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:14 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1597 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:15.378100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:15.384810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:15.395378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.396091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.397580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.399567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.510346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.520367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.522427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.535808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f17240f-b34b-4b6a-bd05-3b0fd73e4ab7 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.247081 Aug 04 04:36:15.547285 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1478/2952] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:15 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:15.557942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:15.557942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:15.587904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.588364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.588837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.589157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.589599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.597120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.598686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.608908 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-656deb90-4ec4-428c-83e7-71f236e31d96 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.244203 Aug 04 04:36:15.609968 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1475/2953] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:15 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:15.619617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00cc602b-1dc4-4807-aab7-5cec515f63af tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:15.622085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00cc602b-1dc4-4807-aab7-5cec515f63af tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:15.634992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00cc602b-1dc4-4807-aab7-5cec515f63af tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.635455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00cc602b-1dc4-4807-aab7-5cec515f63af tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.636241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00cc602b-1dc4-4807-aab7-5cec515f63af tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.649995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00cc602b-1dc4-4807-aab7-5cec515f63af tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.901328 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00cc602b-1dc4-4807-aab7-5cec515f63af tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action" status: 202 len: 0 microversion: 2.1 time: 0.290194 Aug 04 04:36:15.901960 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1476/2954] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:36:15 2022] POST /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:15.910747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ea21556-d668-48a0-9061-e6961c7dd1c1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:15.911427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ea21556-d668-48a0-9061-e6961c7dd1c1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:15.920338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:15.928656 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24a6ead0-ad74-4a39-a7f6-5245a9fc6df9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1366 microversion: 2.1 time: 0.386087 Aug 04 04:36:15.929244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1479/2955] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:15 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:15.942402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea21556-d668-48a0-9061-e6961c7dd1c1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.943139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea21556-d668-48a0-9061-e6961c7dd1c1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:15.944154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea21556-d668-48a0-9061-e6961c7dd1c1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:15.944711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea21556-d668-48a0-9061-e6961c7dd1c1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.218019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:16.218741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:16.237069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.240914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.242719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.243229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.330034 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ea21556-d668-48a0-9061-e6961c7dd1c1 tempest-ServersAdminTestJSON-396904438 tempest-ServersAdminTestJSON-396904438-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1614 microversion: 2.1 time: 0.420926 Aug 04 04:36:16.350282 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1477/2956] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:15 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1614 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:16.364309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:16.365127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:16.375831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.377512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.379234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.380244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.455728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:36:16.458408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:16.518743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:16.670606 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b37c0b03-dbdb-4e04-9559-26073263185c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 204 len: 0 microversion: 2.1 time: 0.310812 Aug 04 04:36:16.671564 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1478/2957] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:36:16 2022] DELETE /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:36:16.694144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:16.694872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:16.709537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.712667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.716665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.717144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.900967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:16.915523 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e9dae86e-4939-45a3-a001-de3ec3857971 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.702545 Aug 04 04:36:16.929623 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1480/2958] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:16 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:16.956138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:16.961349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:16.964366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:16.973593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.977549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.978643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:16.979318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:16.981518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:16.988735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:16.988735 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-af12bc4e-ba4f-40df-85fc-bf4eceeadd28 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.313788 Aug 04 04:36:16.991626 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1479/2959] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:16 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:17.007250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:17.007880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:17.017829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:17.022452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:17.023615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:17.024070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:17.161780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:17.180358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:17.182180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:17.183605 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4d98cc3-9373-4a8a-8412-33f6466a82ec tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.250210 Aug 04 04:36:17.199444 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1481/2960] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:16 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:17.205187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:17.215916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:17.222561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:17.222929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:17.223752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:17.224190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:17.303449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:17.611181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:17.619998 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d17c40b-bf2d-4eeb-80fb-b8a1e6c414c9 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1366 microversion: 2.1 time: 0.419081 Aug 04 04:36:17.620595 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1482/2961] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:17 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:17.681173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:17.695193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78abf44c-ab7f-4069-887c-08e271769dbd tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1468 microversion: 2.1 time: 0.702281 Aug 04 04:36:17.697788 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1480/2962] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:16 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1468 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:17.942538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:17.943799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:17.957535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:17.958342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:17.960371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:17.963301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.065071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:18.079189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:18.079189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.079189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.108264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.108836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.447232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:18.463243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:18.463243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:18.464367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ce1b0142-96b8-41d3-9b7c-812680d7a2d8 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.403826 Aug 04 04:36:18.465194 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1481/2963] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:18 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:18.494763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:18.495406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:18.512646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.513098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.513888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.514324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.729617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:18.745428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:18.752249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:18.760977 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e485d25-ad02-4efb-8f8a-d2110087061f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1365 microversion: 2.47 time: 0.272367 Aug 04 04:36:18.764761 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1482/2964] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:18 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:18.774279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:18.780263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:18.786078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:18.803429 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34f35258-769d-418c-919e-3bdf75cc208a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.867022 Aug 04 04:36:18.804421 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1483/2965] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:17 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:18.810451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.811792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.812838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.815836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.821002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:18.826408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:18.846829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.850015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:18.853483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:18.854156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:19.438666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:19.451645 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-131aa17e-c27f-48c0-b6c2-6d1e3a36410c tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1468 microversion: 2.1 time: 0.645429 Aug 04 04:36:19.452682 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1484/2966] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:18 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1468 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:19.508859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:19.509517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:19.525029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:19.525493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:19.535272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:19.535779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:19.547368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:19.559604 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-481d4746-937e-4384-8529-6d697de976b0 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1366 microversion: 2.1 time: 0.792696 Aug 04 04:36:19.561132 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1483/2967] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:18 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1366 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:19.658132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:19.681734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:19.683787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:19.685474 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-867c61b0-1e43-461f-a3b0-65cfa6f43496 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.195322 Aug 04 04:36:19.686352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1485/2968] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:19 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:36:19.788075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:19.788828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:19.803750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:19.806029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:19.808239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:19.808911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:20.035902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:20.049884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:20.052038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:20.053569 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7202f56c-bff7-4c3f-9837-85cc3c09ceab tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1371 microversion: 2.47 time: 0.270061 Aug 04 04:36:20.054667 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1484/2969] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:19 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:20.482627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:20.483359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:20.487318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:20.488217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:20.501056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:20.503908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:20.504974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:20.507564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:20.509688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:20.510150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:20.514158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:20.518786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:20.982166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:20.993144 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eac55db0-9762-4d4f-af26-201cd1a1f2be tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 1.168895 Aug 04 04:36:20.993751 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1486/2970] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:19 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:21.011957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:21.012820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:21.029976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.031071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:21.031610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:21.032479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:21.032999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:21.045974 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06cd9ed7-a1e9-4e13-b41c-c45abe7f24e0 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1468 microversion: 2.1 time: 0.569200 Aug 04 04:36:21.054106 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1485/2971] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:20 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:21.067361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:21.070238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:21.085265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:21.088033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:21.089044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:21.089742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:21.609985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.620746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.622603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.624669 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a062ce9-3a8b-4589-9811-99088a2cd99e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1604 microversion: 2.32 time: 0.569351 Aug 04 04:36:21.641758 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1486/2972] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:21 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1604 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:21.647860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:21.659885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:21.667211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:21.667941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:21.668943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:21.670122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:21.787612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.811721 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-75a6f602-688c-4d24-ad64-717e38674835 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1366 microversion: 2.1 time: 0.812382 Aug 04 04:36:21.818023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.823631 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1487/2973] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:20 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1366 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:21.829820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.842767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:21.845179 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-386975cd-8715-4389-95f1-e23be000ea61 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1371 microversion: 2.47 time: 0.201846 Aug 04 04:36:21.865861 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1487/2974] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:21 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:21.877773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-90d46750-c549-4eed-8c92-e56bc5f49c7e req-ab15874e-c512-4051-a35c-ce1060036f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060e05e8-d3cb-4ab4-83a1-bd584fb1a508", "name": "network-vif-plugged", "status": "completed", "tag": "deebc500-b800-45b5-aacd-422a65dded92"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:21.904961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90d46750-c549-4eed-8c92-e56bc5f49c7e req-ab15874e-c512-4051-a35c-ce1060036f91 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:21.905662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90d46750-c549-4eed-8c92-e56bc5f49c7e req-ab15874e-c512-4051-a35c-ce1060036f91 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:21.940379 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-90d46750-c549-4eed-8c92-e56bc5f49c7e req-ab15874e-c512-4051-a35c-ce1060036f91 service nova] Creating event network-vif-plugged:deebc500-b800-45b5-aacd-422a65dded92 for instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 on n-h1-851337-5 Aug 04 04:36:21.954663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-90d46750-c549-4eed-8c92-e56bc5f49c7e req-ab15874e-c512-4051-a35c-ce1060036f91 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085187 Aug 04 04:36:21.959632 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1488/2975] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:22.015809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:22.017443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:22.035280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.036051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.037928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.040405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.114239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:22.376170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1827667591", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:22.449616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:36:22.456764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:22.464727 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a2f9b4e-7bc3-4504-adaf-b14f2b2ecc98 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1507 microversion: 2.1 time: 0.454434 Aug 04 04:36:22.466516 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1489/2976] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:22 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:22.471399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:22.472276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:22.479201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.479928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.480942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.481590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.644979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:22.653656 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2039af87-2ce5-489e-9e03-637b7d8d45f9 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 200 len: 1426 microversion: 2.1 time: 0.185949 Aug 04 04:36:22.654256 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1490/2977] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:22 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 1426 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:22.671376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-5c612bff-d24f-4d7a-8d49-a9556c8b39df req-35149d95-c5b1-467e-ae7a-788b623014ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29", "name": "network-vif-deleted", "tag": "0409f697-2f76-477a-88e2-8a9c7ee33e38"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:22.682609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5c612bff-d24f-4d7a-8d49-a9556c8b39df req-35149d95-c5b1-467e-ae7a-788b623014ff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.683101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5c612bff-d24f-4d7a-8d49-a9556c8b39df req-35149d95-c5b1-467e-ae7a-788b623014ff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.698655 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-5c612bff-d24f-4d7a-8d49-a9556c8b39df req-35149d95-c5b1-467e-ae7a-788b623014ff service nova] Creating event network-vif-deleted:0409f697-2f76-477a-88e2-8a9c7ee33e38 for instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 on n-h2-851337-5 Aug 04 04:36:22.704306 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-5c612bff-d24f-4d7a-8d49-a9556c8b39df req-35149d95-c5b1-467e-ae7a-788b623014ff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048840 Aug 04 04:36:22.705219 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1491/2978] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:22.711220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:22.711928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:22.718697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.719479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.720512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.721163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.771138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.772349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.773018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lazy-loading 'fault' on Instance uuid 8213be83-56ba-4a4c-9e70-a9b5116d6b5f {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:36:22.793216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:36:22.794043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:36:22.794637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:36:22.795166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:36:22.795674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:36:22.805254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.805701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.806496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.806930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.824529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:22.830440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Getting quotas for project 50b635f2d2104d48896456adb0df340d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:36:22.836723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:22.837187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Getting quotas for user 5fb22c8186f34163be0fa111f39f29e8 and project 50b635f2d2104d48896456adb0df340d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:36:22.838395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37dc980aa515445d9d71f4c20daecef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1642d2eb789f4ec49d07523481fd11f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:22.840432 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bbe96b9f-4613-44c2-a6de-1e919619f01e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 200 len: 1609 microversion: 2.32 time: 0.134078 Aug 04 04:36:22.841453 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1492/2979] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:22 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 1609 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:22.845955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:22.846576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:22.871690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:36:22.872444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.873260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.874274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:22.874890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:22.876308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:36:23.000122 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f3d21da3-5acc-4aee-af3b-848e1156b3ef tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175258 Aug 04 04:36:23.001141 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1488/2980] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:36:23.006241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.007104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.014307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.015035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.016143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.016799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.136964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.137179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.140653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:23.148147 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f51ac0f4-bd64-4f21-9634-704dddd7f21b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1366 microversion: 2.1 time: 0.305615 Aug 04 04:36:23.149257 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1493/2981] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:22 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:23.154866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8911d299-7288-4fce-a600-b94a828ccb47 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.155517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8911d299-7288-4fce-a600-b94a828ccb47 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.161752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.164493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.165947 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04d419fd-4af5-4ac5-95a1-5e85b230bed9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1356 microversion: 2.47 time: 0.163576 Aug 04 04:36:23.166742 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1489/2982] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:23 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:23.192080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.199002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.201770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Searching by: {'deleted': False, 'project_id': 'e79771f9f8c241ca9539460249e813fb'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:36:23.214445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.214913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.215905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.216484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.217955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8911d299-7288-4fce-a600-b94a828ccb47 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.226289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8911d299-7288-4fce-a600-b94a828ccb47 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1214 microversion: 2.1 time: 0.075612 Aug 04 04:36:23.228005 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1494/2983] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:23 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:23.364482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:36:23.467415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.475272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:23.478431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.479166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.493823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.496816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.497771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.499695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.513509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.514335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.515388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.516096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.585784 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4d28d370-d764-4830-9f53-2d2a25f3127a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.399506 Aug 04 04:36:23.587474 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1490/2984] 10.222.0.69 () {60 vars in 1187 bytes} [Thu Aug 4 04:36:23 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:23.620426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.620986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.637171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.637657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.638547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.639069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.681063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:36:23.807119 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85f1c2de-8321-4a1f-b4fc-4dd1a8a7ff20 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 204 len: 0 microversion: 2.47 time: 0.192732 Aug 04 04:36:23.811488 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1491/2985] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:36:23 2022] DELETE /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:36:23.811591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:23.820365 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3ccf69f-6b2f-4bff-9491-91d8bbdf79d2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1507 microversion: 2.1 time: 0.336393 Aug 04 04:36:23.821157 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1495/2986] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:23 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:23.837102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.838139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.838883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.839047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.847352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.847827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.848630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.849073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.864669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.867601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.867741 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] HTTP exception thrown: Instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 could not be found. Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Request method failure captured: Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 HTTP/1.1 Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60w_M7M2vru-5-RvstgLBV5n9kEiBI4E1ob9RmQ_3KWP2-4Ptd9em3-hCfawXPf2VCMenSyOEf-12H2iaUgUYFs6HWURPg3ceABs15t9zinoSB2Zu1sIGpydD_xWR2CjN0bW8H0IYuCkg3cYwQoepDElknFLOZDTvGS7_ULcroz-dgw Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7f160af08e0c453ebcaba72e90fd959d Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7f160af08e0c453ebcaba72e90fd959d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7f160af08e0c453ebcaba72e90fd959d Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminTestJSON-293810312-project Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ffcedb7d0446478fb0290b06bc66ea0a Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminTestJSON-293810312-project Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 could not be found. Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29'} Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 could not be found. Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 could not be found. Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:23.869594 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.873901 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:23.873901 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:23.873901 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:23.873901 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:23.873901 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:23.873901 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 could not be found. Aug 04 04:36:23.873901 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.874641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.874641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.876638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Returning 404 to user: Instance b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:23.877853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d51efc1-8289-4a5d-8284-f9fcc0ac08f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29" status: 404 len: 111 microversion: 2.1 time: 0.068721 Aug 04 04:36:23.878689 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1492/2987] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:23 2022] GET /compute/v2.1/servers/b9bb6f01-7b01-4dc1-b6fa-c2af64fb1e29 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:36:23.883909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.884896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.895713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.896732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.907567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.917299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.937755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:23.948013 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] HTTP exception thrown: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Request method failure captured: Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f HTTP/1.1 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sYUpUN5T4TNpgbyrOpyYSqAb8N4gaEnAIOGXkCtX016jGpWp802uo440MWiVMWURlMkRIiY_2o32nWuaiw9iQIADJC5R57wuMJ4DNOQj15dTA1cEiTqRnZvIdtJgWzm8dBVMU1BMp5DGmQXctFE3tF3LvkgJWf0wxPPTVXZIxN1ro Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 1642d2eb789f4ec49d07523481fd11f4 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1642d2eb789f4ec49d07523481fd11f4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 1642d2eb789f4ec49d07523481fd11f4 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TaggedBootDevicesTest-1184535261-project Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 37dc980aa515445d9d71f4c20daecef9 Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TaggedBootDevicesTest-1184535261-project Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '8213be83-56ba-4a4c-9e70-a9b5116d6b5f'} Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.950192 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Returning 404 to user: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:23.954258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-812ed207-da87-4001-88ce-99077d6f2edb tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 404 len: 111 microversion: 2.32 time: 0.071706 Aug 04 04:36:23.956353 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1493/2988] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:23 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:36:23.962116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:23.962628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:23.971869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.972332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:23.973116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:23.980283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.052322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:36:24.073747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:24.085433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:24.093344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:24.094887 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aaa99b61-f55a-4a9c-94a8-710ba9f17d2a tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1362 microversion: 2.47 time: 0.268585 Aug 04 04:36:24.100488 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1496/2989] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:23 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:24.105791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da7ddbce-80d9-4746-be5f-616c32679d12 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '.version_select at 0x7f191a4f38b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:24.145342 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da7ddbce-80d9-4746-be5f-616c32679d12 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066359939" status: 204 len: 0 microversion: 2.32 time: 0.042200 Aug 04 04:36:24.148464 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1497/2990] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:36:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066359939 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:36:24.175217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:24.176206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:24.185105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.186053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.187699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.188412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.235868 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-028b3285-1066-46a7-850f-3f5a05d66b25 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 204 len: 0 microversion: 2.1 time: 0.277874 Aug 04 04:36:24.236652 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1494/2991] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:36:23 2022] DELETE /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:36:24.248437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:24.249152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:24.260079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.260704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.262012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.262529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.526096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:24.536117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:24.546346 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27ef3c53-b53f-44c6-a566-cebe7692b691 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1470 microversion: 2.1 time: 0.302321 Aug 04 04:36:24.547254 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1495/2992] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:24 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:24.552520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:24.553213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:24.560052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.560586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.561436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.561871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.572275 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7ec8762-3cde-4379-9135-4d4777f2952f tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1556 microversion: 2.1 time: 0.404773 Aug 04 04:36:24.575007 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1498/2993] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:24 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1556 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:24.598003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9014d000-6cb0-4fe4-b20d-c180a9a7c497 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:24.598665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9014d000-6cb0-4fe4-b20d-c180a9a7c497 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:24.607125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9014d000-6cb0-4fe4-b20d-c180a9a7c497 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.607617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9014d000-6cb0-4fe4-b20d-c180a9a7c497 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.609125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9014d000-6cb0-4fe4-b20d-c180a9a7c497 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.609586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9014d000-6cb0-4fe4-b20d-c180a9a7c497 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.647821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:24.657368 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e11d05ea-f7db-4f17-9985-1bb9901b5846 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1210 microversion: 2.1 time: 0.109034 Aug 04 04:36:24.658878 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1496/2994] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:24 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:24.715979 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9014d000-6cb0-4fe4-b20d-c180a9a7c497 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122820 Aug 04 04:36:24.716596 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1499/2995] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:36:24 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:24.843198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:24.844619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:24.852806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.853528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:24.854499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:24.855329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:25.121797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:25.122746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:25.127148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:25.133253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:25.133909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:25.135602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:25.136436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:25.143779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:25.164287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-84d74643-1efc-4299-9840-2a2585573ab9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1507 microversion: 2.1 time: 0.325443 Aug 04 04:36:25.165302 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1497/2996] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:24 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:25.270907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:25.279525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:25.281072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:25.282293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6b858ebf-f139-4465-b994-b4d04aa5f137 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1362 microversion: 2.47 time: 0.166152 Aug 04 04:36:25.282877 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1500/2997] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:25 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:25.580183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:25.581091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:25.605864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:25.607011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:25.608077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:25.608815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:25.680869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:25.681501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:25.698240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:25.698730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:25.699590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:25.700032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:26.048103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:26.058407 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1e828b7-8026-4528-b2b6-3f3508dbeb43 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1210 microversion: 2.1 time: 0.383107 Aug 04 04:36:26.062136 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1501/2998] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:25 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1210 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:26.068777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f05d208a-6363-46f3-b1aa-9a438197953c req-b3222bfb-9528-46f4-ba63-70f20ace0bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c55a9-4b61-4a7a-8732-e0162c1ca354", "name": "network-vif-unplugged", "status": "completed", "tag": "9655202c-3dc5-4bcb-ad7e-8a55e1d57459"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:26.078820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f05d208a-6363-46f3-b1aa-9a438197953c req-b3222bfb-9528-46f4-ba63-70f20ace0bef service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:26.079555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f05d208a-6363-46f3-b1aa-9a438197953c req-b3222bfb-9528-46f4-ba63-70f20ace0bef service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:26.095625 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f05d208a-6363-46f3-b1aa-9a438197953c req-b3222bfb-9528-46f4-ba63-70f20ace0bef service nova] Creating event network-vif-unplugged:9655202c-3dc5-4bcb-ad7e-8a55e1d57459 for instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 on n-h1-851337-5 Aug 04 04:36:26.101874 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f05d208a-6363-46f3-b1aa-9a438197953c req-b3222bfb-9528-46f4-ba63-70f20ace0bef service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037847 Aug 04 04:36:26.102743 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1502/2999] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:26.186986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:26.188146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:26.207458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:26.208336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:26.209995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:26.210693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:26.860905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:26.877796 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a5f2dcf-b512-4e6c-83f1-8fcd5b656ecb tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1470 microversion: 2.1 time: 1.308226 Aug 04 04:36:26.879103 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1498/3000] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:25 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1470 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:26.888920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:26.890423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:26.929967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:26.932820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:26.936465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:26.937231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:26.965660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:26.980950 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63251f24-683d-44d5-9580-c6f9363347c3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 200 len: 1510 microversion: 2.1 time: 0.796392 Aug 04 04:36:26.995983 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1503/3001] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:26 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 1510 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:27.003954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:27.005153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:27.013629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.014365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:27.015399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.016052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:27.221521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:27.236110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:27.239145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:27.241585 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e54282a-f723-4d88-90f2-140f723383bb tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 200 len: 1362 microversion: 2.47 time: 0.361066 Aug 04 04:36:27.242517 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1499/3002] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:26 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:27.248720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:27.251161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:27.261609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.262352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:27.263653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.265152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:27.480147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:27.493013 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc98dcab-1e55-4083-9433-6423c75c43c9 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1272 microversion: 2.1 time: 0.248979 Aug 04 04:36:27.497143 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1500/3003] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:27 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:27.604441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:27.613491 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cca9748d-0abc-4642-82da-e2b2ea076518 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.613262 Aug 04 04:36:27.614427 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1504/3004] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:26 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:27.647262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:27.648637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:27.668197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.668663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:27.669449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.672823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:27.903850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:27.904993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:27.917349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.920124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:27.922908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:27.924118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.452531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:28.460904 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b685f28-06bc-409b-8b59-36cc6c70c3af tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1470 microversion: 2.1 time: 0.564542 Aug 04 04:36:28.471380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1505/3005] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:27 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1470 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:28.478152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-21422f32-f4a1-43f6-9574-ab99de2c3882 req-3909f32e-6847-4e87-927d-852f7366e76b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060e05e8-d3cb-4ab4-83a1-bd584fb1a508", "tag": "deebc500-b800-45b5-aacd-422a65dded92"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:28.503018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-21422f32-f4a1-43f6-9574-ab99de2c3882 req-3909f32e-6847-4e87-927d-852f7366e76b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.503704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-21422f32-f4a1-43f6-9574-ab99de2c3882 req-3909f32e-6847-4e87-927d-852f7366e76b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.529099 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-21422f32-f4a1-43f6-9574-ab99de2c3882 req-3909f32e-6847-4e87-927d-852f7366e76b service nova] Creating event network-changed:deebc500-b800-45b5-aacd-422a65dded92 for instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 on n-h1-851337-5 Aug 04 04:36:28.536583 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-21422f32-f4a1-43f6-9574-ab99de2c3882 req-3909f32e-6847-4e87-927d-852f7366e76b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063808 Aug 04 04:36:28.543666 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1506/3006] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:28.551214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:28.561769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:28.580478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 0fe47c05-e74b-4416-b25c-c1c6d6a37796] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:28.580734 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5972d19e-07aa-4d33-8ec8-05e12615661e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.944046 Aug 04 04:36:28.601830 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1501/3007] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:27 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:28.605275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.605739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.606540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.607002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.613149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:28.614696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:28.626631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.627159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.628523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.628974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.656244 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] HTTP exception thrown: Instance 0fe47c05-e74b-4416-b25c-c1c6d6a37796 could not be found. Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Request method failure captured: Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 HTTP/1.1 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60yZVFh5UQP0KWsjjBBgvXCERFHyttYJQ51xaR55wT1HK6tlz_udACR4QR6LEyjEbSTl0M_VOcqNRzBZ1ad6iJPOFqxs-v4ggxOXuBqNIEMob_9ULfJDAIuiG886W4qWm1ihqPtichH0Gt61bbLkPJRacvW672hzDMF0jRUClIaitJY Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: e79771f9f8c241ca9539460249e813fb Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerShowV247Test-2022450346 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e79771f9f8c241ca9539460249e813fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e79771f9f8c241ca9539460249e813fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e79771f9f8c241ca9539460249e813fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e79771f9f8c241ca9539460249e813fb", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerShowV247Test-2022450346 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: e79771f9f8c241ca9539460249e813fb Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerShowV247Test-2022450346 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerShowV247Test-2022450346-project Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bc22e60d2f734b209ba479d4e4d9e293 Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerShowV247Test-2022450346-project Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0fe47c05-e74b-4416-b25c-c1c6d6a37796 could not be found. Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0fe47c05-e74b-4416-b25c-c1c6d6a37796'} Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe47c05-e74b-4416-b25c-c1c6d6a37796 could not be found. Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe47c05-e74b-4416-b25c-c1c6d6a37796 could not be found. Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:28.657989 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe47c05-e74b-4416-b25c-c1c6d6a37796 could not be found. Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Returning 404 to user: Instance 0fe47c05-e74b-4416-b25c-c1c6d6a37796 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:28.662659 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d654a45f-534a-4dce-a2d5-90841398ba1c tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796" status: 404 len: 111 microversion: 2.47 time: 0.114326 Aug 04 04:36:28.675404 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1507/3008] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:28 2022] GET /compute/v2.1/servers/0fe47c05-e74b-4416-b25c-c1c6d6a37796 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:36:28.682501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:28.683155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:28.696038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.696546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.697410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.697849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.888251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:28.913467 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1235285-99e4-4a56-84f9-4c3c77581260 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1272 microversion: 2.1 time: 0.308158 Aug 04 04:36:28.920942 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1502/3009] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:28 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:28.941980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:28.942666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:28.962543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.966763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:28.969280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:28.971562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.050770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:36:29.054939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:29.176914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:29.192065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ca331ed-03d1-4491-973f-81fcdb67b6b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.515446 Aug 04 04:36:29.192672 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1508/3010] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:28 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:29.222382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:29.223341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:29.231473 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-68234e03-c3c1-4c03-9cd7-4e749ec11d23 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b" status: 204 len: 0 microversion: 2.47 time: 0.307003 Aug 04 04:36:29.232721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1503/3011] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:36:28 2022] DELETE /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:36:29.244356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:29.246583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:29.256953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.257859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.260180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.260921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.263594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.264059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.264873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.265320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.649419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:29.675038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:29.680024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:29.684623 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3f67e7fc-df8e-454c-87fe-4a3e86dc45f3 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b" status: 200 len: 1363 microversion: 2.47 time: 0.447432 Aug 04 04:36:29.688194 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1504/3012] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:29 2022] GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:36:29.704679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:29.705672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:29.723941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.727712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.728856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.730738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.835771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.836518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.837082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lazy-loading 'fault' on Instance uuid 43008e9e-a99a-4c9e-8b02-cd63ed953c92 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:36:29.936754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:29.945154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:29.948410 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e36e3765-d122-4102-94cd-d6d1b0ad3298 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 200 len: 1304 microversion: 2.1 time: 0.258761 Aug 04 04:36:29.949265 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1505/3013] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:29 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 1304 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:29.964330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f503f48-8a12-4a40-ac96-f83634b3cae4 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.752548 Aug 04 04:36:29.967083 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1509/3014] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:29 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:29.972609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:29.973957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:29.981315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.981700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:29.982464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:29.997171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ea372b9-a01d-4d6f-8f42-0156337f4e56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:30.008537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.027530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ea372b9-a01d-4d6f-8f42-0156337f4e56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:30.029671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ea372b9-a01d-4d6f-8f42-0156337f4e56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.086942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0ea372b9-a01d-4d6f-8f42-0156337f4e56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:36:30.180481 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ea372b9-a01d-4d6f-8f42-0156337f4e56 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.174744 Aug 04 04:36:30.184374 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1510/3015] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:36:29 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:36:30.190299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:30.199458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:30.202076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:30.203600 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-508d9241-38e1-42c3-86ac-14c81f51e3fd tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1272 microversion: 2.1 time: 0.237390 Aug 04 04:36:30.204195 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1506/3016] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:29 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:30.213334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:30.213808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.214651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:30.215213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.630926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c253487d-c5eb-4441-abb6-51a0d304887c req-5cbcff10-a16d-44e5-b414-95414f80a065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43008e9e-a99a-4c9e-8b02-cd63ed953c92", "name": "network-vif-deleted", "tag": "a3ba4f75-0fb7-4263-a888-2feea399279a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:30.656185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c253487d-c5eb-4441-abb6-51a0d304887c req-5cbcff10-a16d-44e5-b414-95414f80a065 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:30.657541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c253487d-c5eb-4441-abb6-51a0d304887c req-5cbcff10-a16d-44e5-b414-95414f80a065 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.674742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:30.689681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ced240b-78cc-4341-ab29-cae07962cf37 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.499097 Aug 04 04:36:30.691957 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1511/3017] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:30 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:30.694215 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c253487d-c5eb-4441-abb6-51a0d304887c req-5cbcff10-a16d-44e5-b414-95414f80a065 service nova] Creating event network-vif-deleted:a3ba4f75-0fb7-4263-a888-2feea399279a for instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 on n-h2-851337-5 Aug 04 04:36:30.708090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c253487d-c5eb-4441-abb6-51a0d304887c req-5cbcff10-a16d-44e5-b414-95414f80a065 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082764 Aug 04 04:36:30.714473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1507/3018] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:36:30.725594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:30.726309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:30.746850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:30.747844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.748778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:30.749221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.974116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:30.975323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 43008e9e-a99a-4c9e-8b02-cd63ed953c92] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:30.994128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:30.994687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:30.995604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.000708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.029252 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] HTTP exception thrown: Instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 could not be found. Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Request method failure captured: Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 HTTP/1.1 Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60w_M7M2vru-5-RvstgLBV5n9kEiBI4E1ob9RmQ_3KWP2-4Ptd9em3-hCfawXPf2VCMenSyOEf-12H2iaUgUYFs6HWURPg3ceABs15t9zinoSB2Zu1sIGpydD_xWR2CjN0bW8H0IYuCkg3cYwQoepDElknFLOZDTvGS7_ULcroz-dgw Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7f160af08e0c453ebcaba72e90fd959d Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7f160af08e0c453ebcaba72e90fd959d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7f160af08e0c453ebcaba72e90fd959d Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminTestJSON-293810312-project Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ffcedb7d0446478fb0290b06bc66ea0a Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminTestJSON-293810312-project Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 could not be found. Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '43008e9e-a99a-4c9e-8b02-cd63ed953c92'} Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 could not be found. Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 could not be found. Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:31.031118 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 could not be found. Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Returning 404 to user: Instance 43008e9e-a99a-4c9e-8b02-cd63ed953c92 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:31.038209 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c71e7aa-7507-40f4-9ddd-9506010a1886 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92" status: 404 len: 111 microversion: 2.1 time: 0.065167 Aug 04 04:36:31.041591 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1508/3019] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:30 2022] GET /compute/v2.1/servers/43008e9e-a99a-4c9e-8b02-cd63ed953c92 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:36:31.057817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:31.058705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:31.071100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.071909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.073213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.073981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.111476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:36:31.187789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:31.200633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:31.202149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:31.203424 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc8e6036-112b-4eb4-a7fa-f9cd434a83d9 tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b" status: 200 len: 1363 microversion: 2.47 time: 0.482610 Aug 04 04:36:31.203989 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1512/3020] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:30 2022] GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b => generated 1363 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:31.231353 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53423af4-b5ec-4f31-80fc-9916c4c3df28 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 204 len: 0 microversion: 2.1 time: 0.186801 Aug 04 04:36:31.232105 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1509/3021] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:36:31 2022] DELETE /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:36:31.232729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:31.233556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:31.242267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:31.244089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:31.250440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.251392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.252557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.253212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.254291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.254855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.256427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.262159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.589460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:31.596974 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c59b9c4-8625-4361-a859-72a16490ed6f tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1314 microversion: 2.1 time: 0.373163 Aug 04 04:36:31.607730 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1513/3022] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:31 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:31.677936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:31.687888 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85420f4d-bbeb-4ef1-a913-51b936a669f4 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1469 microversion: 2.1 time: 0.450996 Aug 04 04:36:31.690209 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1510/3023] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:31 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1469 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:31.720146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:31.721219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:31.733552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.734314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.735389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:31.736335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:31.946240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bf95e14-b155-4a18-9f08-25606ee377eb tempest-FloatingIPDetailsNegativeTestJSON-75694254 tempest-FloatingIPDetailsNegativeTestJSON-75694254-project] Calling method '.version_select at 0x7f192398d1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:32.089729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-9bf95e14-b155-4a18-9f08-25606ee377eb tempest-FloatingIPDetailsNegativeTestJSON-75694254 tempest-FloatingIPDetailsNegativeTestJSON-75694254-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e4685e69-c349-43e7-bf31-d8e1738d93f5 could not be found", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:36:32.090432 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-9bf95e14-b155-4a18-9f08-25606ee377eb tempest-FloatingIPDetailsNegativeTestJSON-75694254 tempest-FloatingIPDetailsNegativeTestJSON-75694254-project] HTTP exception thrown: Floating IP not found for ID e4685e69-c349-43e7-bf31-d8e1738d93f5 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bf95e14-b155-4a18-9f08-25606ee377eb tempest-FloatingIPDetailsNegativeTestJSON-75694254 tempest-FloatingIPDetailsNegativeTestJSON-75694254-project] Request method failure captured: Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-floating-ips/e4685e69-c349-43e7-bf31-d8e1738d93f5 HTTP/1.1 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60zP6kQSDwFiuw1jnQc4pmz_218_GrqEXHB-cdcA4hkBkKXceo0WhpFu5mHOmEqUlz1BTNqMhY1I7xr-SbfXUBYIYtIKaPPZn68jp0F8bUb5mdL63hmsGntXzQKASFQe1tDa8e20qxT1T8XewyssAL52NuwpwDMAq_1-LsKSsfv-XxY Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5e483ecd667449229204ec537cacf9ca Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-75694254 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5e483ecd667449229204ec537cacf9ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5e483ecd667449229204ec537cacf9ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5e483ecd667449229204ec537cacf9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5e483ecd667449229204ec537cacf9ca", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-75694254 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5e483ecd667449229204ec537cacf9ca Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-75694254 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-75694254-project Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f051581a916141b0861d4341e5ef62f7 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-75694254-project Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: exception: Floating IP not found for ID e4685e69-c349-43e7-bf31-d8e1738d93f5 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'e4685e69-c349-43e7-bf31-d8e1738d93f5'} Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e4685e69-c349-43e7-bf31-d8e1738d93f5 could not be found Aug 04 04:36:32.092397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e55ca902-50d2-4e6b-9e7a-9f5c44953f07'] Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e4685e69-c349-43e7-bf31-d8e1738d93f5. Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e4685e69-c349-43e7-bf31-d8e1738d93f5 Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e4685e69-c349-43e7-bf31-d8e1738d93f5 Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bf95e14-b155-4a18-9f08-25606ee377eb tempest-FloatingIPDetailsNegativeTestJSON-75694254 tempest-FloatingIPDetailsNegativeTestJSON-75694254-project] Returning 404 to user: Floating IP not found for ID e4685e69-c349-43e7-bf31-d8e1738d93f5 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9bf95e14-b155-4a18-9f08-25606ee377eb tempest-FloatingIPDetailsNegativeTestJSON-75694254 tempest-FloatingIPDetailsNegativeTestJSON-75694254-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/e4685e69-c349-43e7-bf31-d8e1738d93f5" status: 404 len: 111 microversion: 2.1 time: 0.342884 Aug 04 04:36:32.096125 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1511/3024] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:36:31 2022] GET /compute/v2.1/os-floating-ips/e4685e69-c349-43e7-bf31-d8e1738d93f5 => generated 111 bytes in 344 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:36:32.212784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:32.226413 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44f69a4e-c4a8-49b8-804c-2f1d93246c99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.513789 Aug 04 04:36:32.228552 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1514/3025] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:31 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:32.248520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:32.249640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:32.265715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:32.269322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:32.270484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:32.273640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:32.629521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:32.630450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:32.657243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:32.668940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:32.672701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:32.673425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:32.688459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:32.698872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:32.703184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc22e60d2f734b209ba479d4e4d9e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79771f9f8c241ca9539460249e813fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:32.706904 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d51b1a20-a0c6-49bb-b143-dd18eeaf124f tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b" status: 200 len: 1363 microversion: 2.47 time: 0.485056 Aug 04 04:36:32.720570 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1512/3026] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:32 2022] GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:32.742095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:32.760220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:32.761526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:32.772009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:32.773430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:32.774873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:32.775895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.226169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:33.267864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:33.460694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:33.488617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:33.497338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b9e15f7b-7382-478f-8147-9b32e9f3e485 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1469 microversion: 2.1 time: 0.771685 Aug 04 04:36:33.498578 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1513/3027] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:32 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1469 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:33.503212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:33.503907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:33.510395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.511588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.512479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.513030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.582108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:33.596941 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8e54ca46-a3d3-47cb-bab2-8f96b9a75063 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1314 microversion: 2.1 time: 0.971710 Aug 04 04:36:33.602703 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1515/3028] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:32 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:33.613010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-03288a01-f845-48da-8ded-3ae32444cb73 req-03e2e2cd-8585-48ad-ae41-cf0f345744a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841f8acc-ba11-47ac-9e9b-de6f5344733f", "tag": "5c156b28-63a1-4c6c-948c-0e830f1532b9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:33.627037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-03288a01-f845-48da-8ded-3ae32444cb73 req-03e2e2cd-8585-48ad-ae41-cf0f345744a5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.627622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-03288a01-f845-48da-8ded-3ae32444cb73 req-03e2e2cd-8585-48ad-ae41-cf0f345744a5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.645132 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-03288a01-f845-48da-8ded-3ae32444cb73 req-03e2e2cd-8585-48ad-ae41-cf0f345744a5 service nova] Creating event network-changed:5c156b28-63a1-4c6c-948c-0e830f1532b9 for instance 841f8acc-ba11-47ac-9e9b-de6f5344733f on n-h1-851337-5 Aug 04 04:36:33.655143 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-03288a01-f845-48da-8ded-3ae32444cb73 req-03e2e2cd-8585-48ad-ae41-cf0f345744a5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049918 Aug 04 04:36:33.656424 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1516/3029] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:33.663216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:33.664029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:33.672213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.672957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.673943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.674603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.688950 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] HTTP exception thrown: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Request method failure captured: Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f HTTP/1.1 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sYUpUN5T4TNpgbyrOpyYSqAb8N4gaEnAIOGXkCtX016jGpWp802uo440MWiVMWURlMkRIiY_2o32nWuaiw9iQIADJC5R57wuMJ4DNOQj15dTA1cEiTqRnZvIdtJgWzm8dBVMU1BMp5DGmQXctFE3tF3LvkgJWf0wxPPTVXZIxN1ro Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 1642d2eb789f4ec49d07523481fd11f4 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1642d2eb789f4ec49d07523481fd11f4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 1642d2eb789f4ec49d07523481fd11f4 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TaggedBootDevicesTest-1184535261-project Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 37dc980aa515445d9d71f4c20daecef9 Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TaggedBootDevicesTest-1184535261-project Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '8213be83-56ba-4a4c-9e70-a9b5116d6b5f'} Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:33.692131 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Returning 404 to user: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9192d20f-8f20-4c48-970d-762ce908f7b1 tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 404 len: 111 microversion: 2.32 time: 0.036521 Aug 04 04:36:33.697609 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1517/3030] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:36:33 2022] DELETE /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:36:33.705364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:33.705909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] [instance: 8213be83-56ba-4a4c-9e70-a9b5116d6b5f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:33.714005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.714459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.715339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.715827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.732700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] HTTP exception thrown: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Request method failure captured: Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f HTTP/1.1 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sYUpUN5T4TNpgbyrOpyYSqAb8N4gaEnAIOGXkCtX016jGpWp802uo440MWiVMWURlMkRIiY_2o32nWuaiw9iQIADJC5R57wuMJ4DNOQj15dTA1cEiTqRnZvIdtJgWzm8dBVMU1BMp5DGmQXctFE3tF3LvkgJWf0wxPPTVXZIxN1ro Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 1642d2eb789f4ec49d07523481fd11f4 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1642d2eb789f4ec49d07523481fd11f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1642d2eb789f4ec49d07523481fd11f4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 1642d2eb789f4ec49d07523481fd11f4 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1184535261 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TaggedBootDevicesTest-1184535261-project Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 37dc980aa515445d9d71f4c20daecef9 Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TaggedBootDevicesTest-1184535261-project Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '8213be83-56ba-4a4c-9e70-a9b5116d6b5f'} Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.734274 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. Aug 04 04:36:33.738986 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.741036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] Returning 404 to user: Instance 8213be83-56ba-4a4c-9e70-a9b5116d6b5f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:33.742291 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-75fa608b-ef70-4415-bbdc-c0b881d38e3e tempest-TaggedBootDevicesTest-1184535261 tempest-TaggedBootDevicesTest-1184535261-project] 10.222.0.69 "GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f" status: 404 len: 111 microversion: 2.32 time: 0.040906 Aug 04 04:36:33.742862 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1518/3031] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:33 2022] GET /compute/v2.1/servers/8213be83-56ba-4a4c-9e70-a9b5116d6b5f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:36:33.750424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:33.751262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] [instance: 2d132992-1d18-41e0-9a3e-5c577c3fea0b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:33.759989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.761168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.762862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:33.763914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:33.788320 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] HTTP exception thrown: Instance 2d132992-1d18-41e0-9a3e-5c577c3fea0b could not be found. Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Request method failure captured: Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b HTTP/1.1 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60yZVFh5UQP0KWsjjBBgvXCERFHyttYJQ51xaR55wT1HK6tlz_udACR4QR6LEyjEbSTl0M_VOcqNRzBZ1ad6iJPOFqxs-v4ggxOXuBqNIEMob_9ULfJDAIuiG886W4qWm1ihqPtichH0Gt61bbLkPJRacvW672hzDMF0jRUClIaitJY Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: e79771f9f8c241ca9539460249e813fb Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerShowV247Test-2022450346 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e79771f9f8c241ca9539460249e813fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e79771f9f8c241ca9539460249e813fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e79771f9f8c241ca9539460249e813fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e79771f9f8c241ca9539460249e813fb", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerShowV247Test-2022450346 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: e79771f9f8c241ca9539460249e813fb Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerShowV247Test-2022450346 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerShowV247Test-2022450346-project Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bc22e60d2f734b209ba479d4e4d9e293 Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerShowV247Test-2022450346-project Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 2d132992-1d18-41e0-9a3e-5c577c3fea0b could not be found. Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '2d132992-1d18-41e0-9a3e-5c577c3fea0b'} Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d132992-1d18-41e0-9a3e-5c577c3fea0b could not be found. Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d132992-1d18-41e0-9a3e-5c577c3fea0b could not be found. Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:33.790164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.794306 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:33.794306 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:33.794306 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:33.794306 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:33.794306 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:33.794306 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d132992-1d18-41e0-9a3e-5c577c3fea0b could not be found. Aug 04 04:36:33.794306 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:36:33.795434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] Returning 404 to user: Instance 2d132992-1d18-41e0-9a3e-5c577c3fea0b could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:33.796434 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b1a32da1-71b8-4c6c-854d-a2f76c1bb7af tempest-ServerShowV247Test-2022450346 tempest-ServerShowV247Test-2022450346-project] 10.222.0.69 "GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b" status: 404 len: 111 microversion: 2.47 time: 0.052316 Aug 04 04:36:33.802025 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1519/3032] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:33 2022] GET /compute/v2.1/servers/2d132992-1d18-41e0-9a3e-5c577c3fea0b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:36:34.032699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:34.059232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b93f6bfd-b5ef-4148-acc9-bb1de03cdce1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.559591 Aug 04 04:36:34.066913 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1514/3033] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:33 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:34.530450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:34.543248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:34.554707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:34.555562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:34.557495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:34.558531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:34.624862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:34.629995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:34.641756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:34.643359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:34.644511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:34.645260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:35.305274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:35.314608 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f5107ac-a4db-497c-b4f5-1bc66b5563eb tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1314 microversion: 2.1 time: 0.694233 Aug 04 04:36:35.315378 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1515/3034] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:34 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:35.326240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:35.326874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:35.355919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:35.357662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:35.359664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:35.361009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:35.369358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcedb7d0446478fb0290b06bc66ea0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f160af08e0c453ebcaba72e90fd959d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:35.382259 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2c10e48-5fb2-4934-9e3e-7037fe95f435 tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 200 len: 1469 microversion: 2.1 time: 0.867895 Aug 04 04:36:35.383012 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1520/3035] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:34 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 1469 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:35.695020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f9180997-b91f-40b3-9a7c-45667ba12dce req-a958aa00-3211-4be9-8256-5602f8c76011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5633ea-df6b-404c-90e8-611d4a40f753", "name": "network-vif-deleted", "tag": "a1864dde-7a45-41ae-93e7-81d73b54d4ad"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:35.726522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9180997-b91f-40b3-9a7c-45667ba12dce req-a958aa00-3211-4be9-8256-5602f8c76011 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:35.729832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9180997-b91f-40b3-9a7c-45667ba12dce req-a958aa00-3211-4be9-8256-5602f8c76011 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:35.746493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:35.756282 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-763725ef-5c6f-46c3-aca2-645e833a42d9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.439966 Aug 04 04:36:35.759191 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1516/3036] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:35 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:35.787687 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f9180997-b91f-40b3-9a7c-45667ba12dce req-a958aa00-3211-4be9-8256-5602f8c76011 service nova] Creating event network-vif-deleted:a1864dde-7a45-41ae-93e7-81d73b54d4ad for instance 3b5633ea-df6b-404c-90e8-611d4a40f753 on n-h2-851337-5 Aug 04 04:36:35.811265 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f9180997-b91f-40b3-9a7c-45667ba12dce req-a958aa00-3211-4be9-8256-5602f8c76011 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122451 Aug 04 04:36:35.813220 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1521/3037] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:36.244079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-773534156", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": "none"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:36.315207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:36:36.315911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:36:36.316489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:36:36.317039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:36:36.317569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:36:36.332720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.334868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:36.335884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.336329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:36.339217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:36.340542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:36.356416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.357135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:36.358139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.358903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Getting quotas for project 49978a37316d4e88a00e9c6f27306350. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:36:36.366629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Getting quotas for user 4a48cd27cd25470db8df61424b0ef476 and project 49978a37316d4e88a00e9c6f27306350. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:36:36.371756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:36.381383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:36:36.383983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:36:36.438443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2fe3701-6326-44bd-a2f0-3d94dce31cf3 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.339265 Aug 04 04:36:36.445611 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1517/3038] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 347 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:36:36.450755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:36.451561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] [instance: 3b5633ea-df6b-404c-90e8-611d4a40f753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:36.459401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.459854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:36.460505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.460938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:36.477388 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] HTTP exception thrown: Instance 3b5633ea-df6b-404c-90e8-611d4a40f753 could not be found. Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Request method failure captured: Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 HTTP/1.1 Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60w_M7M2vru-5-RvstgLBV5n9kEiBI4E1ob9RmQ_3KWP2-4Ptd9em3-hCfawXPf2VCMenSyOEf-12H2iaUgUYFs6HWURPg3ceABs15t9zinoSB2Zu1sIGpydD_xWR2CjN0bW8H0IYuCkg3cYwQoepDElknFLOZDTvGS7_ULcroz-dgw Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7f160af08e0c453ebcaba72e90fd959d Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7f160af08e0c453ebcaba72e90fd959d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7f160af08e0c453ebcaba72e90fd959d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7f160af08e0c453ebcaba72e90fd959d Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminTestJSON-293810312 Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminTestJSON-293810312-project Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ffcedb7d0446478fb0290b06bc66ea0a Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminTestJSON-293810312-project Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3b5633ea-df6b-404c-90e8-611d4a40f753 could not be found. Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3b5633ea-df6b-404c-90e8-611d4a40f753'} Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5633ea-df6b-404c-90e8-611d4a40f753 could not be found. Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5633ea-df6b-404c-90e8-611d4a40f753 could not be found. Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:36.478999 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5633ea-df6b-404c-90e8-611d4a40f753 could not be found. Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] Returning 404 to user: Instance 3b5633ea-df6b-404c-90e8-611d4a40f753 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-706310ac-4b3a-4adc-804a-12255860eb7f tempest-ServersAdminTestJSON-293810312 tempest-ServersAdminTestJSON-293810312-project] 10.222.0.69 "GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753" status: 404 len: 111 microversion: 2.1 time: 0.033751 Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1518/3039] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:36 2022] GET /compute/v2.1/servers/3b5633ea-df6b-404c-90e8-611d4a40f753 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9be7462-4819-45a4-bbe7-2123cbed6788 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:36.498102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f9be7462-4819-45a4-bbe7-2123cbed6788 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:36.606249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9be7462-4819-45a4-bbe7-2123cbed6788 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:36.618810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9be7462-4819-45a4-bbe7-2123cbed6788 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:36.622761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9be7462-4819-45a4-bbe7-2123cbed6788 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:36.625910 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f9be7462-4819-45a4-bbe7-2123cbed6788 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1277 microversion: 2.54 time: 0.143363 Aug 04 04:36:36.643629 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1519/3040] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:36 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:36.720394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:36.745462 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87cb68cf-d388-4a52-b993-595166851954 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1314 microversion: 2.1 time: 0.412280 Aug 04 04:36:36.746695 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1522/3041] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:36 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:36.791648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:36.792933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:36.808251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:36.814326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.816410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:36.818441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:36.818903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:37.070598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:37.090473 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cf177e7f-88b9-42bd-a1e9-6a8e6b798a41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.306770 Aug 04 04:36:37.093526 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1520/3042] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:36 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:37.660287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:37.664139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:37.694142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:37.700734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:37.705936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:37.707494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:37.770680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:37.772234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:37.788566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:37.790225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:37.791275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:37.792936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:37.832442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:38.008288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:38.028524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:38.030402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:38.032215 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-45138064-e47c-4efb-b67f-c62ecb7cf826 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1329 microversion: 2.54 time: 0.383995 Aug 04 04:36:38.033009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1523/3043] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:37 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1329 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:38.118338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:38.119147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:38.134919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:38.135417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:38.137001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:38.140099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:38.159362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:38.174233 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53438d67-10ec-4e20-a349-ea3923b8cf31 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1314 microversion: 2.1 time: 0.409675 Aug 04 04:36:38.177241 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1521/3044] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:37 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:38.498344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:38.509526 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-efe25fba-5375-4146-b6a1-65b3c6a79c9c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.396479 Aug 04 04:36:38.520910 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1524/3045] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:38 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:39.060440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:39.061740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:39.081316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:39.081945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:39.082894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:39.084384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:39.198980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:39.199892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:39.214025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:39.214561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:39.216354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:39.216945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:39.311568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:39.332354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:39.337861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:39.339877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2710567a-3275-427a-ab06-65b0b02b2d4d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1335 microversion: 2.54 time: 0.284014 Aug 04 04:36:39.351272 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1522/3046] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:39 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1335 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:39.533846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:39.534590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:39.543610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:39.553523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:39.554787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:39.556227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:39.618241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:39.627676 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a127357-a715-4c23-be79-34f419ff0084 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1314 microversion: 2.1 time: 0.432401 Aug 04 04:36:39.630524 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1525/3047] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:39 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:40.127768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:40.129566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:40.145025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.146544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.150770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.153416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.229679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:36:40.249388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:40.258989 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7b639957-9471-430a-a24f-9aed78c0fce5 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1680 microversion: 2.1 time: 0.728999 Aug 04 04:36:40.271645 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1523/3048] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:39 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1680 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:40.275975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ff479ec9-a24f-4a08-b055-47f4ebc5e716 req-2355aad1-5615-437a-8de4-82991123f451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841f8acc-ba11-47ac-9e9b-de6f5344733f", "name": "network-vif-plugged", "status": "completed", "tag": "5c156b28-63a1-4c6c-948c-0e830f1532b9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:40.320494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ff479ec9-a24f-4a08-b055-47f4ebc5e716 req-2355aad1-5615-437a-8de4-82991123f451 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.323230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ff479ec9-a24f-4a08-b055-47f4ebc5e716 req-2355aad1-5615-437a-8de4-82991123f451 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.341039 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ff479ec9-a24f-4a08-b055-47f4ebc5e716 req-2355aad1-5615-437a-8de4-82991123f451 service nova] Creating event network-vif-plugged:5c156b28-63a1-4c6c-948c-0e830f1532b9 for instance 841f8acc-ba11-47ac-9e9b-de6f5344733f on n-h1-851337-5 Aug 04 04:36:40.346483 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ff479ec9-a24f-4a08-b055-47f4ebc5e716 req-2355aad1-5615-437a-8de4-82991123f451 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077242 Aug 04 04:36:40.347779 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1524/3049] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:40.373514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:40.375508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:40.389608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.390074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.393365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.397787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.454858 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-268b61cb-86c0-4ef7-a17a-0720ecee75c4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 204 len: 0 microversion: 2.42 time: 0.711794 Aug 04 04:36:40.455728 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1526/3050] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:36:39 2022] DELETE /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:36:40.470112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:40.473150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:40.495072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.495553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.496339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.501707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.728919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:40.744605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:40.746745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:40.748810 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db79c1ac-d573-4a7b-8fc7-67d0f911ac9d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1335 microversion: 2.54 time: 0.386701 Aug 04 04:36:40.755366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1525/3051] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:40 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1335 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:36:40.769749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:40.770512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:40.781178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.783421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:40.785402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:40.787878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:41.078838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.094520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.098290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.103644 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c21971b-07ce-4548-a656-1acb9b78ca48 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2956 microversion: 2.42 time: 0.640018 Aug 04 04:36:41.105440 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1527/3052] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:40 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2956 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:41.125502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.136845 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7c95ea8-5585-4619-b8f0-9e58de688b60 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1314 microversion: 2.1 time: 0.380112 Aug 04 04:36:41.150786 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1526/3053] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:40 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:41.283553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:41.284167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:41.294411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:41.295138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:41.324065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:41.324726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:41.789859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:41.790503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:41.811640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:41.813082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:41.816280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:41.818326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:41.934016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.946898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.948590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.953023 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fdb105bb-dd2f-4515-bacb-bf2da3f8e780 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1356 microversion: 2.54 time: 0.180771 Aug 04 04:36:41.953828 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1527/3054] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:41 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:36:41.980981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e298f89a-4b92-4d54-a00a-c28abb783dc5 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Action: 'create', calling method: .version_select at 0x7f1923ace700>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-884567564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjGHfADR8SIla3DcoBTWgPqsiFOcTtSLkNaf0xYo4U7bRDJ6tdem/Vw5WLCzSXCHxn7qu5AVgoLEjLD42EFyaWZwgqJtwo1vg9VkgXdceJUJKnZwBALkZRmgTaiU/hsOQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:41.982870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:41.990899 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-68f1594c-a5c5-4e1b-a7ac-4411fe9fe50a tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1657 microversion: 2.1 time: 0.712119 Aug 04 04:36:41.991517 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1528/3055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:41 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1657 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:42.013895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7326fb69-af0e-4d17-ab12-12f62ef6334c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:42.016055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e298f89a-4b92-4d54-a00a-c28abb783dc5 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Getting quotas for project 49978a37316d4e88a00e9c6f27306350. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:36:42.024198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7326fb69-af0e-4d17-ab12-12f62ef6334c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.024656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7326fb69-af0e-4d17-ab12-12f62ef6334c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.025098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e298f89a-4b92-4d54-a00a-c28abb783dc5 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Getting quotas for user 4a48cd27cd25470db8df61424b0ef476 and project 49978a37316d4e88a00e9c6f27306350. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:36:42.062894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7326fb69-af0e-4d17-ab12-12f62ef6334c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Going to try to start instance {{(pid=119343) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 04:36:42.069265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e298f89a-4b92-4d54-a00a-c28abb783dc5 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.093084 Aug 04 04:36:42.069883 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1528/3056] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:36:41 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 04:36:42.081368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-884567564", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:42.084728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:42.092644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.093105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.093892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.094337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.129725 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7326fb69-af0e-4d17-ab12-12f62ef6334c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.120037 Aug 04 04:36:42.131768 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1529/3057] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:36:42 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:42.159189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:42.161057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:42.204431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.205386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.207698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.208963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.286755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:36:42.287441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:36:42.287962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:36:42.289163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:36:42.290475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:36:42.464560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:42.477691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.478328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.482821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.483467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.600664 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d29242d-43a9-4794-a1bc-687154983540 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "POST /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976/action" status: 202 len: 1138 microversion: 2.54 time: 0.521014 Aug 04 04:36:42.603455 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1529/3058] 10.222.0.69 () {62 vars in 1320 bytes} [Thu Aug 4 04:36:42 2022] POST /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976/action => generated 1138 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 04:36:42.615279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:42.615937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:42.635268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.636926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.640685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.642678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.859674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:42.876673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:42.878534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:42.896912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-715521de-582a-40ca-adb5-7de17bc663c8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2956 microversion: 2.42 time: 0.751312 Aug 04 04:36:42.904202 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1530/3059] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:42 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2956 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:42.914317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:42.924578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:42.943228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.943698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:42.957380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:42.958124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:43.128822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:43.143073 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-820f15c4-6c4d-400a-8601-c1bdf936cfef tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1666 microversion: 2.1 time: 0.538240 Aug 04 04:36:43.148992 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1530/3060] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:42 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1666 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:43.169553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:43.173149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:43.191262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:43.194080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:43.198548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:43.199299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:43.341470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:43.351909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:43.354049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:43.358341 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f449e4f0-336f-4645-b196-e60edcc8db13 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.207856 Aug 04 04:36:43.371856 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1531/3061] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:43 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:43.435303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:43.446264 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3eb0fdde-b676-4ab4-8319-ca132fcdc3b5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1464 microversion: 2.1 time: 0.536851 Aug 04 04:36:43.449159 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1531/3062] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:42 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1464 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:43.808930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbaa08a3-20ea-4162-ab78-a6b118dcbc3a tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Calling method '.version_select at 0x7f19239b71f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:43.826467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbaa08a3-20ea-4162-ab78-a6b118dcbc3a tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:43.837588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbaa08a3-20ea-4162-ab78-a6b118dcbc3a tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:43.902213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbaa08a3-20ea-4162-ab78-a6b118dcbc3a tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:43.903099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbaa08a3-20ea-4162-ab78-a6b118dcbc3a tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:43.926623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:43.929104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:43.939993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:43.940765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:43.942078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:43.943257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:43.968606 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbaa08a3-20ea-4162-ab78-a6b118dcbc3a tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/50b635f2d2104d48896456adb0df340d?start=2022-08-03T04%3A36%3A43.461901&end=2022-08-05T04%3A36%3A43.461901" status: 200 len: 695 microversion: 2.1 time: 0.497591 Aug 04 04:36:43.973816 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1532/3063] 10.222.0.69 () {58 vars in 1412 bytes} [Thu Aug 4 04:36:43 2022] GET /compute/v2.1/os-simple-tenant-usage/50b635f2d2104d48896456adb0df340d?start=2022-08-03T04%3A36%3A43.461901&end=2022-08-05T04%3A36%3A43.461901 => generated 695 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:43.988857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-742dbf38-dd38-421b-b778-206bc2fd2231 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '.version_select at 0x7f1919f0fd30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:44.014181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-742dbf38-dd38-421b-b778-206bc2fd2231 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.014638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-742dbf38-dd38-421b-b778-206bc2fd2231 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.046346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-742dbf38-dd38-421b-b778-206bc2fd2231 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.047024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-742dbf38-dd38-421b-b778-206bc2fd2231 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.076315 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-742dbf38-dd38-421b-b778-206bc2fd2231 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/50b635f2d2104d48896456adb0df340d?start=2022-08-03T04%3A36%3A43.461901&end=2022-08-05T04%3A36%3A43.461901" status: 200 len: 695 microversion: 2.1 time: 0.087024 Aug 04 04:36:44.077330 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1533/3064] 10.222.0.69 () {58 vars in 1412 bytes} [Thu Aug 4 04:36:43 2022] GET /compute/v2.1/os-simple-tenant-usage/50b635f2d2104d48896456adb0df340d?start=2022-08-03T04%3A36%3A43.461901&end=2022-08-05T04%3A36%3A43.461901 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:36:44.109266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-279541d9-5d0e-4766-8e79-8edba45e2eba tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Calling method '.version_select at 0x7f191a3ab820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:44.123595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-279541d9-5d0e-4766-8e79-8edba45e2eba tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.124349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-279541d9-5d0e-4766-8e79-8edba45e2eba tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.147848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-279541d9-5d0e-4766-8e79-8edba45e2eba tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.148989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-279541d9-5d0e-4766-8e79-8edba45e2eba tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.353936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-279541d9-5d0e-4766-8e79-8edba45e2eba tempest-TenantUsagesTestJSON-1364199992 tempest-TenantUsagesTestJSON-1364199992-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T04%3A36%3A43.461901&end=2022-08-05T04%3A36%3A43.461901&detailed=1" status: 200 len: 37287 microversion: 2.1 time: 0.265698 Aug 04 04:36:44.360247 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1534/3065] 10.222.0.69 () {58 vars in 1335 bytes} [Thu Aug 4 04:36:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T04%3A36%3A43.461901&end=2022-08-05T04%3A36%3A43.461901&detailed=1 => generated 37287 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:36:44.390940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:44.403568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:44.412995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.413449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.414256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.414764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.849873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:44.854639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:44.867901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:44.870983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:44.878998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d55cc9e8-87a3-4d71-85e5-13e7394904db tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2956 microversion: 2.42 time: 0.956801 Aug 04 04:36:44.880524 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1532/3066] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:43 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2956 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:36:44.897820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:44.898805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:44.905926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.906720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.907860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:44.908574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:44.993436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:45.008735 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-585e5bb5-9abe-401a-a935-9a1e6c29afd1 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1666 microversion: 2.1 time: 0.630887 Aug 04 04:36:45.009654 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1535/3067] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:44 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1666 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:45.030537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:45.031124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:45.037546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:45.037996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:45.038774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:45.039251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:45.080782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:36:45.139444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:45.151433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:45.156264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:45.161699 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-21a74f19-ed0d-47ae-992c-aa02d550b9ae tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.279794 Aug 04 04:36:45.164800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1533/3068] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:44 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:45.223918 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5188519a-277f-4a91-9b72-f1ca3427b249 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "DELETE /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 204 len: 0 microversion: 2.1 time: 0.196812 Aug 04 04:36:45.227268 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1536/3069] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:36:45 2022] DELETE /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:36:45.236979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:45.238136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:45.253304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:45.257874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:45.258929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:45.261443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:45.646672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:45.655681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e7e11dea-f666-443d-ba10-f92ec17174e5 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1470 microversion: 2.1 time: 0.424020 Aug 04 04:36:45.659274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1534/3070] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:45 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:45.912358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:45.913783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:45.921950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:45.922979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:45.923990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:45.924639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.032111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:46.033010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:46.042520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.045456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.046519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.049329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.418664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:46.432087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:46.445387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:46.450707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:46.454505 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd1af50b-52ba-4a4e-95cb-10fc2b3efc51 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2935 microversion: 2.42 time: 0.548667 Aug 04 04:36:46.455448 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1537/3071] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:45 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2935 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:46.472011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:46.473034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:46.500154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.501604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.504598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.506584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.547372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:46.560607 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bbc3b1b5-8baa-4933-9700-e86672753298 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.528781 Aug 04 04:36:46.563750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1535/3072] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:46 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:46.588151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:46.589192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:46.595819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.596498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.597448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.598050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.743687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:46.756814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:46.759611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:46.761293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-935c7745-80b7-4aa5-81e4-ab57a64206d1 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.302256 Aug 04 04:36:46.778209 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1538/3073] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:46 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:46.783472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:46.784109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:46.791915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.792377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:46.793153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:46.793595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:47.372697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:47.389301 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcb625e9-15de-4db7-8d6c-e807f3f40388 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.805869 Aug 04 04:36:47.390934 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1536/3074] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:46 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:47.419847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:47.420927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:47.474471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:47.478147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:47.480774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:47.482304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:47.633323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:47.646004 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34dde8e9-8f1b-4b94-b523-ee6ed66aeb10 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1470 microversion: 2.1 time: 0.862530 Aug 04 04:36:47.647234 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1539/3075] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:46 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1470 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:47.661085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:47.661857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:47.676330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:47.679574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:47.680467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:47.682133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.221567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:48.236009 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c92ddff0-b91b-4b1a-a9cc-825df5fda53e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.818081 Aug 04 04:36:48.236742 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1537/3076] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:47 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:48.246329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:48.250185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:48.264225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.266732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.274290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.275061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.541273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:48.560902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:48.565658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:48.570714 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9c1fd4c1-35d8-4ad6-a76a-67f05d73f10a tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2914 microversion: 2.42 time: 0.917706 Aug 04 04:36:48.573703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:48.593051 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1540/3077] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:47 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2914 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:48.595418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:48.604117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-dfe2fbe2-889e-47ed-a01e-806ec5d2f2de req-b50113bb-9fee-4abc-8211-b80c54ff6883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-unplugged", "status": "completed", "tag": "e394ea21-6aa5-4297-9493-7b1d332e8b50"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:48.605312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:48.607970 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dbf128d5-0f36-4fb3-a434-bc63cd4ecfff tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.370202 Aug 04 04:36:48.619033 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1538/3078] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:48 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:48.627229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:48.627561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dfe2fbe2-889e-47ed-a01e-806ec5d2f2de req-b50113bb-9fee-4abc-8211-b80c54ff6883 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.628169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dfe2fbe2-889e-47ed-a01e-806ec5d2f2de req-b50113bb-9fee-4abc-8211-b80c54ff6883 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.632593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:48.653750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.654226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.654561 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dfe2fbe2-889e-47ed-a01e-806ec5d2f2de req-b50113bb-9fee-4abc-8211-b80c54ff6883 service nova] Creating event network-vif-unplugged:e394ea21-6aa5-4297-9493-7b1d332e8b50 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:48.655118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.655513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.668998 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-dfe2fbe2-889e-47ed-a01e-806ec5d2f2de req-b50113bb-9fee-4abc-8211-b80c54ff6883 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074473 Aug 04 04:36:48.669767 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1541/3079] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:48.678633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-394b4a42-c146-4130-bcf0-b6a11a481302 req-7ca263b5-cc63-419c-91fd-8fffc82ed46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-deleted", "tag": "e394ea21-6aa5-4297-9493-7b1d332e8b50"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:48.714527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-394b4a42-c146-4130-bcf0-b6a11a481302 req-7ca263b5-cc63-419c-91fd-8fffc82ed46c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.714994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-394b4a42-c146-4130-bcf0-b6a11a481302 req-7ca263b5-cc63-419c-91fd-8fffc82ed46c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.753031 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-394b4a42-c146-4130-bcf0-b6a11a481302 req-7ca263b5-cc63-419c-91fd-8fffc82ed46c service nova] Creating event network-vif-deleted:e394ea21-6aa5-4297-9493-7b1d332e8b50 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:48.771321 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-394b4a42-c146-4130-bcf0-b6a11a481302 req-7ca263b5-cc63-419c-91fd-8fffc82ed46c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096339 Aug 04 04:36:48.777428 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1542/3080] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:48.788236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:48.794451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:48.818528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.819770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:48.823640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:48.826631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:49.531964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:49.544123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b90ba69c-5c2a-48bc-8784-4bde40cfadbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.929813 Aug 04 04:36:49.544827 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1539/3081] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:48 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:49.581151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:49.583248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:49.600296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:49.604197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:49.606721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:49.609887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.001499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.011921 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f1225a60-e0aa-453d-89f9-b9717c3f88b7 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1470 microversion: 2.1 time: 1.232934 Aug 04 04:36:50.012512 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1543/3082] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:48 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1470 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:50.028381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:50.031030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:50.050343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.051562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.052193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.052724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.557436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.565468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.570337 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41c69586-ae7f-4928-9699-44daadb46c41 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 1.003539 Aug 04 04:36:50.571903 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1540/3083] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:49 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:50.582445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.585664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.591291 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb89b528-8021-46ab-b617-1efb006efbf2 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2754 microversion: 2.42 time: 0.568128 Aug 04 04:36:50.591812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:50.591924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1544/3084] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:50 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2754 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:50.593995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:50.609414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:50.610141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:50.618346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.627657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.629461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.633440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.637074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.637951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.644521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.645226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.725919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lazy-loading 'flavor' on Instance uuid 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:36:50.837577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.856942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.860050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:50.861752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-088c0982-00d4-45fb-ab63-3fd963916538 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.283825 Aug 04 04:36:50.862329 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1541/3085] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:50 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:50.869090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5aed432d-b581-4a23-9bdd-0b6668f35615 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.275086 Aug 04 04:36:50.874018 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1545/3086] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:36:50 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:50.884438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a798126d-29ad-4d28-9bde-e37e146c1c98 req-f0f55471-e922-4005-a2ee-2586f30c3b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841f8acc-ba11-47ac-9e9b-de6f5344733f", "name": "network-vif-deleted", "tag": "5c156b28-63a1-4c6c-948c-0e830f1532b9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:50.906548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-28ce1da6-8a97-4e8c-af0f-0eb9599a628a req-d77d9314-8b81-457a-b24a-4061646ebe37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-unplugged", "status": "completed", "tag": "43500245-7cb8-47d9-b8ab-7204efa8bd6d"}, {"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-unplugged", "status": "completed", "tag": "f55f1dcc-d5c6-4541-a7e6-6317c075bfed"}, {"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-unplugged", "status": "completed", "tag": "9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:50.913345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a798126d-29ad-4d28-9bde-e37e146c1c98 req-f0f55471-e922-4005-a2ee-2586f30c3b9e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.915939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a798126d-29ad-4d28-9bde-e37e146c1c98 req-f0f55471-e922-4005-a2ee-2586f30c3b9e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.938373 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a798126d-29ad-4d28-9bde-e37e146c1c98 req-f0f55471-e922-4005-a2ee-2586f30c3b9e service nova] Creating event network-vif-deleted:5c156b28-63a1-4c6c-948c-0e830f1532b9 for instance 841f8acc-ba11-47ac-9e9b-de6f5344733f on n-h1-851337-5 Aug 04 04:36:50.949153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-28ce1da6-8a97-4e8c-af0f-0eb9599a628a req-d77d9314-8b81-457a-b24a-4061646ebe37 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.949315 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a798126d-29ad-4d28-9bde-e37e146c1c98 req-f0f55471-e922-4005-a2ee-2586f30c3b9e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073831 Aug 04 04:36:50.949754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-28ce1da6-8a97-4e8c-af0f-0eb9599a628a req-d77d9314-8b81-457a-b24a-4061646ebe37 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.953244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1546/3087] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:50.966638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:50.967465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:50.971209 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-28ce1da6-8a97-4e8c-af0f-0eb9599a628a req-d77d9314-8b81-457a-b24a-4061646ebe37 service nova] Creating event network-vif-unplugged:43500245-7cb8-47d9-b8ab-7204efa8bd6d for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:50.971739 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-28ce1da6-8a97-4e8c-af0f-0eb9599a628a req-d77d9314-8b81-457a-b24a-4061646ebe37 service nova] Creating event network-vif-unplugged:f55f1dcc-d5c6-4541-a7e6-6317c075bfed for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:50.972258 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-28ce1da6-8a97-4e8c-af0f-0eb9599a628a req-d77d9314-8b81-457a-b24a-4061646ebe37 service nova] Creating event network-vif-unplugged:9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:50.979993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.980457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:50.981608 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-28ce1da6-8a97-4e8c-af0f-0eb9599a628a req-d77d9314-8b81-457a-b24a-4061646ebe37 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.101377 Aug 04 04:36:50.982481 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1542/3088] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:50.984217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:50.984684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.033728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:51.035109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:51.044567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.045322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.046518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.047332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.089148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.089975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.090657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lazy-loading 'fault' on Instance uuid 841f8acc-ba11-47ac-9e9b-de6f5344733f {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:36:51.178238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fb22c8186f34163be0fa111f39f29e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b635f2d2104d48896456adb0df340d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:51.187410 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da5fc9b9-a098-449d-803d-bb9cd316433b tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 200 len: 1304 microversion: 2.1 time: 0.158144 Aug 04 04:36:51.202751 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1543/3089] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:51 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:51.434795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:51.446487 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-56c3f058-2e73-4422-9bcd-a637e6d81fbf tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1678 microversion: 2.1 time: 0.491821 Aug 04 04:36:51.451597 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1547/3090] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:50 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1678 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:51.626088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:51.627414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:51.636469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.637198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.638169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.638987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.885987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:51.888666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:51.905957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.908108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.910474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.911947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:52.036751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:52.067886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:52.087198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:52.089889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:52.091479 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2407f032-12f4-4bca-9ee0-0c3764278de4 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.210020 Aug 04 04:36:52.093018 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1548/3091] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:51 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:52.207755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:52.209649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:52.210013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] [instance: 841f8acc-ba11-47ac-9e9b-de6f5344733f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:52.219589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:52.222744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:52.223895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:52.224706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:52.226625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:52.229324 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-96c8051e-43c4-40fd-9a1c-31089bae52a9 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2708 microversion: 2.42 time: 0.607232 Aug 04 04:36:52.231249 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1544/3092] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:51 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2708 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:52.231976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:52.264399 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] HTTP exception thrown: Instance 841f8acc-ba11-47ac-9e9b-de6f5344733f could not be found. Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Request method failure captured: Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f HTTP/1.1 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60zDthJTq31TViviJcqgjzUE5eAPiG8k69XcogiA0gYjiMA3ksMeE0YeBNYjtrAiQgqiGdDi__awOIo2bKz5eeT-oEZGV_fSJW0KERUknVYec4ktE03pgTvbUUD3Kd79KO5l3YjsxdP25O0FE-Np6yKHOTeJGEWFTiCAewo1V4Y2Cto Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 50b635f2d2104d48896456adb0df340d Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TenantUsagesTestJSON-1779947887 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/50b635f2d2104d48896456adb0df340d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/50b635f2d2104d48896456adb0df340d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/50b635f2d2104d48896456adb0df340d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_50b635f2d2104d48896456adb0df340d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TenantUsagesTestJSON-1779947887 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 50b635f2d2104d48896456adb0df340d Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1779947887 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TenantUsagesTestJSON-1779947887-project Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5fb22c8186f34163be0fa111f39f29e8 Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TenantUsagesTestJSON-1779947887-project Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 841f8acc-ba11-47ac-9e9b-de6f5344733f could not be found. Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '841f8acc-ba11-47ac-9e9b-de6f5344733f'} Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841f8acc-ba11-47ac-9e9b-de6f5344733f could not be found. Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841f8acc-ba11-47ac-9e9b-de6f5344733f could not be found. Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:36:52.266382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841f8acc-ba11-47ac-9e9b-de6f5344733f could not be found. Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] Returning 404 to user: Instance 841f8acc-ba11-47ac-9e9b-de6f5344733f could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:36:52.270880 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5dd97790-a8d7-43ff-bde5-589d4f726e92 tempest-TenantUsagesTestJSON-1779947887 tempest-TenantUsagesTestJSON-1779947887-project] 10.222.0.69 "GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f" status: 404 len: 111 microversion: 2.1 time: 0.063019 Aug 04 04:36:52.271870 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1549/3093] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:52 2022] GET /compute/v2.1/servers/841f8acc-ba11-47ac-9e9b-de6f5344733f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:36:52.473112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:52.473805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:52.480341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:52.481236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:52.482202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:52.482809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:52.956711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:52.980178 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e7db1179-5d61-4919-9209-a5f50c35a46c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1661 microversion: 2.1 time: 0.510713 Aug 04 04:36:52.982799 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1545/3094] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:52 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1661 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:53.006315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9390c389-de31-4a2b-8572-61a5a3ead740 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:53.007863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9390c389-de31-4a2b-8572-61a5a3ead740 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:53.011754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8d5fedb1-b7de-4d0c-b54a-64c2c1b67252 req-9a4e3b56-df10-4686-9fb7-ead45e74b4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-unplugged", "status": "completed", "tag": "6207fab3-7934-47a2-9393-61682681be83"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:53.017031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9390c389-de31-4a2b-8572-61a5a3ead740 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.017428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9390c389-de31-4a2b-8572-61a5a3ead740 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.018223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9390c389-de31-4a2b-8572-61a5a3ead740 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.018668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9390c389-de31-4a2b-8572-61a5a3ead740 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.027511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:53.033755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8d5fedb1-b7de-4d0c-b54a-64c2c1b67252 req-9a4e3b56-df10-4686-9fb7-ead45e74b4b4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.034640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8d5fedb1-b7de-4d0c-b54a-64c2c1b67252 req-9a4e3b56-df10-4686-9fb7-ead45e74b4b4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.062278 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8d5fedb1-b7de-4d0c-b54a-64c2c1b67252 req-9a4e3b56-df10-4686-9fb7-ead45e74b4b4 service nova] Creating event network-vif-unplugged:6207fab3-7934-47a2-9393-61682681be83 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:53.081179 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8d5fedb1-b7de-4d0c-b54a-64c2c1b67252 req-9a4e3b56-df10-4686-9fb7-ead45e74b4b4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072715 Aug 04 04:36:53.082328 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1546/3095] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:36:53.107720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-483faa1f-f6ea-410c-a3be-6a86339185a5 req-25e50d01-0fe7-4536-a06a-f8fe4b5dfd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-deleted", "tag": "43500245-7cb8-47d9-b8ab-7204efa8bd6d"}, {"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-deleted", "tag": "f55f1dcc-d5c6-4541-a7e6-6317c075bfed"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:53.121385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-483faa1f-f6ea-410c-a3be-6a86339185a5 req-25e50d01-0fe7-4536-a06a-f8fe4b5dfd83 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.135978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-483faa1f-f6ea-410c-a3be-6a86339185a5 req-25e50d01-0fe7-4536-a06a-f8fe4b5dfd83 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.164652 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-483faa1f-f6ea-410c-a3be-6a86339185a5 req-25e50d01-0fe7-4536-a06a-f8fe4b5dfd83 service nova] Creating event network-vif-deleted:43500245-7cb8-47d9-b8ab-7204efa8bd6d for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:53.165396 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-483faa1f-f6ea-410c-a3be-6a86339185a5 req-25e50d01-0fe7-4536-a06a-f8fe4b5dfd83 service nova] Creating event network-vif-deleted:f55f1dcc-d5c6-4541-a7e6-6317c075bfed for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:53.176520 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-483faa1f-f6ea-410c-a3be-6a86339185a5 req-25e50d01-0fe7-4536-a06a-f8fe4b5dfd83 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072564 Aug 04 04:36:53.187135 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1547/3096] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:36:53.193546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:53.194521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:53.206454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.210940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.211905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.212693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.215915 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9390c389-de31-4a2b-8572-61a5a3ead740 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action" status: 202 len: 0 microversion: 2.1 time: 0.216571 Aug 04 04:36:53.217607 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1550/3097] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:36:52 2022] POST /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:36:53.244467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:53.248519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:53.261561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.263056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.266224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.267128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.459658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:53.469503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:53.481699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:53.482994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c34e2939-f042-4d3e-b988-292ca34805c9 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.294295 Aug 04 04:36:53.483591 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1548/3098] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:53 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:53.506452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:53.507405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:53.514767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.515595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:53.516391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:53.521302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:54.141964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:55.169378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:55.178839 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6128613f-168d-4e92-97e3-8b615561e614 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1667 microversion: 2.1 time: 1.946207 Aug 04 04:36:55.179451 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1551/3099] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:53 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1667 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:55.201344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:55.203803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:55.221337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:55.221796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:55.222576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:55.223035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:55.456766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:55.473024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:55.474765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:55.476138 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-be84af23-b9d9-446a-8088-6a2bab513b0a tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.289895 Aug 04 04:36:55.483550 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1552/3100] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:55 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:55.491228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:55.508977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:55.511863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:55.515089 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb475cd6-c77a-4dcc-afea-5b1577bd2eab tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2390 microversion: 2.42 time: 2.013681 Aug 04 04:36:55.515908 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1549/3101] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:53 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2390 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:55.888301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-240df501-f00b-4de2-90b1-019949c2e448 req-b822a7bf-3246-4c46-91d1-66c1a14888e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-deleted", "tag": "9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:55.943252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-240df501-f00b-4de2-90b1-019949c2e448 req-b822a7bf-3246-4c46-91d1-66c1a14888e6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:55.944243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-240df501-f00b-4de2-90b1-019949c2e448 req-b822a7bf-3246-4c46-91d1-66c1a14888e6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:55.944437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1680222216", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:55.969771 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-240df501-f00b-4de2-90b1-019949c2e448 req-b822a7bf-3246-4c46-91d1-66c1a14888e6 service nova] Creating event network-vif-deleted:9b17ce8d-dc80-4ef9-95dd-d85e78b3bac0 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:36:55.992053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-240df501-f00b-4de2-90b1-019949c2e448 req-b822a7bf-3246-4c46-91d1-66c1a14888e6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108030 Aug 04 04:36:55.993511 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1550/3102] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:56.124629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] validate_networks() for [('8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:36:56.206367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:56.207344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:56.219695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:56.220729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:56.222311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:56.223152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:57.246364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:57.249970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:57.263163 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-351cfbc9-7f71-4c25-8736-18319cff82da tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1667 microversion: 2.1 time: 1.061867 Aug 04 04:36:57.264155 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1551/3103] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:56 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1667 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:36:57.269772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:57.270891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:57.284724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:57.285401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:57.286387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:57.287025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:57.471200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:57.484338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:57.491045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:57.492833 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8bb2636-e192-4717-a509-e6908da66074 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.227418 Aug 04 04:36:57.494516 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1552/3104] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:57 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:57.505629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:57.506183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:57.524468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:57.524923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:57.525730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:57.526174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:57.854363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:36:57.854907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:36:57.855300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:36:57.860993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:36:57.861894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:36:57.880259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:57.880910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:57.881889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:57.882710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:57.904706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Getting quotas for project 3b79d1753e8c422fbe63de69fc20cdbf. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:36:57.911699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Getting quotas for user ba1f58af29924fddadf25abcc5255606 and project 3b79d1753e8c422fbe63de69fc20cdbf. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:36:57.932122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:36:57.934780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:36:57.951957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:57.999114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f3832a3a-2996-49ee-8a77-45442147a164 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514105 Aug 04 04:36:58.000045 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1553/3105] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:36:58.088300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.105249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.111494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.114505 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ddbfff5b-d946-4671-a6a0-4d13c545afb0 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2230 microversion: 2.42 time: 0.617013 Aug 04 04:36:58.131982 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1553/3106] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:57 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2230 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:36:58.138464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92278b73-9961-404e-a6b3-eb9432c1669c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:58.139906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-92278b73-9961-404e-a6b3-eb9432c1669c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:58.198610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b444f7d1-790c-4b9a-8ad2-1b407f22431a tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:58.214277 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b444f7d1-790c-4b9a-8ad2-1b407f22431a tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.212421 Aug 04 04:36:58.215186 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1554/3107] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:36:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:58.286541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:58.287956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:58.309149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:58.309598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:58.310540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:58.311176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:58.435866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92278b73-9961-404e-a6b3-eb9432c1669c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.444800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92278b73-9961-404e-a6b3-eb9432c1669c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1224 microversion: 2.1 time: 0.311350 Aug 04 04:36:58.445642 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1554/3108] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:58 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1224 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:58.518057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:58.519289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:58.536611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:58.537165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:58.538993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:58.541822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:58.737332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.760420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.766173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.768130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c3a689d-8448-420c-b980-d19689550953 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.255732 Aug 04 04:36:58.772462 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1555/3109] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:58 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:36:58.847928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:58.862054 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7adbc9d2-4ab8-4c2e-82f2-4b99c7359fc7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1667 microversion: 2.1 time: 0.579734 Aug 04 04:36:58.865117 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1555/3110] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:58 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1667 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:59.128982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8281bf2-20db-4973-af6f-28fdc13d8c61 tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1422425444", "imageRef": "30d876ab-6180-4cc8-b7a9-df5239d1ee5d", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:36:59.144882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:59.146059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:59.166720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:59.167207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:59.172852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:59.173317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:59.281023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-e8281bf2-20db-4973-af6f-28fdc13d8c61 tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:36:59.286350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:59.671307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:59.681695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:59.683483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:59.684718 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45878c8c-ecff-4c60-940c-93b5bec29ea6 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 2163 microversion: 2.42 time: 0.543795 Aug 04 04:36:59.699717 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1556/3111] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:36:59 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 2163 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:36:59.711171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:59.711808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:36:59.719765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:59.721509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:59.722489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:59.723130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:59.983719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:36:59.994018 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a42c19af-b4f0-4026-b6d0-07668205e990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1276 microversion: 2.1 time: 0.292971 Aug 04 04:36:59.999362 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1557/3112] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:36:59 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1276 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:00.020079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:00.020983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:00.032975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:00.035668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:00.037216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:00.039556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:00.255852 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e8281bf2-20db-4973-af6f-28fdc13d8c61 tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8281bf2-20db-4973-af6f-28fdc13d8c61 tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] Request method failure captured: Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 143 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60zoK7XXgOlEAh3KBOT4IZDiCXDDu5I7N8siPu9TL4nDbGqBA1Mol-kLaKlL8y9KhRWRUAuGCKIShBxyhgJ41Kt4DW5YC2urU_RfFTDuk1bpuigMLiVBL1OtrpT32qsFtG3rZoEbFwPtTs4yIykGOXSU9WkVqtW4OI1MDYZ5h0ZDkeM Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 44bb399188754423a087cf9ca1f4252a Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FlavorsV2NegativeTest-1431054057 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/44bb399188754423a087cf9ca1f4252a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/44bb399188754423a087cf9ca1f4252a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/44bb399188754423a087cf9ca1f4252a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_44bb399188754423a087cf9ca1f4252a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FlavorsV2NegativeTest-1431054057 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 44bb399188754423a087cf9ca1f4252a Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1431054057 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FlavorsV2NegativeTest-1431054057-project Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 489ff7b5187d4f988c322f4edcea9e53 Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FlavorsV2NegativeTest-1431054057-project Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1422425444", "imageRef": "30d876ab-6180-4cc8-b7a9-df5239d1ee5d", "flavorRef": "452"}} Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: exception: Flavor's memory is too small for requested image. Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1422425444', 'imageRef': '30d876ab-6180-4cc8-b7a9-df5239d1ee5d', 'flavorRef': '452'}}} Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:37:00.257846 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8281bf2-20db-4973-af6f-28fdc13d8c61 tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:00.262740 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8281bf2-20db-4973-af6f-28fdc13d8c61 tempest-FlavorsV2NegativeTest-1431054057 tempest-FlavorsV2NegativeTest-1431054057-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.141818 Aug 04 04:37:00.264897 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1556/3113] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:36:59 2022] POST /compute/v2.1/servers => generated 93 bytes in 1144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:37:00.272926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:00.273558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:00.324503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:00.325014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:00.330615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:00.331130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:00.421937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:00.431075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:00.432616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:00.433800 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd0060bb-4a6c-488a-b40c-8b49853c4e71 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.429424 Aug 04 04:37:00.450820 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1558/3114] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:00 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:00.463328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-78dccaf0-01dd-4174-918d-f5485c78ae58 req-d4be51ca-95f6-4c50-bc51-665948d30322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba46ac9-dd58-4f8e-990f-e3f3c8325b73", "name": "network-vif-deleted", "tag": "6207fab3-7934-47a2-9393-61682681be83"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:00.489223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-78dccaf0-01dd-4174-918d-f5485c78ae58 req-d4be51ca-95f6-4c50-bc51-665948d30322 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:00.490026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-78dccaf0-01dd-4174-918d-f5485c78ae58 req-d4be51ca-95f6-4c50-bc51-665948d30322 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:00.513087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-78dccaf0-01dd-4174-918d-f5485c78ae58 req-d4be51ca-95f6-4c50-bc51-665948d30322 service nova] Creating event network-vif-deleted:6207fab3-7934-47a2-9393-61682681be83 for instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 on n-h2-851337-5 Aug 04 04:37:00.531255 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-78dccaf0-01dd-4174-918d-f5485c78ae58 req-d4be51ca-95f6-4c50-bc51-665948d30322 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078944 Aug 04 04:37:00.537417 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1559/3115] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:00.718455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:00.719485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:00.735439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:00.739811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:00.741644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:00.742340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:01.251830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:01.272364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:01.279997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:01.281532 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9709f9db-e876-4b55-b646-1d5ff4cc7adf tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.568966 Aug 04 04:37:01.282332 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1560/3116] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:00 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:01.293906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:01.294816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:01.311256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:01.320235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:01.331973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:01.331973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:01.340848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:01.362584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a624d959-8bf5-4e08-9f4c-03e0f9b2518c tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 1.094228 Aug 04 04:37:01.364051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1557/3117] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:00 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:01.398654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:01.404374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:01.440917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:01.442654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:01.448357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:01.449023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:01.621945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:01.645936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-da4ab0a4-0109-446c-93d1-48ba937d1d61 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1282 microversion: 2.1 time: 0.361719 Aug 04 04:37:01.670730 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1561/3118] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:01 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1282 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:01.941754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:01.954053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffeae42e-5564-43cc-b48e-cd3fda0029ba tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1670 microversion: 2.1 time: 0.573052 Aug 04 04:37:01.964603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1558/3119] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:01 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1670 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:01.995846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:01.998088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1196318130", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:02.001167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:02.013203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:02.013667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:02.014465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:02.015125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:02.098157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] validate_networks() for [('c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:37:02.242781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:02.263582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:02.265684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:02.267169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36357ef1-f2fc-4ad4-a777-47cf78ea0b3b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.301463 Aug 04 04:37:02.268944 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1559/3120] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:01 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:02.280443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:02.282530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:02.319938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:02.320896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:02.322472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:02.324818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:02.382158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:37:02.394307 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Working on deleting snapshot 80daf676-13f6-4613-be24-1485b4963b48 from shelved instance... Aug 04 04:37:03.572283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:37:03.573439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:37:03.574169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:37:03.574817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:37:03.575480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:37:03.591158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:03.595703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:03.599841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:03.600682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:03.633397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:37:03.646077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for user bb9ca81b2ec24bd1b139bb817a47bb29 and project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:37:03.661481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:37:03.664108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:37:03.725306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Doing local delete in cell 252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=119343) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 04:37:03.727837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:03.728311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:03.728754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 04:37:03.735001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b5c745e9-48aa-42bb-8ac1-6822b70eef49 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062980 Aug 04 04:37:03.741850 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1562/3121] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:37:03.750401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] deallocate_for_instance() {{(pid=119343) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 04:37:03.774972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:03.776403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:03.788605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:03.789347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:03.790558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:03.791134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:04.193768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:04.205817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:04.211688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:04.219773 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-788acb55-faf7-41ce-8100-7b33043cf2e4 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.470512 Aug 04 04:37:04.220923 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1563/3122] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:03 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:04.226753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:04.227689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:04.234264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:04.235059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:04.236077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:04.236734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:05.206442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:05.217128 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f8bc42c-f3c6-457e-8b63-b7a4d8e6d19e tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 0.994736 Aug 04 04:37:05.222588 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1564/3123] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:04 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:05.234323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:05.234964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:05.249471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:05.250302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:05.251329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:05.251958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:05.799375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:05.815016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:05.818916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:05.821627 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c2a853b-db50-47fe-9f4b-c65cc4f86fdb tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.597877 Aug 04 04:37:05.823664 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1565/3124] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:05 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:05.849461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:05.853936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:05.874643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:05.878365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:05.880648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:05.881113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:06.150697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:06.176294 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2d6beaea-0cbf-4487-b081-ef0ff9539533 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1266 microversion: 2.1 time: 0.345274 Aug 04 04:37:06.190983 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1566/3125] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:05 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:06.196424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:06.200016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:06.217616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:06.218291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:06.219085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:06.219627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:06.394253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:06.418006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:06.419581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:06.423638 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e15f9cab-ad59-4ccb-be0d-007aa8da12d8 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.242588 Aug 04 04:37:06.427282 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1567/3126] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:06 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:06.432368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:06.435812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:06.450258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:06.454692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:06.455565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:06.456020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:06.772366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Updating instance_info_cache with network_info: [] {{(pid=119343) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:37:07.133102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.145747 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-97cded67-b926-4d81-abeb-821373f71d93 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 0.712518 Aug 04 04:37:07.146579 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1568/3127] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:06 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:07.158437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f67edd8f-167c-49fd-80eb-da97cf7d778e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923967e50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:07.224344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f67edd8f-167c-49fd-80eb-da97cf7d778e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/59cdd736-3e0d-4e32-9b30-b1c77fc8085f" status: 200 len: 662 microversion: 2.1 time: 0.075929 Aug 04 04:37:07.225800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1569/3128] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:07 2022] GET /compute/v2.1/images/59cdd736-3e0d-4e32-9b30-b1c77fc8085f => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:07.230923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ab75dbae-992a-4829-810f-e39b7b6bd850 req-56a6dd45-b729-4d55-84d3-7737e6255950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c55a9-4b61-4a7a-8732-e0162c1ca354", "name": "network-vif-deleted", "tag": "9655202c-3dc5-4bcb-ad7e-8a55e1d57459"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:07.261520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ab75dbae-992a-4829-810f-e39b7b6bd850 req-56a6dd45-b729-4d55-84d3-7737e6255950 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.264237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ab75dbae-992a-4829-810f-e39b7b6bd850 req-56a6dd45-b729-4d55-84d3-7737e6255950 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.288414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.compute.server_external_events [req-ab75dbae-992a-4829-810f-e39b7b6bd850 req-56a6dd45-b729-4d55-84d3-7737e6255950 service nova] Unable to find a host for instance 899c55a9-4b61-4a7a-8732-e0162c1ca354. Dropping event network-vif-deleted {{(pid=119342) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 04:37:07.289665 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ab75dbae-992a-4829-810f-e39b7b6bd850 req-56a6dd45-b729-4d55-84d3-7737e6255950 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.062440 Aug 04 04:37:07.293089 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1570/3129] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 04:37:07.302115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:07.302729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:07.321130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.323980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.333784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.334572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.453376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.467124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.469262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.473748 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ae3aafe5-8092-4a67-a50b-c7c23b11c944 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.176685 Aug 04 04:37:07.475719 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1571/3130] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:07 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:07.480629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:07.489917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:07.504262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.505600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.507397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.508573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.619903 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8b3b911-25c3-4e94-8849-63c7d63914ae tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "DELETE /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 204 len: 0 microversion: 2.1 time: 5.349360 Aug 04 04:37:07.623287 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1560/3131] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:37:02 2022] DELETE /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 0 bytes in 5351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:37:07.627535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9a1726f7-0269-480f-a148-d7bc726c5d86 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a82fe50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:07.674747 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9a1726f7-0269-480f-a148-d7bc726c5d86 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/59cdd736-3e0d-4e32-9b30-b1c77fc8085f" status: 200 len: 662 microversion: 2.1 time: 0.052764 Aug 04 04:37:07.676164 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1561/3132] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:07 2022] GET /compute/v2.1/images/59cdd736-3e0d-4e32-9b30-b1c77fc8085f => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:07.682413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:07.683487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:07.708263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.708713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.709491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.709928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.801155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.811217 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-896f9ea1-3934-4a44-bbc1-d65df17d7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1266 microversion: 2.1 time: 0.334133 Aug 04 04:37:07.812290 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1572/3133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:07 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:07.820802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:07.821703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 899c55a9-4b61-4a7a-8732-e0162c1ca354] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:07.840194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.846284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.847360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.850091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.850549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.853692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.855572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:07.858910 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe077716-c399-4ce6-9abf-c39a32ae4b65 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.180679 Aug 04 04:37:07.860987 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1562/3134] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:07 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:07.877539 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] HTTP exception thrown: Instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 could not be found. Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Request method failure captured: Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 HTTP/1.1 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60podco1f1NQ0KFnlgq8TCri7jZxUHHhpInTe6jkNOHea4c7wAydUcrbpODtgrywLF0DQaMyYkEcCulE5qEI-M3fqkd0qZhdMyEZOgxzVoyjw67KLhJi1VRrANM6iMnVdxQdPEcc687SbyWJ3FnKHeoMk0guuJgomB9rSnjVgUsvuuI Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85353a54064c4117bfedd41efcde07db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85353a54064c4117bfedd41efcde07db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d51068c4cce544e38ad1b23996efdec3 Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 could not be found. Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '899c55a9-4b61-4a7a-8732-e0162c1ca354'} Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 could not be found. Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 could not be found. Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:07.880400 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 could not be found. Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Returning 404 to user: Instance 899c55a9-4b61-4a7a-8732-e0162c1ca354 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03f97cc5-30d0-46c7-ac73-fe6726dfbbbb tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354" status: 404 len: 111 microversion: 2.1 time: 0.068628 Aug 04 04:37:07.885047 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1573/3135] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:07 2022] GET /compute/v2.1/servers/899c55a9-4b61-4a7a-8732-e0162c1ca354 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:37:07.892217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:07.892743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:07.912408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.913382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.915014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:07.915750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:07.949514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:37:08.016921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:08.079621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dba04c2f-e23c-4185-bdfb-ce279a7c2c7b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "DELETE /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 204 len: 0 microversion: 2.1 time: 0.191367 Aug 04 04:37:08.081403 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1563/3136] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:37:07 2022] DELETE /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:37:08.091347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:08.092481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:08.101616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.102411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.103602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.104257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.167654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:08.168685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:08.182621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.183603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.185439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.187541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.330811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:08.347758 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6bdfbf6-03cc-4b66-9ed3-4431a0cea3b7 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1467 microversion: 2.1 time: 0.262303 Aug 04 04:37:08.348634 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1574/3137] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:08 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1467 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:08.440321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:08.497771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:08.498717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:08.509189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.513116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:08.513454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.514371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.515635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.527346 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a42aeb1b-a11e-433f-be23-b544454249f1 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 0.364481 Aug 04 04:37:08.534423 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1564/3138] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:08 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:08.700114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:08.711569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:08.714129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:08.715587 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-efcba646-b27e-4f7c-9b35-995035d066ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1407 microversion: 2.54 time: 0.222104 Aug 04 04:37:08.716923 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1575/3139] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:08 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:08.838890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:08.839739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:08.851304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.852445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.853668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.854677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.888167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:08.889272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:08.902554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.904729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.906568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:08.908375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:08.951816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:09.051769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:09.067778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:09.069485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:09.070716 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d392f8a-2f1d-43d8-ac47-3f5b66098b61 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.187621 Aug 04 04:37:09.073363 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1576/3140] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:08 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:09.239337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:09.253403 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-583c521d-d98e-4ca2-a066-e7efed5dad63 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1308 microversion: 2.1 time: 0.419360 Aug 04 04:37:09.254231 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1565/3141] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:08 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:09.378492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:09.379315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:09.380373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9b3dc720-ecd4-4526-b498-12f98f568bf2 req-03d49083-dd33-4cf0-b257-1c8152d0743d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85365ce3-281d-44b9-ab6b-85cf98bacc8e", "tag": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:09.388269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:09.389863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:09.390882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:09.391517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:09.423844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b3dc720-ecd4-4526-b498-12f98f568bf2 req-03d49083-dd33-4cf0-b257-1c8152d0743d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:09.424291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b3dc720-ecd4-4526-b498-12f98f568bf2 req-03d49083-dd33-4cf0-b257-1c8152d0743d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:09.438845 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9b3dc720-ecd4-4526-b498-12f98f568bf2 req-03d49083-dd33-4cf0-b257-1c8152d0743d service nova] Creating event network-changed:4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5 for instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e on n-h1-851337-5 Aug 04 04:37:09.445129 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9b3dc720-ecd4-4526-b498-12f98f568bf2 req-03d49083-dd33-4cf0-b257-1c8152d0743d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071448 Aug 04 04:37:09.446531 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1566/3142] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:09.459938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0da837a4-e8a3-448a-89aa-0aa1523725a6 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a79bca0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:09.536631 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0da837a4-e8a3-448a-89aa-0aa1523725a6 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/fa1eb3a6-c743-48fc-a90c-738c947c56ef" status: 200 len: 661 microversion: 2.1 time: 0.085789 Aug 04 04:37:09.537250 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1567/3143] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:09 2022] GET /compute/v2.1/images/fa1eb3a6-c743-48fc-a90c-738c947c56ef => generated 661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:09.642777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:09.654897 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bdf5d13e-78b3-4c07-a325-514d7201d230 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1467 microversion: 2.1 time: 0.283211 Aug 04 04:37:09.674120 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1577/3144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:09 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1467 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:09.684819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:09.688080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:09.702995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:09.704610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:09.706754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:09.709017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:09.814688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-568051955", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "5e3fdba6-d309-4c23-8062-04b4331659ba"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:09.895789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] validate_networks() for [('5e3fdba6-d309-4c23-8062-04b4331659ba', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:37:10.199398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:10.211505 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69be9d0b-85d7-4070-97d3-414488d7cbfb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 0.535721 Aug 04 04:37:10.213143 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1578/3145] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:09 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:10.218270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e02e848e-323e-4264-82eb-213883a0456e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19239a5700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:10.288453 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e02e848e-323e-4264-82eb-213883a0456e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/fa1eb3a6-c743-48fc-a90c-738c947c56ef" status: 200 len: 661 microversion: 2.1 time: 0.073642 Aug 04 04:37:10.296936 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1579/3146] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:10 2022] GET /compute/v2.1/images/fa1eb3a6-c743-48fc-a90c-738c947c56ef => generated 661 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:10.296936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:10.296936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:10.310423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:10.310899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:10.311729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:10.312171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:10.843262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:10.855498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:10.857640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:10.860531 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e7a8fa18-6b1e-473b-a9eb-09916bdba81e tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1413 microversion: 2.54 time: 0.568823 Aug 04 04:37:10.862169 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1580/3147] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:10 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1413 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:10.868926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:10.871005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:10.882189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:10.883108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:10.884350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:10.885076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.078119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:11.093669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:11.110722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:11.114473 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-920d02ad-08fb-4bd4-ab69-40486bfa0286 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.250519 Aug 04 04:37:11.122666 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1581/3148] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:10 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:11.135865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:11.136834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:11.150925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.158331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.159503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.159958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.468842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:37:11.474096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:37:11.476393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:37:11.476711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:11.477315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:37:11.478031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:37:11.484455 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca2b5371-57e1-4421-85c7-1d2ceb4be543 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1308 microversion: 2.1 time: 0.359824 Aug 04 04:37:11.498732 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1582/3149] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:11 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:11.498732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:11.499304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:11.511015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.511475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.512262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.512701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.513521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.514195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.515360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.516042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.571917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Getting quotas for project 954a6a18b4b446f1a81cb37c65d6b08e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:37:11.580792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Getting quotas for user 608edb7e76194928aa7b5c1ddadbfc7d and project 954a6a18b4b446f1a81cb37c65d6b08e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:37:11.591117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.592075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.592075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lazy-loading 'fault' on Instance uuid eee7160e-6b36-4d4f-a709-35df0bf04698 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:37:11.599950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:37:11.602663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:37:11.675705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-69f4c262-cff4-4bf7-814d-a713247a282e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.136303 Aug 04 04:37:11.687009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1568/3150] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:37:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:37:11.687009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e30854a1-b6f9-435f-a11d-fcb1b68fe90c req-e6075b45-c8db-488f-9316-ea08583b8bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee7160e-6b36-4d4f-a709-35df0bf04698", "name": "network-vif-deleted", "tag": "239fe2be-b8f3-4876-b7d3-4a295e71cd25"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:11.710449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:11.718786 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-87553c7c-42b0-4328-827f-9180c7514366 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1305 microversion: 2.1 time: 0.229782 Aug 04 04:37:11.719315 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1583/3151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:11 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1305 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:11.729096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:11.729713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:11.740271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e30854a1-b6f9-435f-a11d-fcb1b68fe90c req-e6075b45-c8db-488f-9316-ea08583b8bbf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.740743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e30854a1-b6f9-435f-a11d-fcb1b68fe90c req-e6075b45-c8db-488f-9316-ea08583b8bbf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.748608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.749480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.753561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.754301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.790543 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e30854a1-b6f9-435f-a11d-fcb1b68fe90c req-e6075b45-c8db-488f-9316-ea08583b8bbf service nova] Creating event network-vif-deleted:239fe2be-b8f3-4876-b7d3-4a295e71cd25 for instance eee7160e-6b36-4d4f-a709-35df0bf04698 on n-h1-851337-5 Aug 04 04:37:11.802327 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e30854a1-b6f9-435f-a11d-fcb1b68fe90c req-e6075b45-c8db-488f-9316-ea08583b8bbf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120857 Aug 04 04:37:11.813467 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1569/3152] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:11.822135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1f901cef-3d87-4849-9a5e-df00e052dfd8 req-88d08239-5d13-474e-bf81-f6eaacb703de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda976a3-dfdf-4c91-a785-81aac0a7913f", "tag": "2dda9179-29ad-44b0-bd9f-92fb9a9d2563"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:11.888008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1f901cef-3d87-4849-9a5e-df00e052dfd8 req-88d08239-5d13-474e-bf81-f6eaacb703de service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:11.889665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1f901cef-3d87-4849-9a5e-df00e052dfd8 req-88d08239-5d13-474e-bf81-f6eaacb703de service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:11.937512 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1f901cef-3d87-4849-9a5e-df00e052dfd8 req-88d08239-5d13-474e-bf81-f6eaacb703de service nova] Creating event network-changed:2dda9179-29ad-44b0-bd9f-92fb9a9d2563 for instance fda976a3-dfdf-4c91-a785-81aac0a7913f on n-h2-851337-5 Aug 04 04:37:11.945794 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1f901cef-3d87-4849-9a5e-df00e052dfd8 req-88d08239-5d13-474e-bf81-f6eaacb703de service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133797 Aug 04 04:37:11.947936 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1570/3153] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:11.961146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-474276332", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "5e3fdba6-d309-4c23-8062-04b4331659ba"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:12.096101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] validate_networks() for [('5e3fdba6-d309-4c23-8062-04b4331659ba', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:37:12.174411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.183405 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-64e726ee-64d8-4037-98be-42b91d33ac25 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 0.460143 Aug 04 04:37:12.184355 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1584/3154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:11 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:12.189986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.191077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:12.200347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.201292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.202306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.204262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.374893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.390895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.398711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.403482 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39478d19-8b90-48a1-b6e8-267d8da71fc8 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1398 microversion: 2.54 time: 0.216482 Aug 04 04:37:12.404389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1585/3155] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:12 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1398 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:12.424808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-effa2a14-49e9-43b1-8aee-29b4e4d12429 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a634ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.487406 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-effa2a14-49e9-43b1-8aee-29b4e4d12429 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/d7fbaeef-aa61-4988-bb23-c152a0bb0b48" status: 200 len: 661 microversion: 2.1 time: 0.080799 Aug 04 04:37:12.489296 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1586/3156] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:12 2022] GET /compute/v2.1/images/d7fbaeef-aa61-4988-bb23-c152a0bb0b48 => generated 661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:12.494371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.495003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:12.501736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.502421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.503362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.503902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.583591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.593224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.595024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.596366 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41b5d1c3-102a-4167-ab0e-86fd636c76cd tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.105911 Aug 04 04:37:12.597237 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1587/3157] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:12 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:12.602876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-89090f68-c09f-4d61-ba00-f34d65224e8b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '.version_select at 0x7f1923967550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.629862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-89090f68-c09f-4d61-ba00-f34d65224e8b tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-884567564" status: 204 len: 0 microversion: 2.54 time: 0.030931 Aug 04 04:37:12.630721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1588/3158] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-884567564 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:37:12.636257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0da26221-ef5c-4812-b993-06a221f32e0a tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919fa2670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.695101 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0da26221-ef5c-4812-b993-06a221f32e0a tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/d7fbaeef-aa61-4988-bb23-c152a0bb0b48" status: 200 len: 661 microversion: 2.1 time: 0.062939 Aug 04 04:37:12.696016 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1589/3159] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:12 2022] GET /compute/v2.1/images/d7fbaeef-aa61-4988-bb23-c152a0bb0b48 => generated 661 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:12.701255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.701988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:12.709676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:37:12.710321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:37:12.710627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:37:12.710771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.711077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:37:12.711268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.711861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:37:12.712071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.713011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.732817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.733445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.735743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.737002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.773067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Getting quotas for project 954a6a18b4b446f1a81cb37c65d6b08e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:37:12.787851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Getting quotas for user 608edb7e76194928aa7b5c1ddadbfc7d and project 954a6a18b4b446f1a81cb37c65d6b08e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:37:12.823646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:37:12.826251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:37:12.899982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:12.902360 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-acfe23a1-77b2-4678-ac24-5b6438d60562 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952302 Aug 04 04:37:12.903820 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1571/3160] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:37:12.909036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.909547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:12.913486 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d30f866-482b-4033-8fec-8dc10af03baf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1308 microversion: 2.1 time: 0.216156 Aug 04 04:37:12.918526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.919009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.919801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.920673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.945325 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1590/3161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:12 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:12.955665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:12.956297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:12.963263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:37:12.971166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.971914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:12.973548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:12.974151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:13.023412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:13.023969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:13.024438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lazy-loading 'fault' on Instance uuid eee7160e-6b36-4d4f-a709-35df0bf04698 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:37:13.091702 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93c009cd-c15a-45ed-9a71-0e5e316248ec tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "DELETE /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 204 len: 0 microversion: 2.54 time: 0.186201 Aug 04 04:37:13.093323 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1572/3162] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:37:12 2022] DELETE /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:37:13.105580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1371927036", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:13.111340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:13.130989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:13.133170 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07eea286-a995-4d94-8a20-4a9fff4ab948 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 200 len: 1305 microversion: 2.1 time: 0.185055 Aug 04 04:37:13.137167 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1591/3163] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:12 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 1305 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:13.151300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2114135218", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "451", "networks": [{"uuid": "5e3fdba6-d309-4c23-8062-04b4331659ba"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:13.228818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:37:13.235159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] validate_networks() for [('5e3fdba6-d309-4c23-8062-04b4331659ba', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:37:13.612084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:13.655639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:14.189186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:37:14.190773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:37:14.192278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:37:14.192975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:37:14.193820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:37:14.226799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.229937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.231679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.232664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.277016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Getting quotas for project ed5e7fb335aa4deeaeb338d81461bf0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:37:14.282920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Getting quotas for user ae674ecf70df4ccab46111fbcb4d426d and project ed5e7fb335aa4deeaeb338d81461bf0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:37:14.296378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:37:14.298907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:37:14.346163 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8151fb9-0c0f-4a69-8c2a-80e5650beee9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251301 Aug 04 04:37:14.347031 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1573/3164] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:37:14.351496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:14.352135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:14.358273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.358728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.359537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.359977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.432748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:14.441531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:14.443698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a48cd27cd25470db8df61424b0ef476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49978a37316d4e88a00e9c6f27306350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:14.445106 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9439d235-104b-418a-bfcb-beaf7bc8d29d tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 200 len: 1404 microversion: 2.54 time: 0.097320 Aug 04 04:37:14.459045 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1574/3165] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:14 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 1404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:14.461239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:37:14.461707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:37:14.462137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:37:14.462717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:37:14.463174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:37:14.470807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:14.473470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:14.477680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.478486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.479839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.481190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.481685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.482146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.482929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.483428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.505323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Getting quotas for project 954a6a18b4b446f1a81cb37c65d6b08e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:37:14.511485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Getting quotas for user 608edb7e76194928aa7b5c1ddadbfc7d and project 954a6a18b4b446f1a81cb37c65d6b08e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:37:14.514376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:14.562208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:37:14.578353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:37:14.712832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca25a8be-61e9-4f9e-ae2f-d9f5460aa5d0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572617 Aug 04 04:37:14.715125 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1592/3166] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:37:14.727336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:14.728798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:14.749823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.751468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:14.753503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:14.758472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:15.080365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:15.089021 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e8e1d43-fe2e-4cc5-97d4-df851b817fff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 0.628558 Aug 04 04:37:15.089619 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1575/3167] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:14 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:15.090701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:15.107722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:15.108625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:15.118344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:15.126184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:15.126634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:15.127524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:15.127973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:15.128202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:15.134307 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aa78b06e-5d5d-487e-98dc-ccd6e4d18bc7 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.418054 Aug 04 04:37:15.139832 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1593/3168] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:14 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:15.162042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:15.172123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: eee7160e-6b36-4d4f-a709-35df0bf04698] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:15.195933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:15.198658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:15.201264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:15.202879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:15.242206 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] HTTP exception thrown: Instance eee7160e-6b36-4d4f-a709-35df0bf04698 could not be found. Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Request method failure captured: Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 HTTP/1.1 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60podco1f1NQ0KFnlgq8TCri7jZxUHHhpInTe6jkNOHea4c7wAydUcrbpODtgrywLF0DQaMyYkEcCulE5qEI-M3fqkd0qZhdMyEZOgxzVoyjw67KLhJi1VRrANM6iMnVdxQdPEcc687SbyWJ3FnKHeoMk0guuJgomB9rSnjVgUsvuuI Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85353a54064c4117bfedd41efcde07db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85353a54064c4117bfedd41efcde07db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d51068c4cce544e38ad1b23996efdec3 Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance eee7160e-6b36-4d4f-a709-35df0bf04698 could not be found. Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'eee7160e-6b36-4d4f-a709-35df0bf04698'} Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee7160e-6b36-4d4f-a709-35df0bf04698 could not be found. Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee7160e-6b36-4d4f-a709-35df0bf04698 could not be found. Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:15.247297 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:15.251670 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:15.251670 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:15.251670 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:15.251670 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:15.251670 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:15.251670 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee7160e-6b36-4d4f-a709-35df0bf04698 could not be found. Aug 04 04:37:15.251670 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:15.255283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Returning 404 to user: Instance eee7160e-6b36-4d4f-a709-35df0bf04698 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:15.258788 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ea249b8-abbc-4c7b-82dc-0f33fbe4da72 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698" status: 404 len: 111 microversion: 2.1 time: 0.117460 Aug 04 04:37:15.260858 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1594/3169] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:15 2022] GET /compute/v2.1/servers/eee7160e-6b36-4d4f-a709-35df0bf04698 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:37:15.274424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-608614224", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:15.372074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:37:16.371791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:16.387972 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76ad7c4c-b48a-4cfc-a68a-99dbad0a6308 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1308 microversion: 2.1 time: 1.292620 Aug 04 04:37:16.390566 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1576/3170] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:15 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1308 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:16.407138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:16.408056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:16.418032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:16.418733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:16.419935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:16.424738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:16.847632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:16.867266 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f8d579b-42e9-4d4c-8656-c7a73b25ec59 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1273 microversion: 2.1 time: 0.474580 Aug 04 04:37:16.867891 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1577/3171] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:16 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1273 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:16.873068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:16.873674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:16.893774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:16.894239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:16.895141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:16.895862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.006043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:37:17.023081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:37:17.023687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:37:17.023985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:37:17.024824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:37:17.025423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:37:17.052418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.053177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.054268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.061315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.128232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Getting quotas for project ed5e7fb335aa4deeaeb338d81461bf0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:37:17.155263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Getting quotas for user ae674ecf70df4ccab46111fbcb4d426d and project ed5e7fb335aa4deeaeb338d81461bf0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:37:17.194583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:37:17.196507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1dc8d122-8477-4f2d-a341-686902f1bae8 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "DELETE /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 204 len: 0 microversion: 2.1 time: 0.326694 Aug 04 04:37:17.198574 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1578/3172] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:37:16 2022] DELETE /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:37:17.206405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:17.208363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:37:17.209159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] [instance: 71179b0e-85e0-4dba-8452-791974c09976] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:17.220446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.221705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.223398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.224434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.255998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] HTTP exception thrown: Instance 71179b0e-85e0-4dba-8452-791974c09976 could not be found. Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Request method failure captured: Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 HTTP/1.1 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60zTWqmyq3tbnEPLLaoadgI7uO1nIrZ6Cf9DWjpslCp971WpWj9tH18_nJPkRSuzZeNMx2e24vlcqSAiSw5JdTwqDUKg7k-wZ29gFC8tU7BtTPFHEgXy-lLfpThhdh5wD-ybmmQcHoEt3gCr2Pj-NknYvY_XlgaZAHPetfzl5vPypnw Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.54 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 49978a37316d4e88a00e9c6f27306350 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerShowV254Test-1771216158 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/49978a37316d4e88a00e9c6f27306350"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/49978a37316d4e88a00e9c6f27306350"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/49978a37316d4e88a00e9c6f27306350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_49978a37316d4e88a00e9c6f27306350", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerShowV254Test-1771216158 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 49978a37316d4e88a00e9c6f27306350 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerShowV254Test-1771216158 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerShowV254Test-1771216158-project Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4a48cd27cd25470db8df61424b0ef476 Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerShowV254Test-1771216158-project Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 71179b0e-85e0-4dba-8452-791974c09976 could not be found. Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '71179b0e-85e0-4dba-8452-791974c09976'} Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71179b0e-85e0-4dba-8452-791974c09976 could not be found. Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71179b0e-85e0-4dba-8452-791974c09976 could not be found. Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:17.258189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71179b0e-85e0-4dba-8452-791974c09976 could not be found. Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] Returning 404 to user: Instance 71179b0e-85e0-4dba-8452-791974c09976 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:17.263627 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83f51d50-c48d-4d37-a85d-5f400116aa40 tempest-ServerShowV254Test-1771216158 tempest-ServerShowV254Test-1771216158-project] 10.222.0.69 "GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976" status: 404 len: 111 microversion: 2.54 time: 0.060365 Aug 04 04:37:17.278639 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1579/3173] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:17 2022] GET /compute/v2.1/servers/71179b0e-85e0-4dba-8452-791974c09976 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:37:17.291591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:17.292438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:17.310200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.312715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.313028 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04dd45fc-a7dc-4971-89d4-7d66adefd97b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.048936 Aug 04 04:37:17.313537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.314016 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1595/3174] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:37:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:37:17.322692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.324143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:17.324778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:17.333656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.339586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.340552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.343518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.687395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:17.725238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:17.729578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:17.733977 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4dcc38dd-45b6-43b5-a939-64aec539a635 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.418791 Aug 04 04:37:17.749539 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1596/3175] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:17 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:17.774653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-36bab5d2-fe2c-44a5-ac73-d01d6628cfde req-85a56809-81ef-4162-9027-2c0c83a299d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85365ce3-281d-44b9-ab6b-85cf98bacc8e", "name": "network-vif-plugged", "status": "completed", "tag": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:17.820417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-36bab5d2-fe2c-44a5-ac73-d01d6628cfde req-85a56809-81ef-4162-9027-2c0c83a299d0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.822077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-36bab5d2-fe2c-44a5-ac73-d01d6628cfde req-85a56809-81ef-4162-9027-2c0c83a299d0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.863822 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-36bab5d2-fe2c-44a5-ac73-d01d6628cfde req-85a56809-81ef-4162-9027-2c0c83a299d0 service nova] Creating event network-vif-plugged:4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5 for instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e on n-h1-851337-5 Aug 04 04:37:17.881368 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-36bab5d2-fe2c-44a5-ac73-d01d6628cfde req-85a56809-81ef-4162-9027-2c0c83a299d0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125985 Aug 04 04:37:17.882760 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1597/3176] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:17.905982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:17.908823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:17.933212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.933967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:17.936707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:17.948334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:18.453104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:18.463711 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2c65a92-018f-4a43-9443-a9971bc6a899 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 1.183777 Aug 04 04:37:18.467002 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1580/3177] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:17 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:18.481547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:18.485566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:18.500921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:18.507639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:18.508760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:18.509571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:18.773812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:18.788682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ae5d6b9-4028-4e6b-ac29-4bcc6e908481 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1213 microversion: 2.1 time: 0.319483 Aug 04 04:37:18.791210 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1581/3178] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:18 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1213 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:18.798446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:18.799522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:18.807575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:18.808535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:18.809566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:18.810235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:18.843722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:18.894547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:18.904092 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8fcf370-f47c-4e1e-a413-09a4a5b0b411 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1507 microversion: 2.1 time: 1.017745 Aug 04 04:37:18.908032 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1598/3179] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:17 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1507 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:18.922826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:18.923673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:18.933392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:18.943044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:18.944605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:18.945186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:18.949956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:19.106716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:19.126369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-001a33a1-db32-4e28-a78f-1bf7d5293402 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1279 microversion: 2.1 time: 0.216827 Aug 04 04:37:19.127185 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1599/3180] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:18 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1279 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:19.132602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:19.133468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:19.142349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.152188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:19.153243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.153874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:19.420067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:19.433925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:19.435519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:19.436740 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e0f2c25e-0d3e-40aa-8d2a-96a55eb8e864 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.308430 Aug 04 04:37:19.437317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1600/3181] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:19 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:19.491272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:19.492400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:19.499299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.500076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:19.501092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.502006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:19.590270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:19.611558 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-faed5ef9-9d80-46fc-a5c2-b5dba08e7a3f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1308 microversion: 2.1 time: 0.818684 Aug 04 04:37:19.612195 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1582/3182] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:18 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1308 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:19.811735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:19.813897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:19.828007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.828945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:19.830112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.830864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:19.854633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:19.870585 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cf42ca2f-ba01-4927-8664-98df803eab74 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1324 microversion: 2.1 time: 0.382599 Aug 04 04:37:19.872746 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1601/3183] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:19 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:19.929089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:19.929913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:19.938444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.946184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:19.950108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:19.950565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.180512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:20.196219 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6ab62f09-d3a4-45a1-a734-2fd2648dba63 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1275 microversion: 2.1 time: 0.386754 Aug 04 04:37:20.219167 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1583/3184] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:19 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1275 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:20.237803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-20d96fc0-082e-4455-bd5a-4aa0122744c4 req-bcdf2d79-eaa0-4c6f-9ee3-ce3b2a2d818f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda976a3-dfdf-4c91-a785-81aac0a7913f", "name": "network-vif-plugged", "status": "completed", "tag": "2dda9179-29ad-44b0-bd9f-92fb9a9d2563"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:20.261171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:20.276050 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0f2d3c72-759f-4b9e-ba14-6f06e8d2340b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 200 len: 1465 microversion: 2.1 time: 0.351539 Aug 04 04:37:20.279308 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1602/3185] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:19 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 1465 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:20.295594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:20.300055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-20d96fc0-082e-4455-bd5a-4aa0122744c4 req-bcdf2d79-eaa0-4c6f-9ee3-ce3b2a2d818f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.300416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:20.300588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-20d96fc0-082e-4455-bd5a-4aa0122744c4 req-bcdf2d79-eaa0-4c6f-9ee3-ce3b2a2d818f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.325044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.326484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.328730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.330161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.346384 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-20d96fc0-082e-4455-bd5a-4aa0122744c4 req-bcdf2d79-eaa0-4c6f-9ee3-ce3b2a2d818f service nova] Creating event network-vif-plugged:2dda9179-29ad-44b0-bd9f-92fb9a9d2563 for instance fda976a3-dfdf-4c91-a785-81aac0a7913f on n-h2-851337-5 Aug 04 04:37:20.361651 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-20d96fc0-082e-4455-bd5a-4aa0122744c4 req-bcdf2d79-eaa0-4c6f-9ee3-ce3b2a2d818f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140800 Aug 04 04:37:20.363098 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1584/3186] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:20.377981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f81ddd17-de12-4ee4-aa9e-b825d42a43eb req-4dade613-e66e-46a0-a69a-ead95a30314b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516857b7-6247-41be-a977-883970904cd0", "name": "network-vif-deleted", "tag": "7729b6c9-8d05-4315-915b-46108809ceec"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:20.403137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f81ddd17-de12-4ee4-aa9e-b825d42a43eb req-4dade613-e66e-46a0-a69a-ead95a30314b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.404702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f81ddd17-de12-4ee4-aa9e-b825d42a43eb req-4dade613-e66e-46a0-a69a-ead95a30314b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.433795 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f81ddd17-de12-4ee4-aa9e-b825d42a43eb req-4dade613-e66e-46a0-a69a-ead95a30314b service nova] Creating event network-vif-deleted:7729b6c9-8d05-4315-915b-46108809ceec for instance 516857b7-6247-41be-a977-883970904cd0 on n-h2-851337-5 Aug 04 04:37:20.446478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f81ddd17-de12-4ee4-aa9e-b825d42a43eb req-4dade613-e66e-46a0-a69a-ead95a30314b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078881 Aug 04 04:37:20.447500 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1585/3187] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:20.466097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:20.467103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:20.481313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.482620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.483834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.485751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.729937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:20.743230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:20.754789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:20.760526 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41e01e6e-8327-4058-8040-ccfffda47e83 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.299209 Aug 04 04:37:20.763106 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1586/3188] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:20 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:20.768149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:20.773894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:20.791344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.800622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:20.802346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:20.803021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:21.198131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:21.227794 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1a027b67-f4ba-4f1f-9103-2499797e2858 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.938598 Aug 04 04:37:21.236862 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1603/3189] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:20 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:21.258183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:21.258737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:21.277896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:21.278916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:21.280030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:21.280857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:21.321244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:21.328990 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eddbf497-09d0-49c6-8ab2-64504c7fac6a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1308 microversion: 2.1 time: 0.564536 Aug 04 04:37:21.329584 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1587/3190] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:20 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1308 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:21.348960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:21.350038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:21.358932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:21.359821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:21.360851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:21.367056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.095369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:22.105915 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61578536-745e-4b2e-8e84-36db79cffda1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.761442 Aug 04 04:37:22.106530 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1588/3191] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:21 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:22.135882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:22.136875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 516857b7-6247-41be-a977-883970904cd0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:22.144089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.144565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.146916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.147555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.165487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] HTTP exception thrown: Instance 516857b7-6247-41be-a977-883970904cd0 could not be found. Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Request method failure captured: Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 HTTP/1.1 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60podco1f1NQ0KFnlgq8TCri7jZxUHHhpInTe6jkNOHea4c7wAydUcrbpODtgrywLF0DQaMyYkEcCulE5qEI-M3fqkd0qZhdMyEZOgxzVoyjw67KLhJi1VRrANM6iMnVdxQdPEcc687SbyWJ3FnKHeoMk0guuJgomB9rSnjVgUsvuuI Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85353a54064c4117bfedd41efcde07db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85353a54064c4117bfedd41efcde07db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d51068c4cce544e38ad1b23996efdec3 Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 516857b7-6247-41be-a977-883970904cd0 could not be found. Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '516857b7-6247-41be-a977-883970904cd0'} Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516857b7-6247-41be-a977-883970904cd0 could not be found. Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516857b7-6247-41be-a977-883970904cd0 could not be found. Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:22.167879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:22.172869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:22.172869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:22.172869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:22.172869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:22.172869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:22.172869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516857b7-6247-41be-a977-883970904cd0 could not be found. Aug 04 04:37:22.172869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:22.175595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Returning 404 to user: Instance 516857b7-6247-41be-a977-883970904cd0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:22.177664 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e28c5839-0ae5-4e89-823d-be886579b213 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0" status: 404 len: 111 microversion: 2.1 time: 0.059881 Aug 04 04:37:22.178725 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1589/3192] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:22 2022] GET /compute/v2.1/servers/516857b7-6247-41be-a977-883970904cd0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:37:22.181783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:22.187323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:22.188092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:22.195500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.195966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.196523 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04998306-6864-46a7-b8c6-149f38ff5b41 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1520 microversion: 2.1 time: 0.954723 Aug 04 04:37:22.196754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.197122 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1604/3193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:21 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1520 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:22.212378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.224207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:22.224706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:22.243060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.244554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.248257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.250145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.326394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:37:22.425117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:22.459579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:22.465879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68ad7b2e7ed14adba4edddd770e0da5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b830d9d8e7a41bba8030bc549484aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:22.472233 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4f5affa5-83dc-4ec2-8d00-77acc4a0c3f3 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 200 len: 1604 microversion: 2.42 time: 0.290848 Aug 04 04:37:22.475144 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1590/3194] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:22 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:37:22.482556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ece079b-b6f8-4bb8-8305-640795a51ee7 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'create', calling method: .version_select at 0x7f191a79bca0>, body: {"pool": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:22.510621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67120067-fadb-4a4f-a355-e21d25200346 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 204 len: 0 microversion: 2.1 time: 0.312171 Aug 04 04:37:22.512174 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1605/3195] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:37:22 2022] DELETE /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:37:22.520539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:22.524297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:22.540556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.546432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:22.547776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:22.559707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:23.177894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:23.193280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24e7863b-65f8-4b77-81f1-bf039432679c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.679180 Aug 04 04:37:23.194041 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1606/3196] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:22 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:23.201455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:23.202366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:23.238629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:23.240786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:23.244691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:23.246061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:23.699268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:23.709102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99619df0-e6a4-41f7-897d-a6c98a78e2ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1489 microversion: 2.1 time: 0.513243 Aug 04 04:37:23.719244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1607/3197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:23 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1489 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:23.730308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:23.731700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:23.741401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:23.741931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:23.742803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:23.743496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.163158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:24.175874 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-10861711-ca9e-4e4b-afb9-5e179f9f7826 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 200 len: 1495 microversion: 2.1 time: 0.454759 Aug 04 04:37:24.177121 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1608/3198] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:23 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 1495 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:24.182359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c66c4154-5977-4900-b871-6b60d03a933a req-14ee635b-32db-46cf-b788-ce9aa73cfd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9ce364-fb10-4d85-b724-c523ebfae39a", "tag": "f8452bab-27a5-4c74-9a15-7448bd16835c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:24.196968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c66c4154-5977-4900-b871-6b60d03a933a req-14ee635b-32db-46cf-b788-ce9aa73cfd3f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.197650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c66c4154-5977-4900-b871-6b60d03a933a req-14ee635b-32db-46cf-b788-ce9aa73cfd3f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.219471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c66c4154-5977-4900-b871-6b60d03a933a req-14ee635b-32db-46cf-b788-ce9aa73cfd3f service nova] Creating event network-changed:f8452bab-27a5-4c74-9a15-7448bd16835c for instance 6d9ce364-fb10-4d85-b724-c523ebfae39a on n-h1-851337-5 Aug 04 04:37:24.249750 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c66c4154-5977-4900-b871-6b60d03a933a req-14ee635b-32db-46cf-b788-ce9aa73cfd3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070738 Aug 04 04:37:24.251802 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1609/3199] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:24.259881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:24.260826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:24.268318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:24.277802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.279208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.280123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.280985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.291174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=18 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:24.725418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:24.734121 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-865a0355-d89c-485f-b676-277db8656c2c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.480825 Aug 04 04:37:24.747370 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1610/3200] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:24 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:24.754051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:24.754985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:24.761995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.762507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.763376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.763817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.778607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] HTTP exception thrown: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Request method failure captured: Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 HTTP/1.1 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60tdgfF82No2cr_T6d64q1fVyW7B9cLm6HYcbatltbDWSPQDbngkI2jJwPQxhM6DKp3XSuY71tF4M030j5HV9vtgxiC9jdkwwRvj2l3M03JpDxcjpiQSZGgWJ3B9DwhGIs_KpM5sfxjR5P60CoQ2ti2F97AKSc2bYNSIpe31AKw-MdY Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3b830d9d8e7a41bba8030bc549484aa2 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b830d9d8e7a41bba8030bc549484aa2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3b830d9d8e7a41bba8030bc549484aa2 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TaggedBootDevicesTest_v242-689444458-project Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 68ad7b2e7ed14adba4edddd770e0da5d Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TaggedBootDevicesTest_v242-689444458-project Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'cba46ac9-dd58-4f8e-990f-e3f3c8325b73'} Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:24.780487 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Returning 404 to user: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:24.785944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f9f2213d-3969-4607-8a02-84a7b28c5898 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 404 len: 111 microversion: 2.42 time: 0.033323 Aug 04 04:37:24.787848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1611/3201] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:24 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:37:24.791646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c13fcdcc-8b3e-48c4-b16d-a3795f3a7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:24.792434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c13fcdcc-8b3e-48c4-b16d-a3795f3a7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:24.798897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13fcdcc-8b3e-48c4-b16d-a3795f3a7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.799400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13fcdcc-8b3e-48c4-b16d-a3795f3a7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.800196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13fcdcc-8b3e-48c4-b16d-a3795f3a7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.800637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c13fcdcc-8b3e-48c4-b16d-a3795f3a7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.883039 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c13fcdcc-8b3e-48c4-b16d-a3795f3a7cb9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f/action" status: 202 len: 0 microversion: 2.1 time: 0.094973 Aug 04 04:37:24.884320 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1612/3202] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:37:24 2022] POST /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:37:24.891836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-26371eab-3fe1-4382-8e02-ef84d1cae27b req-88f447fc-dd96-480f-a194-f2484e5d848e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ed652d-4352-4709-9f35-cd6dad67ba0d", "tag": "c418aa72-3ee1-4a69-9a47-4b46b90fd296"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:24.909584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-26371eab-3fe1-4382-8e02-ef84d1cae27b req-88f447fc-dd96-480f-a194-f2484e5d848e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.912149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-26371eab-3fe1-4382-8e02-ef84d1cae27b req-88f447fc-dd96-480f-a194-f2484e5d848e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.932916 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-26371eab-3fe1-4382-8e02-ef84d1cae27b req-88f447fc-dd96-480f-a194-f2484e5d848e service nova] Creating event network-changed:c418aa72-3ee1-4a69-9a47-4b46b90fd296 for instance 11ed652d-4352-4709-9f35-cd6dad67ba0d on n-h2-851337-5 Aug 04 04:37:24.939178 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-26371eab-3fe1-4382-8e02-ef84d1cae27b req-88f447fc-dd96-480f-a194-f2484e5d848e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052882 Aug 04 04:37:24.940365 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1613/3203] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:24.947123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:24.948169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:24.970220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.970787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:24.971648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:24.972111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:25.612049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:25.632014 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-77974c4a-b990-4e6b-be6f-010ce0f69ee0 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.690016 Aug 04 04:37:25.632624 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1614/3204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:24 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:25.688967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1db1005-1be4-4c1e-9af3-e16e7cd5f163 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '.version_select at 0x7f1923935280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:25.725743 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1db1005-1be4-4c1e-9af3-e16e7cd5f163 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035125892" status: 204 len: 0 microversion: 2.42 time: 0.066998 Aug 04 04:37:25.728128 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1615/3205] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:37:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035125892 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:37:25.734175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:25.734802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:25.753783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:25.754485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:25.755537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:25.756788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:25.805479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:25.993144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ece079b-b6f8-4bb8-8305-640795a51ee7 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.516445 Aug 04 04:37:26.009756 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1591/3206] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:37:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:26.019812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:26.020575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: d3289802-1dfa-4410-b3c9-e36f6989c7e6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:26.039233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.040120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.043222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.044877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.056652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:26.069061 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd1c702c-006b-45e0-9a9b-cc7983328d7d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 200 len: 1474 microversion: 2.1 time: 0.341545 Aug 04 04:37:26.069662 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1616/3207] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:25 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:26.083516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:26.084553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:26.104355 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] HTTP exception thrown: Instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 could not be found. Aug 04 04:37:26.107540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.107926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.108876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.109823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Request method failure captured: Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 HTTP/1.1 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60podco1f1NQ0KFnlgq8TCri7jZxUHHhpInTe6jkNOHea4c7wAydUcrbpODtgrywLF0DQaMyYkEcCulE5qEI-M3fqkd0qZhdMyEZOgxzVoyjw67KLhJi1VRrANM6iMnVdxQdPEcc687SbyWJ3FnKHeoMk0guuJgomB9rSnjVgUsvuuI Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85353a54064c4117bfedd41efcde07db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85353a54064c4117bfedd41efcde07db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d51068c4cce544e38ad1b23996efdec3 Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 could not be found. Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'd3289802-1dfa-4410-b3c9-e36f6989c7e6'} Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 could not be found. Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 could not be found. Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:26.109961 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 could not be found. Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:26.115792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Returning 404 to user: Instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:26.116651 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02943a5d-8055-4879-ab57-ad5aaced17ad tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6" status: 404 len: 111 microversion: 2.1 time: 0.105314 Aug 04 04:37:26.120835 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1592/3208] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:26 2022] GET /compute/v2.1/servers/d3289802-1dfa-4410-b3c9-e36f6989c7e6 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:37:26.135179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f70f100a-a512-4307-8c8c-50355e8b058f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1021736548"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:26.146004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f70f100a-a512-4307-8c8c-50355e8b058f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:26.170150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f70f100a-a512-4307-8c8c-50355e8b058f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.170472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f70f100a-a512-4307-8c8c-50355e8b058f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.172500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f70f100a-a512-4307-8c8c-50355e8b058f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.174719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f70f100a-a512-4307-8c8c-50355e8b058f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.489611 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f70f100a-a512-4307-8c8c-50355e8b058f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f/action" status: 202 len: 0 microversion: 2.1 time: 0.366213 Aug 04 04:37:26.495494 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1593/3209] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:37:26 2022] POST /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:37:26.502241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:26.503197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:26.514097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.516948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.518865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.520148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.588528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:26.604881 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4107429b-fa7d-4241-8c1f-10a07b617913 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.529513 Aug 04 04:37:26.606411 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1617/3210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:26 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:26.614721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:37:26.619617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1463506924", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:26.717740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] validate_networks() for [('8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:37:26.781813 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9bd17116-cbde-4f2c-8f1e-2d7bf6dd963e tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 204 len: 0 microversion: 2.1 time: 0.288489 Aug 04 04:37:26.782939 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1594/3211] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:37:26 2022] DELETE /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:37:26.789169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-73340b18-4ffc-4a01-afcf-ba671c054aee req-0a7cfd31-69f0-465a-9f30-1fad5b450639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f5387a-d6f5-4d08-ae53-1f79fa44685b", "tag": "753afc88-8bfd-4e25-af8d-551951c7820c"}, {"name": "network-changed", "server_uuid": "23e70cb6-8312-4eb4-933a-240f846ea50a", "tag": "59ee67cf-4dcc-4d74-b918-71a71aee26e2"}, {"name": "network-changed", "server_uuid": "81cdc530-bc0f-42fa-bb6f-c8bf225761c6", "tag": "63e89099-0992-4a96-b81b-77db4750634e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:26.803557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-73340b18-4ffc-4a01-afcf-ba671c054aee req-0a7cfd31-69f0-465a-9f30-1fad5b450639 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.804274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-73340b18-4ffc-4a01-afcf-ba671c054aee req-0a7cfd31-69f0-465a-9f30-1fad5b450639 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.824110 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-73340b18-4ffc-4a01-afcf-ba671c054aee req-0a7cfd31-69f0-465a-9f30-1fad5b450639 service nova] Creating event network-changed:753afc88-8bfd-4e25-af8d-551951c7820c for instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b on n-h1-851337-5 Aug 04 04:37:26.824915 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-73340b18-4ffc-4a01-afcf-ba671c054aee req-0a7cfd31-69f0-465a-9f30-1fad5b450639 service nova] Creating event network-changed:59ee67cf-4dcc-4d74-b918-71a71aee26e2 for instance 23e70cb6-8312-4eb4-933a-240f846ea50a on n-h2-851337-5 Aug 04 04:37:26.825591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-73340b18-4ffc-4a01-afcf-ba671c054aee req-0a7cfd31-69f0-465a-9f30-1fad5b450639 service nova] Creating event network-changed:63e89099-0992-4a96-b81b-77db4750634e for instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 on n-h2-851337-5 Aug 04 04:37:26.838742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-73340b18-4ffc-4a01-afcf-ba671c054aee req-0a7cfd31-69f0-465a-9f30-1fad5b450639 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.053768 Aug 04 04:37:26.839821 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1595/3212] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:26.848528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-165b09fa-eab1-4631-a898-0bbf6857dddb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a688820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:26.904130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-165b09fa-eab1-4631-a898-0bbf6857dddb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.062746 Aug 04 04:37:26.905039 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1596/3213] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:26 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:26.911708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:26.912883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:26.920501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.921512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:26.922676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:26.923309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:27.088911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:27.168572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:27.368081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:27.378868 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02effa1a-51ef-4cdd-bca7-2b9d5ad5e683 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.472266 Aug 04 04:37:27.380796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1597/3214] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:26 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:27.388869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:27.389748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:27.409699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:27.410745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:27.412436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:27.412878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:27.750377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:27.758000 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4eb612f9-bee3-4ace-b49e-87a39b51653b tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1676 microversion: 2.1 time: 0.375317 Aug 04 04:37:27.772843 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1598/3215] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:27 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1676 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:27.778050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-084b41da-f239-4a01-b3e5-35b9dd08a2b6 req-10e59362-bfef-4aed-8372-8fa6e628e6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3289802-1dfa-4410-b3c9-e36f6989c7e6", "name": "network-vif-deleted", "tag": "518caf45-1b1a-4f28-a9a4-31fc977746eb"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:27.789617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-084b41da-f239-4a01-b3e5-35b9dd08a2b6 req-10e59362-bfef-4aed-8372-8fa6e628e6f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:27.790346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-084b41da-f239-4a01-b3e5-35b9dd08a2b6 req-10e59362-bfef-4aed-8372-8fa6e628e6f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:27.805683 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-084b41da-f239-4a01-b3e5-35b9dd08a2b6 req-10e59362-bfef-4aed-8372-8fa6e628e6f0 service nova] Creating event network-vif-deleted:518caf45-1b1a-4f28-a9a4-31fc977746eb for instance d3289802-1dfa-4410-b3c9-e36f6989c7e6 on n-h2-851337-5 Aug 04 04:37:27.817578 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-084b41da-f239-4a01-b3e5-35b9dd08a2b6 req-10e59362-bfef-4aed-8372-8fa6e628e6f0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043100 Aug 04 04:37:27.818630 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1599/3216] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:27.827171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:27.828871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:27.837152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:27.837885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:27.838853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:27.840229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:28.006691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:37:28.007223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:37:28.007613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:37:28.008026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:37:28.008446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:37:28.028555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:28.029422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:28.030853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:28.031553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:28.092345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Getting quotas for project 3b79d1753e8c422fbe63de69fc20cdbf. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:37:28.101802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Getting quotas for user ba1f58af29924fddadf25abcc5255606 and project 3b79d1753e8c422fbe63de69fc20cdbf. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:37:28.126812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:37:28.149237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:37:28.273465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:28.308837 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45da971b-fbf4-4b3b-b893-d4163f4c9fcc tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.699560 Aug 04 04:37:28.318633 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1618/3217] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:37:28.319004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9bc4ae66-043c-4bc7-9f6d-cbbf9a065c82 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.495102 Aug 04 04:37:28.327525 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1600/3218] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:27 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:28.334299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-81e0c450-e1c8-4478-a31c-8e18677a9f2c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:28.334997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-81e0c450-e1c8-4478-a31c-8e18677a9f2c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:28.341091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2cef5c8-b8c7-4ab0-9547-d731131b1ff8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923935e50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:28.403140 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2cef5c8-b8c7-4ab0-9547-d731131b1ff8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.089814 Aug 04 04:37:28.411235 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1619/3219] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:28 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:28.416900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:28.417923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:28.425539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:28.426559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:28.427895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:28.428829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:28.490726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-81e0c450-e1c8-4478-a31c-8e18677a9f2c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:28.498894 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-81e0c450-e1c8-4478-a31c-8e18677a9f2c tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1224 microversion: 2.1 time: 0.170044 Aug 04 04:37:28.502149 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1601/3220] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:28 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1224 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:28.779507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:28.780135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:28.794121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:28.795113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:28.796206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:28.796889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:28.860274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:28.878001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4619434-93ed-40d0-8266-5610747f0991 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.470705 Aug 04 04:37:28.881242 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1620/3221] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:28 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:29.339398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:29.340028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:29.350977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:29.351439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:29.352222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:29.352662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:29.570260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:29.579885 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3271ce95-1d29-413d-a152-9bcce1821118 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1676 microversion: 2.1 time: 0.804184 Aug 04 04:37:29.581105 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1602/3222] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:28 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1676 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:29.599182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7fed0a39-b7a6-4dd1-a183-509dbff452d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a6881f0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:29.657165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:29.680443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d55e30a9-1b57-4380-8ef3-11da41837492 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.345985 Aug 04 04:37:29.686458 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7fed0a39-b7a6-4dd1-a183-509dbff452d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.099898 Aug 04 04:37:29.688009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1603/3223] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:29 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:29.696087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:29.698418 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1621/3224] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:29 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:29.705418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:29.718892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:29.719721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:29.720814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:29.721448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:29.730976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:29.844316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:29.856124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3fb5d69d-8062-40ec-8e01-0f6eaefc3eb8 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1228 microversion: 2.1 time: 0.166365 Aug 04 04:37:29.857760 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1604/3225] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:29 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1228 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:29.901135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:29.902289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:29.934670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:29.951272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:29.955508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:29.956632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:29.963546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:30.259838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:30.280494 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b29bfa4c-fa0d-45d2-8d53-cde54d413272 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.382029 Aug 04 04:37:30.297980 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1622/3226] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:29 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:30.618715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:30.619499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:30.663506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:30.664206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:30.670195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:30.672203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:30.702382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff28b7f8-ac96-4315-b750-5a162334d8f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919f61550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:30.799155 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff28b7f8-ac96-4315-b750-5a162334d8f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.101273 Aug 04 04:37:30.799709 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1623/3227] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:30 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:30.813545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:30.816392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:30.844585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:30.845061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:30.845883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:30.846618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:30.932716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:30.948083 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ed67893-2770-4837-a58d-fb793c6353f9 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1676 microversion: 2.1 time: 0.345154 Aug 04 04:37:30.948710 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1605/3228] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:30 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1676 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:30.964477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:30.967982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:30.996832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:30.997500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:30.999331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:31.001468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:31.129459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:31.143527 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d227d15-3a0d-420b-a6de-ee9ace1d3af6 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1228 microversion: 2.1 time: 0.193652 Aug 04 04:37:31.146448 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1606/3229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:30 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1228 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:31.159634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-07d8c3b4-0020-497c-8189-058daa4c5ae2 req-3e73878e-7a4b-45b3-8e50-2c8794d53195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9ce364-fb10-4d85-b724-c523ebfae39a", "name": "network-vif-plugged", "status": "completed", "tag": "f8452bab-27a5-4c74-9a15-7448bd16835c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:31.188226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-07d8c3b4-0020-497c-8189-058daa4c5ae2 req-3e73878e-7a4b-45b3-8e50-2c8794d53195 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:31.189891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-07d8c3b4-0020-497c-8189-058daa4c5ae2 req-3e73878e-7a4b-45b3-8e50-2c8794d53195 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:31.233959 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-07d8c3b4-0020-497c-8189-058daa4c5ae2 req-3e73878e-7a4b-45b3-8e50-2c8794d53195 service nova] Creating event network-vif-plugged:f8452bab-27a5-4c74-9a15-7448bd16835c for instance 6d9ce364-fb10-4d85-b724-c523ebfae39a on n-h1-851337-5 Aug 04 04:37:31.235018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:31.241777 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-07d8c3b4-0020-497c-8189-058daa4c5ae2 req-3e73878e-7a4b-45b3-8e50-2c8794d53195 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093169 Aug 04 04:37:31.243448 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1607/3230] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:31.248248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8406c10b-5139-451d-993b-bcc829fe1452 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.446054 Aug 04 04:37:31.248853 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1624/3231] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:30 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:31.314062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:31.316194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:31.337648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:31.350249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:31.354282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:31.356162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:31.818609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27c58f8c-cf6f-4923-8311-0d4977aedfff tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19191dd3a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:31.917782 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27c58f8c-cf6f-4923-8311-0d4977aedfff tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.105903 Aug 04 04:37:31.931452 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1625/3232] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:31 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:31.945916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:31.955675 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c98a70f-a742-430d-9a73-72e77a87481c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.653638 Aug 04 04:37:31.956285 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1608/3233] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:31 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:31.979867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:31.980601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:31.990174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:31.990632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:31.999855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:32.000332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:32.169809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:32.171158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:32.189015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:32.189754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:32.192497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:32.193184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:32.374858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:32.391201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-72998302-4f04-426e-9cee-502e2f50a266 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1276 microversion: 2.1 time: 0.219574 Aug 04 04:37:32.392397 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1609/3234] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:32 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:32.411200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:32.412497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:32.421081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:32.430914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:32.437376 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-25e8eba1-727e-440f-a0f6-4a95328b1a26 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1676 microversion: 2.1 time: 0.461484 Aug 04 04:37:32.437983 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1626/3235] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:31 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1676 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:32.439392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:32.440253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:32.440821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:32.932511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2501727-a7a3-4a80-bfed-4a4fe6ac8e8b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19191ddd30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:32.997322 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2501727-a7a3-4a80-bfed-4a4fe6ac8e8b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.069043 Aug 04 04:37:33.010523 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1627/3236] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:32 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:33.038283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:33.039286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:33.066934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:33.068003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:33.071701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:33.073751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:33.344561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:33.365490 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63d1d28b-9011-48ee-b8d8-d344f319e9c7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.966995 Aug 04 04:37:33.369952 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1610/3237] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:32 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:33.418428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:33.420208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:33.442715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:33.443428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:33.446575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:33.450177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:33.658058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:33.679969 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c92d0f10-2aa5-4931-aa36-c1ced74c7caf tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1282 microversion: 2.1 time: 0.267974 Aug 04 04:37:33.687096 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1611/3238] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:33 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:33.708624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:33.709318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:33.725130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:33.730076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:33.730324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:33.733951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:33.734437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:34.004265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:34.017509 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4fdbfb56-7e4d-4679-9f5c-e2b09a9594e8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 1.004405 Aug 04 04:37:34.038630 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1628/3239] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:33 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:34.055361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbd484e5-6b5e-4b12-8fc0-1fab9b983ab6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919dded30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:34.125519 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fbd484e5-6b5e-4b12-8fc0-1fab9b983ab6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.085118 Aug 04 04:37:34.128000 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1629/3240] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:34 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:34.277578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:34.292382 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78487718-3932-4e17-ba8b-12100a44e9b3 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1676 microversion: 2.1 time: 0.602059 Aug 04 04:37:34.310869 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1612/3241] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:33 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1676 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:34.387373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:34.388395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:34.402501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:34.405861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:34.407109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:34.408787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:34.713963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:34.714600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:34.729870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:34.730553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:34.737151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:34.737830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:34.910162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:34.926397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ee1ce03-0ebc-4938-8e01-1561241e3cce tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1282 microversion: 2.1 time: 0.217104 Aug 04 04:37:34.928241 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1613/3242] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:34 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:35.054469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:35.056879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:35.075478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:35.079600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:35.080716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:35.081389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:35.419599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:35.439607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0dfe2ebc-6003-4f99-a538-ce1b2a68bc50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 1.056635 Aug 04 04:37:35.442653 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1630/3243] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:34 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:35.463453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c325e7b2-edaa-490f-a420-57e88a2308de tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19239a5040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:35.467965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:35.477471 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-937fe4f5-b6ea-4f0b-87df-345c4060ccaa tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.431367 Aug 04 04:37:35.480729 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1614/3244] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:35 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:35.498154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:35.500062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:35.517764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:35.518683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:35.519411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:35.519974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:35.536175 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c325e7b2-edaa-490f-a420-57e88a2308de tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.091918 Aug 04 04:37:35.537026 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1631/3245] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:35 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:35.824394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-58e0b504-cbd1-4051-8050-0bc11442fb46 req-ae15a1f0-9720-4a18-b24d-8b28d2839615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af37cd4-f81e-4645-a5e0-b12e2eead3c5", "name": "network-vif-deleted", "tag": "bd16609f-d365-469b-b246-f3c89eb94b2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:35.848096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-58e0b504-cbd1-4051-8050-0bc11442fb46 req-ae15a1f0-9720-4a18-b24d-8b28d2839615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:35.849029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-58e0b504-cbd1-4051-8050-0bc11442fb46 req-ae15a1f0-9720-4a18-b24d-8b28d2839615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:35.884155 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-58e0b504-cbd1-4051-8050-0bc11442fb46 req-ae15a1f0-9720-4a18-b24d-8b28d2839615 service nova] Creating event network-vif-deleted:bd16609f-d365-469b-b246-f3c89eb94b2a for instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 on n-h1-851337-5 Aug 04 04:37:35.916860 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-58e0b504-cbd1-4051-8050-0bc11442fb46 req-ae15a1f0-9720-4a18-b24d-8b28d2839615 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096217 Aug 04 04:37:35.917488 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1632/3246] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:37:35.967828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:35.968601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:35.984190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:35.987372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:35.991785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:35.992415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:35.993446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51068c4cce544e38ad1b23996efdec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85353a54064c4117bfedd41efcde07db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:36.002733 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ab81472-5eee-4f08-b9c3-8be46b37ba99 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 200 len: 1609 microversion: 2.1 time: 0.519348 Aug 04 04:37:36.012524 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1615/3247] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:35 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 1609 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:36.084039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:36.086167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:36.100858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.108022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:36.109245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.109920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:36.135293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] HTTP exception thrown: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Request method failure captured: Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 HTTP/1.1 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60tdgfF82No2cr_T6d64q1fVyW7B9cLm6HYcbatltbDWSPQDbngkI2jJwPQxhM6DKp3XSuY71tF4M030j5HV9vtgxiC9jdkwwRvj2l3M03JpDxcjpiQSZGgWJ3B9DwhGIs_KpM5sfxjR5P60CoQ2ti2F97AKSc2bYNSIpe31AKw-MdY Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 3b830d9d8e7a41bba8030bc549484aa2 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b830d9d8e7a41bba8030bc549484aa2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 3b830d9d8e7a41bba8030bc549484aa2 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TaggedBootDevicesTest_v242-689444458-project Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 68ad7b2e7ed14adba4edddd770e0da5d Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TaggedBootDevicesTest_v242-689444458-project Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'cba46ac9-dd58-4f8e-990f-e3f3c8325b73'} Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:36.137511 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Returning 404 to user: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:36.142324 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bfe654df-ea1f-44a8-9e53-7365a310e665 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 404 len: 111 microversion: 2.42 time: 0.062402 Aug 04 04:37:36.147009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1616/3248] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:37:36 2022] DELETE /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:37:36.154939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:36.154939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] [instance: cba46ac9-dd58-4f8e-990f-e3f3c8325b73] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:36.170525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.171246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:36.172191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.172791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:36.184603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:36.193201 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1282 microversion: 2.1 time: 0.244288 Aug 04 04:37:36.198828 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1633/3249] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:35 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1282 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:36.199962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:36.200921 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d3147bbd-b8f2-46c6-8748-a8c5320ceb35 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001208 Aug 04 04:37:36.204705 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1634/3250] 10.222.0.69 () {56 vars in 886 bytes} [Thu Aug 4 04:37:36 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 04:37:36.225616 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] HTTP exception thrown: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Request method failure captured: Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 HTTP/1.1 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60tdgfF82No2cr_T6d64q1fVyW7B9cLm6HYcbatltbDWSPQDbngkI2jJwPQxhM6DKp3XSuY71tF4M030j5HV9vtgxiC9jdkwwRvj2l3M03JpDxcjpiQSZGgWJ3B9DwhGIs_KpM5sfxjR5P60CoQ2ti2F97AKSc2bYNSIpe31AKw-MdY Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 3b830d9d8e7a41bba8030bc549484aa2 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b830d9d8e7a41bba8030bc549484aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b830d9d8e7a41bba8030bc549484aa2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 3b830d9d8e7a41bba8030bc549484aa2 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-689444458 Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TaggedBootDevicesTest_v242-689444458-project Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 68ad7b2e7ed14adba4edddd770e0da5d Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TaggedBootDevicesTest_v242-689444458-project Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'cba46ac9-dd58-4f8e-990f-e3f3c8325b73'} Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.227902 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. Aug 04 04:37:36.233009 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:36.236077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] Returning 404 to user: Instance cba46ac9-dd58-4f8e-990f-e3f3c8325b73 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:36.248531 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00daf86d-fc23-4be0-935c-15416386fd00 tempest-TaggedBootDevicesTest_v242-689444458 tempest-TaggedBootDevicesTest_v242-689444458-project] 10.222.0.69 "GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73" status: 404 len: 111 microversion: 2.42 time: 0.087780 Aug 04 04:37:36.250278 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1617/3251] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:37:36 2022] GET /compute/v2.1/servers/cba46ac9-dd58-4f8e-990f-e3f3c8325b73 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:37:36.462282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:36.462908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:36.481643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.482028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:36.482872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.483413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:36.505581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:36.508617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:36.541116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.543434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:36.546406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:36.551238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:37.317562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:37.331562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:37.340232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fde42157-f40e-40be-9443-d929ac678f45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.881850 Aug 04 04:37:37.342538 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1e7a001-8922-4062-8652-f954e2f0f013 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.844027 Aug 04 04:37:37.355389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1635/3252] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:36 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:37.373518 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1618/3253] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:36 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:37.381710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:37.387118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f84fd29-5afc-4fa0-a518-6fc906210028 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923a75430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:37.392624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] [instance: 5af37cd4-f81e-4645-a5e0-b12e2eead3c5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:37.413580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:37.416800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:37.417917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:37.419481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:37.458914 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] HTTP exception thrown: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 could not be found. Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Request method failure captured: Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 HTTP/1.1 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60podco1f1NQ0KFnlgq8TCri7jZxUHHhpInTe6jkNOHea4c7wAydUcrbpODtgrywLF0DQaMyYkEcCulE5qEI-M3fqkd0qZhdMyEZOgxzVoyjw67KLhJi1VRrANM6iMnVdxQdPEcc687SbyWJ3FnKHeoMk0guuJgomB9rSnjVgUsvuuI Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85353a54064c4117bfedd41efcde07db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85353a54064c4117bfedd41efcde07db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85353a54064c4117bfedd41efcde07db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 85353a54064c4117bfedd41efcde07db Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-325245739 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d51068c4cce544e38ad1b23996efdec3 Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-325245739-project Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 could not be found. Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5af37cd4-f81e-4645-a5e0-b12e2eead3c5'} Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 could not be found. Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 could not be found. Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:37:37.462937 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:37.467977 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:37:37.467977 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:37:37.467977 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:37:37.467977 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:37:37.467977 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:37:37.467977 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 could not be found. Aug 04 04:37:37.467977 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:37:37.471589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Returning 404 to user: Instance 5af37cd4-f81e-4645-a5e0-b12e2eead3c5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:37:37.476562 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b849321a-35d1-4143-8763-7063785370f2 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5" status: 404 len: 111 microversion: 2.1 time: 0.098315 Aug 04 04:37:37.489355 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f84fd29-5afc-4fa0-a518-6fc906210028 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.131763 Aug 04 04:37:37.489945 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1636/3254] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:37 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:37.497214 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1619/3255] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:37 2022] GET /compute/v2.1/servers/5af37cd4-f81e-4645-a5e0-b12e2eead3c5 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:37:37.510621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b8042ff7-ce0d-42d5-9c33-de20caafef45 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] Calling method '.version_select at 0x7f191a1871f0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:37.513240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:37.522491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:37.558757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:37.559267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:37.560058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:37.570555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:37.589898 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b8042ff7-ce0d-42d5-9c33-de20caafef45 tempest-ServerActionsTestJSON-325245739 tempest-ServerActionsTestJSON-325245739-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848170105" status: 202 len: 0 microversion: 2.1 time: 0.089848 Aug 04 04:37:37.590596 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1620/3256] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:37:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848170105 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:37:37.925750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7da7b81b-2f63-4ba4-a169-42c8d7abad80 req-16007b66-b378-40ea-b9bb-fcb208213923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed652d-4352-4709-9f35-cd6dad67ba0d", "name": "network-vif-plugged", "status": "completed", "tag": "c418aa72-3ee1-4a69-9a47-4b46b90fd296"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:37.959486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7da7b81b-2f63-4ba4-a169-42c8d7abad80 req-16007b66-b378-40ea-b9bb-fcb208213923 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:37.960011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7da7b81b-2f63-4ba4-a169-42c8d7abad80 req-16007b66-b378-40ea-b9bb-fcb208213923 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:38.002009 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7da7b81b-2f63-4ba4-a169-42c8d7abad80 req-16007b66-b378-40ea-b9bb-fcb208213923 service nova] Creating event network-vif-plugged:c418aa72-3ee1-4a69-9a47-4b46b90fd296 for instance 11ed652d-4352-4709-9f35-cd6dad67ba0d on n-h2-851337-5 Aug 04 04:37:38.013173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7da7b81b-2f63-4ba4-a169-42c8d7abad80 req-16007b66-b378-40ea-b9bb-fcb208213923 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096235 Aug 04 04:37:38.021533 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1621/3257] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 04:37:38.053364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:38.112651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:38.300344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:38.308524 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96be02cb-e406-4431-8c71-44554831c5ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1324 microversion: 2.1 time: 0.809880 Aug 04 04:37:38.312522 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1637/3258] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:37 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1324 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:38.369114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:38.369771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:38.381666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:38.383318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:38.400450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:38.402639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:38.403966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:38.404304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:38.405278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:38.406297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:38.406913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:38.407551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:38.508720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:39.217534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:39.230251 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9936ee6c-5b03-4a83-b4e4-c93498e5fee4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.853100 Aug 04 04:37:39.238910 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1638/3259] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:38 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:39.251715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04c3a2cf-c6fe-4e0c-ba60-a7e5c3853ad5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f192392c4c0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:39.339542 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04c3a2cf-c6fe-4e0c-ba60-a7e5c3853ad5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.098980 Aug 04 04:37:39.340878 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1639/3260] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:39 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:39.357248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1371d18c-b3f4-4a07-b4cb-489d2cde0543 req-01a1c0c4-4179-4bae-a31c-8a912199fc46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3de710-5209-441d-9424-5044bef0ae84", "tag": "694dfd19-31c8-499b-a93d-afc2496ca776"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:39.385210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1371d18c-b3f4-4a07-b4cb-489d2cde0543 req-01a1c0c4-4179-4bae-a31c-8a912199fc46 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:39.385669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1371d18c-b3f4-4a07-b4cb-489d2cde0543 req-01a1c0c4-4179-4bae-a31c-8a912199fc46 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:39.403603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:39.418431 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d317b15-ad6d-4fee-b88a-5df857845a5f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 1.053806 Aug 04 04:37:39.425287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1371d18c-b3f4-4a07-b4cb-489d2cde0543 req-01a1c0c4-4179-4bae-a31c-8a912199fc46 service nova] Creating event network-changed:694dfd19-31c8-499b-a93d-afc2496ca776 for instance 0f3de710-5209-441d-9424-5044bef0ae84 on n-h1-851337-5 Aug 04 04:37:39.430343 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1622/3261] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:38 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:39.452771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:39.453890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1371d18c-b3f4-4a07-b4cb-489d2cde0543 req-01a1c0c4-4179-4bae-a31c-8a912199fc46 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110501 Aug 04 04:37:39.456334 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1640/3262] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:39.464072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:39.481556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:39.482162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:39.484388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:39.484997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:40.276098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:40.277202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:40.316064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:40.318593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:40.322778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:40.323839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:40.728087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:40.743259 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aec7ee35-a49b-4e14-9619-c4a84e689387 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1324 microversion: 2.1 time: 1.306991 Aug 04 04:37:40.764978 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1623/3263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:39 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1324 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:40.788769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0c093611-abfe-4c22-96cd-93fde2835b51 req-8cc6b167-0a76-4616-b014-a912c8a1b8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda976a3-dfdf-4c91-a785-81aac0a7913f", "name": "network-vif-plugged", "status": "completed", "tag": "2dda9179-29ad-44b0-bd9f-92fb9a9d2563"}, {"server_uuid": "d8f5387a-d6f5-4d08-ae53-1f79fa44685b", "name": "network-vif-plugged", "status": "completed", "tag": "753afc88-8bfd-4e25-af8d-551951c7820c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:40.824436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0c093611-abfe-4c22-96cd-93fde2835b51 req-8cc6b167-0a76-4616-b014-a912c8a1b8f2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:40.825140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0c093611-abfe-4c22-96cd-93fde2835b51 req-8cc6b167-0a76-4616-b014-a912c8a1b8f2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:40.870146 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0c093611-abfe-4c22-96cd-93fde2835b51 req-8cc6b167-0a76-4616-b014-a912c8a1b8f2 service nova] Creating event network-vif-plugged:2dda9179-29ad-44b0-bd9f-92fb9a9d2563 for instance fda976a3-dfdf-4c91-a785-81aac0a7913f on n-h2-851337-5 Aug 04 04:37:40.871057 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0c093611-abfe-4c22-96cd-93fde2835b51 req-8cc6b167-0a76-4616-b014-a912c8a1b8f2 service nova] Creating event network-vif-plugged:753afc88-8bfd-4e25-af8d-551951c7820c for instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b on n-h1-851337-5 Aug 04 04:37:40.900776 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0c093611-abfe-4c22-96cd-93fde2835b51 req-8cc6b167-0a76-4616-b014-a912c8a1b8f2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.133754 Aug 04 04:37:40.909684 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1624/3264] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:40.915389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82a68e72-a7be-4cca-8006-b1e2e90b74a2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a7594c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:41.023330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-82a68e72-a7be-4cca-8006-b1e2e90b74a2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.111923 Aug 04 04:37:41.024591 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1625/3265] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:40 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:41.031207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:41.036309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:41.057346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:41.058164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:41.059877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:41.067689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:41.126907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:41.155344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b76555bf-bec2-4f8c-9438-b5b5a44bfe3b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 0.884874 Aug 04 04:37:41.156286 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1641/3266] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:40 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:41.308881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:41.312744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:41.318778 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b1d3f950-4360-4ab0-b41e-a1ab33c8ac50 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 0.292772 Aug 04 04:37:41.322916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1626/3267] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:41 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:41.626171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c8185856-8896-4c1a-85a1-f18e225d7c3b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:41.627280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8185856-8896-4c1a-85a1-f18e225d7c3b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:41.642868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8185856-8896-4c1a-85a1-f18e225d7c3b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:41.643998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8185856-8896-4c1a-85a1-f18e225d7c3b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:41.645009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8185856-8896-4c1a-85a1-f18e225d7c3b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:41.646742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8185856-8896-4c1a-85a1-f18e225d7c3b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:41.735003 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c8185856-8896-4c1a-85a1-f18e225d7c3b tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/ips" status: 200 len: 150 microversion: 2.1 time: 0.115212 Aug 04 04:37:41.760156 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1642/3268] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:37:41 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:41.766438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:41.767258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:41.786101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:41.788858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:41.791620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:41.793152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:42.038425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-58100bb2-8770-4859-9c89-836f14d1c773 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19191d34c0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:42.053232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:42.084021 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-199a1b31-0fcd-47c0-abe1-b6f0e649c498 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1324 microversion: 2.1 time: 0.321751 Aug 04 04:37:42.087054 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1627/3269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:41 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1324 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:42.130224 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-58100bb2-8770-4859-9c89-836f14d1c773 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.095621 Aug 04 04:37:42.138482 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1643/3270] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:42 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:42.177540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:42.178504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:42.190156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:42.190618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:42.194556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:42.195035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:42.344357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:42.344839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:42.352698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:42.358439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:42.359876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:42.360482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:43.405729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:43.416318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f965869c-54c2-4d54-b059-5fd55d23d247 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 1.243251 Aug 04 04:37:43.419508 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1628/3271] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:42 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:43.464210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-372fc145-5284-49ac-8d13-40f03ad8b495 req-2e750708-8a79-494c-b76d-22e488203cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e70cb6-8312-4eb4-933a-240f846ea50a", "name": "network-vif-plugged", "status": "completed", "tag": "59ee67cf-4dcc-4d74-b918-71a71aee26e2"}, {"server_uuid": "81cdc530-bc0f-42fa-bb6f-c8bf225761c6", "name": "network-vif-plugged", "status": "completed", "tag": "63e89099-0992-4a96-b81b-77db4750634e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:43.501062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-372fc145-5284-49ac-8d13-40f03ad8b495 req-2e750708-8a79-494c-b76d-22e488203cff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:43.502827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-372fc145-5284-49ac-8d13-40f03ad8b495 req-2e750708-8a79-494c-b76d-22e488203cff service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:43.517203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:43.536234 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f52cec20-0df0-48a4-be99-024346b7a4a7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 1.195795 Aug 04 04:37:43.540726 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1644/3272] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:42 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:43.558769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:43.562802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:43.583341 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-372fc145-5284-49ac-8d13-40f03ad8b495 req-2e750708-8a79-494c-b76d-22e488203cff service nova] Creating event network-vif-plugged:59ee67cf-4dcc-4d74-b918-71a71aee26e2 for instance 23e70cb6-8312-4eb4-933a-240f846ea50a on n-h2-851337-5 Aug 04 04:37:43.585960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:43.590589 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-372fc145-5284-49ac-8d13-40f03ad8b495 req-2e750708-8a79-494c-b76d-22e488203cff service nova] Creating event network-vif-plugged:63e89099-0992-4a96-b81b-77db4750634e for instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 on n-h2-851337-5 Aug 04 04:37:43.590911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:43.599172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:43.601893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:43.616520 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-372fc145-5284-49ac-8d13-40f03ad8b495 req-2e750708-8a79-494c-b76d-22e488203cff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.181291 Aug 04 04:37:43.622344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:43.629304 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1629/3273] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:43.657492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee22c17c-1aad-41f6-9d94-d364aeb26e37 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a33b550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:43.789410 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee22c17c-1aad-41f6-9d94-d364aeb26e37 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.154441 Aug 04 04:37:43.790095 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1630/3274] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:43 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:44.311738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:44.333715 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-235ef327-274e-4e35-99a5-4485258cb5bb tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1324 microversion: 2.1 time: 0.784394 Aug 04 04:37:44.335905 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1645/3275] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:43 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1324 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:44.459299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:44.463956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:44.531356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:44.538111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:44.544346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:44.545889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:44.565693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:44.569332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:44.606798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:44.609871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:44.616992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:44.619946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:45.538825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:45.566082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8648131b-d373-4ade-a732-e64ff91877cd tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1321 microversion: 2.1 time: 1.125390 Aug 04 04:37:45.568220 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1631/3276] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:44 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1321 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:45.590115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d650f87-6605-440e-afce-c8f3390848dd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923a3f700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:45.728456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:45.742467 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c6e4cfac-2961-4d1d-8a63-11944e3be0f8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1317 microversion: 2.1 time: 1.183893 Aug 04 04:37:45.743700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d650f87-6605-440e-afce-c8f3390848dd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.172968 Aug 04 04:37:45.745899 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1632/3277] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:45 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:45.759054 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1646/3278] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:44 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1317 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:45.768064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:45.770442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:45.831189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:45.831765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:45.835324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:45.835779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:46.000499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4dca4c2a-a306-4865-907c-04a72054d141 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24306ccb-c8e0-4faa-91af-fd9ceeda2b90"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:46.004201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4dca4c2a-a306-4865-907c-04a72054d141 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:46.024090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dca4c2a-a306-4865-907c-04a72054d141 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:46.026207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dca4c2a-a306-4865-907c-04a72054d141 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:46.030585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dca4c2a-a306-4865-907c-04a72054d141 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:46.031687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4dca4c2a-a306-4865-907c-04a72054d141 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:46.376107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:46.386389 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a0cb477-1fd0-42c0-9e96-ecad75e39935 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1324 microversion: 2.1 time: 0.636388 Aug 04 04:37:46.391175 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1633/3279] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:45 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1324 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:46.590929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:46.596389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:46.618395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:46.618872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:46.623273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:46.626071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:46.640066 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4dca4c2a-a306-4865-907c-04a72054d141 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "POST /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644060 Aug 04 04:37:46.655778 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1647/3280] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:37:45 2022] POST /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:37:46.761573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f6b8002-3f01-4267-b88f-fb680d4b7092 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923967a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:46.848742 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f6b8002-3f01-4267-b88f-fb680d4b7092 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.092175 Aug 04 04:37:46.849335 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1648/3281] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:46 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:46.888305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:46.889086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:46.938004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:46.945473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:46.960445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:46.960928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:47.776480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:47.787770 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dcf9902d-82cb-45bc-816d-b1665f34ed6f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1512 microversion: 2.1 time: 1.201025 Aug 04 04:37:47.804274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1634/3282] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:46 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1512 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:47.815112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:47.816577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:47.834298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:47.835035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:47.836014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:47.836619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:48.000610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:48.009064 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57b7d088-a1cd-4ae3-8c84-9ef339b09f38 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1467 microversion: 2.1 time: 1.141290 Aug 04 04:37:48.028889 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1649/3283] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:46 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1467 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:48.033912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:48.052263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:48.064791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:48.065250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:48.076131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:48.077245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.014066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:49.019866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:49.023930 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8061fb44-19f7-4153-b502-1c7d1c071536 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1511 microversion: 2.1 time: 0.993835 Aug 04 04:37:49.038018 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-25af6421-dfa4-4b52-b892-6d546d5fc8df tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1324 microversion: 2.1 time: 1.232258 Aug 04 04:37:49.047093 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1650/3284] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:48 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1511 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:49.055263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e85fd344-6cfe-48dc-87de-332a2cbf3c54 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923a75d30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:49.061603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1635/3285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:47 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1324 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:49.082741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:49.088238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:49.112414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.115345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.119261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.125180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.149817 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e85fd344-6cfe-48dc-87de-332a2cbf3c54 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.101279 Aug 04 04:37:49.150410 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1651/3286] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:49 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:49.159168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e2476e5f-065e-4410-a778-2eb76beb9165 req-f6a689b8-d1aa-4d78-be87-c5429b990e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3de710-5209-441d-9424-5044bef0ae84", "name": "network-vif-plugged", "status": "completed", "tag": "694dfd19-31c8-499b-a93d-afc2496ca776"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:49.181961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e2476e5f-065e-4410-a778-2eb76beb9165 req-f6a689b8-d1aa-4d78-be87-c5429b990e30 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.183482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e2476e5f-065e-4410-a778-2eb76beb9165 req-f6a689b8-d1aa-4d78-be87-c5429b990e30 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.205453 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e2476e5f-065e-4410-a778-2eb76beb9165 req-f6a689b8-d1aa-4d78-be87-c5429b990e30 service nova] Creating event network-vif-plugged:694dfd19-31c8-499b-a93d-afc2496ca776 for instance 0f3de710-5209-441d-9424-5044bef0ae84 on n-h1-851337-5 Aug 04 04:37:49.216580 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e2476e5f-065e-4410-a778-2eb76beb9165 req-f6a689b8-d1aa-4d78-be87-c5429b990e30 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064951 Aug 04 04:37:49.218852 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1652/3287] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:49.230316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:49.231076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:49.250189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.250900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.251926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.252527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.731950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:49.746266 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8dde69e-de5a-4737-9959-4823393689ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 200 len: 1468 microversion: 2.1 time: 0.682347 Aug 04 04:37:49.753483 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1636/3288] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:49 2022] GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 1468 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:49.773758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f785de6-0e3e-4df1-a779-c8245482ade5 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1681601191"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:49.780488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:49.785029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f785de6-0e3e-4df1-a779-c8245482ade5 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:49.792958 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-911f4eba-1821-4be4-880a-2282c0c6889c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 200 len: 1510 microversion: 2.1 time: 0.572803 Aug 04 04:37:49.807608 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1653/3289] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:49 2022] GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 1510 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:49.817635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f785de6-0e3e-4df1-a779-c8245482ade5 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.825117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f785de6-0e3e-4df1-a779-c8245482ade5 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.826136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f785de6-0e3e-4df1-a779-c8245482ade5 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.826717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f785de6-0e3e-4df1-a779-c8245482ade5 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.827592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:49.841852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:49.846070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:37:49.877363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.883605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:49.885433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:49.886052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:50.104866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:37:50.351462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:50.370946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:50.371428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:50.445541 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f785de6-0e3e-4df1-a779-c8245482ade5 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "POST /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d/action" status: 202 len: 0 microversion: 2.1 time: 0.672743 Aug 04 04:37:50.452973 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1637/3290] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:37:49 2022] POST /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:37:50.477998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:50.480049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:50.501038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:50.506354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:50.507488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:50.508140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:51.209883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9615ca8f-a49d-4f56-a7b9-3fe3ae7cfae4 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.392797 Aug 04 04:37:51.211530 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1654/3291] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Aug 4 04:37:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:51.236847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2929bcfa-c46a-44df-8943-7384f381e089 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19191c5280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:51.276996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:51.285871 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d4533ea9-a705-47b6-93b8-a5776e385990 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1324 microversion: 2.1 time: 0.830036 Aug 04 04:37:51.293954 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1638/3292] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:50 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1324 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:51.333622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191abe3670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:51.357865 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2929bcfa-c46a-44df-8943-7384f381e089 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.144618 Aug 04 04:37:51.361669 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1655/3293] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:51 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:51.381093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:51.410304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:51.412786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-568051955', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:37:51.437706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:51.439263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:51.440962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:51.445298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:51.608293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.304425 Aug 04 04:37:51.617027 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1639/3294] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:51 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:51.802541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:37:51.911731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:51.912749 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001371 Aug 04 04:37:51.913455 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1640/3295] 10.222.0.69 () {56 vars in 886 bytes} [Thu Aug 4 04:37:51 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 04 04:37:51.921107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:51.922899 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001967 Aug 04 04:37:51.930396 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1641/3296] 10.222.0.69 () {54 vars in 1035 bytes} [Thu Aug 4 04:37:51 2022] GET /compute/v2/ => generated 379 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 04 04:37:51.932542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:51.934408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002291 Aug 04 04:37:51.935643 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1642/3297] 10.222.0.69 () {54 vars in 1041 bytes} [Thu Aug 4 04:37:51 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:51.947510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:51.948727 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b03482c4-af6e-48a4-82fb-f1e84924dd40 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001581 Aug 04 04:37:51.958595 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1643/3298] 10.222.0.69 () {56 vars in 886 bytes} [Thu Aug 4 04:37:51 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 04:37:52.053395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:52.079064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:52.079531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:52.318108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:52.318932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:52.336868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:52.338928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:52.342736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:52.343381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:53.010121 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ee8ad9e6-cb9f-4909-b606-f726e8415fdc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-568051955" status: 200 len: 1514 microversion: 2.1 time: 1.647256 Aug 04 04:37:53.010709 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1656/3299] 10.222.0.69 () {58 vars in 1261 bytes} [Thu Aug 4 04:37:51 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-568051955 => generated 1514 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:53.023986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d07e44af-c507-42dc-abad-043ae54e8c05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a495040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:53.049611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:53.068460 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-42c0408f-00a7-42ad-bdfe-1ad2fc4bf440 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 200 len: 1520 microversion: 2.1 time: 0.753786 Aug 04 04:37:53.069869 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1644/3300] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:37:52 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 1520 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:37:53.085806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-375bd22a-178d-42f2-829e-55429df33a66 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a33b700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:53.242308 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d07e44af-c507-42dc-abad-043ae54e8c05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1414 microversion: 2.1 time: 0.230338 Aug 04 04:37:53.243233 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1657/3301] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:53 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1414 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:53.248606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:53.259556 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-375bd22a-178d-42f2-829e-55429df33a66 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.186323 Aug 04 04:37:53.261781 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1645/3302] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:53 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:53.264549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:53.270562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.57"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:37:53.271942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:37:53.276559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:37:53.279751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:53.286357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:53.287546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:53.288256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:53.294528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:53.295032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:53.295868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:53.299199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:53.362182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Acquired lock "refresh_cache-85365ce3-281d-44b9-ab6b-85cf98bacc8e" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:37:53.463234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:37:53.622866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:37:53.646940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:53.647498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:54.773252 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd8ee188-3245-40ee-a6f4-e7b4c432408d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 1.528131 Aug 04 04:37:54.773893 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1658/3303] 10.222.0.69 () {58 vars in 1173 bytes} [Thu Aug 4 04:37:53 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:37:54.800621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab1ad9d2-4c93-46ea-93d6-402c3585d311 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19239a5700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:56.210745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Building network info cache for instance {{(pid=119343) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:37:58.085077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Updating instance_info_cache with network_info: [{"id": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5", "address": "fa:16:3e:ff:a2:24", "network": {"id": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1816346120-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b79d1753e8c422fbe63de69fc20cdbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4b9028c5-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119343) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:37:58.102665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Releasing lock "refresh_cache-85365ce3-281d-44b9-ab6b-85cf98bacc8e" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:37:58.107604 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7118ba9-35f2-48ae-87a5-d4ac1f0a80ff tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action" status: 202 len: 0 microversion: 2.1 time: 4.841247 Aug 04 04:37:58.110734 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1646/3304] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:37:53 2022] POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action => generated 0 bytes in 4848 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:37:58.125498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37e28e4f-4165-4691-aae2-30b63644c8b2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19204fe3a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:00.305646 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab1ad9d2-4c93-46ea-93d6-402c3585d311 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1423 microversion: 2.1 time: 5.516903 Aug 04 04:38:00.307013 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1659/3305] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:54 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1423 bytes in 5533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:00.329966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:00.336063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37e28e4f-4165-4691-aae2-30b63644c8b2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 2.221678 Aug 04 04:38:00.347691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:00.349344 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1647/3306] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:37:58 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:00.362013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.compute.servers [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Removing options 'limit' from query {{(pid=119342) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 04:38:00.371608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:00.383509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=56 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:00.385308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:00.385765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:00.396706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:00.397096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:00.460339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-827ee8c5-2169-4256-a18c-b06b835686bb tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Action: 'create', calling method: .version_select at 0x7f191a190f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-232291102"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:00.547572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:00.575726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:00.578426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:01.273704 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6dede5b5-4d87-4d3e-9bca-6bf88bf60eae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.963849 Aug 04 04:38:01.291213 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1660/3307] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 04:38:00 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:01.296589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9f92523d-2ae2-4997-8d03-1904cea6ef67 req-549d84ec-064e-479b-908f-176d75ab0221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85365ce3-281d-44b9-ab6b-85cf98bacc8e", "tag": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:01.298611 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-827ee8c5-2169-4256-a18c-b06b835686bb tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.947416 Aug 04 04:38:01.301705 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1648/3308] 10.222.0.69 () {60 vars in 1155 bytes} [Thu Aug 4 04:38:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 952 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 04:38:01.316075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ae2b0303-cb21-43b8-8ef0-bd783774e413 req-1dcb2a9f-cb59-4b60-bba4-824b0bb0442f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed652d-4352-4709-9f35-cd6dad67ba0d", "name": "network-vif-plugged", "status": "completed", "tag": "c418aa72-3ee1-4a69-9a47-4b46b90fd296"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:01.328033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9f92523d-2ae2-4997-8d03-1904cea6ef67 req-549d84ec-064e-479b-908f-176d75ab0221 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:01.330365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9f92523d-2ae2-4997-8d03-1904cea6ef67 req-549d84ec-064e-479b-908f-176d75ab0221 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:01.356960 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9f92523d-2ae2-4997-8d03-1904cea6ef67 req-549d84ec-064e-479b-908f-176d75ab0221 service nova] Creating event network-changed:4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5 for instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e on n-h1-851337-5 Aug 04 04:38:01.365706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ae2b0303-cb21-43b8-8ef0-bd783774e413 req-1dcb2a9f-cb59-4b60-bba4-824b0bb0442f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:01.366235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ae2b0303-cb21-43b8-8ef0-bd783774e413 req-1dcb2a9f-cb59-4b60-bba4-824b0bb0442f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:01.393046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9f92523d-2ae2-4997-8d03-1904cea6ef67 req-549d84ec-064e-479b-908f-176d75ab0221 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100117 Aug 04 04:38:01.400192 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1661/3309] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:01.422369 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ae2b0303-cb21-43b8-8ef0-bd783774e413 req-1dcb2a9f-cb59-4b60-bba4-824b0bb0442f service nova] Creating event network-vif-plugged:c418aa72-3ee1-4a69-9a47-4b46b90fd296 for instance 11ed652d-4352-4709-9f35-cd6dad67ba0d on n-h2-851337-5 Aug 04 04:38:01.455818 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ae2b0303-cb21-43b8-8ef0-bd783774e413 req-1dcb2a9f-cb59-4b60-bba4-824b0bb0442f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152275 Aug 04 04:38:01.460489 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1649/3310] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:01.480467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'action', calling method: .version_select at 0x7f19214ca670>, body: {"addFloatingIp": {"address": "172.25.2.57"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:01.483369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:01.499382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:01.500342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:01.506968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:01.507919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:01.518246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ba8c051-1729-4b4c-92b6-5b2096ba44ec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a4d75e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:01.732920 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ba8c051-1729-4b4c-92b6-5b2096ba44ec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 200 len: 1423 microversion: 2.1 time: 0.262271 Aug 04 04:38:01.757535 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1650/3311] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:01 2022] GET /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 1423 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:01.780359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:01.788028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Acquired lock "refresh_cache-0f3de710-5209-441d-9424-5044bef0ae84" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:38:01.806232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:01.808918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:01.838601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:01.839511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:01.841111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:01.841906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:02.106153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:02.279210 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31a8b308-2f15-4f09-9d7c-edbc2d1955fc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.518638 Aug 04 04:38:02.279815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1651/3312] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:38:01 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:02.304600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20424d86-5955-4cac-ac80-c75d149e803a tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f191a88de50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:02.458401 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20424d86-5955-4cac-ac80-c75d149e803a tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 200 len: 344 microversion: 2.1 time: 0.177520 Aug 04 04:38:02.459930 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1652/3313] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:02 2022] GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:02.464757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f12df4ae-ed2a-4cff-8efb-da67e4207f49 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a33b8b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:02.658321 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f12df4ae-ed2a-4cff-8efb-da67e4207f49 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.196988 Aug 04 04:38:02.659088 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1653/3314] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:02 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:02.669434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93eb1c1d-48d1-47a6-b44e-74a9c67ed3e8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a88de50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:04.104650 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93eb1c1d-48d1-47a6-b44e-74a9c67ed3e8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 204 len: 0 microversion: 2.1 time: 1.442747 Aug 04 04:38:04.106268 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1654/3315] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:02 2022] DELETE /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 0 bytes in 1445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:38:04.111242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:04.133034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:04.135500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.servers [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Removing options 'limit' from query {{(pid=119343) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 04:38:04.137680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:04.158365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:04.187742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:04.188625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:04.200180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:04.201023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:04.287288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:04.345789 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5de47be-0f9f-4f4a-89b2-5afa6e816d1f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.237607 Aug 04 04:38:04.347850 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1655/3316] 10.222.0.69 () {58 vars in 1150 bytes} [Thu Aug 4 04:38:04 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:04.352617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-755f1659-b83b-4a4c-b827-8b79fc81c9c4 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f191a9f9b80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:04.499292 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-755f1659-b83b-4a4c-b827-8b79fc81c9c4 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 200 len: 345 microversion: 2.1 time: 0.150073 Aug 04 04:38:04.500051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1656/3317] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:04 2022] GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:04.505376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3e0a0445-7ddf-44ee-b3a1-96b3b24ae19d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a187700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:04.591956 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3e0a0445-7ddf-44ee-b3a1-96b3b24ae19d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.090715 Aug 04 04:38:04.593683 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1657/3318] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:04 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:04.605848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:04.609534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:04.624597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:04.627778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:04.628771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:04.629344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:04.636684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:04.708351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:38:04.947996 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-605269aa-510c-4feb-a986-4536a7b75e50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 204 len: 0 microversion: 2.1 time: 0.349591 Aug 04 04:38:04.951022 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1658/3319] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:04 2022] DELETE /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:38:04.970682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:04.994491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:04.998884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:05.022830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:05.023577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:05.027775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:05.029086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:05.075679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:05.134773 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2a9263d0-cdd9-4513-b67a-39251e10d21c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.174858 Aug 04 04:38:05.135892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1659/3320] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:38:04 2022] GET /compute/v2.1/servers => generated 1010 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:05.142106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83513875-ad04-411c-bec7-ad8418ffe8f7 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Action: 'create', calling method: .version_select at 0x7f191a187430>, body: {"snapshot": {"volume_id": "3b8e3936-e00d-479a-b609-d7fc6c9ce55c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-911994275"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:05.537609 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83513875-ad04-411c-bec7-ad8418ffe8f7 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.400493 Aug 04 04:38:05.543683 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1660/3321] 10.222.0.69 () {60 vars in 1162 bytes} [Thu Aug 4 04:38:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:05.554640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7cbdf49e-5c28-4712-b7e1-07c1fb7c62d8 req-64721894-9d32-4470-8324-73a04632a179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda976a3-dfdf-4c91-a785-81aac0a7913f", "name": "network-vif-unplugged", "status": "completed", "tag": "2dda9179-29ad-44b0-bd9f-92fb9a9d2563"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:05.610060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7cbdf49e-5c28-4712-b7e1-07c1fb7c62d8 req-64721894-9d32-4470-8324-73a04632a179 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:05.614441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7cbdf49e-5c28-4712-b7e1-07c1fb7c62d8 req-64721894-9d32-4470-8324-73a04632a179 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:05.690676 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7cbdf49e-5c28-4712-b7e1-07c1fb7c62d8 req-64721894-9d32-4470-8324-73a04632a179 service nova] Creating event network-vif-unplugged:2dda9179-29ad-44b0-bd9f-92fb9a9d2563 for instance fda976a3-dfdf-4c91-a785-81aac0a7913f on n-h2-851337-5 Aug 04 04:38:05.705211 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7cbdf49e-5c28-4712-b7e1-07c1fb7c62d8 req-64721894-9d32-4470-8324-73a04632a179 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164505 Aug 04 04:38:05.708422 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1661/3322] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:05.723682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-417608636", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:05.828703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] validate_networks() for [('c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:38:08.037424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:38:08.038775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:38:08.039542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:38:08.040214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:38:08.040926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:38:08.092150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:08.095481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:08.108044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:08.110208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:08.226128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:38:08.244167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for user bb9ca81b2ec24bd1b139bb817a47bb29 and project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:38:08.321251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:38:08.334867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:38:08.519414 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70e4c08d-c51d-4ae8-a9c3-a6c216ea42f3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.801236 Aug 04 04:38:08.528177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1662/3323] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:38:08.540346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:08.549344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:08.551464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:08.585694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:08.586473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:08.587498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:08.588111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:08.794661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:08.901955 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b582f617-e954-4cf8-a949-6b26952bbc56 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.371502 Aug 04 04:38:08.917385 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1663/3324] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:38:08 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:08.931005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5f517f1a-f558-4647-851e-db7d19b74745 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f191a941820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:09.109979 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5f517f1a-f558-4647-851e-db7d19b74745 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3" status: 200 len: 287 microversion: 2.1 time: 0.191332 Aug 04 04:38:09.112835 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1664/3325] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:08 2022] GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3 => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:09.118427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba2c4bb0-fa73-4076-b98b-3b4f9ec38502 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a884c10>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:09.208494 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba2c4bb0-fa73-4076-b98b-3b4f9ec38502 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.094150 Aug 04 04:38:09.209430 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1665/3326] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:09 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:09.232946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:09.234227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:09.248846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:09.252648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:09.254417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:09.258362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:09.426709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lazy-loading 'services' on Instance uuid 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:38:09.604180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-870e0bac-88fb-4bfc-a859-44560f1ee17c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments/24306ccb-c8e0-4faa-91af-fd9ceeda2b90" status: 202 len: 0 microversion: 2.1 time: 0.376379 Aug 04 04:38:09.604952 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1666/3327] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:38:09 2022] DELETE /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments/24306ccb-c8e0-4faa-91af-fd9ceeda2b90 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:09.627442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:09.636604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:09.658226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:09.660457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:09.661505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:09.667692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:09.996441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:10.033422 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a72f65d4-908e-49a9-a8ea-4adf5204934a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1203 microversion: 2.1 time: 0.419385 Aug 04 04:38:10.040831 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1667/3328] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:09 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1203 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:10.065462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:10.087339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:10.095738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.servers [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Removing options 'limit' from query {{(pid=119343) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 04:38:10.097418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:10.107980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:10.108673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:10.109669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:10.110313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:10.206064 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.network.neutron [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] re-assign floating IP 172.25.2.57 from instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e Aug 04 04:38:10.246462 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b09ab7d-ed1a-4778-9c26-1f60bf85285e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.202637 Aug 04 04:38:10.257703 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1668/3329] 10.222.0.69 () {58 vars in 1140 bytes} [Thu Aug 4 04:38:10 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:10.274414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a448e6da-0f4c-4cf7-877f-09af6cc642c5 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f191a1908b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:10.343595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Building network info cache for instance {{(pid=119342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:38:10.396936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a448e6da-0f4c-4cf7-877f-09af6cc642c5 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.137702 Aug 04 04:38:10.398180 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1669/3330] 10.222.0.69 () {58 vars in 1140 bytes} [Thu Aug 4 04:38:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:10.416598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-95714d1c-ed0b-46ab-a0c1-4dbaf20dde7d req-883bbe5c-8dbb-4119-b827-a7c36c9d5615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85365ce3-281d-44b9-ab6b-85cf98bacc8e", "tag": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:10.442048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:10.457256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-95714d1c-ed0b-46ab-a0c1-4dbaf20dde7d req-883bbe5c-8dbb-4119-b827-a7c36c9d5615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:10.458288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-95714d1c-ed0b-46ab-a0c1-4dbaf20dde7d req-883bbe5c-8dbb-4119-b827-a7c36c9d5615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:10.474322 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-95714d1c-ed0b-46ab-a0c1-4dbaf20dde7d req-883bbe5c-8dbb-4119-b827-a7c36c9d5615 service nova] Creating event network-changed:4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5 for instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e on n-h1-851337-5 Aug 04 04:38:10.480050 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-95714d1c-ed0b-46ab-a0c1-4dbaf20dde7d req-883bbe5c-8dbb-4119-b827-a7c36c9d5615 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080441 Aug 04 04:38:10.481258 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1670/3331] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:10.487717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bcfaadf6-cd9b-4177-a77b-dcc6bc7b1660 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:10.491388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bcfaadf6-cd9b-4177-a77b-dcc6bc7b1660 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:10.500524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcfaadf6-cd9b-4177-a77b-dcc6bc7b1660 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:10.501316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcfaadf6-cd9b-4177-a77b-dcc6bc7b1660 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:10.502409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcfaadf6-cd9b-4177-a77b-dcc6bc7b1660 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:10.503635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcfaadf6-cd9b-4177-a77b-dcc6bc7b1660 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:10.544091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:10.575467 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bcfaadf6-cd9b-4177-a77b-dcc6bc7b1660 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092636 Aug 04 04:38:10.576918 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1671/3332] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:38:10 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:10.582782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cca0c2ec-143c-41ad-a8b2-4316dfdc2b97 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a2dae50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:10.653962 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cca0c2ec-143c-41ad-a8b2-4316dfdc2b97 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.075322 Aug 04 04:38:10.654706 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1672/3333] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:10 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:10.695032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:10.715506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:10.723204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-568051955', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:10.744184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:10.757538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:10.765491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:10.765970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:11.098688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:11.233994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e24e01cc-8cd1-44a8-8402-119783e6eeea tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-568051955" status: 200 len: 345 microversion: 2.1 time: 0.564270 Aug 04 04:38:11.245041 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1673/3334] 10.222.0.69 () {58 vars in 1240 bytes} [Thu Aug 4 04:38:10 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-568051955 => generated 345 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:11.249892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a691b2bb-95a6-4c9e-adcd-e9729dc84fba tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f191a82f550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:11.357477 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a691b2bb-95a6-4c9e-adcd-e9729dc84fba tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3" status: 200 len: 287 microversion: 2.1 time: 0.111226 Aug 04 04:38:11.358281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1674/3335] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:11 2022] GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:11.365811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:11.370022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:11.390051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:11.390505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:11.410149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:11.410658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:11.496235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=7 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:11.843613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:11.866513 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06dd9e81-5b47-44d3-8820-4f430c8cce4c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1265 microversion: 2.1 time: 0.506830 Aug 04 04:38:11.887404 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1675/3336] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:11 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1265 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:11.925755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8de286de-7ce2-420b-afb3-ba2548ff8700 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:11.956794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8de286de-7ce2-420b-afb3-ba2548ff8700 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:11.957449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8de286de-7ce2-420b-afb3-ba2548ff8700 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:12.062754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8de286de-7ce2-420b-afb3-ba2548ff8700 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:38:12.296308 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8de286de-7ce2-420b-afb3-ba2548ff8700 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "POST /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b/action" status: 202 len: 0 microversion: 2.1 time: 0.407314 Aug 04 04:38:12.309308 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1676/3337] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:11 2022] POST /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:12.332898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c29c8ba-52de-40bc-bdef-17f59be9c841 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f191a19b820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:12.501478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c29c8ba-52de-40bc-bdef-17f59be9c841 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3" status: 202 len: 0 microversion: 2.1 time: 0.190534 Aug 04 04:38:12.503240 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1677/3338] 10.222.0.69 () {58 vars in 1254 bytes} [Thu Aug 4 04:38:12 2022] DELETE /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:12.508472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5e504a08-c15a-42af-a4a8-8180e1d81ac6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:12.513697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5e504a08-c15a-42af-a4a8-8180e1d81ac6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:12.523251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e504a08-c15a-42af-a4a8-8180e1d81ac6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:12.532202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e504a08-c15a-42af-a4a8-8180e1d81ac6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:12.533469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e504a08-c15a-42af-a4a8-8180e1d81ac6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:12.534530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e504a08-c15a-42af-a4a8-8180e1d81ac6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:12.595004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5e504a08-c15a-42af-a4a8-8180e1d81ac6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090457 Aug 04 04:38:12.597048 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1678/3339] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:38:12 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:12.604993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63581be1-9087-432c-9045-fd2354e576cc tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191af69820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:12.736454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63581be1-9087-432c-9045-fd2354e576cc tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.138055 Aug 04 04:38:12.746149 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1679/3340] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:12 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:12.756624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:12.763966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:12.781853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:12.782554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:12.784362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:12.787187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:13.431682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:13.435383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:13.455430 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6b2f9f6-f4b9-4e9e-a33b-694ff698b108 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1521 microversion: 2.1 time: 0.707320 Aug 04 04:38:13.461344 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1680/3341] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:12 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1521 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:13.487248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1463f5cf-6f06-42a3-bcf1-d37d13a71db4 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f192005a280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:13.587918 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1463f5cf-6f06-42a3-bcf1-d37d13a71db4 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3" status: 200 len: 286 microversion: 2.1 time: 0.123230 Aug 04 04:38:13.588545 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1681/3342] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:13 2022] GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3 => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:13.600679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:13.609297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:13.640930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:13.641794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:13.647573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Updating instance_info_cache with network_info: [{"id": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5", "address": "fa:16:3e:ff:a2:24", "network": {"id": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1816346120-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b79d1753e8c422fbe63de69fc20cdbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4b9028c5-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:38:13.648419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:13.649618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:13.672808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:13.681003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Building network info cache for instance {{(pid=119342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:38:14.016898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:14.033810 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-de72cd6b-8779-4090-a186-6cb656759386 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1265 microversion: 2.1 time: 0.434438 Aug 04 04:38:14.040934 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1682/3343] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:13 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1265 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:14.045805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-39f599cf-cd71-49bb-b6bb-cf314653f1f1 req-0fe9210a-08db-46a8-a9b7-666d952a7729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3de710-5209-441d-9424-5044bef0ae84", "tag": "694dfd19-31c8-499b-a93d-afc2496ca776"}, {"server_uuid": "fda976a3-dfdf-4c91-a785-81aac0a7913f", "name": "network-vif-deleted", "tag": "2dda9179-29ad-44b0-bd9f-92fb9a9d2563"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:14.111611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-39f599cf-cd71-49bb-b6bb-cf314653f1f1 req-0fe9210a-08db-46a8-a9b7-666d952a7729 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:14.117453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-39f599cf-cd71-49bb-b6bb-cf314653f1f1 req-0fe9210a-08db-46a8-a9b7-666d952a7729 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:14.178463 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-39f599cf-cd71-49bb-b6bb-cf314653f1f1 req-0fe9210a-08db-46a8-a9b7-666d952a7729 service nova] Creating event network-changed:694dfd19-31c8-499b-a93d-afc2496ca776 for instance 0f3de710-5209-441d-9424-5044bef0ae84 on n-h1-851337-5 Aug 04 04:38:14.182743 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-39f599cf-cd71-49bb-b6bb-cf314653f1f1 req-0fe9210a-08db-46a8-a9b7-666d952a7729 service nova] Creating event network-vif-deleted:2dda9179-29ad-44b0-bd9f-92fb9a9d2563 for instance fda976a3-dfdf-4c91-a785-81aac0a7913f on n-h2-851337-5 Aug 04 04:38:14.217949 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-39f599cf-cd71-49bb-b6bb-cf314653f1f1 req-0fe9210a-08db-46a8-a9b7-666d952a7729 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.174948 Aug 04 04:38:14.222008 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1683/3344] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:14.238403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-489d8806-f7f2-4f5f-9e52-17f857ddad31 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:14.251485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-489d8806-f7f2-4f5f-9e52-17f857ddad31 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:14.273597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-489d8806-f7f2-4f5f-9e52-17f857ddad31 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:14.274536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-489d8806-f7f2-4f5f-9e52-17f857ddad31 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:14.275641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-489d8806-f7f2-4f5f-9e52-17f857ddad31 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:14.276317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-489d8806-f7f2-4f5f-9e52-17f857ddad31 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:14.339752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-489d8806-f7f2-4f5f-9e52-17f857ddad31 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115355 Aug 04 04:38:14.347399 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1684/3345] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:38:14 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:14.355905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad1c5e3b-8be4-4517-9a0f-5e2ceca7dae3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919ac8550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:14.474374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad1c5e3b-8be4-4517-9a0f-5e2ceca7dae3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.125656 Aug 04 04:38:14.476228 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1685/3346] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:14 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:14.495902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:14.497857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:14.513747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:14.514469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:14.515560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:14.516252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:15.529037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:15.538867 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cfc3e794-fba0-41ff-ab43-5fdbcf8e5352 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1521 microversion: 2.1 time: 1.061000 Aug 04 04:38:15.542360 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1686/3347] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:14 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1521 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:15.558804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a62aa652-b148-475a-8ab7-67f2fe62d71e tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1919adf940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:15.660039 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a62aa652-b148-475a-8ab7-67f2fe62d71e tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3" status: 200 len: 286 microversion: 2.1 time: 0.114778 Aug 04 04:38:15.661258 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1687/3348] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:15 2022] GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3 => generated 286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:15.666284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:15.667995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:15.688362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:15.696987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:15.698537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:15.700201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:16.775765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:16.785375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87a6053d-12d7-4d04-aa40-611498c4b4c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1307 microversion: 2.1 time: 1.122776 Aug 04 04:38:16.802439 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1688/3349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:15 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1307 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:16.802439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-983db7b8-c998-4fc7-8851-24f2c8accafb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:16.805254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-983db7b8-c998-4fc7-8851-24f2c8accafb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:16.823232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-983db7b8-c998-4fc7-8851-24f2c8accafb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:16.823693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-983db7b8-c998-4fc7-8851-24f2c8accafb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:16.827335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-983db7b8-c998-4fc7-8851-24f2c8accafb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:16.827937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-983db7b8-c998-4fc7-8851-24f2c8accafb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:16.875542 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-983db7b8-c998-4fc7-8851-24f2c8accafb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083755 Aug 04 04:38:16.882123 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1689/3350] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:38:16 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:16.891232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3a509516-e161-4d72-88f7-f1b740c5552d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19239e04c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:16.941041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3a509516-e161-4d72-88f7-f1b740c5552d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.057714 Aug 04 04:38:16.942474 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1690/3351] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:16 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:16.947865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:16.948679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:16.955199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:16.956515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:16.957463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:16.958080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:17.713868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:17.727568 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad01b675-bc14-4d99-b9ec-5a8203434927 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1521 microversion: 2.1 time: 0.783404 Aug 04 04:38:17.728537 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1691/3352] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:16 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1521 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:17.744495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-503ef733-e927-43aa-8136-c1d2b0b2471d tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1919ac8040>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:17.829525 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-503ef733-e927-43aa-8136-c1d2b0b2471d tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] HTTP exception thrown: Snapshot 9a194af4-0268-4324-bf35-0b031577e9a3 could not be found. Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-503ef733-e927-43aa-8136-c1d2b0b2471d tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Request method failure captured: Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3 HTTP/1.1 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi600jJ4CeS1xQdrsxRBKMzyJVyW1EC02dFr2cYqWOvsENvv91CZMxC8y8Z-d7iHq09Eor0k9DakxglZLfx_13c1cVwnnXp4-00_qLUcZSIDHuU1pFTMsqgJB_lQcKYuqRUlFR5ksoBZxL84j9rqT4Id3N2gyYkivqRehrb48po6h4lrg Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5980120bc3842daa240b904a1398216"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5980120bc3842daa240b904a1398216", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 8ae50f0cdbf541e98c782a47453975ee Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: exception: Snapshot 9a194af4-0268-4324-bf35-0b031577e9a3 could not be found. Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '9a194af4-0268-4324-bf35-0b031577e9a3'} Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9a194af4-0268-4324-bf35-0b031577e9a3 could not be found. (HTTP 404) (Request-ID: req-6b1f2c02-1e14-4780-b589-515b14cf9487) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:17.844673 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9a194af4-0268-4324-bf35-0b031577e9a3 could not be found. Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9a194af4-0268-4324-bf35-0b031577e9a3 could not be found. Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9a194af4-0268-4324-bf35-0b031577e9a3 could not be found. Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-503ef733-e927-43aa-8136-c1d2b0b2471d tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Returning 404 to user: Snapshot 9a194af4-0268-4324-bf35-0b031577e9a3 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-503ef733-e927-43aa-8136-c1d2b0b2471d tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3" status: 404 len: 111 microversion: 2.1 time: 0.109879 Aug 04 04:38:17.851854 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1692/3353] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:17 2022] GET /compute/v2.1/os-snapshots/9a194af4-0268-4324-bf35-0b031577e9a3 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:17.856537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b323572e-4ec5-4b31-af1d-d8f705f437ca req-93770499-fdda-443d-a40b-612c02c80d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd663b6c-197e-408d-9802-63aaf5ae81d3", "tag": "a4110d95-03c7-4491-8d2d-f3e661efd858"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:17.884259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Updating instance_info_cache with network_info: [{"id": "694dfd19-31c8-499b-a93d-afc2496ca776", "address": "fa:16:3e:a5:a2:26", "network": {"id": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1816346120-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b79d1753e8c422fbe63de69fc20cdbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap694dfd19-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:38:17.897621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Releasing lock "refresh_cache-0f3de710-5209-441d-9424-5044bef0ae84" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:38:17.900560 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b02d32d-cb1e-468f-a89f-e55cb801b984 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84/action" status: 202 len: 0 microversion: 2.1 time: 16.491887 Aug 04 04:38:17.905858 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1662/3354] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:01 2022] POST /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84/action => generated 0 bytes in 16505 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:38:17.912273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:17.913163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:17.918975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b323572e-4ec5-4b31-af1d-d8f705f437ca req-93770499-fdda-443d-a40b-612c02c80d46 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:17.923575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b323572e-4ec5-4b31-af1d-d8f705f437ca req-93770499-fdda-443d-a40b-612c02c80d46 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:17.926171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:17.928736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:17.933877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:17.934700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:17.941175 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b323572e-4ec5-4b31-af1d-d8f705f437ca req-93770499-fdda-443d-a40b-612c02c80d46 service nova] Creating event network-changed:a4110d95-03c7-4491-8d2d-f3e661efd858 for instance cd663b6c-197e-408d-9802-63aaf5ae81d3 on n-h2-851337-5 Aug 04 04:38:17.956999 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b323572e-4ec5-4b31-af1d-d8f705f437ca req-93770499-fdda-443d-a40b-612c02c80d46 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095190 Aug 04 04:38:17.962251 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1693/3355] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:17.974499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55ea6331-4b7d-4950-8dc1-8b8e50018c57 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1919ac8af0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:18.091200 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55ea6331-4b7d-4950-8dc1-8b8e50018c57 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 202 len: 0 microversion: 2.1 time: 0.125546 Aug 04 04:38:18.092924 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1694/3356] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:38:17 2022] DELETE /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:18.099490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a6a7e6ef-669e-44df-aed9-628205f15e75 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:18.112343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a6a7e6ef-669e-44df-aed9-628205f15e75 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:18.146451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ef-669e-44df-aed9-628205f15e75 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:18.147130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ef-669e-44df-aed9-628205f15e75 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:18.151218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ef-669e-44df-aed9-628205f15e75 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:18.152023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ef-669e-44df-aed9-628205f15e75 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:18.241021 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a6a7e6ef-669e-44df-aed9-628205f15e75 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146723 Aug 04 04:38:18.242288 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1695/3357] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:38:18 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:18.247654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.57"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:18.294419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:18.640892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:18.652218 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a8977d7-09e7-42c0-8d10-38c62c69cf56 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1307 microversion: 2.1 time: 0.744958 Aug 04 04:38:18.652826 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1663/3358] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:17 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1307 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:18.664103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2eb00c50-363d-4221-8a04-2eadf63880c9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1918fee430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:18.704278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:18.711532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:18.711998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:18.717427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:18.718021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:18.767795 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2eb00c50-363d-4221-8a04-2eadf63880c9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.111240 Aug 04 04:38:18.769879 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1664/3359] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:18 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:18.775154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1536244-77f0-4d2c-b54b-261804a050eb tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1918f2faf0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:18.907772 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1536244-77f0-4d2c-b54b-261804a050eb tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 200 len: 344 microversion: 2.1 time: 0.136585 Aug 04 04:38:18.908416 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1665/3360] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:18 2022] GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:18.914386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:18.915728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:18.944502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:18.947155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:18.948311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:18.951366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:20.471134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:20.499713 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4ecb55f-b0e3-4af0-83a5-fabf203ae28d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1521 microversion: 2.1 time: 1.589412 Aug 04 04:38:20.500320 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1666/3361] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:18 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1521 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:20.508730 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] HTTP exception thrown: Floating IP 172.25.2.57 is not associated with instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e. Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Request method failure captured: Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action HTTP/1.1 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 48 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60zmwE1JDvD1S97zxYTcYoL9B4I2v8Nitfe4-cWbYJpLr_zff93cMNHH2nXYDZ1kqNnv1NF-xHf9ltS_n_bP6msGRkFeoHm4AlNU3HJNj2llk3wFfkpboeT6FqFQtY3jQIwVaraTJeb17Jg9JXnvVJAply-e7lVTcmpqtCWghlVcg8Q Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b79d1753e8c422fbe63de69fc20cdbf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: ba1f58af29924fddadf25abcc5255606 Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: {"removeFloatingIp": {"address": "172.25.2.57"}} Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: exception: Floating IP 172.25.2.57 is not associated with instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e. Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '85365ce3-281d-44b9-ab6b-85cf98bacc8e', 'body': {'removeFloatingIp': {'address': '172.25.2.57'}}} Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.57 is not associated with instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e. Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.57 is not associated with instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e. Aug 04 04:38:20.511537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:20.517628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Returning 409 to user: Floating IP 172.25.2.57 is not associated with instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:20.520187 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-07c9467a-fbb3-47e2-b770-8e9430118a90 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action" status: 409 len: 145 microversion: 2.1 time: 2.276579 Aug 04 04:38:20.521553 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1696/3362] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:18 2022] POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action => generated 145 bytes in 2278 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:38:20.531716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:20.532864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:20.534230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eb6afc7d-c7a7-47a4-8779-7c2854064fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:20.547200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eb6afc7d-c7a7-47a4-8779-7c2854064fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:20.556933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:20.557950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:20.559905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:20.561969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:20.568648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb6afc7d-c7a7-47a4-8779-7c2854064fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:20.569104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb6afc7d-c7a7-47a4-8779-7c2854064fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:20.569902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb6afc7d-c7a7-47a4-8779-7c2854064fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:20.570344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eb6afc7d-c7a7-47a4-8779-7c2854064fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:20.657930 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eb6afc7d-c7a7-47a4-8779-7c2854064fa5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150313 Aug 04 04:38:20.666031 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1667/3363] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:38:20 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:20.672351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-960cbbd8-6659-492e-a9af-4da452878bd4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1918ee5ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:20.756276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-960cbbd8-6659-492e-a9af-4da452878bd4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1455 microversion: 2.1 time: 0.087872 Aug 04 04:38:20.757648 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1668/3364] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:20 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:20.766053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b9f1d71-5f37-4871-b86b-a77745a0603f tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1918ed2670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:20.864887 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b9f1d71-5f37-4871-b86b-a77745a0603f tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 200 len: 344 microversion: 2.1 time: 0.105385 Aug 04 04:38:20.865472 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1669/3365] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:20 2022] GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:20.876369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'action', calling method: .version_select at 0x7f19214cac10>, body: {"removeFloatingIp": {"address": "172.25.2.57"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:20.882595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:21.135951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:21.160082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ebd911a-8027-4d63-9de0-7176f5d3331a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1307 microversion: 2.1 time: 0.636953 Aug 04 04:38:21.160792 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1697/3366] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:20 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1307 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:21.235997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1547544013", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9a4d4793-c950-428f-aa7a-1e56b07e9780"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:21.246217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:21.255454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:21.258129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:21.277519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:21.279679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:21.338238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] validate_networks() for [('9a4d4793-c950-428f-aa7a-1e56b07e9780', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:38:22.094313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Acquired lock "refresh_cache-0f3de710-5209-441d-9424-5044bef0ae84" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:38:23.295390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:38:23.295823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:38:23.296234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:38:23.296842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:38:23.297424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:38:23.321280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:23.321729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:23.322980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:23.323201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:23.367158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Getting quotas for project e36b3017b2e34c3a9a7dae6a38d35570. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:38:23.374742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Getting quotas for user 35b64415d3434d0483b0836706bab3a6 and project e36b3017b2e34c3a9a7dae6a38d35570. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:38:23.395594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:38:23.399998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:38:23.497144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba0543a1-9a8a-41b5-96c4-48d4d1abee18 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.334789 Aug 04 04:38:23.498746 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1698/3367] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:38:23.533756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:23.534381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:23.560497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:23.560941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:23.561832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:23.562269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:23.995028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:24.009044 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c86a7952-dce6-439a-96ba-44b69cbdd883 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1498 microversion: 2.1 time: 0.478603 Aug 04 04:38:24.012516 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1699/3368] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:23 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1498 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:24.022803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-53ccfb4e-01ca-4b1e-a1ea-d4e2df8ac7a6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:24.025569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-53ccfb4e-01ca-4b1e-a1ea-d4e2df8ac7a6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:24.032392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ccfb4e-01ca-4b1e-a1ea-d4e2df8ac7a6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:24.034071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ccfb4e-01ca-4b1e-a1ea-d4e2df8ac7a6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:24.036491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ccfb4e-01ca-4b1e-a1ea-d4e2df8ac7a6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:24.037225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ccfb4e-01ca-4b1e-a1ea-d4e2df8ac7a6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:24.090427 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-53ccfb4e-01ca-4b1e-a1ea-d4e2df8ac7a6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076706 Aug 04 04:38:24.098326 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1700/3369] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:38:24 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:38:24.099366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87904ac5-c89c-4ece-8869-83bbd4b115fb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a853700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:24.163170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Building network info cache for instance {{(pid=119342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:38:24.214074 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87904ac5-c89c-4ece-8869-83bbd4b115fb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1464 microversion: 2.1 time: 0.120948 Aug 04 04:38:24.223127 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1701/3370] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:24 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1464 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:24.232088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c75372c2-8f1e-466d-b3a8-6e5fa0785896 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1919ab4d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:24.308787 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-c75372c2-8f1e-466d-b3a8-6e5fa0785896 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] HTTP exception thrown: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c75372c2-8f1e-466d-b3a8-6e5fa0785896 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Request method failure captured: Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c HTTP/1.1 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi600jJ4CeS1xQdrsxRBKMzyJVyW1EC02dFr2cYqWOvsENvv91CZMxC8y8Z-d7iHq09Eor0k9DakxglZLfx_13c1cVwnnXp4-00_qLUcZSIDHuU1pFTMsqgJB_lQcKYuqRUlFR5ksoBZxL84j9rqT4Id3N2gyYkivqRehrb48po6h4lrg Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5980120bc3842daa240b904a1398216"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5980120bc3842daa240b904a1398216", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 8ae50f0cdbf541e98c782a47453975ee Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: exception: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '3b8e3936-e00d-479a-b609-d7fc6c9ce55c'} Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. (HTTP 404) (Request-ID: req-7c71365b-415a-4a5d-831c-48584895ca46) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:24.311760 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:24.316561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:24.320729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c75372c2-8f1e-466d-b3a8-6e5fa0785896 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Returning 404 to user: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:24.322232 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c75372c2-8f1e-466d-b3a8-6e5fa0785896 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 404 len: 109 microversion: 2.1 time: 0.095406 Aug 04 04:38:24.323391 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1702/3371] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:24 2022] GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:24.343271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:24.344186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:24.356242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:24.357072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:24.362679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:24.363362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.233576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:25.247376 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24779b98-e731-4f6a-8eaa-313e489aa658 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1307 microversion: 2.1 time: 0.922579 Aug 04 04:38:25.248840 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1703/3372] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:24 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1307 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:25.266836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:25.268306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:25.276217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.277041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.277944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.278491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.375632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:25.393480 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-86464071-08c9-4909-8148-95593659d3c1 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1277 microversion: 2.1 time: 0.142349 Aug 04 04:38:25.398372 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1704/3373] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:25 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:25.409481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:25.414819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:25.415836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:25.421157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:25.423558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.424470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.426219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.426915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.457898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:25.494094 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63cb359d-384f-49f2-9757-1660a7db6c1c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.094319 Aug 04 04:38:25.495310 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1705/3374] 10.222.0.69 () {58 vars in 1154 bytes} [Thu Aug 4 04:38:25 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:25.511928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-642cba94-ac78-495d-ada0-666e749a927e req-d3c8111a-ab05-463f-ba73-6e588e2b4d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3de710-5209-441d-9424-5044bef0ae84", "tag": "694dfd19-31c8-499b-a93d-afc2496ca776"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:25.550301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-642cba94-ac78-495d-ada0-666e749a927e req-d3c8111a-ab05-463f-ba73-6e588e2b4d60 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.551547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-642cba94-ac78-495d-ada0-666e749a927e req-d3c8111a-ab05-463f-ba73-6e588e2b4d60 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.569831 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-642cba94-ac78-495d-ada0-666e749a927e req-d3c8111a-ab05-463f-ba73-6e588e2b4d60 service nova] Creating event network-changed:694dfd19-31c8-499b-a93d-afc2496ca776 for instance 0f3de710-5209-441d-9424-5044bef0ae84 on n-h1-851337-5 Aug 04 04:38:25.577572 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-642cba94-ac78-495d-ada0-666e749a927e req-d3c8111a-ab05-463f-ba73-6e588e2b4d60 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080792 Aug 04 04:38:25.579164 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1706/3375] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:25.589516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a580c34-72f7-47e1-b4ff-f2d570d2f87b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a7594c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:25.656642 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a580c34-72f7-47e1-b4ff-f2d570d2f87b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 200 len: 1464 microversion: 2.1 time: 0.074838 Aug 04 04:38:25.657568 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1707/3376] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:25 2022] GET /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 1464 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:25.670855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:25.671862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:25.682193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.682643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.686704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.690572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.722685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:38:25.764186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:25.858384 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f343ff9e-9ec4-4035-bf24-679e723eda47 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 204 len: 0 microversion: 2.1 time: 0.196954 Aug 04 04:38:25.861024 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1708/3377] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:25 2022] DELETE /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:38:25.870948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b173407f-e6ae-4073-a7ab-4491b891bf36 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1919ac8820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:25.924428 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b173407f-e6ae-4073-a7ab-4491b891bf36 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] HTTP exception thrown: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b173407f-e6ae-4073-a7ab-4491b891bf36 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Request method failure captured: Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c HTTP/1.1 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi600jJ4CeS1xQdrsxRBKMzyJVyW1EC02dFr2cYqWOvsENvv91CZMxC8y8Z-d7iHq09Eor0k9DakxglZLfx_13c1cVwnnXp4-00_qLUcZSIDHuU1pFTMsqgJB_lQcKYuqRUlFR5ksoBZxL84j9rqT4Id3N2gyYkivqRehrb48po6h4lrg Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5980120bc3842daa240b904a1398216"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5980120bc3842daa240b904a1398216", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 8ae50f0cdbf541e98c782a47453975ee Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: exception: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '3b8e3936-e00d-479a-b609-d7fc6c9ce55c'} Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. (HTTP 404) (Request-ID: req-f434d5a4-3f53-4d3c-a3e0-f21413f32843) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:25.927045 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:25.931510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:25.936600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b173407f-e6ae-4073-a7ab-4491b891bf36 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Returning 404 to user: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:25.936600 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b173407f-e6ae-4073-a7ab-4491b891bf36 tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 404 len: 109 microversion: 2.1 time: 0.072856 Aug 04 04:38:25.936600 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1709/3378] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:38:25 2022] DELETE /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:25.945127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3a277bd-95b6-45ec-b0c1-801f81d7b3ef tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:25.961709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Updating instance_info_cache with network_info: [{"id": "694dfd19-31c8-499b-a93d-afc2496ca776", "address": "fa:16:3e:a5:a2:26", "network": {"id": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1816346120-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b79d1753e8c422fbe63de69fc20cdbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap694dfd19-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:38:25.964742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3a277bd-95b6-45ec-b0c1-801f81d7b3ef tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:25.965319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3a277bd-95b6-45ec-b0c1-801f81d7b3ef tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:25.981283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Releasing lock "refresh_cache-0f3de710-5209-441d-9424-5044bef0ae84" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:38:25.982352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c091dcb0-b1a5-4b0b-bab8-f6a5ae82df99 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84/action" status: 202 len: 0 microversion: 2.1 time: 5.115415 Aug 04 04:38:25.983029 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1670/3379] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:20 2022] POST /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84/action => generated 0 bytes in 5117 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:38:25.993732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-196a0380-775a-4c28-80fc-6b15c4df07ff req-c90f70c2-5d99-49fb-87eb-25e1355aadc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd663b6c-197e-408d-9802-63aaf5ae81d3", "name": "network-vif-plugged", "status": "completed", "tag": "a4110d95-03c7-4491-8d2d-f3e661efd858"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:26.011460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-196a0380-775a-4c28-80fc-6b15c4df07ff req-c90f70c2-5d99-49fb-87eb-25e1355aadc4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.012237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-196a0380-775a-4c28-80fc-6b15c4df07ff req-c90f70c2-5d99-49fb-87eb-25e1355aadc4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.022193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3a277bd-95b6-45ec-b0c1-801f81d7b3ef tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Going to try to start instance {{(pid=119343) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 04:38:26.027730 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-196a0380-775a-4c28-80fc-6b15c4df07ff req-c90f70c2-5d99-49fb-87eb-25e1355aadc4 service nova] Creating event network-vif-plugged:a4110d95-03c7-4491-8d2d-f3e661efd858 for instance cd663b6c-197e-408d-9802-63aaf5ae81d3 on n-h2-851337-5 Aug 04 04:38:26.042642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-196a0380-775a-4c28-80fc-6b15c4df07ff req-c90f70c2-5d99-49fb-87eb-25e1355aadc4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054364 Aug 04 04:38:26.047677 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1671/3380] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:26.054007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:26.054716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:26.062792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.063525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.064315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.065541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.119246 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3a277bd-95b6-45ec-b0c1-801f81d7b3ef tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "POST /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b/action" status: 202 len: 0 microversion: 2.1 time: 0.180914 Aug 04 04:38:26.122995 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1710/3381] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:25 2022] POST /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:26.126379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:26.127246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:26.137854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.141978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.143213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.143677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.338988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:26.349369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-79c3303e-e216-4a01-aea7-eb83a9a9affa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 200 len: 1468 microversion: 2.1 time: 0.300088 Aug 04 04:38:26.366358 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1672/3382] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:26 2022] GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:26.389987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44f57992-8aac-4c95-928b-6492da113e7c tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Calling method '.version_select at 0x7f1918ee5af0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:26.419205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:26.430105 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c3753444-358f-414f-8dbd-8a6734b8212c tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1681 microversion: 2.1 time: 0.308084 Aug 04 04:38:26.432088 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1711/3383] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:26 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:26.437009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:26.437971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:26.443364 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-44f57992-8aac-4c95-928b-6492da113e7c tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] HTTP exception thrown: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44f57992-8aac-4c95-928b-6492da113e7c tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Request method failure captured: Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c HTTP/1.1 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi600jJ4CeS1xQdrsxRBKMzyJVyW1EC02dFr2cYqWOvsENvv91CZMxC8y8Z-d7iHq09Eor0k9DakxglZLfx_13c1cVwnnXp4-00_qLUcZSIDHuU1pFTMsqgJB_lQcKYuqRUlFR5ksoBZxL84j9rqT4Id3N2gyYkivqRehrb48po6h4lrg Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5980120bc3842daa240b904a1398216"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5980120bc3842daa240b904a1398216"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5980120bc3842daa240b904a1398216", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f5980120bc3842daa240b904a1398216 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-613044893 Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 8ae50f0cdbf541e98c782a47453975ee Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesSnapshotsTestJSON-613044893-project Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: exception: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3b8e3936-e00d-479a-b609-d7fc6c9ce55c'} Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. (HTTP 404) (Request-ID: req-f69a5f55-69f3-4ba5-8501-6d6ce5b3092c) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:26.446142 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. Aug 04 04:38:26.450616 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:26.454841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.454841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.455273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.456217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.457160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44f57992-8aac-4c95-928b-6492da113e7c tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] Returning 404 to user: Volume 3b8e3936-e00d-479a-b609-d7fc6c9ce55c could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:26.460257 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44f57992-8aac-4c95-928b-6492da113e7c tempest-VolumesSnapshotsTestJSON-613044893 tempest-VolumesSnapshotsTestJSON-613044893-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c" status: 404 len: 109 microversion: 2.1 time: 0.091792 Aug 04 04:38:26.464292 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1673/3384] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:26 2022] GET /compute/v2.1/os-volumes/3b8e3936-e00d-479a-b609-d7fc6c9ce55c => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:26.479064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:26.482520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:26.490416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:38:26.511208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.512122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.513093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.515795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.631249 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ed2e3345-86d8-41a6-8454-df5bfb6a77ef tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 204 len: 0 microversion: 2.1 time: 0.193981 Aug 04 04:38:26.632499 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1712/3385] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:26 2022] DELETE /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:38:26.650599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:26.652237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:26.669424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.669878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.671838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.672214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.884754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:26.897546 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f79d4e2c-a8ae-4d84-bbdb-7f935f5e70dc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1507 microversion: 2.1 time: 0.431381 Aug 04 04:38:26.899423 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1674/3386] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:26 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:26.909860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-efd6f8ac-5187-4db0-9975-025333066c56 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-214097302"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:26.916750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-efd6f8ac-5187-4db0-9975-025333066c56 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:26.936696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efd6f8ac-5187-4db0-9975-025333066c56 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.937438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efd6f8ac-5187-4db0-9975-025333066c56 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.938647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efd6f8ac-5187-4db0-9975-025333066c56 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.940312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efd6f8ac-5187-4db0-9975-025333066c56 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:26.966117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:26.974515 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a397410f-accb-4cf7-8cf3-e053a16662c2 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1307 microversion: 2.1 time: 0.339930 Aug 04 04:38:26.976417 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1713/3387] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:26 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1307 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:26.981343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:26.982202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:26.989535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:26.990335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:27.005167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:27.006456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:27.291673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-efd6f8ac-5187-4db0-9975-025333066c56 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "POST /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6/action" status: 202 len: 0 microversion: 2.1 time: 0.388637 Aug 04 04:38:27.292789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:27.293081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1675/3388] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:26 2022] POST /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:38:27.301843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c71d7c4-6ec6-4a3e-9505-6ff8ff51859a tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1317 microversion: 2.1 time: 0.323897 Aug 04 04:38:27.302484 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1714/3389] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:26 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:27.306777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcf9f2b6-d4b0-483d-a0ac-6be5812c4dfa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a4d670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:27.309596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.57"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:27.312049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:27.321870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:27.322394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:27.323540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:27.324044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:27.355287 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcf9f2b6-d4b0-483d-a0ac-6be5812c4dfa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.051881 Aug 04 04:38:27.356544 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1715/3390] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:27 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:27.382272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Acquired lock "refresh_cache-85365ce3-281d-44b9-ab6b-85cf98bacc8e" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:38:27.454786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:27.456587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:27.465634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:27.466475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:27.467566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:27.468717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:27.812723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:27.823556 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f7e75e4-212d-43f7-aeb6-16ee29c90a58 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1681 microversion: 2.1 time: 0.372221 Aug 04 04:38:27.824643 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1716/3391] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:27 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1681 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:38:27.920807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:27.922010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:27.930684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:27.931412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:27.932424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:27.933062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:28.250324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:28.263836 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3a84299a-0f20-48ba-a5b3-173d5fc75f78 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1507 microversion: 2.1 time: 0.347962 Aug 04 04:38:28.264874 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1717/3392] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:27 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:28.269807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:28.270670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:28.278365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:28.279063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:28.280270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:28.280901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:28.597872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:28.606294 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-df444228-ddc8-49d0-8d6d-da3313f1f7ce tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1487 microversion: 2.1 time: 0.340583 Aug 04 04:38:28.623527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1718/3393] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:28 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1487 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:28.636414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f62c151a-252e-4025-bcbb-36befb91d42c req-3c34e7a2-23cf-4732-beb5-93cc9e382b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b144c96-cf55-48ef-b7a7-6f1a28bd4c15", "tag": "2bbb86df-519c-4a2e-9018-c707bad09937"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:28.654441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f62c151a-252e-4025-bcbb-36befb91d42c req-3c34e7a2-23cf-4732-beb5-93cc9e382b0f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:28.654895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f62c151a-252e-4025-bcbb-36befb91d42c req-3c34e7a2-23cf-4732-beb5-93cc9e382b0f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:28.688658 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f62c151a-252e-4025-bcbb-36befb91d42c req-3c34e7a2-23cf-4732-beb5-93cc9e382b0f service nova] Creating event network-changed:2bbb86df-519c-4a2e-9018-c707bad09937 for instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 on n-h1-851337-5 Aug 04 04:38:28.694343 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f62c151a-252e-4025-bcbb-36befb91d42c req-3c34e7a2-23cf-4732-beb5-93cc9e382b0f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067462 Aug 04 04:38:28.695356 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1719/3394] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:28.700593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:28.701400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:28.709182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:28.709815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:28.710981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:28.711580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:29.115136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:29.141082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c0152b38-7f5d-4b05-abab-bf5652a6f8f6 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1317 microversion: 2.1 time: 0.444305 Aug 04 04:38:29.144109 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1720/3395] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:28 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:29.151336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ebb27a85-d1da-4048-93b5-98875a3dbd34 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a81b80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:29.248320 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ebb27a85-d1da-4048-93b5-98875a3dbd34 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.102876 Aug 04 04:38:29.250463 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1721/3396] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:29 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:29.266575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c3c7972a-a8b1-46fd-9a91-d6174af726d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:29.276317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3c7972a-a8b1-46fd-9a91-d6174af726d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:29.277366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c3c7972a-a8b1-46fd-9a91-d6174af726d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:29.312818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c3c7972a-a8b1-46fd-9a91-d6174af726d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:38:29.372579 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c3c7972a-a8b1-46fd-9a91-d6174af726d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3/action" status: 202 len: 0 microversion: 2.1 time: 0.116944 Aug 04 04:38:29.395738 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1722/3397] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:29 2022] POST /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:29.400496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1df4c53b-658a-42f9-974f-322f7ddb64cf req-631e3a0f-d95c-4afa-b96b-6a9f2e96fb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed652d-4352-4709-9f35-cd6dad67ba0d", "name": "network-vif-unplugged", "status": "completed", "tag": "c418aa72-3ee1-4a69-9a47-4b46b90fd296"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:29.421652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Building network info cache for instance {{(pid=119342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:38:29.422844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1df4c53b-658a-42f9-974f-322f7ddb64cf req-631e3a0f-d95c-4afa-b96b-6a9f2e96fb8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:29.423324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1df4c53b-658a-42f9-974f-322f7ddb64cf req-631e3a0f-d95c-4afa-b96b-6a9f2e96fb8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:29.467822 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1df4c53b-658a-42f9-974f-322f7ddb64cf req-631e3a0f-d95c-4afa-b96b-6a9f2e96fb8a service nova] Creating event network-vif-unplugged:c418aa72-3ee1-4a69-9a47-4b46b90fd296 for instance 11ed652d-4352-4709-9f35-cd6dad67ba0d on n-h2-851337-5 Aug 04 04:38:29.479416 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1df4c53b-658a-42f9-974f-322f7ddb64cf req-631e3a0f-d95c-4afa-b96b-6a9f2e96fb8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080035 Aug 04 04:38:29.479416 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1723/3398] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:29.493347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:29.494056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:29.510825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:29.511316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:29.512177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:29.512621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:30.225498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:30.229834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:30.241852 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e7a72eda-89d6-4a6e-bd9d-9ac48d269333 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1681 microversion: 2.1 time: 0.757389 Aug 04 04:38:30.242446 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1724/3399] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:29 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1681 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:30.256519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:30.256519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:30.277466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:30.277966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:30.278792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:30.279252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:31.076623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:31.089320 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff039aa8-4eba-44ed-8864-3a759bd7375e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1507 microversion: 2.1 time: 0.845693 Aug 04 04:38:31.090250 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1725/3400] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:30 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1507 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:31.100655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:31.101887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:31.118724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:31.121413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:31.122889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:31.128500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:31.711643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:31.730151 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2b45e993-0529-43d6-aa5e-44d6e53d7be1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.638397 Aug 04 04:38:31.734923 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1726/3401] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:31 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:31.758409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6c1ce077-eba2-4390-ae4f-7d1724b79bcb req-66377340-3b67-4727-b52f-addc9e02013f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85365ce3-281d-44b9-ab6b-85cf98bacc8e", "tag": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:31.763949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Updating instance_info_cache with network_info: [{"id": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5", "address": "fa:16:3e:ff:a2:24", "network": {"id": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1816346120-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b79d1753e8c422fbe63de69fc20cdbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4b9028c5-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:38:31.784937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6c1ce077-eba2-4390-ae4f-7d1724b79bcb req-66377340-3b67-4727-b52f-addc9e02013f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:31.785626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6c1ce077-eba2-4390-ae4f-7d1724b79bcb req-66377340-3b67-4727-b52f-addc9e02013f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:31.789021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Releasing lock "refresh_cache-85365ce3-281d-44b9-ab6b-85cf98bacc8e" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:38:31.790042 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8c50a50-ff34-4cbe-a728-a5be0673e43b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action" status: 202 len: 0 microversion: 2.1 time: 4.494388 Aug 04 04:38:31.794852 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1676/3402] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:27 2022] POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action => generated 0 bytes in 4501 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:38:31.811829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:31.819686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:31.832874 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6c1ce077-eba2-4390-ae4f-7d1724b79bcb req-66377340-3b67-4727-b52f-addc9e02013f service nova] Creating event network-changed:4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5 for instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e on n-h1-851337-5 Aug 04 04:38:31.844560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:31.846874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:31.848886 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6c1ce077-eba2-4390-ae4f-7d1724b79bcb req-66377340-3b67-4727-b52f-addc9e02013f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108858 Aug 04 04:38:31.853536 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1727/3403] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:31.854269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:31.859819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:31.867638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dfed8c96-f644-452d-9a86-58032acd7628 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a4d820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:32.011349 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dfed8c96-f644-452d-9a86-58032acd7628 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.150712 Aug 04 04:38:32.014121 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1728/3404] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:31 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:32.032873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:32.037026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:32.063856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:32.064744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:32.068489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:32.071724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:32.353329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:32.363628 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e290c765-4096-4eee-9f2f-390e3cba225e tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1614 microversion: 2.1 time: 0.348152 Aug 04 04:38:32.364498 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1729/3405] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:32 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1614 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:32.387976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27394720-600c-4195-97f8-bbdd4e79fee0 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '.version_select at 0x7f1919a81b80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:32.656859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:32.675890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6c46eac-4dee-4fea-8427-88be20ee7801 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1317 microversion: 2.1 time: 0.878836 Aug 04 04:38:32.677000 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1677/3406] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:31 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1317 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:32.698598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b1c505d1-09b0-49ce-9e53-24584e426fc7 req-b18d2dc6-a3e4-406f-9257-4e00ddec08e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3de710-5209-441d-9424-5044bef0ae84", "name": "network-vif-deleted", "tag": "694dfd19-31c8-499b-a93d-afc2496ca776"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:32.710657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b1c505d1-09b0-49ce-9e53-24584e426fc7 req-b18d2dc6-a3e4-406f-9257-4e00ddec08e9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:32.712221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b1c505d1-09b0-49ce-9e53-24584e426fc7 req-b18d2dc6-a3e4-406f-9257-4e00ddec08e9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:32.726821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b1c505d1-09b0-49ce-9e53-24584e426fc7 req-b18d2dc6-a3e4-406f-9257-4e00ddec08e9 service nova] Creating event network-vif-deleted:694dfd19-31c8-499b-a93d-afc2496ca776 for instance 0f3de710-5209-441d-9424-5044bef0ae84 on n-h1-851337-5 Aug 04 04:38:32.733306 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b1c505d1-09b0-49ce-9e53-24584e426fc7 req-b18d2dc6-a3e4-406f-9257-4e00ddec08e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039474 Aug 04 04:38:32.734606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1678/3407] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:32.742807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:32.743977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:32.754207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:32.755949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:32.757016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:32.757635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:33.107678 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27394720-600c-4195-97f8-bbdd4e79fee0 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/4ad1d831-592c-4e8a-b6ae-858b1c0f78f1" status: 200 len: 183 microversion: 2.1 time: 0.725870 Aug 04 04:38:33.108285 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1730/3408] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:38:32 2022] GET /compute/v2.1/os-floating-ips/4ad1d831-592c-4e8a-b6ae-858b1c0f78f1 => generated 183 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:33.118058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:33.120035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:33.134653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:33.137402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:33.138059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:33.139882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:33.140762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:33.146052 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55767740-6132-45e8-af9c-38aefc837959 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1507 microversion: 2.1 time: 0.409837 Aug 04 04:38:33.162806 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1679/3409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:32 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:33.168122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f99cd30a-2ae6-4f37-bde9-d9dfea01a391 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1918f50e50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:33.284419 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f99cd30a-2ae6-4f37-bde9-d9dfea01a391 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.120102 Aug 04 04:38:33.288251 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1680/3410] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:33 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:33.293245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.57"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:33.387117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:34.158292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:34.170535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd611e45-abcd-48fe-acc4-c8a645b87fa6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 1.059059 Aug 04 04:38:34.180821 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1731/3411] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:33 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:34.185794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:34.186417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:34.198352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:34.200150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:34.202468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:34.203471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:34.206045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:34.220790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:34.227850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:34.229014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:34.229659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:34.372130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:34.374403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:34.378174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lazy-loading 'fault' on Instance uuid 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:38:34.718577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2588a591dfc42549c0a98fd40f97d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad357c5189504aba9361110360005bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:34.728124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-566fd284-3296-4ca4-a073-def570f7aa2d tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 200 len: 1331 microversion: 2.1 time: 0.546175 Aug 04 04:38:34.735142 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1732/3412] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:34 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 1331 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:35.004787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Acquired lock "refresh_cache-85365ce3-281d-44b9-ab6b-85cf98bacc8e" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:38:35.352255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-759e7291-61a1-40c1-affb-247631d8e580 req-ca08e44e-a7cd-41b1-bd12-61032be6b216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cdc530-bc0f-42fa-bb6f-c8bf225761c6", "name": "network-vif-plugged", "status": "completed", "tag": "63e89099-0992-4a96-b81b-77db4750634e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:35.393611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-759e7291-61a1-40c1-affb-247631d8e580 req-ca08e44e-a7cd-41b1-bd12-61032be6b216 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:35.394468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-759e7291-61a1-40c1-affb-247631d8e580 req-ca08e44e-a7cd-41b1-bd12-61032be6b216 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:35.436186 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-759e7291-61a1-40c1-affb-247631d8e580 req-ca08e44e-a7cd-41b1-bd12-61032be6b216 service nova] Creating event network-vif-plugged:63e89099-0992-4a96-b81b-77db4750634e for instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 on n-h2-851337-5 Aug 04 04:38:35.446614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:35.451546 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-759e7291-61a1-40c1-affb-247631d8e580 req-ca08e44e-a7cd-41b1-bd12-61032be6b216 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.711247 Aug 04 04:38:35.453678 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1733/3413] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:35.471618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:35.477713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:35.504868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:35.509020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:35.510942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:35.513573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:36.762936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:36.773884 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2a70ee45-ee0e-468c-a689-7bb408d47189 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1317 microversion: 2.1 time: 1.316576 Aug 04 04:38:36.780485 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1734/3414] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:35 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1317 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:36.793333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:36.800207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:36.810289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:36.811525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:36.815326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:36.817473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:37.355783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:37.372275 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77f63a75-e486-48e4-ad63-98278d6b6989 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1511 microversion: 2.1 time: 0.588958 Aug 04 04:38:37.375313 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1735/3415] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:36 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1511 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:37.403169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d2829e65-20f7-4eb3-9f0c-e58781ca5443 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a4d700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:37.480944 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d2829e65-20f7-4eb3-9f0c-e58781ca5443 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.104481 Aug 04 04:38:37.481713 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1736/3416] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:37 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:37.490245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3db337ce-2721-4888-aee2-dbfacd4ece59 req-d927c25e-bfe2-4104-8222-f352a019a284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060e05e8-d3cb-4ab4-83a1-bd584fb1a508", "name": "network-vif-deleted", "tag": "deebc500-b800-45b5-aacd-422a65dded92"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:37.520648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3db337ce-2721-4888-aee2-dbfacd4ece59 req-d927c25e-bfe2-4104-8222-f352a019a284 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:37.526234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3db337ce-2721-4888-aee2-dbfacd4ece59 req-d927c25e-bfe2-4104-8222-f352a019a284 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:37.562624 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3db337ce-2721-4888-aee2-dbfacd4ece59 req-d927c25e-bfe2-4104-8222-f352a019a284 service nova] Creating event network-vif-deleted:deebc500-b800-45b5-aacd-422a65dded92 for instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 on n-h1-851337-5 Aug 04 04:38:37.585479 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3db337ce-2721-4888-aee2-dbfacd4ece59 req-d927c25e-bfe2-4104-8222-f352a019a284 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101319 Aug 04 04:38:37.585479 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1737/3417] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:37.590617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:37.591662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:37.616838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:37.617589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:37.618555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:37.619186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:37.924160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:37.935624 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-921591ff-6cff-403b-8fa2-eaa07942a866 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.348862 Aug 04 04:38:37.949008 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1738/3418] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:37 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:37.958533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:37.960512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:37.975297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:37.976068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:37.977174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:37.978144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:38.001285 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 HTTP/1.1 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '060e05e8-d3cb-4ab4-83a1-bd584fb1a508'} Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:38.003854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:38.008881 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:38.008881 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:38.008881 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:38.008881 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:38.008881 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:38.008881 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:38.008881 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:38.009897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:38.010988 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74a281c0-d272-4844-98e7-6756ca2cac62 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 404 len: 111 microversion: 2.1 time: 0.059937 Aug 04 04:38:38.011599 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1739/3419] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:37 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:38.026596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:38.056657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:38.062867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.servers [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Removing options 'limit' from query {{(pid=119343) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 04:38:38.063753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:38.065285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:38.065970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:38.073001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:38.075485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:38.083693 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f3cf5b80-a4cb-4ead-bfd6-9cdebe74689c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.059912 Aug 04 04:38:38.089351 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1740/3420] 10.222.0.69 () {58 vars in 1140 bytes} [Thu Aug 4 04:38:38 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:38:38.111689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:38.112336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:38.122808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:38.139146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:38.143314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:38.143853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:38.227123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Building network info cache for instance {{(pid=119342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:38:38.490257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:38.508190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67f752ce-3a5f-4c1c-b4f5-2ef3dd2b1ed5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1317 microversion: 2.1 time: 0.416731 Aug 04 04:38:38.510012 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1741/3421] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:38 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:38.522236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e438c41d-caaf-4b99-b559-1e5764aee8f6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '.version_select at 0x7f1919a63e50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:38.582539 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e438c41d-caaf-4b99-b559-1e5764aee8f6 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836478969" status: 202 len: 0 microversion: 2.1 time: 0.071208 Aug 04 04:38:38.586664 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1742/3422] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836478969 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:38.591520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:38.592365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:38.608914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:38.609541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:38.610504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:38.611669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:39.190423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:39.208078 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-26deec76-d70e-4b6b-9268-2e99798cb30e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1511 microversion: 2.1 time: 0.620183 Aug 04 04:38:39.213863 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1743/3423] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:38 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1511 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:39.580945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b67f1ad0-fb02-4193-a6b6-c48cbf144439 req-799d1593-027e-474a-9e83-681779ba4519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85365ce3-281d-44b9-ab6b-85cf98bacc8e", "tag": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:39.620431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b67f1ad0-fb02-4193-a6b6-c48cbf144439 req-799d1593-027e-474a-9e83-681779ba4519 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:39.622139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b67f1ad0-fb02-4193-a6b6-c48cbf144439 req-799d1593-027e-474a-9e83-681779ba4519 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:39.653354 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b67f1ad0-fb02-4193-a6b6-c48cbf144439 req-799d1593-027e-474a-9e83-681779ba4519 service nova] Creating event network-changed:4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5 for instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e on n-h1-851337-5 Aug 04 04:38:39.665026 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b67f1ad0-fb02-4193-a6b6-c48cbf144439 req-799d1593-027e-474a-9e83-681779ba4519 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.446985 Aug 04 04:38:39.667359 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1744/3424] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:39.677477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c47738e-7c3f-4065-a771-3affa802b33e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a4db80>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:39.838640 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c47738e-7c3f-4065-a771-3affa802b33e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.170233 Aug 04 04:38:39.842695 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1745/3425] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:39 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:39.856715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:39.857649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:39.876824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:39.879195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:39.880255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:39.883056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:40.592931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:40.608553 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d58903b7-2a99-4942-9d5a-ab7f07cf03ca tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.763872 Aug 04 04:38:40.609557 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1746/3426] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:39 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:40.620241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:40.632666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:40.647953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:40.649699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:40.650894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:40.653125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:40.921248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Updating instance_info_cache with network_info: [{"id": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5", "address": "fa:16:3e:ff:a2:24", "network": {"id": "8e0b7bd4-7c61-4360-bbe0-58cc90dc6b7d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1816346120-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b79d1753e8c422fbe63de69fc20cdbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4b9028c5-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:38:40.922731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:40.929150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:40.940066 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b46fdf80-25ca-4ca8-860e-55a8880c1839 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 200 len: 1510 microversion: 2.1 time: 0.327718 Aug 04 04:38:40.958995 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1747/3427] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:40 2022] GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:40.959231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Releasing lock "refresh_cache-85365ce3-281d-44b9-ab6b-85cf98bacc8e" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:38:40.959231 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8247be9-2869-443e-ad40-77004763fc75 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action" status: 202 len: 0 microversion: 2.1 time: 7.663799 Aug 04 04:38:40.961251 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1681/3428] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:33 2022] POST /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e/action => generated 0 bytes in 7672 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:38:40.965851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:40.967552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:40.972330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a40f0ffb-f7bd-4b34-be06-cdcd2a1fbdfe req-80939883-6d2a-4394-b688-24fc16508ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b144c96-cf55-48ef-b7a7-6f1a28bd4c15", "name": "network-vif-plugged", "status": "completed", "tag": "2bbb86df-519c-4a2e-9018-c707bad09937"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:40.983952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:40.984480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:40.988030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:40.989841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:40.997702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a40f0ffb-f7bd-4b34-be06-cdcd2a1fbdfe req-80939883-6d2a-4394-b688-24fc16508ceb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:41.007457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a40f0ffb-f7bd-4b34-be06-cdcd2a1fbdfe req-80939883-6d2a-4394-b688-24fc16508ceb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:41.036288 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a40f0ffb-f7bd-4b34-be06-cdcd2a1fbdfe req-80939883-6d2a-4394-b688-24fc16508ceb service nova] Creating event network-vif-plugged:2bbb86df-519c-4a2e-9018-c707bad09937 for instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 on n-h1-851337-5 Aug 04 04:38:41.047746 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a40f0ffb-f7bd-4b34-be06-cdcd2a1fbdfe req-80939883-6d2a-4394-b688-24fc16508ceb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083391 Aug 04 04:38:41.048366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1682/3429] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:41.062856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3a6a25d8-262b-4861-89d2-ab3c647b9b45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1918edd5e0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:41.192576 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3a6a25d8-262b-4861-89d2-ab3c647b9b45 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.137145 Aug 04 04:38:41.199899 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1683/3430] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:41 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:41.212119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:41.212767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:41.234801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:41.241926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:41.243680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:41.247281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:41.253883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:41.262195 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae018896-9b85-484f-bdca-f8af745eeb49 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1317 microversion: 2.1 time: 0.311879 Aug 04 04:38:41.270224 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1748/3431] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:40 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:41.296649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:41.299577 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] HTTP exception thrown: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.301163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Request method failure captured: Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 HTTP/1.1 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60zmwE1JDvD1S97zxYTcYoL9B4I2v8Nitfe4-cWbYJpLr_zff93cMNHH2nXYDZ1kqNnv1NF-xHf9ltS_n_bP6msGRkFeoHm4AlNU3HJNj2llk3wFfkpboeT6FqFQtY3jQIwVaraTJeb17Jg9JXnvVJAply-e7lVTcmpqtCWghlVcg8Q Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b79d1753e8c422fbe63de69fc20cdbf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ba1f58af29924fddadf25abcc5255606 Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0f3de710-5209-441d-9424-5044bef0ae84'} Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:41.302358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.306503 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.308859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Returning 404 to user: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:41.309978 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7fd24309-3d17-4f86-969a-db3f608e2d6b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 404 len: 111 microversion: 2.1 time: 0.108988 Aug 04 04:38:41.310781 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1684/3432] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:41 2022] DELETE /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:41.319360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:41.320845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:41.320845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:41.321614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:41.322316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:41.322440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 0f3de710-5209-441d-9424-5044bef0ae84] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:41.330416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:41.343706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:41.345260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:41.346852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:41.366541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] HTTP exception thrown: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Request method failure captured: Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 HTTP/1.1 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60zmwE1JDvD1S97zxYTcYoL9B4I2v8Nitfe4-cWbYJpLr_zff93cMNHH2nXYDZ1kqNnv1NF-xHf9ltS_n_bP6msGRkFeoHm4AlNU3HJNj2llk3wFfkpboeT6FqFQtY3jQIwVaraTJeb17Jg9JXnvVJAply-e7lVTcmpqtCWghlVcg8Q Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b79d1753e8c422fbe63de69fc20cdbf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ba1f58af29924fddadf25abcc5255606 Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0f3de710-5209-441d-9424-5044bef0ae84'} Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.368528 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. Aug 04 04:38:41.372514 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:41.374567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Returning 404 to user: Instance 0f3de710-5209-441d-9424-5044bef0ae84 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:41.375713 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2422ff24-9997-4ffe-b382-b8cc023c53ee tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84" status: 404 len: 111 microversion: 2.1 time: 0.060786 Aug 04 04:38:41.376912 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1685/3433] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:41 2022] GET /compute/v2.1/servers/0f3de710-5209-441d-9424-5044bef0ae84 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:38:41.388877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-abad35e0-1153-4c9a-a572-12c4c3324111 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '.version_select at 0x7f1918ea04c0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:42.473695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:42.483106 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98924485-12b1-4271-bdc7-b272a6f3531b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1512 microversion: 2.1 time: 1.203252 Aug 04 04:38:42.487359 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1749/3434] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:41 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1512 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:42.496851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:42.499713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:42.534088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:42.537038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:42.538097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:42.540477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:42.618336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:42.942179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:42.954724 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-29a91604-832c-424d-b841-333347a13920 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.465720 Aug 04 04:38:42.972051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1750/3435] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:42 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:42.981072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7f5d683b-c536-4f0f-b81b-e510cebe795a tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919ac8550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:43.039567 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7f5d683b-c536-4f0f-b81b-e510cebe795a tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.062970 Aug 04 04:38:43.049259 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1751/3436] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:42 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:43.051558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:43.052703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:43.072165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:43.072735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:43.075884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:43.076952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:43.568715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:43.580150 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba96eeaf-e39a-4430-bbc1-93622b2e5c9f tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1317 microversion: 2.1 time: 0.536953 Aug 04 04:38:43.580966 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1752/3437] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:43 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:43.592472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:43.601875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:43.603105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:44.075808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.076262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.077071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.077509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.143060 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-abad35e0-1153-4c9a-a572-12c4c3324111 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/4ad1d831-592c-4e8a-b6ae-858b1c0f78f1" status: 202 len: 0 microversion: 2.1 time: 2.761355 Aug 04 04:38:44.143690 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1686/3438] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:38:41 2022] DELETE /compute/v2.1/os-floating-ips/4ad1d831-592c-4e8a-b6ae-858b1c0f78f1 => generated 0 bytes in 2763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:44.149189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:44.149918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:44.163181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=33 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.165587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.168623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.169834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.170390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.228906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:44.395642 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-30c7e620-0964-4d28-b6fa-223335c8c44b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.810860 Aug 04 04:38:44.407694 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1753/3439] 10.222.0.69 () {58 vars in 1154 bytes} [Thu Aug 4 04:38:43 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:44.411073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0983c84f-9ff2-4a46-a948-29822123a1ae tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a4d820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:44.497483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:44.506913 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5cc1a0b-8416-42bd-b472-c6ceaeaf539d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.362079 Aug 04 04:38:44.507986 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1687/3440] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:44 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:44.515601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:44.516302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:44.538559 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0983c84f-9ff2-4a46-a948-29822123a1ae tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.136412 Aug 04 04:38:44.544086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.546382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.546772 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1754/3441] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:44 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:44.549068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.553606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:44.554644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:44.559397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.561781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.562457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.572984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.574681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.640021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:38:44.826781 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3372ad44-fc8b-4327-8ed6-61db2ec50a8f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "DELETE /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 204 len: 0 microversion: 2.1 time: 0.315867 Aug 04 04:38:44.828218 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1688/3442] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:44 2022] DELETE /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:38:44.832676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:44.840266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:44.842092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:44.846414 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06d5bfcf-2258-4c1b-9ee0-f57fb450a7fe tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1511 microversion: 2.1 time: 0.297880 Aug 04 04:38:44.847036 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1755/3443] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:44 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:44.856173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.857431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:44.858483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:44.859183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:45.144769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:45.152957 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e085b8f-7b91-4d17-8740-e210473d131e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1505 microversion: 2.1 time: 0.321080 Aug 04 04:38:45.154873 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1689/3444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:44 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:45.174074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:45.175107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:45.190800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:45.191484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:45.192269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:45.192703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:45.502999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:45.516838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bfd90566-4cbf-4b63-8fd5-8b11c0c94c7f tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1526 microversion: 2.1 time: 0.345414 Aug 04 04:38:45.530979 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1690/3445] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:45 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1526 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:45.538073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:45.538073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:45.538371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-194727067", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "4d7b0316-9278-41a0-bbbc-01764ef3318b"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:45.552601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:45.556599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:45.557280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:45.558143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:45.686226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:38:45.995536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:46.010422 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c00ea100-2b93-4e71-8924-6be59f91129c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 200 len: 1510 microversion: 2.1 time: 0.484846 Aug 04 04:38:46.011585 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1691/3446] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:45 2022] GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:46.023677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ecc5294d-bda3-4d33-81c3-4dd0740b1213 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:46.026189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecc5294d-bda3-4d33-81c3-4dd0740b1213 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:46.044910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc5294d-bda3-4d33-81c3-4dd0740b1213 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:46.046711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc5294d-bda3-4d33-81c3-4dd0740b1213 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:46.047861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc5294d-bda3-4d33-81c3-4dd0740b1213 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:46.050381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc5294d-bda3-4d33-81c3-4dd0740b1213 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:46.117231 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ecc5294d-bda3-4d33-81c3-4dd0740b1213 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15/ips" status: 200 len: 108 microversion: 2.1 time: 0.103962 Aug 04 04:38:46.124726 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1692/3447] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:38:46 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15/ips => generated 108 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:46.129572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:46.130174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:46.151789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:46.152802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:46.153733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:46.154341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:46.458629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:46.469730 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-36f25152-51f5-44d5-94a1-80c358f03d3b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.341418 Aug 04 04:38:46.470359 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1693/3448] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:46 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:46.508768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-449c96e8-a455-41e5-bd30-a7608ab9115d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19191d89d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:46.574739 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-449c96e8-a455-41e5-bd30-a7608ab9115d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.085373 Aug 04 04:38:46.582618 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1694/3449] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:46 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:46.587864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:46.589369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:46.597240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:46.597958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:46.598895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:46.600113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.053206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:38:47.055317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:38:47.055976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:38:47.057989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:38:47.058608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:38:47.078987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.079967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.094497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.095872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.121460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:38:47.129268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:47.130938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:38:47.150478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:38:47.153995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:38:47.224391 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1124e6c2-6bee-4dc1-99d6-36df578626f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.372471 Aug 04 04:38:47.225053 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1756/3450] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:38:47.237127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-322caadf-8591-461b-84c8-be0fcc102be5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:47.240898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-322caadf-8591-461b-84c8-be0fcc102be5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:47.266743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-322caadf-8591-461b-84c8-be0fcc102be5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.267832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-322caadf-8591-461b-84c8-be0fcc102be5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.268622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-322caadf-8591-461b-84c8-be0fcc102be5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.269060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-322caadf-8591-461b-84c8-be0fcc102be5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.353681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:47.365700 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e0c903b0-8b39-4b4b-a018-6785d4438e2d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1512 microversion: 2.1 time: 0.781651 Aug 04 04:38:47.367470 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-322caadf-8591-461b-84c8-be0fcc102be5 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15/ips" status: 200 len: 108 microversion: 2.1 time: 0.141287 Aug 04 04:38:47.368543 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1695/3451] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:46 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1512 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:47.381108 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1757/3452] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:38:47 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15/ips => generated 108 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:47.383029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:47.384953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:47.387323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a6752573-b081-4402-a7ae-614965181eb5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:47.387940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a6752573-b081-4402-a7ae-614965181eb5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:47.403838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.404567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.409370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.410064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.489719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a6752573-b081-4402-a7ae-614965181eb5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:47.498851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a6752573-b081-4402-a7ae-614965181eb5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1192 microversion: 2.1 time: 0.116377 Aug 04 04:38:47.502591 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1758/3453] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:47 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1192 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:47.507178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c90170b0-f644-48f6-bcaf-c5b48c69200d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:47.507672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c90170b0-f644-48f6-bcaf-c5b48c69200d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:47.526509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c90170b0-f644-48f6-bcaf-c5b48c69200d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.526770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c90170b0-f644-48f6-bcaf-c5b48c69200d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.527528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c90170b0-f644-48f6-bcaf-c5b48c69200d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.527957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c90170b0-f644-48f6-bcaf-c5b48c69200d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.639372 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c90170b0-f644-48f6-bcaf-c5b48c69200d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15/ips/tempest-ServerAddressesTestJSON-410538671-network" status: 200 len: 93 microversion: 2.1 time: 0.135855 Aug 04 04:38:47.662686 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1759/3454] 10.222.0.69 () {58 vars in 1398 bytes} [Thu Aug 4 04:38:47 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15/ips/tempest-ServerAddressesTestJSON-410538671-network => generated 93 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:38:47.662686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:47.677399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:47.678213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:47.685485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.686022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.686773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.688010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.729950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:47.760868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:47.768578 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-768d0e05-653c-4aad-b68a-e89ca7b3ca7b tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1526 microversion: 2.1 time: 0.398193 Aug 04 04:38:47.791790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:47.793579 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1696/3455] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:47 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1526 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:47.805428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:47.806060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:47.818123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.819725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.820709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.825448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:47.833718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:47.834178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:48.594624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:48.613466 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12064b85-44cc-4b24-af8c-91f102d51edb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.818641 Aug 04 04:38:48.617906 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1697/3456] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:47 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:48.624526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e232032-376f-4308-b90c-cdd0856f23f9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1918ee5a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:48.721298 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e232032-376f-4308-b90c-cdd0856f23f9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.100844 Aug 04 04:38:48.723553 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1698/3457] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:48 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:48.727616 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b06017f-64d2-4f59-a0a2-eeb96c442b2b tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 1.069106 Aug 04 04:38:48.729002 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1760/3458] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:38:47 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:48.742205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3e99840b-4512-4128-aa98-99cbc5f4ff75 req-867ad644-1fb4-41be-87d9-d3e9774542e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85365ce3-281d-44b9-ab6b-85cf98bacc8e", "name": "network-vif-deleted", "tag": "4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:48.752610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:48.765705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:48.786908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3e99840b-4512-4128-aa98-99cbc5f4ff75 req-867ad644-1fb4-41be-87d9-d3e9774542e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:48.788604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3e99840b-4512-4128-aa98-99cbc5f4ff75 req-867ad644-1fb4-41be-87d9-d3e9774542e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:48.790448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:48.793953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:48.798240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:48.802935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:48.842935 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3e99840b-4512-4128-aa98-99cbc5f4ff75 req-867ad644-1fb4-41be-87d9-d3e9774542e1 service nova] Creating event network-vif-deleted:4b9028c5-6e28-4f9f-8d20-3b6896e1e4d5 for instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e on n-h1-851337-5 Aug 04 04:38:48.864826 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3e99840b-4512-4128-aa98-99cbc5f4ff75 req-867ad644-1fb4-41be-87d9-d3e9774542e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132973 Aug 04 04:38:48.872956 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1761/3459] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:48.896910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:48.899672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:48.908424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:38:48.929306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:48.933522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:48.937942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:48.940944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.231179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:49.243362 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f88fee7-d65d-478e-a729-4c179eed369b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1244 microversion: 2.1 time: 0.365539 Aug 04 04:38:49.266191 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1762/3460] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:48 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1244 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:49.284249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.303953 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39f95d31-f728-4258-a6b7-2a8e11b0bb95 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 204 len: 0 microversion: 2.1 time: 0.578363 Aug 04 04:38:49.305577 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1699/3461] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:48 2022] DELETE /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:38:49.307698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:49.312309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:49.324483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.326108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:49.355314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.356388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.358147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.360422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.460876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.462020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.463136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.463824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.471594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.473983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.474479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lazy-loading 'fault' on Instance uuid 85365ce3-281d-44b9-ab6b-85cf98bacc8e {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:38:49.545623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:49.572603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba1f58af29924fddadf25abcc5255606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b79d1753e8c422fbe63de69fc20cdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:49.582447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:49.586533 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-651636a7-c6ed-4d5c-a501-b94d518cd0fa tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 200 len: 1314 microversion: 2.1 time: 0.272940 Aug 04 04:38:49.587492 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1700/3462] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:49 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:49.616754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.617419 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-984b0a59-a059-4792-90f6-2fa563d2c12d tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.344623 Aug 04 04:38:49.618662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:49.619960 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1763/3463] 10.222.0.69 () {58 vars in 1150 bytes} [Thu Aug 4 04:38:49 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:49.643405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.668374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.669595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.671123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.671913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.675595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:49.679553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:49.699995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.700522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.701341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:49.701791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:49.984649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:49.993247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:50.003345 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29a958b2-a288-4b0a-b505-8c0c7e495f34 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1511 microversion: 2.1 time: 0.413418 Aug 04 04:38:50.023428 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1701/3464] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:49 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:50.035084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.035893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:50.053842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.054326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.055238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.055907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.102147 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-594a3350-50fa-441e-a472-fa2e07c65681 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.471491 Aug 04 04:38:50.121906 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1764/3465] 10.222.0.69 () {58 vars in 1212 bytes} [Thu Aug 4 04:38:49 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:38:50.131578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b6f18755-05d3-40eb-8e70-9ab980fa00ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a631f0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.216936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b6f18755-05d3-40eb-8e70-9ab980fa00ed tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.093653 Aug 04 04:38:50.218087 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1765/3466] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:50.226389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.234177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:50.235214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:50.246513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.247280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.249055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.249678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.434641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:50.445044 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc455f0b-16b7-402a-b1e9-013b4d5ed451 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.419637 Aug 04 04:38:50.450278 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1702/3467] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:50.467038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.467838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:50.493337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.494404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.495562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.496461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.507842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:50.627750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:50.636546 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-46252a37-ec80-42ee-8809-12138037d80d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1250 microversion: 2.1 time: 0.183526 Aug 04 04:38:50.656920 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4543bf9b-2595-4d41-9962-35a45c79f8ab tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.430313 Aug 04 04:38:50.656920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1766/3468] 10.222.0.69 () {58 vars in 1196 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:50.661798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.661798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:50.662179 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1703/3469] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1250 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:50.671200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.672687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] [instance: 85365ce3-281d-44b9-ab6b-85cf98bacc8e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:50.676565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.677158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.679148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.679915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.688732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.690891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.694569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.696205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.703027 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 HTTP/1.1 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '060e05e8-d3cb-4ab4-83a1-bd584fb1a508'} Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:50.710796 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.715919 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.719876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:50.729556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] HTTP exception thrown: Instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e could not be found. Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Request method failure captured: Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e HTTP/1.1 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60zmwE1JDvD1S97zxYTcYoL9B4I2v8Nitfe4-cWbYJpLr_zff93cMNHH2nXYDZ1kqNnv1NF-xHf9ltS_n_bP6msGRkFeoHm4AlNU3HJNj2llk3wFfkpboeT6FqFQtY3jQIwVaraTJeb17Jg9JXnvVJAply-e7lVTcmpqtCWghlVcg8Q Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b79d1753e8c422fbe63de69fc20cdbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b79d1753e8c422fbe63de69fc20cdbf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3b79d1753e8c422fbe63de69fc20cdbf Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1605064685 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ba1f58af29924fddadf25abcc5255606 Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1605064685-project Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e could not be found. Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '85365ce3-281d-44b9-ab6b-85cf98bacc8e'} Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e could not be found. Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e could not be found. Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.734682 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e could not be found. Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] Returning 404 to user: Instance 85365ce3-281d-44b9-ab6b-85cf98bacc8e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:50.741308 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53927b00-0bde-483b-9916-5fd6204ab379 tempest-FloatingIPsAssociationTestJSON-1605064685 tempest-FloatingIPsAssociationTestJSON-1605064685-project] 10.222.0.69 "GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e" status: 404 len: 111 microversion: 2.1 time: 0.074857 Aug 04 04:38:50.745146 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d7f93f5-c7f7-4c23-b35d-a688e638f196 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 404 len: 111 microversion: 2.1 time: 0.067823 Aug 04 04:38:50.745274 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1704/3470] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/servers/85365ce3-281d-44b9-ab6b-85cf98bacc8e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:50.746137 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1767/3471] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:50 2022] DELETE /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:50.758230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.762711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.765655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 060e05e8-d3cb-4ab4-83a1-bd584fb1a508] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:50.780785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:50.781033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.781430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.783768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.784291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.784968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'name': '-568051955', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:50.806472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.806991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.809077 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.809578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:50.810050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 HTTP/1.1 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '060e05e8-d3cb-4ab4-83a1-bd584fb1a508'} Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:50.811714 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 060e05e8-d3cb-4ab4-83a1-bd584fb1a508 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eea0002d-7c7b-456e-8395-5d369e14d346 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508" status: 404 len: 111 microversion: 2.1 time: 0.062335 Aug 04 04:38:50.816479 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1768/3472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/servers/060e05e8-d3cb-4ab4-83a1-bd584fb1a508 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:51.025975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.026906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:51.044311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.044976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:51.045856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.046302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:51.113405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:51.220672 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0cf9c4c9-4c2b-4518-9138-d78716089161 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?name=-568051955" status: 200 len: 345 microversion: 2.1 time: 0.474036 Aug 04 04:38:51.221332 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1705/3473] 10.222.0.69 () {58 vars in 1156 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/servers?name=-568051955 => generated 345 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:51.237751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0294df04-e8b2-4966-b01e-fcfa578f5d8e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19191f6a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.338769 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0294df04-e8b2-4966-b01e-fcfa578f5d8e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.106546 Aug 04 04:38:51.341165 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1706/3474] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:51.354155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.368737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:51.374499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:51.386865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.387635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:51.389523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.390158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:51.635213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:51.683595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:51.695244 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c13ec87f-7e6e-450b-909c-13dc82d78b1e tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1511 microversion: 2.1 time: 0.674698 Aug 04 04:38:51.710822 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1769/3475] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1511 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:38:51.728010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.729140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:51.741901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.742504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:51.746430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.747003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:51.817073 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d98f19b-4ba2-4495-941b-3984181f2ebc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.474422 Aug 04 04:38:51.818109 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1707/3476] 10.222.0.69 () {58 vars in 1154 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:51.832844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.833492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:51.848915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.849371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:51.851190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:51.851647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:52.355858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:52.370896 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d249650b-f08f-4b00-aac9-7a930b5353f7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.658446 Aug 04 04:38:52.378508 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1770/3477] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:52.388048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:52.402338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:52.403986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-56805195', 'deleted': False, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:38:52.415283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:52.420211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:52.421743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:52.422690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:52.561575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:52.571753 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14cc0188-c105-4d12-927a-1a54d28a1932 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.751312 Aug 04 04:38:52.594576 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1708/3478] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:52.600490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-977db79e-da11-4810-bd33-56eb0ad11ba4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1918ee5a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:52.699207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:38:52.703878 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-977db79e-da11-4810-bd33-56eb0ad11ba4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.107146 Aug 04 04:38:52.705194 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1709/3479] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:52 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:52.718789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:52.728149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:52.741489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:52.747388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:52.748456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:52.749018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:52.900309 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-523eb294-597e-465c-9cb5-2be2c1f07997 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-56805195" status: 200 len: 345 microversion: 2.1 time: 0.519322 Aug 04 04:38:52.901003 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1771/3480] 10.222.0.69 () {58 vars in 1226 bytes} [Thu Aug 4 04:38:52 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-56805195 => generated 345 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:52.916420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:52.916933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:52.949740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:52.951555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:52.955816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:52.956272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:53.266710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:53.284058 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f2d066a4-90e3-4400-b371-784f05847951 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1511 microversion: 2.1 time: 0.565398 Aug 04 04:38:53.284718 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1710/3481] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:52 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1511 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:53.399288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:53.399946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:53.407962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:53.424795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:53.425661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:53.426136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:53.580303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:53.601844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:38:53.760432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:53.777183 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-80bace1e-7a12-48a7-9504-29521bb2222f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 0.381891 Aug 04 04:38:53.777810 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1711/3482] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:53 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:53.799343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:53.806986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:53.826895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:53.830244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:53.834867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:53.836812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:53.989683 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0fc70321-5c7f-4ba1-8cc2-da251704c8f8 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "DELETE /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 204 len: 0 microversion: 2.1 time: 1.078056 Aug 04 04:38:53.990694 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1772/3483] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:52 2022] DELETE /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:38:54.005264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5455aa71-a333-4a25-9617-72abc7b471eb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919837790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:54.133858 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5455aa71-a333-4a25-9617-72abc7b471eb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.141224 Aug 04 04:38:54.136827 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1773/3484] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:53 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:54.166127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:54.188574 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-adb035fd-5601-4eb5-bfe3-826b906e937d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.406745 Aug 04 04:38:54.192329 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1712/3485] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:53 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:54.201713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:54.209306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:54.240866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.241753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:54.242759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.243229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:54.615480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7867d8c9-69ef-47f2-a308-d6e089a36c54 req-f00ad86a-c523-4a9b-b27b-57ac40ad41e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b144c96-cf55-48ef-b7a7-6f1a28bd4c15", "name": "network-vif-deleted", "tag": "2bbb86df-519c-4a2e-9018-c707bad09937"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:54.630109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7867d8c9-69ef-47f2-a308-d6e089a36c54 req-f00ad86a-c523-4a9b-b27b-57ac40ad41e8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.631773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7867d8c9-69ef-47f2-a308-d6e089a36c54 req-f00ad86a-c523-4a9b-b27b-57ac40ad41e8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:54.663116 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7867d8c9-69ef-47f2-a308-d6e089a36c54 req-f00ad86a-c523-4a9b-b27b-57ac40ad41e8 service nova] Creating event network-vif-deleted:2bbb86df-519c-4a2e-9018-c707bad09937 for instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 on n-h1-851337-5 Aug 04 04:38:54.690757 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7867d8c9-69ef-47f2-a308-d6e089a36c54 req-f00ad86a-c523-4a9b-b27b-57ac40ad41e8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.552448 Aug 04 04:38:54.695611 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1774/3486] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:54.706913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:54.709457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:54.738822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.743947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:54.746072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.746902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:54.843040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:54.852958 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-919dba03-2bbf-455c-b8f2-303f3afe7709 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1518 microversion: 2.1 time: 0.658566 Aug 04 04:38:54.855692 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1713/3487] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:54 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1518 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:54.861975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:54.869598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:54.871144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.873740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:54.874718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lazy-loading 'fault' on Instance uuid 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:38:54.880600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.881056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:54.881848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:54.885717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:55.039478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b64415d3434d0483b0836706bab3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36b3017b2e34c3a9a7dae6a38d35570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:55.100379 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb215820-1c1d-42b4-90e4-9eeda0063871 tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 200 len: 1307 microversion: 2.1 time: 0.400677 Aug 04 04:38:55.105712 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1775/3488] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:54 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:55.156742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-221f31c5-2ce5-41fd-b547-d8fc8b32640b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a263a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.268797 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-221f31c5-2ce5-41fd-b547-d8fc8b32640b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.119631 Aug 04 04:38:55.270024 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1776/3489] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:55.291532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.292492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:55.300329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:55.301110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:55.302140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:55.302782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:55.972634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:55.980994 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4a622e4e-31f5-4b64-8946-6452dd46cb14 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1497 microversion: 2.1 time: 1.123972 Aug 04 04:38:55.988628 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1714/3490] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:54 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1497 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:55.994932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.003903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:56.013998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:56.014749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:56.022886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:56.023541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:56.506548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:56.519392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4178a196-b910-4afe-a8ec-360de28cdf39 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 1.247932 Aug 04 04:38:56.519980 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1777/3491] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:56.543624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.545062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] [instance: 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:56.560459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:56.561696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:56.565001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:56.567249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:56.601743 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] HTTP exception thrown: Instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 could not be found. Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Request method failure captured: Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 HTTP/1.1 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6008VPdcc7pltKNGF9O7Dps6-x87F1DmC1OsmORBK8Ve7zny6ehrxoHHD9rA0cipgVMNntIwLZgutX6YWs2TRaMXhc2Qkryw13b15hr7notk14zIEEoIwRolSMYCDa9hMdfJIQodmhcQEIE66zXULnhfJ2IPeTTNCzlTIzwV5V8NxZg Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: e36b3017b2e34c3a9a7dae6a38d35570 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerAddressesTestJSON-1648485140 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e36b3017b2e34c3a9a7dae6a38d35570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e36b3017b2e34c3a9a7dae6a38d35570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e36b3017b2e34c3a9a7dae6a38d35570"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e36b3017b2e34c3a9a7dae6a38d35570", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerAddressesTestJSON-1648485140 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: e36b3017b2e34c3a9a7dae6a38d35570 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1648485140 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerAddressesTestJSON-1648485140-project Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 35b64415d3434d0483b0836706bab3a6 Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerAddressesTestJSON-1648485140-project Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 could not be found. Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '8b144c96-cf55-48ef-b7a7-6f1a28bd4c15'} Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 could not be found. Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 could not be found. Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:56.607138 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.611973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:56.611973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:56.611973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:56.611973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:56.611973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:56.611973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 could not be found. Aug 04 04:38:56.611973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.618614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] Returning 404 to user: Instance 8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:56.620841 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-32010e5d-956c-422f-8d0b-7ff461cfa54d tempest-ServerAddressesTestJSON-1648485140 tempest-ServerAddressesTestJSON-1648485140-project] 10.222.0.69 "GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15" status: 404 len: 111 microversion: 2.1 time: 0.099570 Aug 04 04:38:56.636484 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1778/3492] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:56 2022] GET /compute/v2.1/servers/8b144c96-cf55-48ef-b7a7-6f1a28bd4c15 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:56.675565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-972074f3-e678-4421-a3d4-cb78623885f4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a155e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.784728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-972074f3-e678-4421-a3d4-cb78623885f4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1454 microversion: 2.1 time: 0.146785 Aug 04 04:38:56.785429 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1779/3493] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:56 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:56.804702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-50a42073-eb6a-4f3a-8302-a3d28457db93 req-655e770a-def8-44e1-b7fd-f10d40f1e128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2da970f-9222-4cef-89a6-0920cd4378d0", "tag": "86d1a786-3553-434e-82af-0c6c7fbded9f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:56.845986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-50a42073-eb6a-4f3a-8302-a3d28457db93 req-655e770a-def8-44e1-b7fd-f10d40f1e128 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:56.846751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-50a42073-eb6a-4f3a-8302-a3d28457db93 req-655e770a-def8-44e1-b7fd-f10d40f1e128 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:56.862035 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-50a42073-eb6a-4f3a-8302-a3d28457db93 req-655e770a-def8-44e1-b7fd-f10d40f1e128 service nova] Creating event network-changed:86d1a786-3553-434e-82af-0c6c7fbded9f for instance c2da970f-9222-4cef-89a6-0920cd4378d0 on n-h2-851337-5 Aug 04 04:38:56.869674 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-50a42073-eb6a-4f3a-8302-a3d28457db93 req-655e770a-def8-44e1-b7fd-f10d40f1e128 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081920 Aug 04 04:38:56.870674 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1780/3494] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:56.928502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:56.936232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24db2587-22a2-4950-98aa-93bdaf3b3c74 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1518 microversion: 2.1 time: 0.945966 Aug 04 04:38:56.936826 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1715/3495] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1518 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:57.005356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:57.006377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:57.032497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:57.033514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:57.039265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:57.042199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:57.507141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:57.522531 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5483d9d2-94db-4ebf-9d83-2760ddab8ba1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 200 len: 1474 microversion: 2.1 time: 0.523329 Aug 04 04:38:57.527944 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1781/3496] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:56 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 1474 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:57.543510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:57.544755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:57.564731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-276b4a8d-6184-44c4-80b4-50f27503216f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1582419475"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:57.567503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:57.568457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:57.571635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:57.572295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:57.573644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-276b4a8d-6184-44c4-80b4-50f27503216f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:57.622270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-276b4a8d-6184-44c4-80b4-50f27503216f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:57.623475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-276b4a8d-6184-44c4-80b4-50f27503216f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:57.624812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-276b4a8d-6184-44c4-80b4-50f27503216f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:57.629598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-276b4a8d-6184-44c4-80b4-50f27503216f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:57.800307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:58.211221 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-276b4a8d-6184-44c4-80b4-50f27503216f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3/action" status: 202 len: 0 microversion: 2.1 time: 0.658581 Aug 04 04:38:58.214248 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1782/3497] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:57 2022] POST /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:38:58.228279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f81c4421-4909-4f7b-b71f-d30a4b4da1d0 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a263a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.275747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:58.301598 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-70f5146f-80e5-4425-8b4c-ded72ffb6139 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.762964 Aug 04 04:38:58.302730 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1716/3498] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:57 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:58.313183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c494d005-1bd3-4ddc-8bfc-1f64c50976df req-4a4e6506-55be-44c0-aae1-74a0d52f6f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e70cb6-8312-4eb4-933a-240f846ea50a", "name": "network-vif-deleted", "tag": "59ee67cf-4dcc-4d74-b918-71a71aee26e2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:58.363135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c494d005-1bd3-4ddc-8bfc-1f64c50976df req-4a4e6506-55be-44c0-aae1-74a0d52f6f45 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.366300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c494d005-1bd3-4ddc-8bfc-1f64c50976df req-4a4e6506-55be-44c0-aae1-74a0d52f6f45 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.375166 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f81c4421-4909-4f7b-b71f-d30a4b4da1d0 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1463 microversion: 2.1 time: 0.149306 Aug 04 04:38:58.387709 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1783/3499] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:58 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:58.394613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.395903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:58.408396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.409116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.410194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.410328 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c494d005-1bd3-4ddc-8bfc-1f64c50976df req-4a4e6506-55be-44c0-aae1-74a0d52f6f45 service nova] Creating event network-vif-deleted:59ee67cf-4dcc-4d74-b918-71a71aee26e2 for instance 23e70cb6-8312-4eb4-933a-240f846ea50a on n-h2-851337-5 Aug 04 04:38:58.410915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.429758 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c494d005-1bd3-4ddc-8bfc-1f64c50976df req-4a4e6506-55be-44c0-aae1-74a0d52f6f45 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124212 Aug 04 04:38:58.432170 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1717/3500] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:58.453445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.454821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:58.457334 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c HTTP/1.1 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b9a2f759-f92a-4b9f-9090-55d1bcb5e93c'} Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:58.460047 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8a367ca2-1fc1-412d-8352-3e453bd590bb tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 404 len: 111 microversion: 2.1 time: 0.073248 Aug 04 04:38:58.465302 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1784/3501] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:58 2022] DELETE /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:58.468337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-052dac80-9c9d-493b-a301-6dca5768b5ed tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919ab44c0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.482868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.483626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.484809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.485492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.542980 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-052dac80-9c9d-493b-a301-6dca5768b5ed tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 200 len: 1414 microversion: 2.1 time: 0.078291 Aug 04 04:38:58.552956 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1785/3502] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:58 2022] GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:58.590811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c8ea5603-e74f-4dc0-aebe-4c8271d09281 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a74670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.628999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.629446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.629958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lazy-loading 'fault' on Instance uuid 23e70cb6-8312-4eb4-933a-240f846ea50a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:38:58.701252 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c8ea5603-e74f-4dc0-aebe-4c8271d09281 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 200 len: 1463 microversion: 2.1 time: 0.143284 Aug 04 04:38:58.701915 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1786/3503] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:58 2022] GET /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:58.733022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.734642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: b9a2f759-f92a-4b9f-9090-55d1bcb5e93c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:58.758181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.758707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.760022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.760453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.789807 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c HTTP/1.1 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b9a2f759-f92a-4b9f-9090-55d1bcb5e93c'} Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:58.791618 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.796435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.796435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:58.796435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:58.796435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:58.796435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:58.796435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. Aug 04 04:38:58.796435 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.799133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance b9a2f759-f92a-4b9f-9090-55d1bcb5e93c could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:58.800153 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b2d2b26-3743-4fcd-a1c5-9654616b2366 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c" status: 404 len: 111 microversion: 2.1 time: 0.087900 Aug 04 04:38:58.801195 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1787/3504] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:58 2022] GET /compute/v2.1/servers/b9a2f759-f92a-4b9f-9090-55d1bcb5e93c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:58.807473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.808383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:58.816841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.817724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.830198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:58.843855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4f2bf551-d1de-4eb3-a435-1cddec58ea93 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 200 len: 1311 microversion: 2.1 time: 0.405941 Aug 04 04:38:58.848619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.849410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.854880 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1718/3505] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:58 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 1311 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:58.867286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.873477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:58.893144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.893597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.896518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.897137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.930825 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 HTTP/1.1 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6ab3ca78-87df-46a4-a7f7-7648c150a4c4'} Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:58.935505 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:58.941640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:58.944197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:58.946828 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca34c3d0-472c-4a0b-96af-ec82a5cd25b2 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 404 len: 111 microversion: 2.1 time: 0.090723 Aug 04 04:38:58.947928 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1719/3506] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:38:58 2022] DELETE /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:58.956555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:58.957744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 6ab3ca78-87df-46a4-a7f7-7648c150a4c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:58.968002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.969114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:58.970177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:58.970929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:59.003855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 HTTP/1.1 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6ab3ca78-87df-46a4-a7f7-7648c150a4c4'} Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:59.007478 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:59.011540 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:59.011540 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:59.011540 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:59.011540 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:59.011540 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:59.011540 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. Aug 04 04:38:59.011540 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:38:59.013619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 6ab3ca78-87df-46a4-a7f7-7648c150a4c4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:59.014903 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1a3cbf8-5ec0-482d-9254-b65d9141e032 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4" status: 404 len: 111 microversion: 2.1 time: 0.062673 Aug 04 04:38:59.015866 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1720/3507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:58 2022] GET /compute/v2.1/servers/6ab3ca78-87df-46a4-a7f7-7648c150a4c4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:59.323817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:59.324666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:59.335214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:59.335671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:59.336657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:59.337081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:59.341343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:38:59.354401 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1508757-08e9-49b1-8257-81bea369d96f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1467 microversion: 2.1 time: 0.551714 Aug 04 04:38:59.358630 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1788/3508] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:58 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1467 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:59.359389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:59.379828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3e16612b-e65a-4f94-bbf4-c8c0188cb4af tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1939665426"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:59.382871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3e16612b-e65a-4f94-bbf4-c8c0188cb4af tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:38:59.393053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e16612b-e65a-4f94-bbf4-c8c0188cb4af tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:59.395533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e16612b-e65a-4f94-bbf4-c8c0188cb4af tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:59.399293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e16612b-e65a-4f94-bbf4-c8c0188cb4af tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:59.399915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e16612b-e65a-4f94-bbf4-c8c0188cb4af tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:59.754649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3e16612b-e65a-4f94-bbf4-c8c0188cb4af tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "POST /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d/action" status: 202 len: 0 microversion: 2.1 time: 0.371621 Aug 04 04:38:59.761296 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1789/3509] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:38:59 2022] POST /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 04 04:38:59.772513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c48d33a4-b8ec-4195-b52e-c90b11fb04dd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a22550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:59.837606 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c48d33a4-b8ec-4195-b52e-c90b11fb04dd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 200 len: 1414 microversion: 2.1 time: 0.074935 Aug 04 04:38:59.838195 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1790/3510] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:59 2022] GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:59.851226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1557a326-e802-433e-a4bb-30e783719385 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a2d3a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:59.954265 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1557a326-e802-433e-a4bb-30e783719385 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1455 microversion: 2.1 time: 0.110440 Aug 04 04:38:59.970193 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1791/3511] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:38:59 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:59.991545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:59.992325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 23e70cb6-8312-4eb4-933a-240f846ea50a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:00.020007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:00.020727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:00.022049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:00.022886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:00.058792 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] HTTP exception thrown: Instance 23e70cb6-8312-4eb4-933a-240f846ea50a could not be found. Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Request method failure captured: Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a HTTP/1.1 Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60z1nGK8lOeG6KcbI28kl0tBgj5kWmuhkCnzAOV5_z5qQLFhB5naTekFBNSOQUaLONkjQSKVOa0LVjIe__wF2Sf6_VHp2OWPQZZNCJABAPKmddxSl_iQTk_TvejitKrAAYQ4W9Adk30YxvM_7izJSLQMFT66McQ-HV0YvCSx5AZiYWE Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 954a6a18b4b446f1a81cb37c65d6b08e Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_954a6a18b4b446f1a81cb37c65d6b08e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 954a6a18b4b446f1a81cb37c65d6b08e Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListServerFiltersTestJSON-881733850-project Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 608edb7e76194928aa7b5c1ddadbfc7d Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListServerFiltersTestJSON-881733850-project Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 23e70cb6-8312-4eb4-933a-240f846ea50a could not be found. Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '23e70cb6-8312-4eb4-933a-240f846ea50a'} Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e70cb6-8312-4eb4-933a-240f846ea50a could not be found. Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e70cb6-8312-4eb4-933a-240f846ea50a could not be found. Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:00.061126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e70cb6-8312-4eb4-933a-240f846ea50a could not be found. Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Returning 404 to user: Instance 23e70cb6-8312-4eb4-933a-240f846ea50a could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:00.066006 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bd011576-da95-4bd3-888b-5f2ca4ba8d9e tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a" status: 404 len: 111 microversion: 2.1 time: 0.091258 Aug 04 04:39:00.067221 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1792/3512] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:59 2022] GET /compute/v2.1/servers/23e70cb6-8312-4eb4-933a-240f846ea50a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:00.082875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:00.083764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:00.104420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:00.104856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:00.106898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:00.110927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:00.214224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:39:00.266903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:00.276047 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-199f3c18-254c-417e-9ee1-873e25f489b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.956069 Aug 04 04:39:00.291645 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1721/3513] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:59 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:00.357350 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87872ac9-ee80-438c-a90c-99a8bb739aae tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 204 len: 0 microversion: 2.1 time: 0.283314 Aug 04 04:39:00.358623 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1793/3514] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:00 2022] DELETE /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:39:00.366759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:00.367417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:00.377408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:00.385131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:00.386299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:00.386919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:00.855127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c72580c-cebf-4c46-a91d-11c3fc86062b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a22310>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:00.983494 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c72580c-cebf-4c46-a91d-11c3fc86062b tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 200 len: 1414 microversion: 2.1 time: 0.133035 Aug 04 04:39:00.984197 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1794/3515] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:00 2022] GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:00.988413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:00.997587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8228e7ff-207d-4ace-9631-17c6d064de8d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a22670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:01.006118 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab64b7d8-a3d3-43de-9272-714c5f8f46f7 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 200 len: 1516 microversion: 2.1 time: 0.636357 Aug 04 04:39:01.009389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1722/3516] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:00 2022] GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 1516 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:01.120118 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8228e7ff-207d-4ace-9631-17c6d064de8d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1455 microversion: 2.1 time: 0.132981 Aug 04 04:39:01.121093 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1795/3517] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:00 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:01.308751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:01.309412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:01.332481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:01.333030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:01.334816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:01.337215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:01.456240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:01.907253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:01.919377 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7a6a6ce-0b19-4cd7-b69b-d2b35b3dbaa1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.616609 Aug 04 04:39:01.922679 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1723/3518] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:01 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:02.007006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b912a7cb-6ce0-41ef-ab2a-c15509d39b83 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919ab48b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:02.032576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:02.033742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:02.051964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:02.054222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:02.055638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:02.056099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:02.116710 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b912a7cb-6ce0-41ef-ab2a-c15509d39b83 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 200 len: 1414 microversion: 2.1 time: 0.119858 Aug 04 04:39:02.117310 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1796/3519] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:01 2022] GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:02.137682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-402b2e77-8ba2-47ec-ab12-9609ca110ca9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919837af0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:02.230624 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-402b2e77-8ba2-47ec-ab12-9609ca110ca9 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1455 microversion: 2.1 time: 0.098027 Aug 04 04:39:02.231643 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1797/3520] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:02 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:02.786701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:02.796001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5955536-a26b-413c-a40b-29a417d3decc tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 200 len: 1516 microversion: 2.1 time: 0.770936 Aug 04 04:39:02.802503 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1724/3521] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:02 2022] GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 1516 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:02.940269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:02.946334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:02.947455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:02.960665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:02.967691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:02.969367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:02.971940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:03.021383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:03.132609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7234028a-d2bf-4d1d-814a-fabae60a4609 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1918ee5160>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:03.252744 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7234028a-d2bf-4d1d-814a-fabae60a4609 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 200 len: 1414 microversion: 2.1 time: 0.121971 Aug 04 04:39:03.253932 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1725/3522] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:03 2022] GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:03.280055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f0b5c689-0160-4e52-abc9-28abb1f65215 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923abde50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:03.325250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:03.338004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fa614583-8526-43dc-b1a4-8a7e9e578727 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.398845 Aug 04 04:39:03.339423 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1798/3523] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:02 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:03.379122 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f0b5c689-0160-4e52-abc9-28abb1f65215 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1455 microversion: 2.1 time: 0.123931 Aug 04 04:39:03.390447 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1726/3524] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:03 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:03.789236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-69275bc1-8743-4ac1-89ac-b50b13765bcc req-6eea730a-6eb3-4c2c-a5aa-3144204e6289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9ce364-fb10-4d85-b724-c523ebfae39a", "name": "network-vif-deleted", "tag": "f8452bab-27a5-4c74-9a15-7448bd16835c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:03.810858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-69275bc1-8743-4ac1-89ac-b50b13765bcc req-6eea730a-6eb3-4c2c-a5aa-3144204e6289 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:03.812290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-69275bc1-8743-4ac1-89ac-b50b13765bcc req-6eea730a-6eb3-4c2c-a5aa-3144204e6289 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:03.828123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:03.832403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:03.855343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:03.859748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:03.861879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:03.865433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:03.892320 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-69275bc1-8743-4ac1-89ac-b50b13765bcc req-6eea730a-6eb3-4c2c-a5aa-3144204e6289 service nova] Creating event network-vif-deleted:f8452bab-27a5-4c74-9a15-7448bd16835c for instance 6d9ce364-fb10-4d85-b724-c523ebfae39a on n-h1-851337-5 Aug 04 04:39:03.928424 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-69275bc1-8743-4ac1-89ac-b50b13765bcc req-6eea730a-6eb3-4c2c-a5aa-3144204e6289 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140471 Aug 04 04:39:03.930740 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1799/3525] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:04.095495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:04.105876 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-353319e7-64ec-44e1-bfd4-a6aa39aab4f6 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 200 len: 1305 microversion: 2.1 time: 0.285282 Aug 04 04:39:04.106496 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1727/3526] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:03 2022] GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 1305 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:04.269966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9db61cc8-a114-4f39-8381-6abc24052d50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919adf940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:04.363658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:04.370917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:04.403923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:04.404411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:04.413923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:04.414384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:05.690772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:05.704475 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c9ded782-b147-45c6-9931-fe927f33ba67 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 1.347826 Aug 04 04:39:05.711534 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1728/3527] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:04 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:05.720159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-65d28394-508a-43c9-a503-a556d5fa983e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f192392cd30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:13.807651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:13.843579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:14.382570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:15.696757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=35 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:24.249520 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9db61cc8-a114-4f39-8381-6abc24052d50 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 200 len: 1423 microversion: 2.1 time: 19.984645 Aug 04 04:39:24.250118 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1800/3528] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:04 2022] GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 1423 bytes in 19986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:24.264005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:24.264758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: 6d9ce364-fb10-4d85-b724-c523ebfae39a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:24.286642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-65d28394-508a-43c9-a503-a556d5fa983e tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1455 microversion: 2.1 time: 18.573606 Aug 04 04:39:24.287328 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1729/3529] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:05 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1455 bytes in 18575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:24.289181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.289973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.291129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.291723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.296354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a733daf9-920c-40ef-beb3-46e83c7766ef req-68738719-6fd1-4217-8ecf-0cab7d68c1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd663b6c-197e-408d-9802-63aaf5ae81d3", "name": "network-vif-plugged", "status": "completed", "tag": "a4110d95-03c7-4491-8d2d-f3e661efd858"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:24.311243 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] HTTP exception thrown: Instance 6d9ce364-fb10-4d85-b724-c523ebfae39a could not be found. Aug 04 04:39:24.314670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a733daf9-920c-40ef-beb3-46e83c7766ef req-68738719-6fd1-4217-8ecf-0cab7d68c1d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Request method failure captured: Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a HTTP/1.1 Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60z1nGK8lOeG6KcbI28kl0tBgj5kWmuhkCnzAOV5_z5qQLFhB5naTekFBNSOQUaLONkjQSKVOa0LVjIe__wF2Sf6_VHp2OWPQZZNCJABAPKmddxSl_iQTk_TvejitKrAAYQ4W9Adk30YxvM_7izJSLQMFT66McQ-HV0YvCSx5AZiYWE Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 954a6a18b4b446f1a81cb37c65d6b08e Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_954a6a18b4b446f1a81cb37c65d6b08e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 954a6a18b4b446f1a81cb37c65d6b08e Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListServerFiltersTestJSON-881733850-project Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 608edb7e76194928aa7b5c1ddadbfc7d Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListServerFiltersTestJSON-881733850-project Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6d9ce364-fb10-4d85-b724-c523ebfae39a could not be found. Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6d9ce364-fb10-4d85-b724-c523ebfae39a'} Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9ce364-fb10-4d85-b724-c523ebfae39a could not be found. Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9ce364-fb10-4d85-b724-c523ebfae39a could not be found. Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:24.314857 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9ce364-fb10-4d85-b724-c523ebfae39a could not be found. Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Returning 404 to user: Instance 6d9ce364-fb10-4d85-b724-c523ebfae39a could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-88c8508f-5d00-4338-af13-01656c364d58 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a" status: 404 len: 111 microversion: 2.1 time: 0.057061 Aug 04 04:39:24.321818 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1801/3530] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:24 2022] GET /compute/v2.1/servers/6d9ce364-fb10-4d85-b724-c523ebfae39a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:24.323247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:24.323421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:24.327720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a733daf9-920c-40ef-beb3-46e83c7766ef req-68738719-6fd1-4217-8ecf-0cab7d68c1d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.330431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.330890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.331715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.332152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.351318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:24.352751 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a733daf9-920c-40ef-beb3-46e83c7766ef req-68738719-6fd1-4217-8ecf-0cab7d68c1d9 service nova] Creating event network-vif-plugged:a4110d95-03c7-4491-8d2d-f3e661efd858 for instance cd663b6c-197e-408d-9802-63aaf5ae81d3 on n-h2-851337-5 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 HTTP/1.1 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '491721d5-4a6a-44c9-bb27-3dff3ce3ae79'} Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:24.353265 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d644821d-4c21-4090-bc05-a08bb459f6e5 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "DELETE /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 404 len: 111 microversion: 2.1 time: 0.036397 Aug 04 04:39:24.360521 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1802/3531] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:24 2022] DELETE /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:24.368583 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a733daf9-920c-40ef-beb3-46e83c7766ef req-68738719-6fd1-4217-8ecf-0cab7d68c1d9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079551 Aug 04 04:39:24.368856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:24.369682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:24.374193 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1730/3532] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:24.376689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.377138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.377915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.378349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.738864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:24.750123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b88072a0-3f0a-4f31-9ac2-43ea87f7dcf2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.388844 Aug 04 04:39:24.751031 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1803/3533] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:24 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:24.941280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-55495001", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "ef8d42be-b24c-4110-99ec-2eb02fb9f35e"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:25.077466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] validate_networks() for [('ef8d42be-b24c-4110-99ec-2eb02fb9f35e', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:25.198191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-137674191", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:25.308823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] validate_networks() for [('3d7e33ff-d38a-4774-b4fa-1f6ef2b80bb7', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:26.460057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:26.460866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:26.461072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:26.461732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:26.463659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:26.492854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.495930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.497082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.497738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.498288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:26.498778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:26.499228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:26.499782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:26.500051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:26.517392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.518237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.522879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.523658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.529084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Getting quotas for project f969370a6b5d42699443e01d59435d61. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:26.538848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Getting quotas for user 11559fdf745a4ac49b343b056a5f961c and project f969370a6b5d42699443e01d59435d61. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:26.561831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:26.567779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:26.571736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Getting quotas for project 9488df2de5f2402596ad614ca0132778. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:26.580440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Getting quotas for user c39dc10490454d4a9f5c39507a469bb0 and project 9488df2de5f2402596ad614ca0132778. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:26.624752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:26.629685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:26.696537 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4052cfb0-1428-400c-8f4f-38271794c9e2 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.943611 Aug 04 04:39:26.697556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1804/3534] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:26.703447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b9b47eb-aa6e-4c91-89d5-b3434e53fab8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a22670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:26.764584 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e26fe887-7f68-4b83-87b2-6f893ed2f3db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.385515 Aug 04 04:39:26.765591 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1731/3535] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:26.787197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:26.789999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:26.809647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.810635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.812076 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b9b47eb-aa6e-4c91-89d5-b3434e53fab8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 200 len: 1423 microversion: 2.1 time: 0.112562 Aug 04 04:39:26.812593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.814249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.815029 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1805/3536] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:26 2022] GET /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:26.827734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:26.833168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] [instance: 491721d5-4a6a-44c9-bb27-3dff3ce3ae79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:26.878248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.879636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.884535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.886134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.940063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] HTTP exception thrown: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Request method failure captured: Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 HTTP/1.1 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60sxWwhwR3_V3xVbmRHH5hPR0C765lBTs7MSjy5dlbACZXpAXjKPNxtOhRaq_DMyC0AUreTA8BkvChR5uPimSoHj_g4T_4nNJVBhKJpROyeh_OF3OUa9ZI_aoGPDCDrNoDq-D4ouCjE-bzZQR5h7fQn3-hmUFWLS_uo3VrRdOmcm3zs Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ad357c5189504aba9361110360005bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ad357c5189504aba9361110360005bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ad357c5189504aba9361110360005bd2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ad357c5189504aba9361110360005bd2 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1977161979 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b2588a591dfc42549c0a98fd40f97d58 Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeNegativeTest-1977161979-project Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '491721d5-4a6a-44c9-bb27-3dff3ce3ae79'} Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:26.943258 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:26.950294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:26.950294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:26.950294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:26.950294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:26.950294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:26.950294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. Aug 04 04:39:26.950294 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:26.960235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:39:26.966556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] Returning 404 to user: Instance 491721d5-4a6a-44c9-bb27-3dff3ce3ae79 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:26.968958 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a30bd804-70d3-4f5c-853f-6d2f276ff065 tempest-AttachVolumeNegativeTest-1977161979 tempest-AttachVolumeNegativeTest-1977161979-project] 10.222.0.69 "GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79" status: 404 len: 111 microversion: 2.1 time: 0.151329 Aug 04 04:39:26.972816 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1806/3537] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:26 2022] GET /compute/v2.1/servers/491721d5-4a6a-44c9-bb27-3dff3ce3ae79 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:27.008297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-416b7f30-0fde-4dbe-b7ca-a9e9e0d2b391 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a74d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:27.194354 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-416b7f30-0fde-4dbe-b7ca-a9e9e0d2b391 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1455 microversion: 2.1 time: 0.213719 Aug 04 04:39:27.197786 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1807/3538] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:26 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1455 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:27.223999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:27.224889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:27.234396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:27.236054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:27.237678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:27.238568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:27.420826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1baa0d3-3220-4fcc-bc9c-69a08d03b189 tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 204 len: 0 microversion: 2.1 time: 0.649299 Aug 04 04:39:27.421453 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1732/3539] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:26 2022] DELETE /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:27.446511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6bf873b1-0e78-487a-8e14-c5e212414931 req-39265eea-f71e-42c7-8af0-ab87c9f9cfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cdc530-bc0f-42fa-bb6f-c8bf225761c6", "name": "network-vif-unplugged", "status": "completed", "tag": "63e89099-0992-4a96-b81b-77db4750634e"}, {"server_uuid": "c2da970f-9222-4cef-89a6-0920cd4378d0", "name": "network-vif-plugged", "status": "completed", "tag": "86d1a786-3553-434e-82af-0c6c7fbded9f"}, {"server_uuid": "11ed652d-4352-4709-9f35-cd6dad67ba0d", "name": "network-vif-plugged", "status": "completed", "tag": "c418aa72-3ee1-4a69-9a47-4b46b90fd296"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:27.492295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6bf873b1-0e78-487a-8e14-c5e212414931 req-39265eea-f71e-42c7-8af0-ab87c9f9cfbf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:27.494344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6bf873b1-0e78-487a-8e14-c5e212414931 req-39265eea-f71e-42c7-8af0-ab87c9f9cfbf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:27.541552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:27.554085 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6bf873b1-0e78-487a-8e14-c5e212414931 req-39265eea-f71e-42c7-8af0-ab87c9f9cfbf service nova] Creating event network-vif-unplugged:63e89099-0992-4a96-b81b-77db4750634e for instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 on n-h2-851337-5 Aug 04 04:39:27.555055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6bf873b1-0e78-487a-8e14-c5e212414931 req-39265eea-f71e-42c7-8af0-ab87c9f9cfbf service nova] Creating event network-vif-plugged:86d1a786-3553-434e-82af-0c6c7fbded9f for instance c2da970f-9222-4cef-89a6-0920cd4378d0 on n-h2-851337-5 Aug 04 04:39:27.558268 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48639a00-f2e4-4a63-9bf1-aef296b36b3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.356925 Aug 04 04:39:27.559214 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6bf873b1-0e78-487a-8e14-c5e212414931 req-39265eea-f71e-42c7-8af0-ab87c9f9cfbf service nova] Creating event network-vif-plugged:c418aa72-3ee1-4a69-9a47-4b46b90fd296 for instance 11ed652d-4352-4709-9f35-cd6dad67ba0d on n-h2-851337-5 Aug 04 04:39:27.560540 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1808/3540] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:27 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:27.566874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-45fc86e7-d6cd-4c44-b5f6-e430b40c4645 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:27.567931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-45fc86e7-d6cd-4c44-b5f6-e430b40c4645 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:27.591963 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6bf873b1-0e78-487a-8e14-c5e212414931 req-39265eea-f71e-42c7-8af0-ab87c9f9cfbf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.165055 Aug 04 04:39:27.596973 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1733/3541] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:27.617833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1dfdb85c-70dc-43c1-be9d-0d6bb1c70bf4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:27.618982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1dfdb85c-70dc-43c1-be9d-0d6bb1c70bf4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:27.665959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45fc86e7-d6cd-4c44-b5f6-e430b40c4645 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:27.677271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-45fc86e7-d6cd-4c44-b5f6-e430b40c4645 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1213 microversion: 2.1 time: 0.115368 Aug 04 04:39:27.677852 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1809/3542] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:27 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:27.694395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e45faf69-57d1-4644-93b1-6196fe6d1dd3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a2da790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:27.994694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1dfdb85c-70dc-43c1-be9d-0d6bb1c70bf4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:28.017335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1dfdb85c-70dc-43c1-be9d-0d6bb1c70bf4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1230 microversion: 2.1 time: 0.415424 Aug 04 04:39:28.035221 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1734/3543] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:27 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1230 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:28.049625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:28.052869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:28.086684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.087228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.088079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.088525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.502724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:28.523873 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-075a468f-6370-477c-a2c4-ca1775f0344c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1517 microversion: 2.1 time: 0.487460 Aug 04 04:39:28.524477 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1735/3544] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:28 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1517 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:28.541695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a82d1dc5-719b-4add-8a97-36536f7c6237 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923a71310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:28.751732 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a82d1dc5-719b-4add-8a97-36536f7c6237 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1464 microversion: 2.1 time: 0.223835 Aug 04 04:39:28.752786 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1736/3545] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:28 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:28.779816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:28.780991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:28.820844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.824255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.829827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.833134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.019201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e45faf69-57d1-4644-93b1-6196fe6d1dd3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 204 len: 0 microversion: 2.1 time: 1.335937 Aug 04 04:39:29.023050 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1810/3546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:27 2022] DELETE /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 0 bytes in 1342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:29.028998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:29.029629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:29.050494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.050984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.051783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.052236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.433846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:29.445298 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-988a08be-f121-483d-81c7-d79ef494282d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1209 microversion: 2.1 time: 0.420876 Aug 04 04:39:29.463480 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1811/3547] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:29 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1209 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:29.469258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35d4e609-d957-45e8-a209-0095d60fe292 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919ac8550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:29.528799 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35d4e609-d957-45e8-a209-0095d60fe292 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 200 len: 1464 microversion: 2.1 time: 0.063879 Aug 04 04:39:29.533962 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1812/3548] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:29 2022] GET /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 1464 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:29.559349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:29.560837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:29.585890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.591135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.591135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.591135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.678473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:39:29.689617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:29.710546 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fe618bfb-5ee5-4696-8e23-fdc839ede105 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1292 microversion: 2.1 time: 0.952290 Aug 04 04:39:29.739009 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1737/3549] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:28 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1292 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:29.745625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:29.754929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:29.771970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.772584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.775028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.775505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.004656 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-18d719cb-839e-4583-ba17-edcf6636dc45 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 204 len: 0 microversion: 2.1 time: 0.458229 Aug 04 04:39:30.012230 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1813/3550] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:29 2022] DELETE /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:30.029356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:30.030075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:30.053682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.054187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.055419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.056174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.091144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:30.099924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a2962070-1de7-4745-9f18-02a1ac8c278b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1282 microversion: 2.1 time: 0.359077 Aug 04 04:39:30.120251 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1738/3551] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:29 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1282 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:30.144295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:30.151109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:30.176981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.177636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.178448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.178891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.715373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:30.724926 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24f536e4-d1e9-42e6-820f-e3faf2f3eefa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 200 len: 1468 microversion: 2.1 time: 0.711207 Aug 04 04:39:30.725545 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1814/3552] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:30 2022] GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 1468 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:30.740653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2de80166-1528-48ae-8645-26158337c76f req-68fdec2f-747f-4652-9dfe-f0cf7c2268ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd663b6c-197e-408d-9802-63aaf5ae81d3", "name": "network-vif-unplugged", "status": "completed", "tag": "a4110d95-03c7-4491-8d2d-f3e661efd858"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:30.763900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2de80166-1528-48ae-8645-26158337c76f req-68fdec2f-747f-4652-9dfe-f0cf7c2268ab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.764377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2de80166-1528-48ae-8645-26158337c76f req-68fdec2f-747f-4652-9dfe-f0cf7c2268ab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.782099 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2de80166-1528-48ae-8645-26158337c76f req-68fdec2f-747f-4652-9dfe-f0cf7c2268ab service nova] Creating event network-vif-unplugged:a4110d95-03c7-4491-8d2d-f3e661efd858 for instance cd663b6c-197e-408d-9802-63aaf5ae81d3 on n-h2-851337-5 Aug 04 04:39:30.799486 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2de80166-1528-48ae-8645-26158337c76f req-68fdec2f-747f-4652-9dfe-f0cf7c2268ab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070048 Aug 04 04:39:30.800147 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1815/3553] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:30.816027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1359877957", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:30.818054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608edb7e76194928aa7b5c1ddadbfc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954a6a18b4b446f1a81cb37c65d6b08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:30.829332 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a8e2543-5723-4a68-a208-d7afd003e21f tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 200 len: 1517 microversion: 2.1 time: 0.707891 Aug 04 04:39:30.830479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1739/3554] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:30 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 1517 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:30.851148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:30.852319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:30.877979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.878663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.879557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.880087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.972700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] validate_networks() for [('c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:31.064554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:31.083984 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-107aee12-de61-4997-b7f3-02c2ef043528 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1271 microversion: 2.1 time: 0.252220 Aug 04 04:39:31.092042 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1740/3555] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:30 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:31.109127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:31.110564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:31.122841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.123717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.126294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.127384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.532973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:31.548842 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-54cfa07f-f705-4aa3-a7de-64d6d3fe0ad0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1473 microversion: 2.1 time: 0.449765 Aug 04 04:39:31.550107 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1741/3556] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:31 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1473 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:31.558899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2de72cfc-2536-46af-bd79-03aac78503fa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923a71820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:31.786782 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2de72cfc-2536-46af-bd79-03aac78503fa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?changes-since=2022-08-04T04%3A37%3A10Z" status: 200 len: 1902 microversion: 2.1 time: 0.235329 Aug 04 04:39:31.787434 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1742/3557] 10.222.0.69 () {58 vars in 1199 bytes} [Thu Aug 4 04:39:31 2022] GET /compute/v2.1/images?changes-since=2022-08-04T04%3A37%3A10Z => generated 1902 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:31.806167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b8f79dd1-eb58-457f-b73e-9cd0adc0b2b1 req-e45e5dea-70e2-409d-8406-d42b038f4517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f5387a-d6f5-4d08-ae53-1f79fa44685b", "name": "network-vif-deleted", "tag": "753afc88-8bfd-4e25-af8d-551951c7820c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:31.820979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b8f79dd1-eb58-457f-b73e-9cd0adc0b2b1 req-e45e5dea-70e2-409d-8406-d42b038f4517 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.821727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b8f79dd1-eb58-457f-b73e-9cd0adc0b2b1 req-e45e5dea-70e2-409d-8406-d42b038f4517 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.838457 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b8f79dd1-eb58-457f-b73e-9cd0adc0b2b1 req-e45e5dea-70e2-409d-8406-d42b038f4517 service nova] Creating event network-vif-deleted:753afc88-8bfd-4e25-af8d-551951c7820c for instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b on n-h1-851337-5 Aug 04 04:39:31.849537 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b8f79dd1-eb58-457f-b73e-9cd0adc0b2b1 req-e45e5dea-70e2-409d-8406-d42b038f4517 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047745 Aug 04 04:39:31.850621 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1743/3558] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:31.857502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:31.858530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:31.867167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.867374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.868152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.868858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.133064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:32.150402 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-13557770-52f2-426d-9000-b4595e5aaca4 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1288 microversion: 2.1 time: 0.298353 Aug 04 04:39:32.152579 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1744/3559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:31 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1288 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:32.164809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a9f07a9e-3a24-462a-a4b0-fb0b4a2f4378 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923967280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:32.273957 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a9f07a9e-3a24-462a-a4b0-fb0b4a2f4378 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1972067914" status: 200 len: 485 microversion: 2.1 time: 0.119342 Aug 04 04:39:32.274556 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1745/3560] 10.222.0.69 () {58 vars in 1231 bytes} [Thu Aug 4 04:39:32 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1972067914 => generated 485 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:32.283642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1521247776", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:32.348690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:32.349212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:32.349752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:32.350266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:32.350783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:32.355719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:32.365657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.371519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.372559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.373161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.433724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:32.451179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for user bb9ca81b2ec24bd1b139bb817a47bb29 and project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:32.487670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:32.492493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:32.606180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-678f56f8-a13f-4cfc-9d0c-7302b22c2c62 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.797571 Aug 04 04:39:32.610778 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1816/3561] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:32.624427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:32.633257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] [instance: d8f5387a-d6f5-4d08-ae53-1f79fa44685b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:32.642675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.646774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.648767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.649867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.697416 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] HTTP exception thrown: Instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b could not be found. Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Request method failure captured: Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b HTTP/1.1 Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60z1nGK8lOeG6KcbI28kl0tBgj5kWmuhkCnzAOV5_z5qQLFhB5naTekFBNSOQUaLONkjQSKVOa0LVjIe__wF2Sf6_VHp2OWPQZZNCJABAPKmddxSl_iQTk_TvejitKrAAYQ4W9Adk30YxvM_7izJSLQMFT66McQ-HV0YvCSx5AZiYWE Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 954a6a18b4b446f1a81cb37c65d6b08e Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/954a6a18b4b446f1a81cb37c65d6b08e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_954a6a18b4b446f1a81cb37c65d6b08e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 954a6a18b4b446f1a81cb37c65d6b08e Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-881733850 Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListServerFiltersTestJSON-881733850-project Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 608edb7e76194928aa7b5c1ddadbfc7d Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListServerFiltersTestJSON-881733850-project Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b could not be found. Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'd8f5387a-d6f5-4d08-ae53-1f79fa44685b'} Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b could not be found. Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b could not be found. Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:32.713679 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:32.718646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:32.718646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:32.718646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:32.718646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:32.718646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:32.718646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b could not be found. Aug 04 04:39:32.718646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:32.723145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] Returning 404 to user: Instance d8f5387a-d6f5-4d08-ae53-1f79fa44685b could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:32.725249 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4407cace-d37b-45a0-8647-2f705569952c tempest-ListServerFiltersTestJSON-881733850 tempest-ListServerFiltersTestJSON-881733850-project] 10.222.0.69 "GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b" status: 404 len: 111 microversion: 2.1 time: 0.112745 Aug 04 04:39:32.726012 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1817/3562] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:32 2022] GET /compute/v2.1/servers/d8f5387a-d6f5-4d08-ae53-1f79fa44685b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:32.743428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:32.745487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:32.758250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.758712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.759556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.760004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:33.683560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:33.695144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0fae7a0c-18f1-4055-85ea-c360c48778ec tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.964046 Aug 04 04:39:33.711631 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1818/3563] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:32 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:33.717046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd1711eb-9c7e-4d58-95dd-ae2c4f5d210f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919ab40d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:33.824605 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bd1711eb-9c7e-4d58-95dd-ae2c4f5d210f tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?server=11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 200 len: 958 microversion: 2.1 time: 0.110919 Aug 04 04:39:33.825436 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1819/3564] 10.222.0.69 () {58 vars in 1209 bytes} [Thu Aug 4 04:39:33 2022] GET /compute/v2.1/images?server=11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 958 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:33.833612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:33.834891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:33.844695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:33.845765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:33.846788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:33.847476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:33.994896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:34.007343 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27372bd1-0041-497f-97b8-695f63ae359a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1260 microversion: 2.1 time: 0.179758 Aug 04 04:39:34.025237 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1820/3565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:33 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:34.042435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:34.044054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:34.073450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.075379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.079073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.081380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.472127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:34.472613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:34.476470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:34.476944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:34.477383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:34.497426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.497877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.498670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.499327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.544728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:34.555718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:34.564653 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1e8aafc5-9178-4284-bd72-dd8ad3854b57 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.537460 Aug 04 04:39:34.567884 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1821/3566] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:34 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:34.571084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:34.574838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a4285a51-b7e0-4c85-b091-430bcb0c0e4a req-41d4d107-c8b8-4863-a238-994d58895c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed652d-4352-4709-9f35-cd6dad67ba0d", "name": "network-vif-unplugged", "status": "completed", "tag": "c418aa72-3ee1-4a69-9a47-4b46b90fd296"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:34.599717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a4285a51-b7e0-4c85-b091-430bcb0c0e4a req-41d4d107-c8b8-4863-a238-994d58895c95 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.600510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a4285a51-b7e0-4c85-b091-430bcb0c0e4a req-41d4d107-c8b8-4863-a238-994d58895c95 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.605454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:34.610682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: b2718ff9-cc77-4a75-9491-d3ca98717aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:34.623795 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a4285a51-b7e0-4c85-b091-430bcb0c0e4a req-41d4d107-c8b8-4863-a238-994d58895c95 service nova] Creating event network-vif-unplugged:c418aa72-3ee1-4a69-9a47-4b46b90fd296 for instance 11ed652d-4352-4709-9f35-cd6dad67ba0d on n-h2-851337-5 Aug 04 04:39:34.638414 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a4285a51-b7e0-4c85-b091-430bcb0c0e4a req-41d4d107-c8b8-4863-a238-994d58895c95 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067983 Aug 04 04:39:34.640947 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1822/3567] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:34.651992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cca67328-1f1a-4722-948c-6547d0ca7d20 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919ab4280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:34.718561 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-556912dc-28fe-4c26-9ecc-39ccb47ef3a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.442785 Aug 04 04:39:34.722649 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1746/3568] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:34.730503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-abb5cfc5-8d6f-4bbe-a6a0-dd9f9b5b4381 req-f76c988b-d3bc-47ec-ac81-0fac4b6d9a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd663b6c-197e-408d-9802-63aaf5ae81d3", "name": "network-vif-deleted", "tag": "a4110d95-03c7-4491-8d2d-f3e661efd858"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:34.741591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-abb5cfc5-8d6f-4bbe-a6a0-dd9f9b5b4381 req-f76c988b-d3bc-47ec-ac81-0fac4b6d9a44 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.742355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-abb5cfc5-8d6f-4bbe-a6a0-dd9f9b5b4381 req-f76c988b-d3bc-47ec-ac81-0fac4b6d9a44 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.784227 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cca67328-1f1a-4722-948c-6547d0ca7d20 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 484 microversion: 2.1 time: 0.141464 Aug 04 04:39:34.795516 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1823/3569] 10.222.0.69 () {58 vars in 1317 bytes} [Thu Aug 4 04:39:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 484 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:34.798894 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-abb5cfc5-8d6f-4bbe-a6a0-dd9f9b5b4381 req-f76c988b-d3bc-47ec-ac81-0fac4b6d9a44 service nova] Creating event network-vif-deleted:a4110d95-03c7-4491-8d2d-f3e661efd858 for instance cd663b6c-197e-408d-9802-63aaf5ae81d3 on n-h2-851337-5 Aug 04 04:39:34.804756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:34.809307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:34.812696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-abb5cfc5-8d6f-4bbe-a6a0-dd9f9b5b4381 req-f76c988b-d3bc-47ec-ac81-0fac4b6d9a44 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082545 Aug 04 04:39:34.814113 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1747/3570] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:34.835396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.835852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.836643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.845856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.846642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a3430f3-46a5-4719-9420-158d106674f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:34.847277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a3430f3-46a5-4719-9420-158d106674f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: b2718ff9-cc77-4a75-9491-d3ca98717aa2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:34.901868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a3430f3-46a5-4719-9420-158d106674f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: b2718ff9-cc77-4a75-9491-d3ca98717aa2] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:39:35.521293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a3430f3-46a5-4719-9420-158d106674f6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2" status: 204 len: 0 microversion: 2.1 time: 0.705194 Aug 04 04:39:35.521947 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1748/3571] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:34 2022] DELETE /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:35.535109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5baaf87d-b2c2-4bcb-831e-e2e036a54df1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19191de430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:35.617136 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5baaf87d-b2c2-4bcb-831e-e2e036a54df1 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 484 microversion: 2.1 time: 0.093978 Aug 04 04:39:35.620176 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1749/3572] 10.222.0.69 () {58 vars in 1303 bytes} [Thu Aug 4 04:39:35 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 484 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:35.639351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:35.643288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:35.662726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.665208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.669392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:35.682197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.682658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.683830 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08a6750f-725b-4357-9180-7d052a3c2efe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.884425 Aug 04 04:39:35.685799 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1824/3573] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:34 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:35.706329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dae50755-0f97-470c-a365-79674d9829a3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:35.707456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dae50755-0f97-470c-a365-79674d9829a3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: b2718ff9-cc77-4a75-9491-d3ca98717aa2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:35.729450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-dae50755-0f97-470c-a365-79674d9829a3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dae50755-0f97-470c-a365-79674d9829a3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2 HTTP/1.1 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b2718ff9-cc77-4a75-9491-d3ca98717aa2'} Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:35.733397 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:35.739568 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:35.739568 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:35.739568 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:35.739568 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:39:35.739568 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:39:35.744829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dae50755-0f97-470c-a365-79674d9829a3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:35.747700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dae50755-0f97-470c-a365-79674d9829a3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2" status: 404 len: 111 microversion: 2.1 time: 0.060727 Aug 04 04:39:35.751031 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1825/3574] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:35 2022] GET /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:35.770809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:35.782096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:35.807754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.814633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.815910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.819727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.941525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:35.950207 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2f76ca9-890b-49f4-ab70-a863fe2c150a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1266 microversion: 2.1 time: 0.328144 Aug 04 04:39:35.970204 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1750/3575] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:35 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:35.975254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4937cf99-c483-4115-a1e6-e6c2493bc0d7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19239b58b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:36.150247 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4937cf99-c483-4115-a1e6-e6c2493bc0d7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.188960 Aug 04 04:39:36.156716 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1751/3576] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:39:35 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:36.161799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-dfb1d318-d7c1-4579-82ba-09c97ddf798d req-c74fed2b-9725-4d7e-b0df-1e1672d53c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecffab2-8b53-4458-be5c-86b73b3b7836", "tag": "949b2a74-9647-4bb2-b9c9-0a838d14863e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:36.189486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dfb1d318-d7c1-4579-82ba-09c97ddf798d req-c74fed2b-9725-4d7e-b0df-1e1672d53c71 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:36.197129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dfb1d318-d7c1-4579-82ba-09c97ddf798d req-c74fed2b-9725-4d7e-b0df-1e1672d53c71 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:36.216619 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dfb1d318-d7c1-4579-82ba-09c97ddf798d req-c74fed2b-9725-4d7e-b0df-1e1672d53c71 service nova] Creating event network-changed:949b2a74-9647-4bb2-b9c9-0a838d14863e for instance eecffab2-8b53-4458-be5c-86b73b3b7836 on n-h1-851337-5 Aug 04 04:39:36.217544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:36.233579 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-dfb1d318-d7c1-4579-82ba-09c97ddf798d req-c74fed2b-9725-4d7e-b0df-1e1672d53c71 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075372 Aug 04 04:39:36.235048 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1752/3577] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:36.242326 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a548dea7-a132-466a-825d-49aa7dfe83a0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.487000 Aug 04 04:39:36.243601 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1826/3578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:35 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:36.249271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8dcb8430-c010-43af-9026-ff0bcbaab8fd tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a2da430>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:36.258705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-520733138", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "4d7b0316-9278-41a0-bbbc-01764ef3318b"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:36.357245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:36.392601 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8dcb8430-c010-43af-9026-ff0bcbaab8fd tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.147815 Aug 04 04:39:36.398274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1827/3579] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:39:36 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:36.412243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da8e2e7a-6b04-43bb-8129-35d52f4d4247 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919964280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:36.595484 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da8e2e7a-6b04-43bb-8129-35d52f4d4247 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.184719 Aug 04 04:39:36.596919 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1828/3580] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:39:36 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:39:36.611905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4c2fa595-62e3-42a5-9cc4-e58648d1b50b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919837d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:36.724598 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4c2fa595-62e3-42a5-9cc4-e58648d1b50b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/detail?changes-since=2022-08-04T04%3A37%3A05Z" status: 200 len: 6333 microversion: 2.1 time: 0.117388 Aug 04 04:39:36.735474 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1829/3581] 10.222.0.69 () {58 vars in 1220 bytes} [Thu Aug 4 04:39:36 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-04T04%3A37%3A05Z => generated 6333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:36.764688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:36.765330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:36.803654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:36.804108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:36.805019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:36.812851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.318198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:37.355064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb753a78-9161-41d7-ba02-a55fed6a6980 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.613950 Aug 04 04:39:37.356407 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1830/3582] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:36 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:37.378589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c359964-c966-4e12-bed6-64d303b480aa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f191a343670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:37.439567 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c359964-c966-4e12-bed6-64d303b480aa tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1972067914" status: 200 len: 665 microversion: 2.1 time: 0.066962 Aug 04 04:39:37.440222 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1831/3583] 10.222.0.69 () {58 vars in 1252 bytes} [Thu Aug 4 04:39:37 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1972067914 => generated 665 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:37.463851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:37.477527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:37.487230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.495532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.497196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.498561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.595156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:37.595714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:37.596058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:37.597120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:37.597563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:37.609026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.610032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.610838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.611302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.620153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:37.629059 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d49805ec-996b-48b0-93e8-6ce77faa0c5c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1266 microversion: 2.1 time: 0.184455 Aug 04 04:39:37.630715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:37.631678 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1832/3584] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:37 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:37.648403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:37.649467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:37.654082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:37.674111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.674830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.677013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.678776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.693417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:37.695999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:37.714022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:37.731904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:37.776135 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93911fd3-601f-4d2c-96ef-03231e287e03 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539271 Aug 04 04:39:37.777630 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1753/3585] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:37.785108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a3d881cc-7db8-4f26-bd77-819fec4f12eb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19239b7af0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:37.855474 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a3d881cc-7db8-4f26-bd77-819fec4f12eb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1466 microversion: 2.1 time: 0.076275 Aug 04 04:39:37.870119 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1754/3586] 10.222.0.69 () {58 vars in 1338 bytes} [Thu Aug 4 04:39:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1466 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:37.878338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-66ac9ae8-18a8-4fef-8503-9f93452e671e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:37.881597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-66ac9ae8-18a8-4fef-8503-9f93452e671e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:38.720873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-66ac9ae8-18a8-4fef-8503-9f93452e671e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:38.740167 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-66ac9ae8-18a8-4fef-8503-9f93452e671e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1220 microversion: 2.1 time: 0.867795 Aug 04 04:39:38.741269 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1755/3587] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:37 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1220 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:38.758172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aa372dd6-8a7c-4dd4-80ac-f33ecf4b538d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f192391c670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:38.977286 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aa372dd6-8a7c-4dd4-80ac-f33ecf4b538d tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1466 microversion: 2.1 time: 0.231246 Aug 04 04:39:38.977895 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1756/3588] 10.222.0.69 () {58 vars in 1324 bytes} [Thu Aug 4 04:39:38 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1466 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:38.989236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-dc71d3ed-b058-4f85-967d-b8bb99c036be req-9fb16c76-8169-46f2-913b-4a4620f11b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b2d356-9387-48cc-8afd-f39c6ecbf349", "tag": "0c0aa630-fc30-45e4-8b65-f6156b694ebd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:39.024152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dc71d3ed-b058-4f85-967d-b8bb99c036be req-9fb16c76-8169-46f2-913b-4a4620f11b9f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.025088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dc71d3ed-b058-4f85-967d-b8bb99c036be req-9fb16c76-8169-46f2-913b-4a4620f11b9f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.055756 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dc71d3ed-b058-4f85-967d-b8bb99c036be req-9fb16c76-8169-46f2-913b-4a4620f11b9f service nova] Creating event network-changed:0c0aa630-fc30-45e4-8b65-f6156b694ebd for instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 on n-h1-851337-5 Aug 04 04:39:39.064912 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-dc71d3ed-b058-4f85-967d-b8bb99c036be req-9fb16c76-8169-46f2-913b-4a4620f11b9f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085555 Aug 04 04:39:39.072560 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1757/3589] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:39.079023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.079671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:39.096421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.098645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.100757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.102312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.138513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:39.149645 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0c96d72-facd-44e8-833c-c04df206c0cf tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 1.503918 Aug 04 04:39:39.150290 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1833/3590] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:37 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:39.158170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.165939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:39.175189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.175744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.176653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.177195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.495626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:39.506728 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a4c91c8a-424a-4e61-98a0-f80cf3f61489 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.432637 Aug 04 04:39:39.519473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:39.519592 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1758/3591] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:39.526085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1100589d-40fc-4b00-8de3-82546f90b9c4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f192392c160>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.526541 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0f01d96d-8f42-4cb7-9ae0-433eb233885d tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1308 microversion: 2.1 time: 0.373848 Aug 04 04:39:39.527531 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1834/3592] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:39.690798 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1100589d-40fc-4b00-8de3-82546f90b9c4 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.173384 Aug 04 04:39:39.692904 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1759/3593] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:39.711263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4e3502e-0208-436a-aa8e-98f9193d5dd2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a15790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.769177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.770464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:39.782806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.788174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.789262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.790621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.840403 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e4e3502e-0208-436a-aa8e-98f9193d5dd2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.132778 Aug 04 04:39:39.841388 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1835/3594] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:39.856980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a4360439-7741-4c39-b39e-0018ad2bb964 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a630d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.928861 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a4360439-7741-4c39-b39e-0018ad2bb964 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/9aa8a0ec-360d-40bf-b352-1066adb51df0" status: 200 len: 784 microversion: 2.1 time: 0.071782 Aug 04 04:39:39.929737 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1836/3595] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/images/9aa8a0ec-360d-40bf-b352-1066adb51df0 => generated 784 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:39:39.943760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d577cdd1-663c-4d3b-ad4f-7edc7998f72c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1919a26940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.996196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:40.005471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f066770d-cec8-497b-a590-ba31bdcb60da tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1224 microversion: 2.1 time: 0.241479 Aug 04 04:39:40.008981 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1760/3596] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1224 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:40.051566 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d577cdd1-663c-4d3b-ad4f-7edc7998f72c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.111695 Aug 04 04:39:40.052406 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1837/3597] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:40.071172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50f469fb-969a-4935-990b-4735e561b8a2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f19239a5f70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:40.170924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:40.172389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:40.180982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.181563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.182512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.183229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.389576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:40.408419 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2dff9d76-2b38-4b2b-81b1-797526063a63 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.241748 Aug 04 04:39:40.409771 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1838/3598] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:40 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:40.529747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:40.530390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:40.539472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.539933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.540728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.541178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.736378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:40.761345 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-740f3f03-757f-4f12-beca-7387fcecfa2b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.229381 Aug 04 04:39:40.763303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1839/3599] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:40 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:40.788121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:40.788962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:40.817117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.818744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.819652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.820106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.103886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:41.111340 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0f11f56-d467-4dc1-aca3-dcbd995dc537 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1308 microversion: 2.1 time: 0.341903 Aug 04 04:39:41.111936 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1840/3600] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:40 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:41.124186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:41.126199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:41.136907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.137856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.139241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.140390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.252043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:41.267328 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cfba1c10-af0e-4df4-9751-cea8d159a80a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1224 microversion: 2.1 time: 0.149008 Aug 04 04:39:41.268328 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1841/3601] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:41 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:41.280726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-62f6c284-f5d7-4535-afaa-2656fe5f6f0d req-1bc81597-e403-4644-a653-f210cc449a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810afe59-9e7b-4b78-a7fa-8ffd88e7cc61", "tag": "1dbb11d7-408e-41f7-8ab5-074fd79d005c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:41.288884 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50f469fb-969a-4935-990b-4735e561b8a2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0" status: 204 len: 0 microversion: 2.1 time: 1.224728 Aug 04 04:39:41.293881 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1761/3602] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:40 2022] DELETE /compute/v2.1/images/2536343e-4fb8-45a7-a71f-e0d651bd91d0 => generated 0 bytes in 1228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:41.302388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a4daf1f-51b1-4eff-97e0-3e6219a31dbb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923a2a550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:41.306814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-62f6c284-f5d7-4535-afaa-2656fe5f6f0d req-1bc81597-e403-4644-a653-f210cc449a65 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.307428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-62f6c284-f5d7-4535-afaa-2656fe5f6f0d req-1bc81597-e403-4644-a653-f210cc449a65 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.348661 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-62f6c284-f5d7-4535-afaa-2656fe5f6f0d req-1bc81597-e403-4644-a653-f210cc449a65 service nova] Creating event network-changed:1dbb11d7-408e-41f7-8ab5-074fd79d005c for instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 on n-h2-851337-5 Aug 04 04:39:41.368049 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-62f6c284-f5d7-4535-afaa-2656fe5f6f0d req-1bc81597-e403-4644-a653-f210cc449a65 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097196 Aug 04 04:39:41.369897 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1842/3603] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:41.432009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:41.433232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:41.448540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.449468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.454764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.455467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.099123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:42.108259 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab6daee9-2811-4ad9-8ae0-a71c08b44686 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.682066 Aug 04 04:39:42.108874 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1843/3604] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:41 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:42.128298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:42.128929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:42.138236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.138744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.140972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.141678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.401374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:42.473088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:42.482525 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4a4daf1f-51b1-4eff-97e0-3e6219a31dbb tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610" status: 204 len: 0 microversion: 2.1 time: 1.187086 Aug 04 04:39:42.483924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1762/3605] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:41 2022] DELETE /compute/v2.1/images/6e29af65-cb01-46ab-807c-6abc224b6610 => generated 0 bytes in 1189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:42.490216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:42.491249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:42.512201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.512872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.513941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.514587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.771878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:42.793248 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-786e6436-e9b7-488d-9328-f9e7956dac32 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.670803 Aug 04 04:39:42.796198 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1844/3606] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:42 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:42.815502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:42.816994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:42.830780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:42.845063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.863264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.866193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.870430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.894711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:42.899808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:42.910461 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3644a224-dca4-4bb8-95dd-b6da52e97cc7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1308 microversion: 2.1 time: 0.424607 Aug 04 04:39:42.914530 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1763/3607] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:42 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:42.925445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9801868a-8400-492a-a8c4-db38d99d92f7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f192391c820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:43.247111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:43.257886 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7eb7e7f4-b113-4cd3-821a-0067743ca90d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1272 microversion: 2.1 time: 0.460339 Aug 04 04:39:43.279355 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1845/3608] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:42 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1272 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:43.293604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:43.295498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:43.309574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:43.311368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:43.312997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:43.319243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:43.879335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:43.891644 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1683054-4d9e-43eb-a898-e31c08d753c6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.610677 Aug 04 04:39:43.896156 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1846/3609] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:43 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:43.916459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:43.927673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:43.957201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:43.959099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:43.963503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:43.964125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.542871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:44.558337 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-79e44dc3-94ee-427d-85a5-a3efe03103ba tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.659205 Aug 04 04:39:44.561882 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1847/3610] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:43 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:44.589883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:44.590904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:44.609719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.613648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.615264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.615888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.667030 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9801868a-8400-492a-a8c4-db38d99d92f7 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001" status: 204 len: 0 microversion: 2.1 time: 1.751064 Aug 04 04:39:44.667703 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1764/3611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:42 2022] DELETE /compute/v2.1/images/24001d0b-d9e8-4868-bb6e-5ea9e2d40001 => generated 0 bytes in 1752 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:44.675194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:44.676641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:44.713042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.714105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.715176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.715834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.897838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:44.911302 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ece60654-2e32-4d90-b75f-3343ab79dd8e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1278 microversion: 2.1 time: 0.240783 Aug 04 04:39:44.913678 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1765/3612] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:44 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:44.927498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:44.928718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:44.946042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.946811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.948026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.951057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:45.028567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:39:45.157407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:45.171538 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64775877-8654-4a2a-a6ea-774cc96821c5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1308 microversion: 2.1 time: 0.606554 Aug 04 04:39:45.181039 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1848/3613] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:44 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1308 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:45.246479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:45.247225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:45.268075 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7128b790-ee2c-4cc9-a499-8d8f3c219286 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 204 len: 0 microversion: 2.1 time: 0.352446 Aug 04 04:39:45.272335 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1766/3614] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:44 2022] DELETE /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:45.274741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:45.275236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:45.283427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:45.283885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:45.287112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:45.303405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:45.329365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:45.329837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:45.330655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:45.331136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:46.474327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:46.505452 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92ddd6a4-3894-4b01-8160-1b4de7534fc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1473 microversion: 2.1 time: 1.231627 Aug 04 04:39:46.506657 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1767/3615] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:45 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1473 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:46.517040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:46.525581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:46.548615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:46.554677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:46.557599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:46.562123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:46.700107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:46.713951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4cf1ae41-02b3-4f08-9e3f-73854dad96b1 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 1.517576 Aug 04 04:39:46.715227 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1849/3616] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:45 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:46.734330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:46.743331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:46.754163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:46.755109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:46.757934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:46.758395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:47.422362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:47.430485 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fdc14db0-96f0-45e6-8612-8b29f96e89b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1320 microversion: 2.1 time: 0.699972 Aug 04 04:39:47.435350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1850/3617] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:46 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1320 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:47.447961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:47.448271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:47.453362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:47.459893 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0c098b87-3f1c-4d82-b7ca-db6be0369bda tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.952006 Aug 04 04:39:47.460894 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1768/3618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:46 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:47.467862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f4ceb0d4-ef27-4b11-a2df-2e14e1fe997d req-36d8bb11-634d-43f6-9322-5779f6b71203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810afe59-9e7b-4b78-a7fa-8ffd88e7cc61", "name": "network-vif-plugged", "status": "completed", "tag": "1dbb11d7-408e-41f7-8ab5-074fd79d005c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:47.472875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:47.473382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:47.474126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:47.474567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:47.480302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f4ceb0d4-ef27-4b11-a2df-2e14e1fe997d req-36d8bb11-634d-43f6-9322-5779f6b71203 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:47.481444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f4ceb0d4-ef27-4b11-a2df-2e14e1fe997d req-36d8bb11-634d-43f6-9322-5779f6b71203 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:47.498050 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f4ceb0d4-ef27-4b11-a2df-2e14e1fe997d req-36d8bb11-634d-43f6-9322-5779f6b71203 service nova] Creating event network-vif-plugged:1dbb11d7-408e-41f7-8ab5-074fd79d005c for instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 on n-h2-851337-5 Aug 04 04:39:47.511524 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f4ceb0d4-ef27-4b11-a2df-2e14e1fe997d req-36d8bb11-634d-43f6-9322-5779f6b71203 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048317 Aug 04 04:39:47.515776 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1769/3619] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:47.527889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:47.530270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:47.543695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:47.545017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:47.548539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:47.549284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:47.630054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:48.140215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:48.154642 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c93ac025-4a74-413f-8456-7e440d6b5463 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1308 microversion: 2.1 time: 0.715526 Aug 04 04:39:48.156000 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1851/3620] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:47 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1308 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:48.165636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-04faa8bc-5556-43cc-b2a8-f4b66a977236 req-d05e7c7a-bfa8-4e58-8ff8-23bbccd4a9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a42991e-15c5-4f6e-ab07-db25663a2f3d", "tag": "27dfafcc-bf6b-4d19-ac90-47c8377eb8cd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:48.208512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-04faa8bc-5556-43cc-b2a8-f4b66a977236 req-d05e7c7a-bfa8-4e58-8ff8-23bbccd4a9c6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:48.220274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-04faa8bc-5556-43cc-b2a8-f4b66a977236 req-d05e7c7a-bfa8-4e58-8ff8-23bbccd4a9c6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:48.256441 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-04faa8bc-5556-43cc-b2a8-f4b66a977236 req-d05e7c7a-bfa8-4e58-8ff8-23bbccd4a9c6 service nova] Creating event network-changed:27dfafcc-bf6b-4d19-ac90-47c8377eb8cd for instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d on n-h1-851337-5 Aug 04 04:39:48.268918 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-04faa8bc-5556-43cc-b2a8-f4b66a977236 req-d05e7c7a-bfa8-4e58-8ff8-23bbccd4a9c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109935 Aug 04 04:39:48.269554 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1852/3621] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:48.273645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:48.279595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:48.280644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:48.297875 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0018d114-45fe-42cd-b893-40f13b6ca632 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1473 microversion: 2.1 time: 0.774101 Aug 04 04:39:48.298487 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1770/3622] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:47 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1473 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:48.299229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:48.300059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:48.300985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:48.301665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:48.460202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:48.460761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:48.479157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:48.479813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:48.480815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:48.481858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:48.727983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=24 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:49.064763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:49.074112 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-10483af5-2fa4-4d7b-8222-f66a06a134b6 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.803152 Aug 04 04:39:49.075201 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1853/3623] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:48 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:49.081047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:49.081838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:49.089203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.089731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.090898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.091775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.097249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:49.284537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:49.298994 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b21752ab-ca83-4937-95e1-e72bcb8c63fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1320 microversion: 2.1 time: 0.842859 Aug 04 04:39:49.300042 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1771/3624] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:48 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1320 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:49.317408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:49.320551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:49.339273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.341112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.344651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.345330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.556504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:49.577536 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-79b40a21-eb34-46e6-8030-0b6da5fee4ad tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.500970 Aug 04 04:39:49.579350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1854/3625] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:49 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:49.585468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:49.586311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:49.615644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.616649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.622537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.622944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.693258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.693652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.694121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lazy-loading 'fault' on Instance uuid 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:39:49.775314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:49.785420 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-096a10c3-2a62-49f2-8612-247933b45dc2 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 200 len: 1307 microversion: 2.1 time: 0.204721 Aug 04 04:39:49.800851 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1855/3626] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:49 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:49.808137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-de53aa8b-995b-4b44-b31f-a4bf177a7bf0 req-8c95a282-bab5-4ff1-921b-dbc41a2c203b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecffab2-8b53-4458-be5c-86b73b3b7836", "name": "network-vif-plugged", "status": "completed", "tag": "949b2a74-9647-4bb2-b9c9-0a838d14863e"}, {"server_uuid": "93b2d356-9387-48cc-8afd-f39c6ecbf349", "name": "network-vif-plugged", "status": "completed", "tag": "0c0aa630-fc30-45e4-8b65-f6156b694ebd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:49.820084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-de53aa8b-995b-4b44-b31f-a4bf177a7bf0 req-8c95a282-bab5-4ff1-921b-dbc41a2c203b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.820896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-de53aa8b-995b-4b44-b31f-a4bf177a7bf0 req-8c95a282-bab5-4ff1-921b-dbc41a2c203b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.836511 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-de53aa8b-995b-4b44-b31f-a4bf177a7bf0 req-8c95a282-bab5-4ff1-921b-dbc41a2c203b service nova] Creating event network-vif-plugged:949b2a74-9647-4bb2-b9c9-0a838d14863e for instance eecffab2-8b53-4458-be5c-86b73b3b7836 on n-h1-851337-5 Aug 04 04:39:49.837451 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-de53aa8b-995b-4b44-b31f-a4bf177a7bf0 req-8c95a282-bab5-4ff1-921b-dbc41a2c203b service nova] Creating event network-vif-plugged:0c0aa630-fc30-45e4-8b65-f6156b694ebd for instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 on n-h1-851337-5 Aug 04 04:39:49.846497 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-de53aa8b-995b-4b44-b31f-a4bf177a7bf0 req-8c95a282-bab5-4ff1-921b-dbc41a2c203b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043128 Aug 04 04:39:49.847832 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1856/3627] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:49.958223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:49.968227 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2ee36e0e-1d0e-4f97-9549-85c9822ce962 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1308 microversion: 2.1 time: 0.666822 Aug 04 04:39:49.975389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1772/3628] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:49 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:50.099094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:50.100103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:50.108245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.109732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.111883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.112996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.303434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6ede40a0-db7c-40e0-b7ef-4312f993b8fa req-de138d80-7107-4012-bb05-93cf060b6595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cdc530-bc0f-42fa-bb6f-c8bf225761c6", "name": "network-vif-deleted", "tag": "63e89099-0992-4a96-b81b-77db4750634e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:50.314762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ede40a0-db7c-40e0-b7ef-4312f993b8fa req-de138d80-7107-4012-bb05-93cf060b6595 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.315234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ede40a0-db7c-40e0-b7ef-4312f993b8fa req-de138d80-7107-4012-bb05-93cf060b6595 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.336133 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6ede40a0-db7c-40e0-b7ef-4312f993b8fa req-de138d80-7107-4012-bb05-93cf060b6595 service nova] Creating event network-vif-deleted:63e89099-0992-4a96-b81b-77db4750634e for instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 on n-h2-851337-5 Aug 04 04:39:50.342853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6ede40a0-db7c-40e0-b7ef-4312f993b8fa req-de138d80-7107-4012-bb05-93cf060b6595 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043319 Aug 04 04:39:50.344164 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1773/3629] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:39:50.354610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:50.355774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:50.364063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.365045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.366020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.366648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.418079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:50.433278 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a642860a-5f6e-422c-8273-d1717e78c925 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.340258 Aug 04 04:39:50.454686 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1857/3630] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:50 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:50.601977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:50.603586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:50.619225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.619700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.622728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.623216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.634285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:50.654642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ae637352-eb3a-4f5d-9135-5806b88bbdeb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1320 microversion: 2.1 time: 0.308711 Aug 04 04:39:50.678682 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1774/3631] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:50 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:50.810882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:50.820316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 81cdc530-bc0f-42fa-bb6f-c8bf225761c6] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:50.832831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.838870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.841918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.842605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.881548 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] HTTP exception thrown: Instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 could not be found. Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Request method failure captured: Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 HTTP/1.1 Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60zwk8QWNGg0XCCT0C7gxBKoKaWun1C7tmm-J4MwmEddgPLRULDUUpixHEYIjvTbUZ8bN4jpKsd6kBgFjr4AfijJNikNUYKb4T1iRYyRqdO9XyhNkzrZ92LFsmdJ_TNQi4ZU4WnwKNJ918wkJ6WLzKII9szCkCBSU9mYfrgQB-9UWOw Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ed5e7fb335aa4deeaeb338d81461bf0f Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ListImageFiltersTestJSON-1732911045 Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed5e7fb335aa4deeaeb338d81461bf0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed5e7fb335aa4deeaeb338d81461bf0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed5e7fb335aa4deeaeb338d81461bf0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed5e7fb335aa4deeaeb338d81461bf0f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ListImageFiltersTestJSON-1732911045 Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ed5e7fb335aa4deeaeb338d81461bf0f Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1732911045 Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ListImageFiltersTestJSON-1732911045-project Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ae674ecf70df4ccab46111fbcb4d426d Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ListImageFiltersTestJSON-1732911045-project Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 could not be found. Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '81cdc530-bc0f-42fa-bb6f-c8bf225761c6'} Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 could not be found. Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 could not be found. Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:50.888064 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 could not be found. Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Returning 404 to user: Instance 81cdc530-bc0f-42fa-bb6f-c8bf225761c6 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:50.893827 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b933469e-c4c4-4f47-a730-3a4e8760c51b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6" status: 404 len: 111 microversion: 2.1 time: 0.085829 Aug 04 04:39:50.896340 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1775/3632] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:50 2022] GET /compute/v2.1/servers/81cdc530-bc0f-42fa-bb6f-c8bf225761c6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:50.908304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:50.908848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:50.927971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.929522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.932377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:50.933402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:50.982776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:50.988991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:39:50.994395 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b53b7e36-9f08-4783-9e95-151fd46117d1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.397634 Aug 04 04:39:50.996029 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1858/3633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:50 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:51.001221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:51.007982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.024405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.025075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.026159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.026770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.147863 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c9b3ce8-8c3c-4b6c-b5c3-556e97430e51 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 204 len: 0 microversion: 2.1 time: 0.244210 Aug 04 04:39:51.148982 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1776/3634] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:50 2022] DELETE /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:51.158136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:51.161190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.181342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.181962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.182901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.183612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.358804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:51.368217 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19431def-6a65-437f-abe2-631eda639056 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1488 microversion: 2.1 time: 0.371105 Aug 04 04:39:51.372562 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1859/3635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:50 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1488 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:51.403113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:51.403938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.413507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.414574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.416490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.417226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.470027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lazy-loading 'flavor' on Instance uuid 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:39:51.507077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:51.524563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-80d473ac-7ae7-4995-b4e3-27b4a61cd57b tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 200 len: 1474 microversion: 2.1 time: 0.370542 Aug 04 04:39:51.528175 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1777/3636] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:51 2022] GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:51.541206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:51.542729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.555544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.556027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.557301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.557959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.594520 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3a93de99-af29-4b40-926c-62f62abdc6e5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61/action" status: 202 len: 0 microversion: 2.1 time: 0.194380 Aug 04 04:39:51.595386 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1860/3637] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:39:51 2022] POST /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:39:51.785594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:51.794387 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec972d21-4fc4-44ff-a41c-96eb0a566d50 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.264592 Aug 04 04:39:51.796122 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1778/3638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:51 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:51.815967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:51.816606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.823795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.824251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.825235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.825906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.953661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7dfb9047-016b-4cde-86a9-ba76377e5d9b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Action: 'create', calling method: .version_select at 0x7f191a3438b0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1747722054", "policies": ["affinity"]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:51.980467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7dfb9047-016b-4cde-86a9-ba76377e5d9b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:51.987137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7dfb9047-016b-4cde-86a9-ba76377e5d9b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:52.064944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7dfb9047-016b-4cde-86a9-ba76377e5d9b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:52.071767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-7dfb9047-016b-4cde-86a9-ba76377e5d9b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:52.072503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:52.085477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73252565-59b6-4041-9867-f788e3451061 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1496 microversion: 2.1 time: 0.281000 Aug 04 04:39:52.089197 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7dfb9047-016b-4cde-86a9-ba76377e5d9b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.491260 Aug 04 04:39:52.091021 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1861/3639] 10.222.0.69 () {60 vars in 1174 bytes} [Thu Aug 4 04:39:51 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:52.100417 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1779/3640] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:51 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1496 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:52.105787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.106987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:52.109360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.115626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:52.117944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.118677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.120412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.121022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.125785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.126295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.142738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.143275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.153033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:52.399412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:52.404004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:52.410123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d35bcb44-87e0-40cb-95a1-77864a11c860 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1320 microversion: 2.1 time: 0.317812 Aug 04 04:39:52.410910 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1862/3641] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:52 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:52.412242 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26d023b3-b3ba-4b32-9bee-5d24f2e154c1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1313 microversion: 2.1 time: 0.310648 Aug 04 04:39:52.426183 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1780/3642] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:52 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:52.430500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bce32f27-9310-4f2c-937c-cfb68b178b5b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Action: 'create', calling method: .version_select at 0x7f1919adf820>, body: {"server_group": {"name": "tempest-server-group-373267175", "policies": ["affinity"]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:52.481324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bce32f27-9310-4f2c-937c-cfb68b178b5b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:52.488274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bce32f27-9310-4f2c-937c-cfb68b178b5b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:52.550384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.551134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:52.557257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bce32f27-9310-4f2c-937c-cfb68b178b5b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:52.569925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bce32f27-9310-4f2c-937c-cfb68b178b5b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:52.572572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.573261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.578168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.578849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.592067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bce32f27-9310-4f2c-937c-cfb68b178b5b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.165547 Aug 04 04:39:52.593752 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1863/3643] 10.222.0.69 () {60 vars in 1173 bytes} [Thu Aug 4 04:39:52 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:52.605493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c71b6d12-84c2-4bfd-b617-37c01c483088 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Action: 'create', calling method: .version_select at 0x7f1919a81ca0>, body: {"server_group": {"name": "tempest-server-group-373267175", "policies": ["affinity"]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:52.635716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c71b6d12-84c2-4bfd-b617-37c01c483088 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:52.642584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c71b6d12-84c2-4bfd-b617-37c01c483088 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:52.662841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:52.763811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c71b6d12-84c2-4bfd-b617-37c01c483088 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:52.776797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:52.785900 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab41584b-e9ed-4ea4-8880-928d64dc74df tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 200 len: 1474 microversion: 2.1 time: 0.239975 Aug 04 04:39:52.786511 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1781/3644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:52 2022] GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 1474 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:52.797958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c71b6d12-84c2-4bfd-b617-37c01c483088 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:52.819233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.821401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:52.826039 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c71b6d12-84c2-4bfd-b617-37c01c483088 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.224623 Aug 04 04:39:52.826750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1864/3645] 10.222.0.69 () {60 vars in 1173 bytes} [Thu Aug 4 04:39:52 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:52.831520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.832829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.833949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.834792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.838596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1109b050-ef87-4914-b016-cf90a8be6990 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.880124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1109b050-ef87-4914-b016-cf90a8be6990 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/0e66d6a5-1c95-46b1-9e61-0eaa491e4c82" status: 204 len: 0 microversion: 2.1 time: 0.044574 Aug 04 04:39:52.885611 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1865/3646] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:39:52 2022] DELETE /compute/v2.1/os-server-groups/0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:52.897350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b481fba2-f71b-4337-aafb-f73056b10586 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.945395 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b481fba2-f71b-4337-aafb-f73056b10586 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.057280 Aug 04 04:39:52.953876 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1866/3647] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:39:52 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:52.962279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff844047-e945-4248-8c56-bbf1610a6693 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.999538 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff844047-e945-4248-8c56-bbf1610a6693 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/cbca6fc0-20d4-4fb3-8c47-6db8f59faa82" status: 204 len: 0 microversion: 2.1 time: 0.043104 Aug 04 04:39:53.006790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1867/3648] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:39:52 2022] DELETE /compute/v2.1/os-server-groups/cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:53.021061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be229c58-5dcb-4d3c-a880-667ed192b0ca tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.075719 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-be229c58-5dcb-4d3c-a880-667ed192b0ca tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.063295 Aug 04 04:39:53.083161 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1868/3649] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:39:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:53.091999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d258a2d3-cb67-4cd0-8caf-10a009192e0d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Action: 'create', calling method: .version_select at 0x7f191a6a0310>, body: {"server_group": {"name": "tempest-server-group-1519060813", "policies": ["affinity"]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:53.134142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:53.136223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d258a2d3-cb67-4cd0-8caf-10a009192e0d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:53.149289 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f479f041-39dc-497b-bfdd-c539201a4491 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1330 microversion: 2.1 time: 0.335129 Aug 04 04:39:53.150073 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1782/3650] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:52 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1330 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:53.159895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d258a2d3-cb67-4cd0-8caf-10a009192e0d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:53.168976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.177271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:53.194162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.194894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.198760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.200606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.264816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d258a2d3-cb67-4cd0-8caf-10a009192e0d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:53.283843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d258a2d3-cb67-4cd0-8caf-10a009192e0d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:53.336246 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d258a2d3-cb67-4cd0-8caf-10a009192e0d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.236746 Aug 04 04:39:53.343644 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1869/3651] 10.222.0.69 () {60 vars in 1173 bytes} [Thu Aug 4 04:39:53 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:39:53.372074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1961d717-3b66-4106-8266-c583d5bd010f tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.414675 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1961d717-3b66-4106-8266-c583d5bd010f tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e" status: 204 len: 0 microversion: 2.1 time: 0.061502 Aug 04 04:39:53.414675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1870/3652] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:39:53 2022] DELETE /compute/v2.1/os-server-groups/17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:53.425892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c02b94c-556f-4a7e-aa0a-68e8831a62e1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.450855 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c02b94c-556f-4a7e-aa0a-68e8831a62e1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033611 Aug 04 04:39:53.459911 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1871/3653] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:39:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:39:53.468429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.469411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:53.491639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.496109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.496967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.497410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.590013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:53.603810 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c8457bbe-2a0f-4ad2-96fa-2d0d2945dc6f tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1496 microversion: 2.1 time: 0.452188 Aug 04 04:39:53.607095 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1783/3654] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:53 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1496 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:53.626682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.629909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:53.657456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.675096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.676841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.678377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.399116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:54.428921 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44216948-feab-4b87-ae32-8f9ca0366985 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1320 microversion: 2.1 time: 0.972180 Aug 04 04:39:54.429502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1872/3655] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:53 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1320 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:54.443457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:54.461936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffe177b7-ec3e-4e8c-a23d-170edfd6e351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1498 microversion: 2.1 time: 0.853447 Aug 04 04:39:54.466627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-387d2465-d10e-4de2-b303-515c57ec4ab3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Action: 'create', calling method: .version_select at 0x7f1919a2d9d0>, body: {"server_group": {"name": "tempest-server-group-1870074600", "policies": ["anti-affinity"]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:54.476539 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1784/3656] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:53 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1498 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:54.494840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:54.497520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:54.506445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-387d2465-d10e-4de2-b303-515c57ec4ab3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:54.513435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.515601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.519349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.520806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.536060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-387d2465-d10e-4de2-b303-515c57ec4ab3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:54.623447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.625419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.626087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lazy-loading 'fault' on Instance uuid 11ed652d-4352-4709-9f35-cd6dad67ba0d {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:39:54.668315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-387d2465-d10e-4de2-b303-515c57ec4ab3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:54.705157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-387d2465-d10e-4de2-b303-515c57ec4ab3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:54.752060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=85,nova_api:DELETE=9 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:54.766013 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-387d2465-d10e-4de2-b303-515c57ec4ab3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.320102 Aug 04 04:39:54.767592 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1873/3657] 10.222.0.69 () {60 vars in 1173 bytes} [Thu Aug 4 04:39:54 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:54.768031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae674ecf70df4ccab46111fbcb4d426d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5e7fb335aa4deeaeb338d81461bf0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:54.778497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:54.779573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:54.783207 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-440db1da-d808-4b9d-a0ba-969596a93de3 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 200 len: 1308 microversion: 2.1 time: 0.300566 Aug 04 04:39:54.789173 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1785/3658] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:54 2022] GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:54.790411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.791846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.792807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.793669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.811197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b829c050-e997-451a-995c-3bbb5814d277 req-1a6a7f26-47f6-4f66-9cba-a2ab9d21e923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed652d-4352-4709-9f35-cd6dad67ba0d", "name": "network-vif-deleted", "tag": "c418aa72-3ee1-4a69-9a47-4b46b90fd296"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:54.823987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b829c050-e997-451a-995c-3bbb5814d277 req-1a6a7f26-47f6-4f66-9cba-a2ab9d21e923 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.824859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b829c050-e997-451a-995c-3bbb5814d277 req-1a6a7f26-47f6-4f66-9cba-a2ab9d21e923 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.839149 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b829c050-e997-451a-995c-3bbb5814d277 req-1a6a7f26-47f6-4f66-9cba-a2ab9d21e923 service nova] Creating event network-vif-deleted:c418aa72-3ee1-4a69-9a47-4b46b90fd296 for instance 11ed652d-4352-4709-9f35-cd6dad67ba0d on n-h2-851337-5 Aug 04 04:39:54.846134 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b829c050-e997-451a-995c-3bbb5814d277 req-1a6a7f26-47f6-4f66-9cba-a2ab9d21e923 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042297 Aug 04 04:39:54.847615 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1786/3659] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:54.854147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a2e97111-7f64-42fc-949c-016143191732 req-89e33c5b-8732-4b75-9a05-bed05ab50a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a42991e-15c5-4f6e-ab07-db25663a2f3d", "name": "network-vif-plugged", "status": "completed", "tag": "27dfafcc-bf6b-4d19-ac90-47c8377eb8cd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:54.866906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a2e97111-7f64-42fc-949c-016143191732 req-89e33c5b-8732-4b75-9a05-bed05ab50a30 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.868464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a2e97111-7f64-42fc-949c-016143191732 req-89e33c5b-8732-4b75-9a05-bed05ab50a30 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.886671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a2e97111-7f64-42fc-949c-016143191732 req-89e33c5b-8732-4b75-9a05-bed05ab50a30 service nova] Creating event network-vif-plugged:27dfafcc-bf6b-4d19-ac90-47c8377eb8cd for instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d on n-h1-851337-5 Aug 04 04:39:54.902431 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a2e97111-7f64-42fc-949c-016143191732 req-89e33c5b-8732-4b75-9a05-bed05ab50a30 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052242 Aug 04 04:39:54.904183 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1787/3660] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:54.921963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:54.929081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:54.941077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.942005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.943125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.943947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.987177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lazy-loading 'flavor' on Instance uuid 93b2d356-9387-48cc-8afd-f39c6ecbf349 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:39:55.107468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:55.119215 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9be26bf0-5e5b-4a55-b3ae-d66f3d2dbf9f tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1533 microversion: 2.1 time: 0.345915 Aug 04 04:39:55.120400 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1874/3661] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:54 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1533 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:55.128678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:55.129756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:55.132762 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39ed3395-32f1-4944-afad-098569dc6418 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "POST /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349/action" status: 200 len: 32 microversion: 2.1 time: 0.221604 Aug 04 04:39:55.138424 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1788/3662] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:39:54 2022] POST /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:39:55.143684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.144495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.145479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.146080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.154755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f765e3e1-8867-4e40-bc28-60d664a6c775 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:55.237517 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f765e3e1-8867-4e40-bc28-60d664a6c775 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce" status: 204 len: 0 microversion: 2.1 time: 0.097155 Aug 04 04:39:55.238456 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1789/3663] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:39:55 2022] DELETE /compute/v2.1/os-server-groups/f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:55.246294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:55.247431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:55.256706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.257414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.258526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.259172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.344438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:55.362893 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4e8425b-38fa-40ff-8ab8-5912f746649a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 200 len: 1479 microversion: 2.1 time: 0.241086 Aug 04 04:39:55.364815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1875/3664] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:55 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 1479 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:55.378097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b8d19ff-edfc-41be-8ea5-8185657e33d0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'create', calling method: .version_select at 0x7f1919a81820>, body: {"pool": "f32dc227-4b62-4e6a-8762-1ae683269841"} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:55.689257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:55.701075 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a306a875-c104-4d77-9dcf-d901a03a6863 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.460846 Aug 04 04:39:55.715624 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1790/3665] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:55 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:55.739617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ce46317-fd6c-4c02-828e-4925b16d123d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:55.771611 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5ce46317-fd6c-4c02-828e-4925b16d123d tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.041244 Aug 04 04:39:55.775097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1791/3666] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:39:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:55.780416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f4d20a9e-78aa-49fb-8767-55f8ffcbc5d7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1242649351"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:55.800647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f4d20a9e-78aa-49fb-8767-55f8ffcbc5d7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:55.816745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4d20a9e-78aa-49fb-8767-55f8ffcbc5d7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.817236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4d20a9e-78aa-49fb-8767-55f8ffcbc5d7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.818357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4d20a9e-78aa-49fb-8767-55f8ffcbc5d7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.818491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4d20a9e-78aa-49fb-8767-55f8ffcbc5d7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:56.112999 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f4d20a9e-78aa-49fb-8767-55f8ffcbc5d7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61/action" status: 202 len: 0 microversion: 2.1 time: 0.338950 Aug 04 04:39:56.113687 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1792/3667] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:39:55 2022] POST /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:39:56.130825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:56.134384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:56.141385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:56.141844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:56.142630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:56.143341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:56.461680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:56.469837 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f104df00-10b8-4658-8660-67c0e822cf43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1320 microversion: 2.1 time: 0.343365 Aug 04 04:39:56.472519 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1793/3668] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:56 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:56.482548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:56.495104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] [instance: 11ed652d-4352-4709-9f35-cd6dad67ba0d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:56.524050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:56.524523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:56.525323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:56.525759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] HTTP exception thrown: Instance 11ed652d-4352-4709-9f35-cd6dad67ba0d could not be found. Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Request method failure captured: Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d HTTP/1.1 Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60zwk8QWNGg0XCCT0C7gxBKoKaWun1C7tmm-J4MwmEddgPLRULDUUpixHEYIjvTbUZ8bN4jpKsd6kBgFjr4AfijJNikNUYKb4T1iRYyRqdO9XyhNkzrZ92LFsmdJ_TNQi4ZU4WnwKNJ918wkJ6WLzKII9szCkCBSU9mYfrgQB-9UWOw Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ed5e7fb335aa4deeaeb338d81461bf0f Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ListImageFiltersTestJSON-1732911045 Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed5e7fb335aa4deeaeb338d81461bf0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed5e7fb335aa4deeaeb338d81461bf0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed5e7fb335aa4deeaeb338d81461bf0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed5e7fb335aa4deeaeb338d81461bf0f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ListImageFiltersTestJSON-1732911045 Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ed5e7fb335aa4deeaeb338d81461bf0f Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1732911045 Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ListImageFiltersTestJSON-1732911045-project Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ae674ecf70df4ccab46111fbcb4d426d Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ListImageFiltersTestJSON-1732911045-project Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 11ed652d-4352-4709-9f35-cd6dad67ba0d could not be found. Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '11ed652d-4352-4709-9f35-cd6dad67ba0d'} Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ed652d-4352-4709-9f35-cd6dad67ba0d could not be found. Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:56.549578 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ed652d-4352-4709-9f35-cd6dad67ba0d could not be found. Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ed652d-4352-4709-9f35-cd6dad67ba0d could not be found. Aug 04 04:39:56.555172 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:39:56.557780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Returning 404 to user: Instance 11ed652d-4352-4709-9f35-cd6dad67ba0d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:56.559910 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-059a7b14-9dac-43f6-83d8-43ffd3080259 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d" status: 404 len: 111 microversion: 2.1 time: 0.084526 Aug 04 04:39:56.564790 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1794/3669] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:56 2022] GET /compute/v2.1/servers/11ed652d-4352-4709-9f35-cd6dad67ba0d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:56.576903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1493133356", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "31b1026d-1042-4540-8cbf-2fad61150003"}]}, "os:scheduler_hints": {"group": "a36e97ad-faa2-44ac-91ab-8a53dec24a31"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:56.716325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] validate_networks() for [('31b1026d-1042-4540-8cbf-2fad61150003', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:57.595813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:57.596219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:57.596737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:57.597140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:57.597556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:57.613338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.614162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.615325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.616091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.635243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:57.643749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:57.654190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:57.669696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:57.673817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:57.753211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:57.761799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:57.814763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:57.824844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Getting quotas for user 911f453dfc4f4c729f76199bbbbfedc0 and project 2b48032ff08946eeab6dd7f845ec1a30. Resources: {'server_group_members'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:57.848284 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b8d19ff-edfc-41be-8ea5-8185657e33d0 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.482370 Aug 04 04:39:57.862582 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07d463e6-652d-4b4a-ae65-572f82aa62c9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.299119 Aug 04 04:39:57.863312 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1876/3670] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:39:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:57.864317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1795/3671] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:57.874216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92ff391a-9a69-4a5a-adaf-2a530470524c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f192391c790>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:57.876841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4c81407b-5783-4029-83b6-db216c441219 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a9411f0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:58.532239 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92ff391a-9a69-4a5a-adaf-2a530470524c tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/images/d7fbaeef-aa61-4988-bb23-c152a0bb0b48" status: 204 len: 0 microversion: 2.1 time: 0.666578 Aug 04 04:39:58.533143 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1796/3672] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:57 2022] DELETE /compute/v2.1/images/d7fbaeef-aa61-4988-bb23-c152a0bb0b48 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:58.542265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:58.552146 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4c81407b-5783-4029-83b6-db216c441219 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.686741 Aug 04 04:39:58.552778 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1877/3673] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:39:57 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:58.557678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:58.579087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:58.579748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:58.585976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.586770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.590244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.595227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.595784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.596437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.597409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.598453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.908555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:58.912917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:58.927964 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23801308-a112-4cf1-ba23-431a4fd78977 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1501 microversion: 2.1 time: 0.374056 Aug 04 04:39:58.928738 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1878/3674] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:58 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1501 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:58.929539 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a208b307-8255-41c4-bb7e-e46040b1d0b7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.387704 Aug 04 04:39:58.931319 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1797/3675] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:58 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:58.940325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:58.941030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.13"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:58.943909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:58.946628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:58.954725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.955223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.956048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.956482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.960512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.961586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.962591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.967722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.998737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Acquired lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:39:59.090149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:59.096404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:59.106382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f55c7903-5603-4cbc-a17d-321fb70f18b9 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1265 microversion: 2.1 time: 0.173477 Aug 04 04:39:59.112227 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1798/3676] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:58 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:59.123900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-619d194a-529e-4756-936e-0a1d32d7a783 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923a080d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:59.545948 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-619d194a-529e-4756-936e-0a1d32d7a783 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/images/fa1eb3a6-c743-48fc-a90c-738c947c56ef" status: 204 len: 0 microversion: 2.1 time: 0.432471 Aug 04 04:39:59.546870 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1799/3677] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:59 2022] DELETE /compute/v2.1/images/fa1eb3a6-c743-48fc-a90c-738c947c56ef => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:59.553268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:59.554788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:59.571737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:59.572295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:59.573117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:59.575240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:00.681132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:00.717520 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-657c28c4-ecb7-416b-b29e-c48a572ddbde tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1501 microversion: 2.1 time: 1.159053 Aug 04 04:40:00.719091 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1800/3678] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:59 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1501 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:00.746049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-13f5a938-c46d-4e5d-a58a-a3ec32816ad8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] Calling method '.version_select at 0x7f1923a449d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:01.302446 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-13f5a938-c46d-4e5d-a58a-a3ec32816ad8 tempest-ListImageFiltersTestJSON-1732911045 tempest-ListImageFiltersTestJSON-1732911045-project] 10.222.0.69 "DELETE /compute/v2.1/images/59cdd736-3e0d-4e32-9b30-b1c77fc8085f" status: 204 len: 0 microversion: 2.1 time: 0.560944 Aug 04 04:40:01.303524 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1801/3679] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:00 2022] DELETE /compute/v2.1/images/59cdd736-3e0d-4e32-9b30-b1c77fc8085f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:01.309618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4013a86f-8729-426e-bc39-13950ddb64d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923a08670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:01.494437 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4013a86f-8729-426e-bc39-13950ddb64d9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.189629 Aug 04 04:40:01.495486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1802/3680] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:01 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:01.500701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:01.515928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:01.539169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:01.539617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:01.547211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:01.547666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.118087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:02.143138 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbbd6367-15eb-46f2-810d-beccc1fc655f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.646458 Aug 04 04:40:02.148658 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1803/3681] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:01 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:02.163391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:02.164019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:02.199605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.200977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.201827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.210562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.318517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Building network info cache for instance {{(pid=119343) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:40:02.550128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:02.564353 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec319b13-3d60-4ea3-92cd-87697a10dce2 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1313 microversion: 2.1 time: 0.413720 Aug 04 04:40:02.570726 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1804/3682] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:02 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:02.594095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:02.598880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:02.613257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.613964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.615233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.616254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.658894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:02.790887 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a01761f3-960a-43dd-a074-3ca0c8a39b2e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 204 len: 0 microversion: 2.1 time: 0.203592 Aug 04 04:40:02.795479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1805/3683] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:02 2022] DELETE /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:02.802557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-bb1f89d6-911c-43c8-8773-f7cfa16e1fa2 req-f2a6df74-479b-42a2-8659-49ae0464ce78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810afe59-9e7b-4b78-a7fa-8ffd88e7cc61", "name": "network-vif-plugged", "status": "completed", "tag": "1dbb11d7-408e-41f7-8ab5-074fd79d005c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:02.817788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bb1f89d6-911c-43c8-8773-f7cfa16e1fa2 req-f2a6df74-479b-42a2-8659-49ae0464ce78 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.818659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bb1f89d6-911c-43c8-8773-f7cfa16e1fa2 req-f2a6df74-479b-42a2-8659-49ae0464ce78 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.852547 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-bb1f89d6-911c-43c8-8773-f7cfa16e1fa2 req-f2a6df74-479b-42a2-8659-49ae0464ce78 service nova] Creating event network-vif-plugged:1dbb11d7-408e-41f7-8ab5-074fd79d005c for instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 on n-h2-851337-5 Aug 04 04:40:02.862979 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-bb1f89d6-911c-43c8-8773-f7cfa16e1fa2 req-f2a6df74-479b-42a2-8659-49ae0464ce78 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064274 Aug 04 04:40:02.871460 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1806/3684] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:02.878350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a9f38703-1554-4810-aa63-f8de74897add req-c0e11031-b63d-4f35-a648-3e54bf7bb874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6744b854-ebcc-4099-b04b-353f63757196", "tag": "0d51a085-ecec-4dde-a09a-70e5e0330d76"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:02.890330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a9f38703-1554-4810-aa63-f8de74897add req-c0e11031-b63d-4f35-a648-3e54bf7bb874 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.891234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a9f38703-1554-4810-aa63-f8de74897add req-c0e11031-b63d-4f35-a648-3e54bf7bb874 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.909614 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a9f38703-1554-4810-aa63-f8de74897add req-c0e11031-b63d-4f35-a648-3e54bf7bb874 service nova] Creating event network-changed:0d51a085-ecec-4dde-a09a-70e5e0330d76 for instance 6744b854-ebcc-4099-b04b-353f63757196 on n-h2-851337-5 Aug 04 04:40:02.915620 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a9f38703-1554-4810-aa63-f8de74897add req-c0e11031-b63d-4f35-a648-3e54bf7bb874 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042214 Aug 04 04:40:02.917270 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1807/3685] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:02.926510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-51ed6b37-2198-451c-8301-faf71515b079 req-a27a69a3-2d47-43b8-9dda-e4ad2dd8959b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecffab2-8b53-4458-be5c-86b73b3b7836", "tag": "949b2a74-9647-4bb2-b9c9-0a838d14863e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:02.940743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-51ed6b37-2198-451c-8301-faf71515b079 req-a27a69a3-2d47-43b8-9dda-e4ad2dd8959b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.941391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-51ed6b37-2198-451c-8301-faf71515b079 req-a27a69a3-2d47-43b8-9dda-e4ad2dd8959b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.961494 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-51ed6b37-2198-451c-8301-faf71515b079 req-a27a69a3-2d47-43b8-9dda-e4ad2dd8959b service nova] Creating event network-changed:949b2a74-9647-4bb2-b9c9-0a838d14863e for instance eecffab2-8b53-4458-be5c-86b73b3b7836 on n-h1-851337-5 Aug 04 04:40:02.969210 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-51ed6b37-2198-451c-8301-faf71515b079 req-a27a69a3-2d47-43b8-9dda-e4ad2dd8959b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048619 Aug 04 04:40:02.971934 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1808/3686] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:02.991440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-907e57a0-8151-4188-8d9d-b4c8a0b912c1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923b03f70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:03.196028 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-907e57a0-8151-4188-8d9d-b4c8a0b912c1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.220686 Aug 04 04:40:03.200150 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1809/3687] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:02 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:03.206708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:03.207489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:03.226474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:03.228873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:03.231215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:03.231874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:03.433661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Updating instance_info_cache with network_info: [{"id": "949b2a74-9647-4bb2-b9c9-0a838d14863e", "address": "fa:16:3e:e3:f3:17", "network": {"id": "ef8d42be-b24c-4110-99ec-2eb02fb9f35e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-915458299-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f969370a6b5d42699443e01d59435d61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap949b2a74-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119343) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:40:03.460764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Releasing lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:40:03.464084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f901b400-0222-4ac0-9b91-128b59c64a07 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action" status: 202 len: 0 microversion: 2.1 time: 4.532942 Aug 04 04:40:03.472001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:03.472689 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1879/3688] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:39:58 2022] POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action => generated 0 bytes in 4540 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:40:03.478355 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73b06aa6-301c-4483-9372-2164bf92638c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1507 microversion: 2.1 time: 0.277107 Aug 04 04:40:03.480205 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1810/3689] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:03 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:03.491666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:03.492720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:03.500255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8e4eab8-7b1f-4f64-9cfc-e3e1f965135a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'create', calling method: .version_select at 0x7f19191dddc0>, body: {"pool": "f32dc227-4b62-4e6a-8762-1ae683269841"} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:03.532130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:03.536326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:03.541005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:03.544346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:03.950811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:03.972341 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2667c6c-8fb9-4e34-8fbf-b11e3d7734c8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.501638 Aug 04 04:40:03.974286 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1880/3690] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:03 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:03.991332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:03.992234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:04.000595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.009579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:04.010622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.015336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:04.554422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:04.560730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:04.563259 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5c1713a8-1775-44a8-aefe-f0367ec928d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1313 microversion: 2.1 time: 0.587223 Aug 04 04:40:04.567550 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1881/3691] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:03 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:04.587336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a0ed6ef-06dc-4040-b88f-a0a82b3c53c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a818b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:04.724206 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2a0ed6ef-06dc-4040-b88f-a0a82b3c53c6 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.151989 Aug 04 04:40:04.724993 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1882/3692] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:04 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:04.731798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:04.740313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:04.744552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=40 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:04.770855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.772175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:04.773387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.779232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.162049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:05.170393 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d51e2e7a-03f9-4eac-84c4-a0a1d4ca124f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1507 microversion: 2.1 time: 0.442278 Aug 04 04:40:05.179395 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1883/3693] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:04 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1507 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:05.184414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:05.197979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:05.222379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:05.233827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.238259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:05.244181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.836806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:05.854128 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-051c15f8-b50a-42df-b6c1-a1fb5d637d62 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.671941 Aug 04 04:40:05.872031 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1884/3694] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:05 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:05.883243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:05.886569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:05.903328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:05.906191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.910147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:05.911176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:06.810249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:06.822725 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ef91cda-26e5-4d7b-880f-7483d352e281 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1313 microversion: 2.1 time: 0.948916 Aug 04 04:40:06.837924 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1885/3695] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:05 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1313 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:06.845876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43c04ade-cfac-414e-8f03-aed0d3342b1a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a22dc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:07.178864 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43c04ade-cfac-414e-8f03-aed0d3342b1a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.338480 Aug 04 04:40:07.186399 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1886/3696] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:06 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:07.468843 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8e4eab8-7b1f-4f64-9cfc-e3e1f965135a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.974947 Aug 04 04:40:07.470725 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1811/3697] 10.222.0.69 () {60 vars in 1170 bytes} [Thu Aug 4 04:40:03 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:07.486642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:07.490492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:07.506796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.507684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.510916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.511981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.602664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.604378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.605830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lazy-loading 'fault' on Instance uuid 3a42991e-15c5-4f6e-ab07-db25663a2f3d {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:40:07.632079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:07.643849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9f193c5-d1c2-405b-bf25-781582a1af5d tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Calling method '.version_select at 0x7f191a9b5700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:07.691090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9f193c5-d1c2-405b-bf25-781582a1af5d tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.692027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9f193c5-d1c2-405b-bf25-781582a1af5d tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.693030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9f193c5-d1c2-405b-bf25-781582a1af5d tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.694515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9f193c5-d1c2-405b-bf25-781582a1af5d tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.741355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:07.750584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9f193c5-d1c2-405b-bf25-781582a1af5d tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] 10.222.0.69 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.567342 Aug 04 04:40:07.764200 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f33ee50e-5a9c-45fb-a0fb-278abc5d2729 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 200 len: 1310 microversion: 2.1 time: 0.282863 Aug 04 04:40:07.764317 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1887/3698] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:07.776505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:07.779481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:07.793861 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1812/3699] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:07 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 1310 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:07.795123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.795665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.802211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.802674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.818152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-67aceebd-ee4e-42ea-86cc-5373649e4ec7 req-00206829-3b8e-4872-bc86-98b844547995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a42991e-15c5-4f6e-ab07-db25663a2f3d", "name": "network-vif-deleted", "tag": "27dfafcc-bf6b-4d19-ac90-47c8377eb8cd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:07.849167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=14 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:07.878360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-67aceebd-ee4e-42ea-86cc-5373649e4ec7 req-00206829-3b8e-4872-bc86-98b844547995 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.878360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-67aceebd-ee4e-42ea-86cc-5373649e4ec7 req-00206829-3b8e-4872-bc86-98b844547995 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.908683 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-67aceebd-ee4e-42ea-86cc-5373649e4ec7 req-00206829-3b8e-4872-bc86-98b844547995 service nova] Creating event network-vif-deleted:27dfafcc-bf6b-4d19-ac90-47c8377eb8cd for instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d on n-h1-851337-5 Aug 04 04:40:07.931873 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-67aceebd-ee4e-42ea-86cc-5373649e4ec7 req-00206829-3b8e-4872-bc86-98b844547995 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132541 Aug 04 04:40:07.932876 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1813/3700] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:07.959808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.70"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:07.973031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:07.998891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.000541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.001670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.002416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.115270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Acquired lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:40:08.320303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:08.336139 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3a3fa8d-ad19-499d-b8fc-6ac2faa9e3d7 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.573818 Aug 04 04:40:08.338167 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1888/3701] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:07 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:08.354183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:08.357055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:08.376766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.379289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.380405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.382287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.807471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:08.816173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-762a7b96-723a-4195-a15e-b60573e2aab0 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1313 microversion: 2.1 time: 0.476696 Aug 04 04:40:08.820276 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1889/3702] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:08 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:08.840368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1406076770", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:08.923146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:08.964622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841.", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:40:08.966857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Releasing lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:40:08.968903 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841. Aug 04 04:40:08.968903 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-6e0e660f-8f79-465b-95e6-b41d1ec27551'] Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Request method failure captured: Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action HTTP/1.1 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 45 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6015HAITFQBzHS6OotEguCKYL4pTx6TEWaKfM7Zh4YPQDvpZtkFAiYtyzkl8b2xuHU5JZcB43Iv733gGnc_q9SMF2zmcSeL3X7WrBibG7e3wyhfsgtOYtuPYOEmBzb7h9GijBf0WG2nw9FIQzhsY0zadmFlKykELILMmsla90YXedzM Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f969370a6b5d42699443e01d59435d61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f969370a6b5d42699443e01d59435d61", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 11559fdf745a4ac49b343b056a5f961c Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: {"addFloatingIp": {"address": "172.25.2.70"}} Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: exception: Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841. Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-6e0e660f-8f79-465b-95e6-b41d1ec27551'] Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'eecffab2-8b53-4458-be5c-86b73b3b7836', 'body': {'addFloatingIp': {'address': '172.25.2.70'}}} Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:40:08.971762 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841. Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0e660f-8f79-465b-95e6-b41d1ec27551'] Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841. Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0e660f-8f79-465b-95e6-b41d1ec27551'] Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841. Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0e660f-8f79-465b-95e6-b41d1ec27551'] Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841. Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0e660f-8f79-465b-95e6-b41d1ec27551'] Aug 04 04:40:08.980393 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:08.998154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Returning 400 to user: Cannot associate floating IP 172.25.2.70 (08d131f9-b4d8-47b0-b3f8-f4407ba86c38) with port 949b2a74-9647-4bb2-b9c9-0a838d14863e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network f32dc227-4b62-4e6a-8762-1ae683269841. Aug 04 04:40:08.998154 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-6e0e660f-8f79-465b-95e6-b41d1ec27551'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:09.000191 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd988224-6044-4ff0-9e6c-f81b6e37a8ff tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action" status: 400 len: 380 microversion: 2.1 time: 1.063292 Aug 04 04:40:09.007927 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1814/3703] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:07 2022] POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action => generated 380 bytes in 1072 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:40:09.016236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca38afc3-565c-406c-99ff-a757f55dbd11 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923a4be50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:09.120742 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca38afc3-565c-406c-99ff-a757f55dbd11 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.111141 Aug 04 04:40:09.121637 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1815/3704] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:09 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:09.126792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:09.131119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:09.144323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.145359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:09.148573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.149372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:09.167896 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d HTTP/1.1 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3a42991e-15c5-4f6e-ab07-db25663a2f3d'} Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:09.169913 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.175509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:09.177820 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-075adbb3-d8aa-4a4f-8d1e-f34a0b4cde64 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 404 len: 111 microversion: 2.1 time: 0.055128 Aug 04 04:40:09.179094 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1816/3705] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:09 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:09.184106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e855d66a-cd6a-4da4-8613-d7b45f98714c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '.version_select at 0x7f1923b6e3a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:09.317534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Getting quotas for project 6df08735eb9b4c569c9213910b755b0f. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:09.323616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Getting quotas for user bcbc84f703404846afff3a481263c1a6 and project 6df08735eb9b4c569c9213910b755b0f. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:09.357946 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Request method failure captured: Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 1752 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi602lXHUhRbG2xiGLVlnQrh2GvgAwQRZgKO4JUjt3NK67GgdcQdNx1CT_ruxL9Hu8xBHI3WrH5cdGZN-07NqV-bO8V7jZA7JMdDWgQTOH6J4X5VI_1dPHnhZ2a9tBOOKmBRUEM2SP-Geyv2APuGR3WVmSMD01NZ7-j-BgpmhGZlb4LSY Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 6df08735eb9b4c569c9213910b755b0f Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-648369138 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6df08735eb9b4c569c9213910b755b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6df08735eb9b4c569c9213910b755b0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6df08735eb9b4c569c9213910b755b0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6df08735eb9b4c569c9213910b755b0f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-648369138 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 6df08735eb9b4c569c9213910b755b0f Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-648369138 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-648369138-project Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bcbc84f703404846afff3a481263c1a6 Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-648369138-project Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1406076770", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:40:09.360167 n-d-851337-5 devstack@n-api.service[119343]: exception: Maximum number of metadata items exceeds 128 Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1406076770', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:40:09.367834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:09.370843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51221adf-91fe-46c9-ad2c-df792cc81e68 tempest-AbsoluteLimitsNegativeTestJSON-648369138 tempest-AbsoluteLimitsNegativeTestJSON-648369138-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.528614 Aug 04 04:40:09.382609 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1890/3706] 10.222.0.69 () {60 vars in 1148 bytes} [Thu Aug 4 04:40:08 2022] POST /compute/v2.1/servers => generated 87 bytes in 550 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:40:09.392919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-954ee210-9b58-46e6-8b17-f5f4eee9e1e9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: .version_select at 0x7f191a9b5310>, body: {"keypair": {"name": "tempest-key-271068952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoLyP86gnHlOAvzs34fvUXn9o4vEUcqVEcfpQijP0Lh7PvFxrGJaVMJwVxjNfd2YudmGRaQeM3BM04fBo4PKmOTTI/07heeqbahcD5EJoyn7srahCiz12dqSeedL12oSA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:09.436014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-954ee210-9b58-46e6-8b17-f5f4eee9e1e9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:09.446906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-954ee210-9b58-46e6-8b17-f5f4eee9e1e9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:09.517509 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-954ee210-9b58-46e6-8b17-f5f4eee9e1e9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.132673 Aug 04 04:40:09.524266 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1891/3707] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:40:09 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:09.541058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:09.542251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:09.559042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.560824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:09.563139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.563610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:09.902895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:09.914382 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-622790c4-f1be-4009-bf80-4f9fb055eca4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.388672 Aug 04 04:40:09.917179 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1892/3708] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:09 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:09.936891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8f91b54-301e-4c7a-89f7-a191c096d481 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '.version_select at 0x7f191a33bd30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:09.944669 n-d-851337-5 devstack@n-api.service[119343]: WARNING oslo_db.sqlalchemy.utils [None req-d8f91b54-301e-4c7a-89f7-a191c096d481 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 04:40:09.953364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8f91b54-301e-4c7a-89f7-a191c096d481 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.032228 Aug 04 04:40:09.957640 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1893/3709] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:40:09 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:09.962570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b0dbb553-cca0-49e1-a434-83c7487f23d3 req-c293ae87-6494-4de5-aed2-fcadc96ec1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6744b854-ebcc-4099-b04b-353f63757196", "name": "network-vif-plugged", "status": "completed", "tag": "0d51a085-ecec-4dde-a09a-70e5e0330d76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:09.988649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b0dbb553-cca0-49e1-a434-83c7487f23d3 req-c293ae87-6494-4de5-aed2-fcadc96ec1be service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.990512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b0dbb553-cca0-49e1-a434-83c7487f23d3 req-c293ae87-6494-4de5-aed2-fcadc96ec1be service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:10.023270 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b0dbb553-cca0-49e1-a434-83c7487f23d3 req-c293ae87-6494-4de5-aed2-fcadc96ec1be service nova] Creating event network-vif-plugged:0d51a085-ecec-4dde-a09a-70e5e0330d76 for instance 6744b854-ebcc-4099-b04b-353f63757196 on n-h2-851337-5 Aug 04 04:40:10.035542 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b0dbb553-cca0-49e1-a434-83c7487f23d3 req-c293ae87-6494-4de5-aed2-fcadc96ec1be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075003 Aug 04 04:40:10.038446 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1894/3710] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:10.049261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:10.050303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:10.078184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:10.080139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:10.081000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:10.081752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:10.421852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:10.432597 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20dc6ab4-2be4-477a-ad72-aae934a04ca3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1313 microversion: 2.1 time: 0.391603 Aug 04 04:40:10.434269 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1895/3711] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:10 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:10.441189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4d20df3-9adf-4d1e-b0cd-1ba1765f2924 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a26040>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:10.526750 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e4d20df3-9adf-4d1e-b0cd-1ba1765f2924 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.091098 Aug 04 04:40:10.535006 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1896/3712] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:10 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:10.548024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-304307313", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-key-271068952", "networks": [{"uuid": "4d7b0316-9278-41a0-bbbc-01764ef3318b"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:10.673555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:11.519819 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e855d66a-cd6a-4da4-8613-d7b45f98714c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/08d131f9-b4d8-47b0-b3f8-f4407ba86c38" status: 202 len: 0 microversion: 2.1 time: 2.339336 Aug 04 04:40:11.520718 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1817/3713] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:40:09 2022] DELETE /compute/v2.1/os-floating-ips/08d131f9-b4d8-47b0-b3f8-f4407ba86c38 => generated 0 bytes in 2341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:40:11.529199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:11.530814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:11.559612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:11.563453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:11.565914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:11.566356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.216772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:12.255349 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8de2245f-992a-44f5-b44e-cea85158914b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.732931 Aug 04 04:40:12.279223 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1818/3714] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:11 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:12.290675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.291422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:12.302681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:12.303263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:12.303615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:12.304034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:12.304452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:12.312810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.313410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.314056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.314504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.319808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.320270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.321091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.321527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.417544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:12.443911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:12.492008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:12.504474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:12.614914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:12.628010 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f219ec9-5cb2-4770-8d5d-cc7dcb469cc1 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1498 microversion: 2.1 time: 0.351696 Aug 04 04:40:12.630352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1819/3715] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:12 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1498 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:12.657335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.13"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:12.681275 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b35f29d4-f296-4818-826e-856ab78ad27b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.148211 Aug 04 04:40:12.689104 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1897/3716] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:12.694810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26e3c389-080e-4453-9be1-9e4f824a71c1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a268b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.796841 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-26e3c389-080e-4453-9be1-9e4f824a71c1 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.096679 Aug 04 04:40:12.805448 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1898/3717] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:12 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:12.811275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d92c70ec-1978-408c-bf54-572cfd569513 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.831246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.server_groups [None req-d92c70ec-1978-408c-bf54-572cfd569513 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Querying cell 252fd515-9666-4464-b81b-0a319b17989b(cell1) for 1 instances {{(pid=119343) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 04:40:12.832330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d92c70ec-1978-408c-bf54-572cfd569513 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.833001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d92c70ec-1978-408c-bf54-572cfd569513 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.862926 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d92c70ec-1978-408c-bf54-572cfd569513 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/a36e97ad-faa2-44ac-91ab-8a53dec24a31" status: 200 len: 222 microversion: 2.1 time: 0.055917 Aug 04 04:40:12.864346 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1899/3718] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:40:12 2022] GET /compute/v2.1/os-server-groups/a36e97ad-faa2-44ac-91ab-8a53dec24a31 => generated 222 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:12.871856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea9bff44-f017-4a69-9180-e9ca84e1ca12 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.873538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea9bff44-f017-4a69-9180-e9ca84e1ca12 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:13.024909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea9bff44-f017-4a69-9180-e9ca84e1ca12 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:13.033589 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea9bff44-f017-4a69-9180-e9ca84e1ca12 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1227 microversion: 2.1 time: 0.166976 Aug 04 04:40:13.034177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1900/3719] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:12 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1227 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:13.066289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:13.066810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:13.084371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.084976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.085934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.090904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.101514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:13.109283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.109833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.110818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.120629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.185818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:13.500537 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e58c5ac-18d5-4475-8987-c88f81466206 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 204 len: 0 microversion: 2.1 time: 0.444114 Aug 04 04:40:13.501172 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1901/3720] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:13 2022] DELETE /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:13.508612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:13.509691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:13.523964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.524513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.525601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.551742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.934336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Acquired lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:40:14.243300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:14.252986 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ecec04b-4372-48bc-949c-d2e319d9a652 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.749494 Aug 04 04:40:14.255786 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1902/3721] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:13 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:14.268092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:14.271437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:14.285427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:14.286346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:14.287766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:14.290870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:14.871694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:14.887596 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0bdea2a0-52c4-42e0-8da2-8984f2136969 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1504 microversion: 2.1 time: 0.624159 Aug 04 04:40:14.888524 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1903/3722] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:14 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:14.904598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-14271182-6060-4642-9704-4933de102810 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19203d8c10>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:14.992593 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-14271182-6060-4642-9704-4933de102810 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.102724 Aug 04 04:40:15.002099 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1904/3723] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:14 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:15.007422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:15.008359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:15.015771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.016635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.017731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.018454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.680402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:15.694367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-59503347-cb47-401d-8229-58aaefac9549 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1279 microversion: 2.1 time: 0.686326 Aug 04 04:40:15.695116 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1905/3724] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:15 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1279 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:15.714782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:15.715832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:15.719809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:15.727471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.728282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.729521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.730128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.688710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:16.722783 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-287d0251-135d-4481-ada1-dd2f9f2054b9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 1.012906 Aug 04 04:40:16.725558 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1906/3725] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:15 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:16.735588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:16.740357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:16.753447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.753928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.754913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.761951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.963869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911f453dfc4f4c729f76199bbbbfedc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b48032ff08946eeab6dd7f845ec1a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:16.972910 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a572ef5-c1e3-4d55-8f0d-a22f12d18663 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 200 len: 1462 microversion: 2.1 time: 0.241191 Aug 04 04:40:16.975656 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1907/3726] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:16 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 1462 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:16.990010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7fec5d5b-c087-413e-b0a6-27a21997eb0c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a6a0280>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:17.075821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7fec5d5b-c087-413e-b0a6-27a21997eb0c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.095284 Aug 04 04:40:17.076416 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1908/3727] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:16 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:17.083060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:17.083993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:17.097188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.098017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.099535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.100681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.107146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:17.346361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:17.355743 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dc429da8-0218-4202-a081-548e91c55a8c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1285 microversion: 2.1 time: 0.278234 Aug 04 04:40:17.356335 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1909/3728] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:17 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1285 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:17.373775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2dc00245-2594-43dd-97b4-16e9babb2b2f req-58efeeab-361d-46ad-ad94-ba04e56f6dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6744b854-ebcc-4099-b04b-353f63757196", "name": "network-vif-deleted", "tag": "0d51a085-ecec-4dde-a09a-70e5e0330d76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:17.387970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2dc00245-2594-43dd-97b4-16e9babb2b2f req-58efeeab-361d-46ad-ad94-ba04e56f6dcf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.390127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2dc00245-2594-43dd-97b4-16e9babb2b2f req-58efeeab-361d-46ad-ad94-ba04e56f6dcf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.423903 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2dc00245-2594-43dd-97b4-16e9babb2b2f req-58efeeab-361d-46ad-ad94-ba04e56f6dcf service nova] Creating event network-vif-deleted:0d51a085-ecec-4dde-a09a-70e5e0330d76 for instance 6744b854-ebcc-4099-b04b-353f63757196 on n-h2-851337-5 Aug 04 04:40:17.430700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2dc00245-2594-43dd-97b4-16e9babb2b2f req-58efeeab-361d-46ad-ad94-ba04e56f6dcf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068900 Aug 04 04:40:17.431933 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1910/3729] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:17.746557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:17.747912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:17.759970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.760370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.773747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.774474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.382140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:18.407924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Building network info cache for instance {{(pid=119342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 04:40:18.457637 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e199b860-0de3-4e29-a80b-e782ffa56ad1 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.710030 Aug 04 04:40:18.471741 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1911/3730] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:17 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:18.489461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:18.491851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:18.513532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.515073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.516465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.517349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.535714 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] HTTP exception thrown: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Request method failure captured: Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 HTTP/1.1 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi602XjsFCRV0l89_ZhHPIPoj-CwdIQ4ODM2bhlSIa7E6DL0fp9BaYRwK7wRHm5Dt1zUOCCwksj4d1GhFl2KBQKj8TreGtTX0HxI4jVud3J51lIbEyK4_F30Dir3B0VFR_ZIi91-2mOqbXQL6EXwJYO0C5jIt44DT33FWrZipWnmxfzI0 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2b48032ff08946eeab6dd7f845ec1a30", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 911f453dfc4f4c729f76199bbbbfedc0 Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6744b854-ebcc-4099-b04b-353f63757196'} Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:18.538205 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Returning 404 to user: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:18.544502 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-592ea256-fb3c-483d-9e03-4dfa795037c7 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 404 len: 111 microversion: 2.1 time: 0.078824 Aug 04 04:40:18.553891 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1912/3731] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:18 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:18.558847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9daf435-6d15-464a-ae3b-34460b824952 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a2570d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:18.685776 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9daf435-6d15-464a-ae3b-34460b824952 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.130644 Aug 04 04:40:18.689806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1913/3732] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:18 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:18.715608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:18.724561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:18.759508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.773017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.776457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.786160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.680167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:19.696143 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a42fa89-3e7e-419f-aa04-e01e948c60eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1285 microversion: 2.1 time: 1.001683 Aug 04 04:40:19.697074 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1914/3733] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:18 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1285 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:19.705119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-01fc9cc1-33ea-4610-8e4a-2b1244b5383a req-71a5259b-238d-49b9-92f0-c12e2253d006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecffab2-8b53-4458-be5c-86b73b3b7836", "tag": "949b2a74-9647-4bb2-b9c9-0a838d14863e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:19.736118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-01fc9cc1-33ea-4610-8e4a-2b1244b5383a req-71a5259b-238d-49b9-92f0-c12e2253d006 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.737058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-01fc9cc1-33ea-4610-8e4a-2b1244b5383a req-71a5259b-238d-49b9-92f0-c12e2253d006 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.756490 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-01fc9cc1-33ea-4610-8e4a-2b1244b5383a req-71a5259b-238d-49b9-92f0-c12e2253d006 service nova] Creating event network-changed:949b2a74-9647-4bb2-b9c9-0a838d14863e for instance eecffab2-8b53-4458-be5c-86b73b3b7836 on n-h1-851337-5 Aug 04 04:40:19.766628 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-01fc9cc1-33ea-4610-8e4a-2b1244b5383a req-71a5259b-238d-49b9-92f0-c12e2253d006 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064438 Aug 04 04:40:19.768440 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1915/3734] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:19.778920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74f0e30a-e797-49c8-bec8-1a7895fb1beb tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:19.819766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.server_groups [None req-74f0e30a-e797-49c8-bec8-1a7895fb1beb tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Querying cell 252fd515-9666-4464-b81b-0a319b17989b(cell1) for 1 instances {{(pid=119343) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 04:40:19.821091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74f0e30a-e797-49c8-bec8-1a7895fb1beb tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.821763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74f0e30a-e797-49c8-bec8-1a7895fb1beb tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.870004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74f0e30a-e797-49c8-bec8-1a7895fb1beb tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.100008 Aug 04 04:40:19.871560 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1916/3735] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:40:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:19.884221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:19.884975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:19.899345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.900061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.901027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.902924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.642859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:20.657980 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-894e4824-2e5a-41d3-a79a-dad86ccb0831 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.784119 Aug 04 04:40:20.669335 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1917/3736] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:19 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:20.681488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb2d27d6-1b5a-4e7c-aa45-7e6f7296cf5a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1919a4d820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:20.803786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb2d27d6-1b5a-4e7c-aa45-7e6f7296cf5a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1440 microversion: 2.1 time: 0.130770 Aug 04 04:40:20.805014 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1918/3737] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:20 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1440 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:20.820183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a3e1854-1eeb-4ad3-8071-05adf617bb2b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:20.857294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.server_groups [None req-6a3e1854-1eeb-4ad3-8071-05adf617bb2b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Querying cell 252fd515-9666-4464-b81b-0a319b17989b(cell1) for 1 instances {{(pid=119343) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 04:40:20.858576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a3e1854-1eeb-4ad3-8071-05adf617bb2b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.860110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a3e1854-1eeb-4ad3-8071-05adf617bb2b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.887907 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a3e1854-1eeb-4ad3-8071-05adf617bb2b tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/a36e97ad-faa2-44ac-91ab-8a53dec24a31" status: 200 len: 184 microversion: 2.1 time: 0.081245 Aug 04 04:40:20.889768 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1919/3738] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:40:20 2022] GET /compute/v2.1/os-server-groups/a36e97ad-faa2-44ac-91ab-8a53dec24a31 => generated 184 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:20.903671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:20.905353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:20.914259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.914722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.915540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.916169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:21.833988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:21.849800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-53ebc64f-2179-4472-9ec0-ba0dfa7180bd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1327 microversion: 2.1 time: 0.958330 Aug 04 04:40:21.851473 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1920/3739] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:20 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1327 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:21.858368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:21.860848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:21.871903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:21.872633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:21.874722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:21.875610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:21.897945 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] HTTP exception thrown: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Request method failure captured: Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 HTTP/1.1 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi602XjsFCRV0l89_ZhHPIPoj-CwdIQ4ODM2bhlSIa7E6DL0fp9BaYRwK7wRHm5Dt1zUOCCwksj4d1GhFl2KBQKj8TreGtTX0HxI4jVud3J51lIbEyK4_F30Dir3B0VFR_ZIi91-2mOqbXQL6EXwJYO0C5jIt44DT33FWrZipWnmxfzI0 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2b48032ff08946eeab6dd7f845ec1a30", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 911f453dfc4f4c729f76199bbbbfedc0 Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6744b854-ebcc-4099-b04b-353f63757196'} Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:21.924824 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:21.931123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:21.933996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Returning 404 to user: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:21.935321 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0761013d-8176-4cf5-a75c-e58daa40e0d6 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 404 len: 111 microversion: 2.1 time: 0.082338 Aug 04 04:40:21.936633 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1921/3740] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:21 2022] DELETE /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:21.943521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:21.945055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:21.956066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:21.956798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:21.957790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:21.958419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:22.078139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Updating instance_info_cache with network_info: [{"id": "949b2a74-9647-4bb2-b9c9-0a838d14863e", "address": "fa:16:3e:e3:f3:17", "network": {"id": "ef8d42be-b24c-4110-99ec-2eb02fb9f35e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-915458299-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f969370a6b5d42699443e01d59435d61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap949b2a74-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:40:22.095127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Releasing lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:40:22.096048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a6b88b7-8072-42c8-be34-b476655e1d26 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action" status: 202 len: 0 microversion: 2.1 time: 9.464448 Aug 04 04:40:22.103220 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1820/3741] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:12 2022] POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action => generated 0 bytes in 9472 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 04:40:22.109015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-512db3e5-4cc7-4b7f-8fc9-ff463268e742 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923b713a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:22.193244 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-512db3e5-4cc7-4b7f-8fc9-ff463268e742 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1449 microversion: 2.1 time: 0.088787 Aug 04 04:40:22.197523 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1821/3742] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:22 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:22.204401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:22.213618 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0495495-938a-4da7-b8ac-bae1adfbed1d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.275644 Aug 04 04:40:22.214090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:22.214861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] [instance: 6744b854-ebcc-4099-b04b-353f63757196] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:22.222105 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1922/3743] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:21 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:22.227972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a3fb0587-c67e-4881-bc9e-43ac83be0d09 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '.version_select at 0x7f191a187d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:22.230399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:22.230917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:22.232123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:22.232576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:22.265332 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] HTTP exception thrown: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Request method failure captured: Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 HTTP/1.1 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi602XjsFCRV0l89_ZhHPIPoj-CwdIQ4ODM2bhlSIa7E6DL0fp9BaYRwK7wRHm5Dt1zUOCCwksj4d1GhFl2KBQKj8TreGtTX0HxI4jVud3J51lIbEyK4_F30Dir3B0VFR_ZIi91-2mOqbXQL6EXwJYO0C5jIt44DT33FWrZipWnmxfzI0 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2b48032ff08946eeab6dd7f845ec1a30", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 911f453dfc4f4c729f76199bbbbfedc0 Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6744b854-ebcc-4099-b04b-353f63757196'} Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:22.267044 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Returning 404 to user: Instance 6744b854-ebcc-4099-b04b-353f63757196 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12b1c2de-aa73-4000-97f7-03011d1df076 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196" status: 404 len: 111 microversion: 2.1 time: 0.066469 Aug 04 04:40:22.272604 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1822/3744] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:22 2022] GET /compute/v2.1/servers/6744b854-ebcc-4099-b04b-353f63757196 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:22.277224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cff4f747-45e1-413a-a6e9-9166127ce359 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f1923b71670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:22.342852 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cff4f747-45e1-413a-a6e9-9166127ce359 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 200 len: 1449 microversion: 2.1 time: 0.068698 Aug 04 04:40:22.353643 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1823/3745] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:22 2022] GET /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 1449 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:22.360902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a129a33-c543-49e2-90d6-73c32580cdba tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:22.365829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:22.369878 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5a129a33-c543-49e2-90d6-73c32580cdba tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] HTTP exception thrown: Instance group f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce could not be found. Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a129a33-c543-49e2-90d6-73c32580cdba tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Request method failure captured: Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-server-groups/f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce HTTP/1.1 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi602XjsFCRV0l89_ZhHPIPoj-CwdIQ4ODM2bhlSIa7E6DL0fp9BaYRwK7wRHm5Dt1zUOCCwksj4d1GhFl2KBQKj8TreGtTX0HxI4jVud3J51lIbEyK4_F30Dir3B0VFR_ZIi91-2mOqbXQL6EXwJYO0C5jIt44DT33FWrZipWnmxfzI0 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2b48032ff08946eeab6dd7f845ec1a30", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 911f453dfc4f4c729f76199bbbbfedc0 Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance group f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce could not be found. Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce'} Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce could not be found. Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce could not be found. Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.376265 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:22.381612 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:22.381612 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:22.381612 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:22.381612 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:22.381612 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce could not be found. Aug 04 04:40:22.381612 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:22.382903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a129a33-c543-49e2-90d6-73c32580cdba tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Returning 404 to user: Instance group f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:22.384489 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a129a33-c543-49e2-90d6-73c32580cdba tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce" status: 404 len: 117 microversion: 2.1 time: 0.029017 Aug 04 04:40:22.385610 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1824/3746] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:40:22 2022] DELETE /compute/v2.1/os-server-groups/f1ba7f06-4a38-49d6-a189-bb13c1b6b8ce => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:22.392688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88470d47-357b-4693-89bf-14365fe7e097 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f19191dddc0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:23.032983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=18 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:23.252662 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-88470d47-357b-4693-89bf-14365fe7e097 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 204 len: 0 microversion: 2.1 time: 0.859952 Aug 04 04:40:23.259326 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1825/3747] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:22 2022] DELETE /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:23.276516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a989edc-0d76-4f52-b753-c477ffc4e278 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:23.309507 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1a989edc-0d76-4f52-b753-c477ffc4e278 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] HTTP exception thrown: Instance group 17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e could not be found. Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a989edc-0d76-4f52-b753-c477ffc4e278 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Request method failure captured: Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-server-groups/17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e HTTP/1.1 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi602XjsFCRV0l89_ZhHPIPoj-CwdIQ4ODM2bhlSIa7E6DL0fp9BaYRwK7wRHm5Dt1zUOCCwksj4d1GhFl2KBQKj8TreGtTX0HxI4jVud3J51lIbEyK4_F30Dir3B0VFR_ZIi91-2mOqbXQL6EXwJYO0C5jIt44DT33FWrZipWnmxfzI0 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2b48032ff08946eeab6dd7f845ec1a30", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 911f453dfc4f4c729f76199bbbbfedc0 Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance group 17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e could not be found. Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e'} Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e could not be found. Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e could not be found. Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:23.313640 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:23.320552 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:23.320552 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:23.320552 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:23.320552 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:23.320552 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e could not be found. Aug 04 04:40:23.320552 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:23.328251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a989edc-0d76-4f52-b753-c477ffc4e278 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Returning 404 to user: Instance group 17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:23.330946 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1a989edc-0d76-4f52-b753-c477ffc4e278 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e" status: 404 len: 117 microversion: 2.1 time: 0.069103 Aug 04 04:40:23.337060 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1826/3748] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:40:23 2022] DELETE /compute/v2.1/os-server-groups/17b6e7c8-e3e6-4cc9-a81f-754a42df7e5e => generated 117 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:23.348906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:23.350722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:23.370156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.372768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.375280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.377811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.914486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:23.927754 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-adb67e58-e90a-4873-b46b-d3c3ad98c4fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1327 microversion: 2.1 time: 0.588261 Aug 04 04:40:23.940584 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1827/3749] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:23 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1327 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:23.947612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:23.948237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:23.957198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.957991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.959200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.959876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.277313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:24.299662 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99ead2b6-65ed-44dc-b747-9614ac0b014a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1504 microversion: 2.1 time: 0.356924 Aug 04 04:40:24.322703 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1828/3750] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:23 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:24.333544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0b5f084e-0ffd-42cd-80db-5f53225c845e req-5992f3c7-72e9-4b83-abe1-08262282c302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e291d8-f13d-4d04-9b03-1b21cfe7b894", "tag": "6efd1a05-df30-42f2-8c1c-dc43ff8b460e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:24.354355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0b5f084e-0ffd-42cd-80db-5f53225c845e req-5992f3c7-72e9-4b83-abe1-08262282c302 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.354818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0b5f084e-0ffd-42cd-80db-5f53225c845e req-5992f3c7-72e9-4b83-abe1-08262282c302 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.362889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:24.383319 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0b5f084e-0ffd-42cd-80db-5f53225c845e req-5992f3c7-72e9-4b83-abe1-08262282c302 service nova] Creating event network-changed:6efd1a05-df30-42f2-8c1c-dc43ff8b460e for instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 on n-h2-851337-5 Aug 04 04:40:24.407307 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0b5f084e-0ffd-42cd-80db-5f53225c845e req-5992f3c7-72e9-4b83-abe1-08262282c302 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082573 Aug 04 04:40:24.409587 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1829/3751] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:24.426630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:24.427159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:24.435167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.435546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.436890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.437550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.466300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:24.605376 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a3fb0587-c67e-4881-bc9e-43ac83be0d09 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/e182ff9b-50c2-41e2-87ef-cb03a8d8977b" status: 202 len: 0 microversion: 2.1 time: 2.381322 Aug 04 04:40:24.606242 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1923/3752] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 04:40:22 2022] DELETE /compute/v2.1/os-floating-ips/e182ff9b-50c2-41e2-87ef-cb03a8d8977b => generated 0 bytes in 2383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:40:24.611577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a97fa41-2cdb-4a9a-9c7f-d6a5adde15ee tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:24.629744 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-6a97fa41-2cdb-4a9a-9c7f-d6a5adde15ee tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] HTTP exception thrown: Instance group cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 could not be found. Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a97fa41-2cdb-4a9a-9c7f-d6a5adde15ee tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Request method failure captured: Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-server-groups/cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 HTTP/1.1 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi602XjsFCRV0l89_ZhHPIPoj-CwdIQ4ODM2bhlSIa7E6DL0fp9BaYRwK7wRHm5Dt1zUOCCwksj4d1GhFl2KBQKj8TreGtTX0HxI4jVud3J51lIbEyK4_F30Dir3B0VFR_ZIi91-2mOqbXQL6EXwJYO0C5jIt44DT33FWrZipWnmxfzI0 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2b48032ff08946eeab6dd7f845ec1a30", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 911f453dfc4f4c729f76199bbbbfedc0 Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance group cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 could not be found. Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'cbca6fc0-20d4-4fb3-8c47-6db8f59faa82'} Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 could not be found. Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 could not be found. Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.633980 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.639831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:24.639831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:24.639831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:24.639831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:24.639831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 could not be found. Aug 04 04:40:24.639831 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.644811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a97fa41-2cdb-4a9a-9c7f-d6a5adde15ee tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Returning 404 to user: Instance group cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:24.646005 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a97fa41-2cdb-4a9a-9c7f-d6a5adde15ee tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/cbca6fc0-20d4-4fb3-8c47-6db8f59faa82" status: 404 len: 117 microversion: 2.1 time: 0.038481 Aug 04 04:40:24.646603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1924/3753] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:40:24 2022] DELETE /compute/v2.1/os-server-groups/cbca6fc0-20d4-4fb3-8c47-6db8f59faa82 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:24.657396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eab620c2-8802-4c4b-ae7d-2e368f56aa0d tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eab620c2-8802-4c4b-ae7d-2e368f56aa0d tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Request method failure captured: Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action HTTP/1.1 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 34 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6015HAITFQBzHS6OotEguCKYL4pTx6TEWaKfM7Zh4YPQDvpZtkFAiYtyzkl8b2xuHU5JZcB43Iv733gGnc_q9SMF2zmcSeL3X7WrBibG7e3wyhfsgtOYtuPYOEmBzb7h9GijBf0WG2nw9FIQzhsY0zadmFlKykELILMmsla90YXedzM Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f969370a6b5d42699443e01d59435d61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f969370a6b5d42699443e01d59435d61", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 11559fdf745a4ac49b343b056a5f961c Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: {"addFloatingIp": {"address": ""}} Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'eecffab2-8b53-4458-be5c-86b73b3b7836', 'body': {'addFloatingIp': {'address': ''}}} Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '' Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:40:24.667583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 04:40:24.673233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.678221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eab620c2-8802-4c4b-ae7d-2e368f56aa0d tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:24.679922 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eab620c2-8802-4c4b-ae7d-2e368f56aa0d tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action" status: 400 len: 142 microversion: 2.1 time: 0.030586 Aug 04 04:40:24.682422 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1925/3754] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:24 2022] POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action => generated 142 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:40:24.696567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb375f2e-3a6a-435f-a415-f72449d80323 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:24.705414 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-147a72b8-a127-47f8-966c-a332ee9b7ef3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 204 len: 0 microversion: 2.1 time: 0.288956 Aug 04 04:40:24.708607 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1830/3755] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:24 2022] DELETE /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:24.709717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-bb375f2e-3a6a-435f-a415-f72449d80323 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] HTTP exception thrown: Instance group 0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 could not be found. Aug 04 04:40:24.719363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:24.726739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb375f2e-3a6a-435f-a415-f72449d80323 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Request method failure captured: Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-server-groups/0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 HTTP/1.1 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi602XjsFCRV0l89_ZhHPIPoj-CwdIQ4ODM2bhlSIa7E6DL0fp9BaYRwK7wRHm5Dt1zUOCCwksj4d1GhFl2KBQKj8TreGtTX0HxI4jVud3J51lIbEyK4_F30Dir3B0VFR_ZIi91-2mOqbXQL6EXwJYO0C5jIt44DT33FWrZipWnmxfzI0 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2b48032ff08946eeab6dd7f845ec1a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2b48032ff08946eeab6dd7f845ec1a30", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 2b48032ff08946eeab6dd7f845ec1a30 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerGroupTestJSON-39892604 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 911f453dfc4f4c729f76199bbbbfedc0 Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerGroupTestJSON-39892604-project Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance group 0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 could not be found. Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0e66d6a5-1c95-46b1-9e61-0eaa491e4c82'} Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 could not be found. Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 could not be found. Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.727099 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 could not be found. Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb375f2e-3a6a-435f-a415-f72449d80323 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Returning 404 to user: Instance group 0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb375f2e-3a6a-435f-a415-f72449d80323 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/0e66d6a5-1c95-46b1-9e61-0eaa491e4c82" status: 404 len: 117 microversion: 2.1 time: 0.041790 Aug 04 04:40:24.732219 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1926/3756] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:40:24 2022] DELETE /compute/v2.1/os-server-groups/0e66d6a5-1c95-46b1-9e61-0eaa491e4c82 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:24.739511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-294eb1fb-853d-489b-b925-f3e79fbae0d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:24.750812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.752599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.754897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.756935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.782865 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-294eb1fb-853d-489b-b925-f3e79fbae0d3 tempest-ServerGroupTestJSON-39892604 tempest-ServerGroupTestJSON-39892604-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/a36e97ad-faa2-44ac-91ab-8a53dec24a31" status: 204 len: 0 microversion: 2.1 time: 0.047769 Aug 04 04:40:24.783765 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1927/3757] 10.222.0.69 () {58 vars in 1266 bytes} [Thu Aug 4 04:40:24 2022] DELETE /compute/v2.1/os-server-groups/a36e97ad-faa2-44ac-91ab-8a53dec24a31 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:24.829856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Acquired lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:40:24.952421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:24.954071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:24.984630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.985833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.990073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.990933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:25.105206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Releasing lock "refresh_cache-eecffab2-8b53-4458-be5c-86b73b3b7836" {{(pid=119342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:40:25.106137 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] HTTP exception thrown: floating IP not found Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Request method failure captured: Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action HTTP/1.1 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 41 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6015HAITFQBzHS6OotEguCKYL4pTx6TEWaKfM7Zh4YPQDvpZtkFAiYtyzkl8b2xuHU5JZcB43Iv733gGnc_q9SMF2zmcSeL3X7WrBibG7e3wyhfsgtOYtuPYOEmBzb7h9GijBf0WG2nw9FIQzhsY0zadmFlKykELILMmsla90YXedzM Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f969370a6b5d42699443e01d59435d61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f969370a6b5d42699443e01d59435d61", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 11559fdf745a4ac49b343b056a5f961c Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: exception: floating IP not found Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'eecffab2-8b53-4458-be5c-86b73b3b7836', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 04 04:40:25.108630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Returning 404 to user: floating IP not found {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:25.120402 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dad18d46-bece-4f69-95ac-ef5169469978 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action" status: 404 len: 67 microversion: 2.1 time: 0.406866 Aug 04 04:40:25.125495 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1831/3758] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:24 2022] POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action => generated 67 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:40:25.136861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-820469033", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:25.168902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:25.263973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] validate_networks() for [('c9f2786e-cbc1-4bf0-b13d-f11c1db7ac6a', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:26.110795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:26.127107 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7b639f3-e80a-4609-b48c-b601377ce263 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1327 microversion: 2.1 time: 1.180706 Aug 04 04:40:26.127985 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1928/3759] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:24 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1327 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:26.141046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9f11da0-0e49-46be-9854-443d703ca1db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:26.236727 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b9f11da0-0e49-46be-9854-443d703ca1db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9f11da0-0e49-46be-9854-443d703ca1db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Request method failure captured: Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action HTTP/1.1 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 44 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6015HAITFQBzHS6OotEguCKYL4pTx6TEWaKfM7Zh4YPQDvpZtkFAiYtyzkl8b2xuHU5JZcB43Iv733gGnc_q9SMF2zmcSeL3X7WrBibG7e3wyhfsgtOYtuPYOEmBzb7h9GijBf0WG2nw9FIQzhsY0zadmFlKykELILMmsla90YXedzM Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f969370a6b5d42699443e01d59435d61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f969370a6b5d42699443e01d59435d61", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 11559fdf745a4ac49b343b056a5f961c Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: exception: Floating IP not found for address 0.0.0.0. Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'eecffab2-8b53-4458-be5c-86b73b3b7836', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 04 04:40:26.238432 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 04 04:40:26.243312 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:26.245516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9f11da0-0e49-46be-9854-443d703ca1db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:26.246504 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9f11da0-0e49-46be-9854-443d703ca1db tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action" status: 404 len: 88 microversion: 2.1 time: 0.117399 Aug 04 04:40:26.252143 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1929/3760] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:26 2022] POST /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836/action => generated 88 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:40:26.258659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:26.260268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:26.280049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:26.280429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:26.292148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:26.292863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.337863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:27.363656 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-345506ff-4377-485a-aaec-790ad531aa9f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1484 microversion: 2.1 time: 1.108392 Aug 04 04:40:27.366171 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1930/3761] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:26 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1484 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:27.374921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:27.376001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:27.376497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:27.376919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:27.377331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:27.385587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:27.387221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:27.394466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.394925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.398242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.399197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.429865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.432857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.438934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.440931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.454910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:27.487253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Getting quotas for user bb9ca81b2ec24bd1b139bb817a47bb29 and project cda3ffc4b73a4d41921e0f80babed85d. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:27.516844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:27.519339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:27.525507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:27.635361 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b99634c0-13e3-4d83-b3c0-38d453f20d86 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508331 Aug 04 04:40:27.635981 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1832/3762] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:27.815539 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fb1c83ee-c91b-4024-a168-ed03acf9829c tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "DELETE /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 204 len: 0 microversion: 2.1 time: 0.447759 Aug 04 04:40:27.822381 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1931/3763] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:27 2022] DELETE /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:27.844572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:27.847733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:27.885819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.886925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.891385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.896209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.213248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8936f8ee-ca15-4466-a31f-952ae4f69143 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Action: 'create', calling method: .version_select at 0x7f1923b31c10>, body: {"keypair": {"name": "tempest-keypair-1816921511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRy5D/UL9IVZ9LqBne/1LssuUBFRNBm/Jgtr2PR/nvgpsgT2ZPVYGcPRlQiD9ANjvz10P7t/kohrIEJ76rpa5LmNm4QHa1OWU66LL9t627WVhkbCQjpwMSByZh/eMZZWg=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:28.255046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8936f8ee-ca15-4466-a31f-952ae4f69143 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Getting quotas for project b67a3f69800c4b0384d6a10580c4d220. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:28.275304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8936f8ee-ca15-4466-a31f-952ae4f69143 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Getting quotas for user a328d218b620478bb1185a7e8be226b5 and project b67a3f69800c4b0384d6a10580c4d220. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:28.355078 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8936f8ee-ca15-4466-a31f-952ae4f69143 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.704994 Aug 04 04:40:28.355695 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1833/3764] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:40:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:28.711638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] Calling method '.version_select at 0x7f1923b31a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:28.713445 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:40:28.713445 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:40:28.714653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:28.715174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.746973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:28.747437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.798779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:28.800268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.818612 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb495c94-1a09-4382-8033-1ad97d8834cc tempest-PortsAdminExtendedAttrsTestJSON-1680556115 tempest-PortsAdminExtendedAttrsTestJSON-1680556115-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.459957 Aug 04 04:40:28.819407 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1834/3765] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:40:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:28.843283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:28.844256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:28.853078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:28.853880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.855149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:28.855862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.859955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:28.875393 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2662050-dc0c-4a6d-abb5-016c3dc8b8c7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1327 microversion: 2.1 time: 1.051447 Aug 04 04:40:28.876319 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1932/3766] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:27 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1327 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:28.882793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-93483485", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:28.972075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] validate_networks() for [('3d7e33ff-d38a-4774-b4fa-1f6ef2b80bb7', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:29.164344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:29.197415 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16f3c959-9142-4259-9be5-aa1328e35ad3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1211 microversion: 2.1 time: 0.364894 Aug 04 04:40:29.203151 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1835/3767] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:28 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1211 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:29.218780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ded12afd-1d63-4cd7-8115-14f412610732 req-852804cf-1e03-46cc-9fea-2595b9cde274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810afe59-9e7b-4b78-a7fa-8ffd88e7cc61", "name": "network-vif-deleted", "tag": "1dbb11d7-408e-41f7-8ab5-074fd79d005c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:29.253369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ded12afd-1d63-4cd7-8115-14f412610732 req-852804cf-1e03-46cc-9fea-2595b9cde274 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.255499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ded12afd-1d63-4cd7-8115-14f412610732 req-852804cf-1e03-46cc-9fea-2595b9cde274 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.283768 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ded12afd-1d63-4cd7-8115-14f412610732 req-852804cf-1e03-46cc-9fea-2595b9cde274 service nova] Creating event network-vif-deleted:1dbb11d7-408e-41f7-8ab5-074fd79d005c for instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 on n-h2-851337-5 Aug 04 04:40:29.299851 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ded12afd-1d63-4cd7-8115-14f412610732 req-852804cf-1e03-46cc-9fea-2595b9cde274 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095139 Aug 04 04:40:29.300466 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1836/3768] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:29.312437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:29.313155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:29.326180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.327380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.337978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.338736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.702236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:29.714252 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4562840-42e7-43b0-9df9-b314122f515e tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1539 microversion: 2.1 time: 0.412576 Aug 04 04:40:29.719179 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1837/3769] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:29 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1539 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:29.898054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:29.898787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:29.913741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.914623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.919081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.919859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.760743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:30.769115 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2f0540e-a243-49fe-ae06-615610503847 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1327 microversion: 2.1 time: 0.876379 Aug 04 04:40:30.783266 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1838/3770] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:29 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1327 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:30.786906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:30.787578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:30.798321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.799199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.800499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.801217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.948768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:30.953875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:30.954517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:30.955148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:30.955789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:30.956795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:30.980450 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-31b59e87-14bc-4081-8062-00c89a50a6ef tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1265 microversion: 2.1 time: 0.205816 Aug 04 04:40:30.981249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.981818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.995409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.995668 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1839/3771] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:30 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:30.995806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.995919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:30.996664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:31.016599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.017288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.018620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.019863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.039391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Getting quotas for project 9488df2de5f2402596ad614ca0132778. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:31.047278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Getting quotas for user c39dc10490454d4a9f5c39507a469bb0 and project 9488df2de5f2402596ad614ca0132778. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:31.078534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:31.087134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:31.162974 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-94625d29-f337-4ff4-8710-0a05c4fbef52 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.283152 Aug 04 04:40:31.180910 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1933/3772] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:31.194801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-498cf349-f1c1-4b2a-bf75-43c06c7a22e3 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:31.197200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-498cf349-f1c1-4b2a-bf75-43c06c7a22e3 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:31.440351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-498cf349-f1c1-4b2a-bf75-43c06c7a22e3 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:31.460229 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-498cf349-f1c1-4b2a-bf75-43c06c7a22e3 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1212 microversion: 2.1 time: 0.275031 Aug 04 04:40:31.461047 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1934/3773] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:31 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1212 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:31.548821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:31.560202 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9c0c7b67-6222-4853-bfd7-dcfdd915e75a tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1539 microversion: 2.1 time: 0.575045 Aug 04 04:40:31.580763 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1840/3774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:30 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1539 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:31.793093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:31.794251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:31.807158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.814639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.828536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.829380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.874244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ae6e45ad-d317-485b-9c86-2665b367ec1b req-a0101d5f-51e9-49d3-b486-2c48e52a897c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e291d8-f13d-4d04-9b03-1b21cfe7b894", "name": "network-vif-plugged", "status": "completed", "tag": "6efd1a05-df30-42f2-8c1c-dc43ff8b460e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:31.928780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ae6e45ad-d317-485b-9c86-2665b367ec1b req-a0101d5f-51e9-49d3-b486-2c48e52a897c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.930489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ae6e45ad-d317-485b-9c86-2665b367ec1b req-a0101d5f-51e9-49d3-b486-2c48e52a897c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.973499 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ae6e45ad-d317-485b-9c86-2665b367ec1b req-a0101d5f-51e9-49d3-b486-2c48e52a897c service nova] Creating event network-vif-plugged:6efd1a05-df30-42f2-8c1c-dc43ff8b460e for instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 on n-h2-851337-5 Aug 04 04:40:31.983983 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ae6e45ad-d317-485b-9c86-2665b367ec1b req-a0101d5f-51e9-49d3-b486-2c48e52a897c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120492 Aug 04 04:40:31.985292 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1841/3775] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:32.029038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:32.031738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:32.040524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.042266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.043981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.044805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.307361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:32.320527 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb5e04c9-24f6-4223-9010-7087188b0d30 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1265 microversion: 2.1 time: 0.319403 Aug 04 04:40:32.326332 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1842/3776] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:31 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:32.481907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:32.482575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:32.490012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.490863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.494273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.495018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.674592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:32.681777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:32.702503 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c640a37-223b-4630-a003-942462381f1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1327 microversion: 2.1 time: 0.912467 Aug 04 04:40:32.706915 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41d79a87-000a-4509-94b9-197c5ad4aafe tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1208 microversion: 2.1 time: 0.229214 Aug 04 04:40:32.725412 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1935/3777] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:31 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1327 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:32.731248 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1843/3778] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:32 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1208 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:32.738471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:32.739829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:32.762500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.762988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.779411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.780046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.003944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11559fdf745a4ac49b343b056a5f961c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f969370a6b5d42699443e01d59435d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:33.020211 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b878d41-dbb7-40b3-91ba-8bca57a4b85b tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 200 len: 1497 microversion: 2.1 time: 0.286478 Aug 04 04:40:33.020733 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1936/3779] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:32 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 1497 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:33.203323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e7ca6dce-df56-4915-a69d-c1c16a2d6e08 req-e433bf09-aeb5-4f95-976d-199895feace1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecffab2-8b53-4458-be5c-86b73b3b7836", "name": "network-vif-deleted", "tag": "949b2a74-9647-4bb2-b9c9-0a838d14863e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:33.223544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e7ca6dce-df56-4915-a69d-c1c16a2d6e08 req-e433bf09-aeb5-4f95-976d-199895feace1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.224406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e7ca6dce-df56-4915-a69d-c1c16a2d6e08 req-e433bf09-aeb5-4f95-976d-199895feace1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.248951 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e7ca6dce-df56-4915-a69d-c1c16a2d6e08 req-e433bf09-aeb5-4f95-976d-199895feace1 service nova] Creating event network-vif-deleted:949b2a74-9647-4bb2-b9c9-0a838d14863e for instance eecffab2-8b53-4458-be5c-86b73b3b7836 on n-h1-851337-5 Aug 04 04:40:33.256232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e7ca6dce-df56-4915-a69d-c1c16a2d6e08 req-e433bf09-aeb5-4f95-976d-199895feace1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059236 Aug 04 04:40:33.257098 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1844/3780] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:33.346427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:33.347154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:33.361582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.362520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.364313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.365188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.458943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:33.463520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:33.472292 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb6ec374-bfdd-4c36-bffa-6a303a5180f9 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1265 microversion: 2.1 time: 0.130592 Aug 04 04:40:33.472897 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1937/3781] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:33 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:33.740773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:33.742121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:33.742598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:33.743476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:33.753750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.754575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.755178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.755736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.756043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.757009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.757229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.757979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.897975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:33.909060 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-360eec8b-1336-4979-a9d3-628e62ecb349 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1270 microversion: 2.1 time: 0.174651 Aug 04 04:40:33.925465 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1938/3782] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:33 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:34.040809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:34.044063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:34.044684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] [instance: eecffab2-8b53-4458-be5c-86b73b3b7836] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:34.050615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-51a1064d-d17d-4b8e-a304-40a1dd63c5f5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1327 microversion: 2.1 time: 0.318107 Aug 04 04:40:34.064511 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1845/3783] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:33 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1327 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:34.066560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.070782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.072051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.073443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.092724 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] HTTP exception thrown: Instance eecffab2-8b53-4458-be5c-86b73b3b7836 could not be found. Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Request method failure captured: Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 HTTP/1.1 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6015HAITFQBzHS6OotEguCKYL4pTx6TEWaKfM7Zh4YPQDvpZtkFAiYtyzkl8b2xuHU5JZcB43Iv733gGnc_q9SMF2zmcSeL3X7WrBibG7e3wyhfsgtOYtuPYOEmBzb7h9GijBf0WG2nw9FIQzhsY0zadmFlKykELILMmsla90YXedzM Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f969370a6b5d42699443e01d59435d61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f969370a6b5d42699443e01d59435d61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f969370a6b5d42699443e01d59435d61", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f969370a6b5d42699443e01d59435d61 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403 Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 11559fdf745a4ac49b343b056a5f961c Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance eecffab2-8b53-4458-be5c-86b73b3b7836 could not be found. Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'eecffab2-8b53-4458-be5c-86b73b3b7836'} Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecffab2-8b53-4458-be5c-86b73b3b7836 could not be found. Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecffab2-8b53-4458-be5c-86b73b3b7836 could not be found. Aug 04 04:40:34.095541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecffab2-8b53-4458-be5c-86b73b3b7836 could not be found. Aug 04 04:40:34.101056 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:34.104590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] Returning 404 to user: Instance eecffab2-8b53-4458-be5c-86b73b3b7836 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:34.105938 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f870b68-4c00-4fba-8d29-98e52579d644 tempest-FloatingIPsAssociationNegativeTestJSON-250106403 tempest-FloatingIPsAssociationNegativeTestJSON-250106403-project] 10.222.0.69 "GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836" status: 404 len: 111 microversion: 2.1 time: 0.065535 Aug 04 04:40:34.106703 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1939/3784] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:34 2022] GET /compute/v2.1/servers/eecffab2-8b53-4458-be5c-86b73b3b7836 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:40:34.351089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2010048693", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d10fc24f-80c4-4f1b-8b2a-b3a97a4a4817"}], "security_groups": [{"name": "tempest-securitygroup--1676959508"}], "key_name": "tempest-keypair-1816921511", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:34.503259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:34.505226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:34.516548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.517452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.518741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.519433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.691046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] validate_networks() for [('d10fc24f-80c4-4f1b-8b2a-b3a97a4a4817', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:35.081460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:35.093626 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb76d479-67c1-4915-ba83-14b6d690e301 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 0.596085 Aug 04 04:40:35.095590 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1940/3785] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:34 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:35.102297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:35.110014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:35.118500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.119383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:35.120658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.121373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.081432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:36.104236 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-df0d1df6-41ed-477a-b9fa-c3fcf3f9b67b tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 1.006684 Aug 04 04:40:36.115250 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1941/3786] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:35 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:36.115498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:36.116412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:36.126091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.127105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.128135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.128968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.761104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Getting quotas for project b67a3f69800c4b0384d6a10580c4d220. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:36.775713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Getting quotas for user a328d218b620478bb1185a7e8be226b5 and project b67a3f69800c4b0384d6a10580c4d220. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:36.795951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:36.796890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:36.797496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:36.798753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:36.798753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:36.806274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:36.815941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.817086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.818103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.818747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.820126 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61c016af-f11e-4ec4-b8b5-265d1de47185 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1509 microversion: 2.1 time: 0.713632 Aug 04 04:40:36.834013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1942/3787] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:36 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1509 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:36.845843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:36.847548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:36.852407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Getting quotas for project b67a3f69800c4b0384d6a10580c4d220. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:36.860362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.860898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Getting quotas for user a328d218b620478bb1185a7e8be226b5 and project b67a3f69800c4b0384d6a10580c4d220. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:36.862004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.863026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.864082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.881669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:36.884480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:36.949132 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d2a7fff-365b-4ab5-9923-58b089f52c3b tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.602365 Aug 04 04:40:36.950487 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1846/3788] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 2604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:36.956896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6703aa0c-d173-4fbf-ab58-fa13e0af2811 req-35060f1e-594b-4c13-861e-2d62586e2515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd441d2-4e11-4b19-a1ce-a38078be6687", "tag": "63e49ed8-c3d0-4299-9915-d540df37edba"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:36.970165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6703aa0c-d173-4fbf-ab58-fa13e0af2811 req-35060f1e-594b-4c13-861e-2d62586e2515 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.970815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6703aa0c-d173-4fbf-ab58-fa13e0af2811 req-35060f1e-594b-4c13-861e-2d62586e2515 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.988415 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6703aa0c-d173-4fbf-ab58-fa13e0af2811 req-35060f1e-594b-4c13-861e-2d62586e2515 service nova] Creating event network-changed:63e49ed8-c3d0-4299-9915-d540df37edba for instance cfd441d2-4e11-4b19-a1ce-a38078be6687 on n-h1-851337-5 Aug 04 04:40:36.994929 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6703aa0c-d173-4fbf-ab58-fa13e0af2811 req-35060f1e-594b-4c13-861e-2d62586e2515 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041598 Aug 04 04:40:37.000504 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1847/3789] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:37.007974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:37.009313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.055399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.056045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.056766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.057291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.573510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:37.584710 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ce58cf15-8e84-4d26-9b89-dc8c4eb455e7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 0.748415 Aug 04 04:40:37.585885 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1943/3790] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:36 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:37.591731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:37.592979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.601811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.603028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.604473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.605197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.778750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:37.792405 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12cc4e20-f283-4b16-ba27-d95935d99dbc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1509 microversion: 2.1 time: 0.790154 Aug 04 04:40:37.793189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1848/3791] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:37 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1509 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:37.799508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:37.800937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.804080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:37.810773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.811450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.812257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.812702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.813203 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e5c27b8-7d04-422d-959f-580a143b0b6e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1282 microversion: 2.1 time: 0.226072 Aug 04 04:40:37.813806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1944/3792] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:37 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:37.818547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:37.819342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.828551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.829084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.829958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.830403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.877233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:37.969029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:37.991913 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da375293-8af7-4160-aba8-4a3cf7a9a5ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 204 len: 0 microversion: 2.1 time: 0.174991 Aug 04 04:40:37.992691 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1945/3793] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:37 2022] DELETE /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:38.012127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:38.014967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:38.025866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.027414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.028735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.030695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.331239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:38.347193 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-074bafb5-bc47-4ab5-b7b4-bfa836ddb30e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.551937 Aug 04 04:40:38.365379 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1849/3794] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:37 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:38.499089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:38.512132 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5ab9e21-a2f6-4cd5-b052-51c2247baca5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1515 microversion: 2.1 time: 0.513315 Aug 04 04:40:38.527028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1946/3795] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:37 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1515 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:38.610831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:38.611700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:38.628242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.629081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.629932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.631899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.636784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:38.837045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:38.838576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:38.852164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.852876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.854459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.856200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:39.418487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:39.436206 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17817351-d815-42d6-a4dc-0106d4c149e9 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1282 microversion: 2.1 time: 0.602661 Aug 04 04:40:39.443961 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1947/3796] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:38 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1282 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:39.449973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4dd6fcfb-bd43-43b6-894f-abc7d60a433d req-067cc5b7-bc0f-4b6d-bf15-a595e154f4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2ebd01-eee6-4750-a7b7-877df63a57f9", "tag": "c35ce392-f594-4608-aa36-60276dc081a5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:39.461618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4dd6fcfb-bd43-43b6-894f-abc7d60a433d req-067cc5b7-bc0f-4b6d-bf15-a595e154f4d1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:39.462438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4dd6fcfb-bd43-43b6-894f-abc7d60a433d req-067cc5b7-bc0f-4b6d-bf15-a595e154f4d1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:39.499572 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4dd6fcfb-bd43-43b6-894f-abc7d60a433d req-067cc5b7-bc0f-4b6d-bf15-a595e154f4d1 service nova] Creating event network-changed:c35ce392-f594-4608-aa36-60276dc081a5 for instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 on n-h2-851337-5 Aug 04 04:40:39.506409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4dd6fcfb-bd43-43b6-894f-abc7d60a433d req-067cc5b7-bc0f-4b6d-bf15-a595e154f4d1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060822 Aug 04 04:40:39.508679 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1948/3797] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:39.515991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:39.517017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:39.525506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:39.526330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:39.527431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:39.528273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:39.751207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:39.762035 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bffecf6-7c28-403a-bcbe-5178c1bc5fd4 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 1.156716 Aug 04 04:40:39.762857 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1850/3798] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:38 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:39.787305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:39.790268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:39.805195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:39.807640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:39.808559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:39.810945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.102007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:40.117560 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-439827fe-e55b-408d-9f05-c0468b3117d0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.607301 Aug 04 04:40:40.121624 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1949/3799] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:39 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:40.357779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:40.376458 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c6e4a2ca-ff37-4b37-8e2e-99d126c2da52 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1515 microversion: 2.1 time: 0.596988 Aug 04 04:40:40.377064 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1851/3800] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:39 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1515 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:40.463502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:40.464465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:40.473502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.480951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.481895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.482781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.716214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:40.737779 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3322f07d-0042-4df7-96d6-3d5c5a577329 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1348 microversion: 2.1 time: 0.277824 Aug 04 04:40:40.753260 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1950/3801] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:40 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1348 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:40.786114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:40.786737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:40.804733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.805676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.808912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.809646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.133240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:41.143010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:41.143638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:41.146805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:41.158355 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0c277c65-ee2e-4cb6-8d51-f538670f63d3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 0.376050 Aug 04 04:40:41.162765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.175934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.177083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.177778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.180325 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1852/3802] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:40 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:41.397915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:41.398557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:41.406706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.409756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.415389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.416285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.445424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:41.882913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:41.893331 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba0748a0-1148-4cde-948a-000e3e911778 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.754982 Aug 04 04:40:41.893940 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1951/3803] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:41 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:41.912757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:41.913669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:41.921992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.933990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.935957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.936986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.079911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:42.091836 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7d69937-a35d-47f6-adae-98bbfd04d17c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1515 microversion: 2.1 time: 0.697811 Aug 04 04:40:42.093110 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1853/3804] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:41 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1515 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:42.142818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:42.164665 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d853019-123f-4390-a89e-9a7eafe19950 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1336 microversion: 2.1 time: 0.254630 Aug 04 04:40:42.167020 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1952/3805] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:41 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1336 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:42.192624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:42.193701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:42.212555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.213329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.215562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.216403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.532024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-5cdca45c-b387-477c-bc18-c6db22fb215a req-9d3cb602-17e7-4b7f-baa7-308a3f0834d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e291d8-f13d-4d04-9b03-1b21cfe7b894", "name": "network-vif-deleted", "tag": "6efd1a05-df30-42f2-8c1c-dc43ff8b460e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:42.552362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5cdca45c-b387-477c-bc18-c6db22fb215a req-9d3cb602-17e7-4b7f-baa7-308a3f0834d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.553119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5cdca45c-b387-477c-bc18-c6db22fb215a req-9d3cb602-17e7-4b7f-baa7-308a3f0834d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.568625 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-5cdca45c-b387-477c-bc18-c6db22fb215a req-9d3cb602-17e7-4b7f-baa7-308a3f0834d6 service nova] Creating event network-vif-deleted:6efd1a05-df30-42f2-8c1c-dc43ff8b460e for instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 on n-h2-851337-5 Aug 04 04:40:42.576479 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-5cdca45c-b387-477c-bc18-c6db22fb215a req-9d3cb602-17e7-4b7f-baa7-308a3f0834d6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053235 Aug 04 04:40:42.577699 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1953/3806] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:42.925152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:42.928335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:42.957792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.959167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.960210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.961116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.004927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:43.018609 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b174cbf4-d95c-4490-9c7f-58dff53d88bd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 0.829884 Aug 04 04:40:43.024167 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1854/3807] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:42 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:43.117203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:43.117912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:43.124922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.125675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.126651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.127283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.180899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.181284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.181742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lazy-loading 'fault' on Instance uuid c8e291d8-f13d-4d04-9b03-1b21cfe7b894 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:40:43.290000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:43.306827 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4fa432e8-bfd5-429f-a2ff-00f8569671dc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 200 len: 1317 microversion: 2.1 time: 0.194190 Aug 04 04:40:43.309417 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1855/3808] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:43 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:43.316964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:43.317963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:43.324584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:43.327640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.329140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.330523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.331460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.332543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:43.336290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:43.353613 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2a3aa33e-0763-4d0a-a916-7085fae1af39 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.437359 Aug 04 04:40:43.354538 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1954/3809] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:42 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:43.531949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:43.552051 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c71b7c31-42b8-4655-a216-e8a1fd2d8665 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1336 microversion: 2.1 time: 0.239253 Aug 04 04:40:43.553373 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1856/3810] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:43 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1336 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:44.051617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:44.055132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:44.065847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.067304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.068992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.071341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.337281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:44.338766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:44.348584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.349501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.351466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.352286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.376655 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 HTTP/1.1 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'c8e291d8-f13d-4d04-9b03-1b21cfe7b894'} Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:44.378724 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:44.384511 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:44.384511 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:44.384511 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:44.384511 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:44.384511 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:44.384511 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:40:44.384511 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:40:44.386737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:44.387956 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3925f29-2a6b-4953-9875-24389778aaca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 404 len: 111 microversion: 2.1 time: 0.055433 Aug 04 04:40:44.392586 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1857/3811] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:44 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:40:44.398938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:44.400165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:44.402053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:44.421555 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf120d5d-dd33-4f51-b8b3-55075ce95327 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 0.377877 Aug 04 04:40:44.423690 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1955/3812] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:44 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:44.424488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.426060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.429170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.430204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.437288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b94f0f35-7d5b-439b-8126-568742f41ce1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '.version_select at 0x7f191a486700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:44.481450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b94f0f35-7d5b-439b-8126-568742f41ce1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-key-271068952" status: 202 len: 0 microversion: 2.1 time: 0.055177 Aug 04 04:40:44.484516 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1956/3813] 10.222.0.69 () {58 vars in 1206 bytes} [Thu Aug 4 04:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-271068952 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:40:44.593656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:44.597193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:44.621995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.622626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.624278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.624761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.968374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:44.978313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d469b02e-250c-4d4a-9ae1-7a9f20f887b4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.582016 Aug 04 04:40:44.978946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1858/3814] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:44 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:44.984668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-899336139", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "4d7b0316-9278-41a0-bbbc-01764ef3318b"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:45.059709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:45.243090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:45.257467 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5f85265b-d7ac-45c4-be13-e4d7c3c3fd81 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.688517 Aug 04 04:40:45.270996 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1957/3815] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:44 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:45.270996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2bac0db4-335d-43c0-bb15-5883883c726c req-930e4564-9a67-4822-80c5-eb46e8de45d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd441d2-4e11-4b19-a1ce-a38078be6687", "name": "network-vif-plugged", "status": "completed", "tag": "63e49ed8-c3d0-4299-9915-d540df37edba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:45.294284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2bac0db4-335d-43c0-bb15-5883883c726c req-930e4564-9a67-4822-80c5-eb46e8de45d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:45.303294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2bac0db4-335d-43c0-bb15-5883883c726c req-930e4564-9a67-4822-80c5-eb46e8de45d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:45.325571 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2bac0db4-335d-43c0-bb15-5883883c726c req-930e4564-9a67-4822-80c5-eb46e8de45d9 service nova] Creating event network-vif-plugged:63e49ed8-c3d0-4299-9915-d540df37edba for instance cfd441d2-4e11-4b19-a1ce-a38078be6687 on n-h1-851337-5 Aug 04 04:40:45.334605 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2bac0db4-335d-43c0-bb15-5883883c726c req-930e4564-9a67-4822-80c5-eb46e8de45d9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070883 Aug 04 04:40:45.335758 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1958/3816] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:45.444297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:45.445254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:45.455831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:45.457478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:45.465491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:45.466021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:45.992973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:46.014354 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d52225c-a7b0-443f-980f-0703e2e17dbc tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 0.574492 Aug 04 04:40:46.015802 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1959/3817] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:45 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:46.033630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:46.035091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:46.048931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.050895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.052087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.055629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.306160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:46.306678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:46.307492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:46.307941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:46.308556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:46.338035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:46.346428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.347094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.349400 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83a5da09-3af1-4845-a927-06389f2925f9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.332123 Aug 04 04:40:46.350676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.351431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.353844 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1960/3818] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:46 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:46.383591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:46.384274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:46.391540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.392235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.393216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.393818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.409112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:46.423456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:46.451738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:46.455291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:46.506373 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-119a608e-65f4-41e8-82d8-030c0b12acdc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526045 Aug 04 04:40:46.507049 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1859/3819] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:46.519974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00468974-785f-4d9c-9399-a260b919dfce tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:46.520667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-00468974-785f-4d9c-9399-a260b919dfce tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:46.646544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-00468974-785f-4d9c-9399-a260b919dfce tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:46.658329 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00468974-785f-4d9c-9399-a260b919dfce tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1208 microversion: 2.1 time: 0.142439 Aug 04 04:40:46.667590 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1860/3820] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:46 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1208 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:46.709445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:46.730491 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d17ed3c-c18e-4965-9a66-d24c57fd0f9e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.361915 Aug 04 04:40:46.734433 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1961/3821] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:46 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:47.037426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:47.038922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:47.061093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.062907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.064825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.065284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.359259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-65b677be-712a-48be-bdd4-583e21999db2 req-90f8c0bb-b3f3-4317-88df-69ddf9f9b267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2ebd01-eee6-4750-a7b7-877df63a57f9", "name": "network-vif-plugged", "status": "completed", "tag": "c35ce392-f594-4608-aa36-60276dc081a5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:47.381578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-65b677be-712a-48be-bdd4-583e21999db2 req-90f8c0bb-b3f3-4317-88df-69ddf9f9b267 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.384106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-65b677be-712a-48be-bdd4-583e21999db2 req-90f8c0bb-b3f3-4317-88df-69ddf9f9b267 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.414443 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-65b677be-712a-48be-bdd4-583e21999db2 req-90f8c0bb-b3f3-4317-88df-69ddf9f9b267 service nova] Creating event network-vif-plugged:c35ce392-f594-4608-aa36-60276dc081a5 for instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 on n-h2-851337-5 Aug 04 04:40:47.426695 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-65b677be-712a-48be-bdd4-583e21999db2 req-90f8c0bb-b3f3-4317-88df-69ddf9f9b267 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069897 Aug 04 04:40:47.427409 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1962/3822] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:47.441800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:47.447386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:47.463134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.463827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.467102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.467727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.832532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:47.840377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70358855-dad4-49e2-9af7-f867d06ae67c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.411638 Aug 04 04:40:47.847955 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1963/3823] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:47 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:47.852882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:47.853499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:47.870316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.872314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:47.874454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.876744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.878496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.887506 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c9b58050-2938-4c68-99ca-2d60779b5c17 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1307 microversion: 2.1 time: 0.853187 Aug 04 04:40:47.900750 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1861/3824] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:47 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1307 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:47.909073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:47.910419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:47.929453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.930018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.931166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.931975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:48.060560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:48.070023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-545dac66-c12c-4fe4-b632-083fadb6a33e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1260 microversion: 2.1 time: 0.220881 Aug 04 04:40:48.071552 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1964/3825] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:47 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:48.301350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f9aae79b-d68c-4bc2-8af7-27072a685c8a req-a11f669b-21b4-4aa3-8db7-353b4f7a5eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336", "tag": "6247e3ec-46ba-464d-ab51-1a9778b1b7ac"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:48.336597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9aae79b-d68c-4bc2-8af7-27072a685c8a req-a11f669b-21b4-4aa3-8db7-353b4f7a5eca service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.339827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9aae79b-d68c-4bc2-8af7-27072a685c8a req-a11f669b-21b4-4aa3-8db7-353b4f7a5eca service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:48.367556 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f9aae79b-d68c-4bc2-8af7-27072a685c8a req-a11f669b-21b4-4aa3-8db7-353b4f7a5eca service nova] Creating event network-changed:6247e3ec-46ba-464d-ab51-1a9778b1b7ac for instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 on n-h1-851337-5 Aug 04 04:40:48.373411 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f9aae79b-d68c-4bc2-8af7-27072a685c8a req-a11f669b-21b4-4aa3-8db7-353b4f7a5eca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082833 Aug 04 04:40:48.374652 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1965/3826] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:48.720346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:48.731355 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-77f52e43-5fbf-47a6-bbd7-5915dc677a67 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.826002 Aug 04 04:40:48.732236 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1862/3827] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:47 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:48.864498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:48.866074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:48.879666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.884747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:48.885945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.890797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:48.911811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:48.913203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:48.943453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.947708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:48.956506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.957341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.373571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:49.381631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:49.389143 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-de927632-3a41-4db9-b0cd-44b578cb6aef tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1312 microversion: 2.1 time: 0.528738 Aug 04 04:40:49.392308 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1966/3828] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:48 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1312 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:49.397676 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb17c29c-4afe-4e3e-a4f8-328e6d65a167 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1488 microversion: 2.1 time: 0.489748 Aug 04 04:40:49.402172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:49.403075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:49.410681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.413901 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1863/3829] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:48 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1488 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:49.419198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.422233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.423115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.434806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-58f2dc6d-46c4-4646-a8f5-6724426dd258 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1568090588"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:49.439842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-58f2dc6d-46c4-4646-a8f5-6724426dd258 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:49.468223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f2dc6d-46c4-4646-a8f5-6724426dd258 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.469178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f2dc6d-46c4-4646-a8f5-6724426dd258 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.471274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f2dc6d-46c4-4646-a8f5-6724426dd258 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.472540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58f2dc6d-46c4-4646-a8f5-6724426dd258 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.611737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:49.629315 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2fe1a9c4-56fe-4543-83a9-3999ce8dba63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1266 microversion: 2.1 time: 0.234786 Aug 04 04:40:49.630344 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1967/3830] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:49 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:49.762483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:49.767640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:49.783303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.784081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.785705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.786165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.921641 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-58f2dc6d-46c4-4646-a8f5-6724426dd258 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "POST /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687/action" status: 202 len: 0 microversion: 2.1 time: 0.499940 Aug 04 04:40:49.924050 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1864/3831] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:49 2022] POST /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 04:40:49.930375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a68d79c-b4ff-44fd-8d33-f4ddfa6d6ec5 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f1923a44670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:49.995371 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a68d79c-b4ff-44fd-8d33-f4ddfa6d6ec5 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04" status: 200 len: 635 microversion: 2.1 time: 0.069701 Aug 04 04:40:49.996673 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1865/3832] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:49 2022] GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04 => generated 635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:50.026481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ee0ac867-f035-4f95-8566-2c63019749a7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a65fc10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:50.134728 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ee0ac867-f035-4f95-8566-2c63019749a7 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e" status: 200 len: 1414 microversion: 2.1 time: 0.124202 Aug 04 04:40:50.135764 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1866/3833] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:50 2022] GET /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:50.147466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f33983dc-86ee-4658-bc06-8f4320642bef tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update_all', calling method: .version_select at 0x7f1923aa9430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:50.248381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=29 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:50.252033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f33983dc-86ee-4658-bc06-8f4320642bef tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:50.253356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:50.269345 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e82c2ae0-9b01-425e-8f48-76e8a372a34f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.520751 Aug 04 04:40:50.269938 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1968/3834] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:49 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:50.275003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41a0750e-431c-454e-8643-b96d43e20483 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a4d7940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:50.287237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f33983dc-86ee-4658-bc06-8f4320642bef tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:50.342408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41a0750e-431c-454e-8643-b96d43e20483 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e" status: 200 len: 1414 microversion: 2.1 time: 0.066629 Aug 04 04:40:50.344139 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1969/3835] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:50 2022] GET /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:50.358843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-460d56d0-2344-4cce-b556-d68155c35bd5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a60c040>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:50.678012 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-460d56d0-2344-4cce-b556-d68155c35bd5 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e" status: 204 len: 0 microversion: 2.1 time: 0.324586 Aug 04 04:40:50.678601 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1970/3836] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:50 2022] DELETE /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:40:50.687691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:50.688759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:50.700876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.703834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:50.704829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.711143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:50.827104 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f33983dc-86ee-4658-bc06-8f4320642bef tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 61 microversion: 2.1 time: 0.687407 Aug 04 04:40:50.827820 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1867/3837] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:40:50 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 61 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:50.835555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:50.836537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:50.847301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.847823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:50.848725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.849434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.204466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:51.218770 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a529fdb0-9dcd-4e11-b8f2-5836eda87db9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1497 microversion: 2.1 time: 0.538233 Aug 04 04:40:51.222346 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1971/3838] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:50 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1497 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:51.235026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d9e06fd-1ddf-411a-8ac9-2541c933141a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a60c0d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:51.249286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:51.261990 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0539c339-ea43-4a2c-ad78-3412c17a76eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.431765 Aug 04 04:40:51.262870 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1868/3839] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:50 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:51.270447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6a19e4b7-4878-4b1a-b54f-27d840c34fbe tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f1923a44b80>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:51.284751 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-8d9e06fd-1ddf-411a-8ac9-2541c933141a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Image not found. Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d9e06fd-1ddf-411a-8ac9-2541c933141a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e HTTP/1.1 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '11409a6e-7d8b-4669-96f7-8c69f2eebe6e'} Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 11409a6e-7d8b-4669-96f7-8c69f2eebe6e Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 04:40:51.286922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 11409a6e-7d8b-4669-96f7-8c69f2eebe6e could not be found. Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d9e06fd-1ddf-411a-8ac9-2541c933141a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8d9e06fd-1ddf-411a-8ac9-2541c933141a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e" status: 404 len: 62 microversion: 2.1 time: 0.064386 Aug 04 04:40:51.291683 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1972/3840] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:51 2022] GET /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:40:51.299619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:51.303253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:51.309923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.310996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.311793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.312229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.341934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lazy-loading 'flavor' on Instance uuid 6c2ebd01-eee6-4750-a7b7-877df63a57f9 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:40:51.482794 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee5a47aa-a02c-43ae-92d6-3110b8a2da6c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "POST /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9/action" status: 200 len: 32 microversion: 2.1 time: 0.190443 Aug 04 04:40:51.483446 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1973/3841] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:51 2022] POST /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:51.493833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:51.494838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:51.502494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.503294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.504364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.505066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.711719 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6a19e4b7-4878-4b1a-b54f-27d840c34fbe tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "DELETE /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.446910 Aug 04 04:40:51.712824 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1869/3842] 10.222.0.69 () {58 vars in 1296 bytes} [Thu Aug 4 04:40:51 2022] DELETE /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata/os_version => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:51.727317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:51.729037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:51.739052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.740151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.741297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.741969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.044084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:52.054023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bdb0e653-f2f3-48e7-8931-d508d7c9347e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.569335 Aug 04 04:40:52.068241 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1974/3843] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:51 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:52.072677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:52.073314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:52.080565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.081027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.081819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.082461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.102567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:52.112727 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76aced59-2429-405c-8adb-07145b44456c tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1500 microversion: 2.1 time: 0.398434 Aug 04 04:40:52.113576 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1870/3844] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:51 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1500 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:52.119264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5dab721-a3bb-4a6f-ab51-7f4f67b56b04 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f191a250310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:52.121432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:52.188763 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5dab721-a3bb-4a6f-ab51-7f4f67b56b04 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 37 microversion: 2.1 time: 0.073720 Aug 04 04:40:52.190097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1871/3845] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:40:52 2022] GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:52.220214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-04cb94dc-7f14-40be-909c-0db44271b479 req-8fb1a779-a121-4002-a9dd-17aaa36a6594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3126e50-1c58-4a26-85cb-f00febbf1e33", "tag": "b320d013-37fd-4a66-a035-f70932afee57"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:52.246122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-04cb94dc-7f14-40be-909c-0db44271b479 req-8fb1a779-a121-4002-a9dd-17aaa36a6594 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.246725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-04cb94dc-7f14-40be-909c-0db44271b479 req-8fb1a779-a121-4002-a9dd-17aaa36a6594 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.274472 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-04cb94dc-7f14-40be-909c-0db44271b479 req-8fb1a779-a121-4002-a9dd-17aaa36a6594 service nova] Creating event network-changed:b320d013-37fd-4a66-a035-f70932afee57 for instance e3126e50-1c58-4a26-85cb-f00febbf1e33 on n-h2-851337-5 Aug 04 04:40:52.289305 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-04cb94dc-7f14-40be-909c-0db44271b479 req-8fb1a779-a121-4002-a9dd-17aaa36a6594 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095045 Aug 04 04:40:52.290588 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1872/3846] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:52.299888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-787464a6-1e24-4d09-b2af-e8d1fd0856f6 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update_all', calling method: .version_select at 0x7f191a28e8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:52.390538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-787464a6-1e24-4d09-b2af-e8d1fd0856f6 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:52.401368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-787464a6-1e24-4d09-b2af-e8d1fd0856f6 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:52.583626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:52.613816 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-344ddbd6-275b-48f4-9f01-537c8a1a7151 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.545161 Aug 04 04:40:52.614558 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1975/3847] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:52 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:52.634921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:52.635585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:52.652843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.653298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.660050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.660505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.879198 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-787464a6-1e24-4d09-b2af-e8d1fd0856f6 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 61 microversion: 2.1 time: 0.587027 Aug 04 04:40:52.879748 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1873/3848] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:40:52 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 61 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:52.899589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-46afc0f9-259b-49c6-9a22-090c3b67ae1c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f1923b71b80>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:52.969060 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-46afc0f9-259b-49c6-9a22-090c3b67ae1c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.083219 Aug 04 04:40:52.978291 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1874/3849] 10.222.0.69 () {58 vars in 1290 bytes} [Thu Aug 4 04:40:52 2022] GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata/os_distro => generated 33 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:52.990928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-861a495f-7034-440f-a4a9-445bf4f87e0f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update_all', calling method: .version_select at 0x7f191a23a940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:53.046230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:53.062397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3442b45f-4b45-4e46-ac76-5fe6f2bd7f6b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.443856 Aug 04 04:40:53.075399 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1976/3850] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:52 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:53.095592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:53.097351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:53.102203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-861a495f-7034-440f-a4a9-445bf4f87e0f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:53.112584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-861a495f-7034-440f-a4a9-445bf4f87e0f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:53.121380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.123367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.124245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.124720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.438278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:53.447033 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-162bdb36-91fe-46b8-955a-be1847b345ca tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.366420 Aug 04 04:40:53.452248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-861a495f-7034-440f-a4a9-445bf4f87e0f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 61 microversion: 2.1 time: 0.472499 Aug 04 04:40:53.457629 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1875/3851] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:40:52 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 61 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:53.460032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:53.460779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:53.463628 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1977/3852] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:53 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:53.473485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-264fecbc-d636-481c-9584-f0a18899a875 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f191a4d7d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:53.479557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.484764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.485656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.487173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.496952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:53.566214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-264fecbc-d636-481c-9584-f0a18899a875 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 61 microversion: 2.1 time: 0.101398 Aug 04 04:40:53.566809 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1978/3853] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:40:53 2022] GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 61 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:53.577331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-073d7456-5290-45a5-8909-26da3237abff tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update_all', calling method: .version_select at 0x7f191a187940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:53.682729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-073d7456-5290-45a5-8909-26da3237abff tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:53.698287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-073d7456-5290-45a5-8909-26da3237abff tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:53.750063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:53.787317 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-23861ba5-7c67-44a5-95b1-1f39b1aa6d05 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1500 microversion: 2.1 time: 0.331619 Aug 04 04:40:53.787946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1876/3854] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:53 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:53.811534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:53.812536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:53.820216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.820991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.824889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.826294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.965635 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-073d7456-5290-45a5-8909-26da3237abff tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 61 microversion: 2.1 time: 0.392177 Aug 04 04:40:53.966280 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1979/3855] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:40:53 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 61 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:40:53.976250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b373164f-74a2-4ffb-9e05-aba22daa044b tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update_all', calling method: .version_select at 0x7f191a5ffb80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:54.053022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b373164f-74a2-4ffb-9e05-aba22daa044b tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:54.074289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b373164f-74a2-4ffb-9e05-aba22daa044b tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:54.083649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:54.093750 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e0d9941-f138-4712-8c0e-91b46dac0cf6 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.297264 Aug 04 04:40:54.100590 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1877/3856] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:53 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:54.105798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:54.106412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:54.119254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.119917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.121053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.121718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.507724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:54.518653 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-639f38dc-ebdc-4ca3-bbff-abd83933eff7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.415807 Aug 04 04:40:54.521441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1878/3857] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:54 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:54.530551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:54.533509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:54.550256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.561553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.564696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.565330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.616602 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b373164f-74a2-4ffb-9e05-aba22daa044b tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 64 microversion: 2.1 time: 0.644315 Aug 04 04:40:54.618396 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1980/3858] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:40:53 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 64 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:54.628018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66400d58-4f91-4582-9b57-3d65dc287f5e tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f1919ac8700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:54.710472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-66400d58-4f91-4582-9b57-3d65dc287f5e tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 64 microversion: 2.1 time: 0.086661 Aug 04 04:40:54.717093 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1981/3859] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:40:54 2022] GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 64 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:54.726525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6079efe-65c9-4c4e-b7ae-44c95c3daf8c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update_all', calling method: .version_select at 0x7f191a63f1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:54.807528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f6079efe-65c9-4c4e-b7ae-44c95c3daf8c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:54.816610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f6079efe-65c9-4c4e-b7ae-44c95c3daf8c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:55.015696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:55.024838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3642d5c-bdf2-4adc-9677-bf30dd6f2c96 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.501998 Aug 04 04:40:55.039241 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1879/3860] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:54 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:55.055401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:55.058341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:55.074527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.078477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.079977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.080592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.337844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:55.345705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6079efe-65c9-4c4e-b7ae-44c95c3daf8c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 61 microversion: 2.1 time: 0.626405 Aug 04 04:40:55.347410 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1982/3861] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:40:54 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 61 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:55.356008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e794203-40a6-4efd-8dd3-7bef44bdba27 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1506 microversion: 2.1 time: 0.315378 Aug 04 04:40:55.359163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:55.359795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:55.362035 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1880/3862] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:55 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:55.368950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.369413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.370073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ddfbfb54-b5bd-41d8-ba99-6a47b380eac3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update', calling method: .version_select at 0x7f191ab3c4c0>, body: {"meta": {"os_version": "alt"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:55.370261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.370864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.455396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ddfbfb54-b5bd-41d8-ba99-6a47b380eac3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:55.466626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ddfbfb54-b5bd-41d8-ba99-6a47b380eac3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:55.617300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:55.629360 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7dfab49d-c9a1-42f8-ba1f-9bac88a81bd9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.274187 Aug 04 04:40:55.629827 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1983/3863] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:55 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:55.636547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:55.637313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:55.676819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.677858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.679107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.679839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.903738 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ddfbfb54-b5bd-41d8-ba99-6a47b380eac3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.539408 Aug 04 04:40:55.904720 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1881/3864] 10.222.0.69 () {60 vars in 1313 bytes} [Thu Aug 4 04:40:55 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata/os_version => generated 31 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:55.916868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-803b6a2f-f0f6-42db-bcf4-c98b1539201c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f1919e10c10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:55.947186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:55.956038 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b76a3bd9-76b4-4285-9c9d-716322ad3f68 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.324693 Aug 04 04:40:55.957578 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1984/3865] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:55 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:55.993605 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-803b6a2f-f0f6-42db-bcf4-c98b1539201c tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 58 microversion: 2.1 time: 0.082968 Aug 04 04:40:55.994702 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1882/3866] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:40:55 2022] GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 58 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:56.006310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65ea28d9-c4e7-4c04-9e37-eef6820601b3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'update_all', calling method: .version_select at 0x7f191a5ffdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:56.047390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:56.048043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:56.060403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.060861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.061634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.062071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.093968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-65ea28d9-c4e7-4c04-9e37-eef6820601b3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:56.100464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-65ea28d9-c4e7-4c04-9e37-eef6820601b3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:56.116039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:56.252459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:56.263330 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd0e1e49-7dfb-4f7c-8545-a7fd1fe09f3e tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.221186 Aug 04 04:40:56.266250 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1883/3867] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:56 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:56.379856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:56.380936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:56.383527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:56.394866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.397115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.398207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.400090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.489116 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65ea28d9-c4e7-4c04-9e37-eef6820601b3 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 61 microversion: 2.1 time: 0.487049 Aug 04 04:40:56.494900 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1985/3868] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:40:56 2022] PUT /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 61 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:56.500992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a39478cd-3ffa-4178-9bb0-dd1cba4ff07f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Action: 'create', calling method: .version_select at 0x7f191a6a0280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:56.585461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-a39478cd-3ffa-4178-9bb0-dd1cba4ff07f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:56.596013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-a39478cd-3ffa-4178-9bb0-dd1cba4ff07f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Getting quotas for user 324abd0ff0f94eda8df8fc5cd1761055 and project ad8c37e48d4645089c65908570296363. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:56.715773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:56.727892 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ebe2da5-451e-4e78-8d90-6cdcdb4199d0 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1506 microversion: 2.1 time: 0.353282 Aug 04 04:40:56.729240 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1884/3869] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:56 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:56.751683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:56.757929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:56.768816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.769614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.770631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.771664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.116719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:57.123550 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a39478cd-3ffa-4178-9bb0-dd1cba4ff07f tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "POST /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 85 microversion: 2.1 time: 0.626851 Aug 04 04:40:57.128257 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1986/3870] 10.222.0.69 () {60 vars in 1281 bytes} [Thu Aug 4 04:40:56 2022] POST /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 85 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:57.128598 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-817faf62-f3ee-4806-828e-b1ddb56ca25f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.395306 Aug 04 04:40:57.128598 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1885/3871] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:56 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:57.134146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:57.134865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:57.135109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92203beb-9b95-4225-9157-06f0d4326593 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] Calling method '.version_select at 0x7f191a23aaf0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:57.148404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.149702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.151053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.176421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.229001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92203beb-9b95-4225-9157-06f0d4326593 tempest-ImagesMetadataTestJSON-573011281 tempest-ImagesMetadataTestJSON-573011281-project] 10.222.0.69 "GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata" status: 200 len: 85 microversion: 2.1 time: 0.098491 Aug 04 04:40:57.229587 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1886/3872] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 04:40:57 2022] GET /compute/v2.1/images/323c5635-1bf2-4f8f-b4e7-312d538f1f04/metadata => generated 85 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:40:57.286194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:57.286924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:57.297685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.298343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.300021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.300643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.050686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:58.064377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23399361-716f-4d38-bb5f-71277373e654 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.933816 Aug 04 04:40:58.065310 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1987/3873] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:57 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:58.120537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:58.135586 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-544aaf59-6d73-4245-b22d-114f794b8b21 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.853455 Aug 04 04:40:58.136187 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1887/3874] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:57 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:58.142603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:58.142603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:58.157204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.157658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.158446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.158891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.421672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:58.432607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-369567556", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:58.449843 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-673736f3-6087-4832-b8b9-3f5f352324fd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1506 microversion: 2.1 time: 0.312583 Aug 04 04:40:58.454029 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1888/3875] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:58 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:58.461991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:58.462616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:58.477729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.478190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.479040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.479489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.526464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] validate_networks() for [('fbe23b09-1a2f-43e8-b59c-a662e93f0661', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:59.023957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:59.033345 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-094b77ad-65f1-403a-93e3-c67f7e85645d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.576112 Aug 04 04:40:59.033937 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1889/3876] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:58 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:59.058359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6f574c92-82c9-4b2a-bb73-8d033790395a req-a0a3456c-a583-4295-a733-30abc49009ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336", "name": "network-vif-plugged", "status": "completed", "tag": "6247e3ec-46ba-464d-ab51-1a9778b1b7ac"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:59.085341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6f574c92-82c9-4b2a-bb73-8d033790395a req-a0a3456c-a583-4295-a733-30abc49009ba service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:59.085807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6f574c92-82c9-4b2a-bb73-8d033790395a req-a0a3456c-a583-4295-a733-30abc49009ba service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:59.114457 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6f574c92-82c9-4b2a-bb73-8d033790395a req-a0a3456c-a583-4295-a733-30abc49009ba service nova] Creating event network-vif-plugged:6247e3ec-46ba-464d-ab51-1a9778b1b7ac for instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 on n-h1-851337-5 Aug 04 04:40:59.130815 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6f574c92-82c9-4b2a-bb73-8d033790395a req-a0a3456c-a583-4295-a733-30abc49009ba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090415 Aug 04 04:40:59.133444 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1890/3877] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:59.147607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:59.148305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:59.166761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:59.167247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:59.168045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:59.168491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:59.668460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:59.682271 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-982c7fa3-6280-4e5f-96d5-f05532758311 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.546990 Aug 04 04:40:59.685663 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1891/3878] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:59 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:59.692709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:59.694566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:59.714879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:59.715493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:59.721359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:59.721849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:59.932641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:59.933866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:59.935684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:59.936362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:59.937065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:59.968744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:59.999449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.004195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.005521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.006557 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81acfecb-7885-41b0-9c54-68a8bbed6242 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1404 microversion: 2.1 time: 0.315088 Aug 04 04:41:00.008999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.010115 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1892/3879] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:59 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1404 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:00.027199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:00.029987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:00.038550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:00.045102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.049526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.051918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.053314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.063533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for project 089163f805e44913b469df4e8c9e85ec. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:00.080329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for user 42e55434a6d24f20b0f95a3b57d06c42 and project 089163f805e44913b469df4e8c9e85ec. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:00.110807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:00.115907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:00.222718 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77bb88a3-8254-4769-bbdf-ba3e6f495c46 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.156008 Aug 04 04:41:00.223724 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1988/3880] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:41:00.253053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:00.254003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:00.264648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.264933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.266151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.266796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.896790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:00.930289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ed45847-101e-447e-847e-75686bb7b404 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.705235 Aug 04 04:41:00.930912 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1989/3881] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:00 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:00.944242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-90e0a750-7989-41eb-85d2-454bb0c88689 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:00.958319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-90e0a750-7989-41eb-85d2-454bb0c88689 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:01.087824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:01.105054 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-896aa102-6503-4163-a68f-1127e33c1624 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1488 microversion: 2.1 time: 1.091387 Aug 04 04:41:01.107669 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1893/3882] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:00 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1488 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:01.128994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:01.137759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:01.172867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.175541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.178570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.179905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.292941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-90e0a750-7989-41eb-85d2-454bb0c88689 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:01.306706 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-90e0a750-7989-41eb-85d2-454bb0c88689 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1221 microversion: 2.1 time: 0.366406 Aug 04 04:41:01.313758 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1990/3883] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:00 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1221 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:01.318930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:01.346165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:01.369376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.375754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.376875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.379531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.819565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:01.828559 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c37e077d-4f6e-468c-8a15-6b40a36d972f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.716388 Aug 04 04:41:01.829150 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1894/3884] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:01 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:01.844407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:01.844923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:01.858767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.859534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.860506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.861113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.907081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:01.918225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f522f38-2640-4aa5-9dfb-e0a8b24e0e03 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1590 microversion: 2.1 time: 0.603005 Aug 04 04:41:01.938529 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1991/3885] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:01 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1590 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:01.946556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:41:01.951027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-39c794bc-9c50-498d-b83c-632e4e5c507e req-58436f5a-c1b8-42f3-a1e7-db63956edcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3126e50-1c58-4a26-85cb-f00febbf1e33", "name": "network-vif-plugged", "status": "completed", "tag": "b320d013-37fd-4a66-a035-f70932afee57"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:01.976284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-39c794bc-9c50-498d-b83c-632e4e5c507e req-58436f5a-c1b8-42f3-a1e7-db63956edcd7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.977051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-39c794bc-9c50-498d-b83c-632e4e5c507e req-58436f5a-c1b8-42f3-a1e7-db63956edcd7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.991021 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-39c794bc-9c50-498d-b83c-632e4e5c507e req-58436f5a-c1b8-42f3-a1e7-db63956edcd7 service nova] Creating event network-vif-plugged:b320d013-37fd-4a66-a035-f70932afee57 for instance e3126e50-1c58-4a26-85cb-f00febbf1e33 on n-h2-851337-5 Aug 04 04:41:01.998508 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-39c794bc-9c50-498d-b83c-632e4e5c507e req-58436f5a-c1b8-42f3-a1e7-db63956edcd7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056621 Aug 04 04:41:02.004232 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1992/3886] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:02.060062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:02.161665 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32ebd866-df31-4170-bb19-6ba2ffd2cc8a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 204 len: 0 microversion: 2.1 time: 0.314968 Aug 04 04:41:02.163774 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1895/3887] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:01 2022] DELETE /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:02.172272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1414599879", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:02.266049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] validate_networks() for [('fbe23b09-1a2f-43e8-b59c-a662e93f0661', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:41:02.313333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6050326b-dcd7-4038-8a1c-5d23a8cff07d tempest-ListImagesTestJSON-373316537 tempest-ListImagesTestJSON-373316537-project] Calling method '.version_select at 0x7f191a63ff70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:02.374840 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6050326b-dcd7-4038-8a1c-5d23a8cff07d tempest-ListImagesTestJSON-373316537 tempest-ListImagesTestJSON-373316537-project] 10.222.0.69 "GET /compute/v2.1/images/9aa8a0ec-360d-40bf-b352-1066adb51df0" status: 200 len: 784 microversion: 2.1 time: 0.368963 Aug 04 04:41:02.375482 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1993/3888] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:02 2022] GET /compute/v2.1/images/9aa8a0ec-360d-40bf-b352-1066adb51df0 => generated 784 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:02.385253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66ca632b-1eba-4594-9c07-f0a201aee896 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:02.386749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-66ca632b-1eba-4594-9c07-f0a201aee896 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:02.395056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66ca632b-1eba-4594-9c07-f0a201aee896 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.395519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66ca632b-1eba-4594-9c07-f0a201aee896 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.396348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66ca632b-1eba-4594-9c07-f0a201aee896 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.396783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66ca632b-1eba-4594-9c07-f0a201aee896 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.743092 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-66ca632b-1eba-4594-9c07-f0a201aee896 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.363995 Aug 04 04:41:02.745039 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1994/3889] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:41:02 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336/os-interface => generated 284 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:02.753454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:02.756433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:02.769037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.769996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.772010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.773705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.222405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:03.241142 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e26d1d5-3889-4841-8cec-c8889bd0e89e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.493752 Aug 04 04:41:03.242819 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1995/3890] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:02 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:03.248529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4286e0b0-1952-4b0b-a259-43e92e9b13eb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a7ea0d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.274663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4286e0b0-1952-4b0b-a259-43e92e9b13eb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Image not found. Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4286e0b0-1952-4b0b-a259-43e92e9b13eb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e HTTP/1.1 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: exception: Image not found. Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '11409a6e-7d8b-4669-96f7-8c69f2eebe6e'} Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 11409a6e-7d8b-4669-96f7-8c69f2eebe6e to delete Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 11409a6e-7d8b-4669-96f7-8c69f2eebe6e could not be found. Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:03.276659 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4286e0b0-1952-4b0b-a259-43e92e9b13eb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Image not found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4286e0b0-1952-4b0b-a259-43e92e9b13eb tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e" status: 404 len: 62 microversion: 2.1 time: 0.034265 Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1996/3891] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:03 2022] DELETE /compute/v2.1/images/11409a6e-7d8b-4669-96f7-8c69f2eebe6e => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:41:03.288032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a89545a-db94-4b18-bde2-fea5c918cd36 tempest-ListImagesTestJSON-373316537 tempest-ListImagesTestJSON-373316537-project] Calling method '.version_select at 0x7f191a4d7700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.359990 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a89545a-db94-4b18-bde2-fea5c918cd36 tempest-ListImagesTestJSON-373316537 tempest-ListImagesTestJSON-373316537-project] 10.222.0.69 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.079060 Aug 04 04:41:03.361560 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1997/3892] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:03 2022] GET /compute/v2.1/images => generated 445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:03.366790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.368393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:03.376784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.377937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.379256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.379944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.628919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:41:03.631278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:41:03.632513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:41:03.633433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:41:03.634087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:41:03.648564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.649028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.650256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.651178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.697213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for project 089163f805e44913b469df4e8c9e85ec. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:03.700483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:03.707851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for user 42e55434a6d24f20b0f95a3b57d06c42 and project 089163f805e44913b469df4e8c9e85ec. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:03.711098 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b454f9ce-ccfc-409e-8687-45d55b55db82 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1308 microversion: 2.1 time: 0.347010 Aug 04 04:41:03.720452 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1998/3893] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:03 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:03.740130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.741090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:03.759990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.762848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.764393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.766275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.776820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:03.785549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:03.837517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:41:03.904364 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6f6b7d7-00e5-4763-bc56-9f6f3fc95469 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.737924 Aug 04 04:41:03.908013 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1896/3894] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:41:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:41:03.920710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba92d8ed-df9b-415f-b61a-192c32e30a48 tempest-ListImagesTestJSON-373316537 tempest-ListImagesTestJSON-373316537-project] Calling method '.version_select at 0x7f191a6449d0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.932737 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Instance is already in deleting state, ignoring this request Aug 04 04:41:03.934624 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-487f3638-ec97-46fe-be0e-8b7364b1e756 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 204 len: 0 microversion: 2.1 time: 0.210942 Aug 04 04:41:03.936093 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 1999/3895] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:03 2022] DELETE /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:03.946292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-acc9cb1b-d0ec-4e45-94fc-f666f38da99a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.947305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-acc9cb1b-d0ec-4e45-94fc-f666f38da99a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:04.010416 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba92d8ed-df9b-415f-b61a-192c32e30a48 tempest-ListImagesTestJSON-373316537 tempest-ListImagesTestJSON-373316537-project] 10.222.0.69 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.099632 Aug 04 04:41:04.012241 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1897/3896] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 04:41:03 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:04.028127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:04.031366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:04.056257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.062669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.063732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.065759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.131427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-acc9cb1b-d0ec-4e45-94fc-f666f38da99a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:04.140857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-acc9cb1b-d0ec-4e45-94fc-f666f38da99a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1222 microversion: 2.1 time: 0.202057 Aug 04 04:41:04.141682 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2000/3897] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:03 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1222 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:04.152750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0bcbb0cf-5185-470c-b176-1dee35ba63a2 req-8df0b959-ddfb-4ee5-8f36-aa8058261745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd441d2-4e11-4b19-a1ce-a38078be6687", "name": "network-vif-plugged", "status": "completed", "tag": "63e49ed8-c3d0-4299-9915-d540df37edba"}, {"server_uuid": "cfd441d2-4e11-4b19-a1ce-a38078be6687", "name": "network-vif-unplugged", "status": "completed", "tag": "63e49ed8-c3d0-4299-9915-d540df37edba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:04.168205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0bcbb0cf-5185-470c-b176-1dee35ba63a2 req-8df0b959-ddfb-4ee5-8f36-aa8058261745 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.169751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0bcbb0cf-5185-470c-b176-1dee35ba63a2 req-8df0b959-ddfb-4ee5-8f36-aa8058261745 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.186525 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0bcbb0cf-5185-470c-b176-1dee35ba63a2 req-8df0b959-ddfb-4ee5-8f36-aa8058261745 service nova] Creating event network-vif-plugged:63e49ed8-c3d0-4299-9915-d540df37edba for instance cfd441d2-4e11-4b19-a1ce-a38078be6687 on n-h1-851337-5 Aug 04 04:41:04.187238 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0bcbb0cf-5185-470c-b176-1dee35ba63a2 req-8df0b959-ddfb-4ee5-8f36-aa8058261745 service nova] Creating event network-vif-unplugged:63e49ed8-c3d0-4299-9915-d540df37edba for instance cfd441d2-4e11-4b19-a1ce-a38078be6687 on n-h1-851337-5 Aug 04 04:41:04.194388 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0bcbb0cf-5185-470c-b176-1dee35ba63a2 req-8df0b959-ddfb-4ee5-8f36-aa8058261745 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050762 Aug 04 04:41:04.196232 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2001/3898] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:04.271483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:04.273551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:04.301969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.302494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.306020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.306742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.390179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:04.404653 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5b3cd730-0d8d-4cb9-a9c9-29d7b02ef8aa tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1494 microversion: 2.1 time: 0.385886 Aug 04 04:41:04.405970 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1898/3899] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:04 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1494 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:04.720296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:04.735708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:04.736959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:04.748653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.751447 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a349ec3d-f82e-415a-91ee-523febabab88 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.464221 Aug 04 04:41:04.763737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.769042 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2002/3900] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:04 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:04.770508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.771380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.128364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:05.139635 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5532643f-175e-43c2-ae6a-a79bcbd99c29 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1490 microversion: 2.1 time: 0.408713 Aug 04 04:41:05.141198 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1899/3901] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:04 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1490 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:05.170390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:05.171119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:05.181715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.183015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.184285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.186238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.332581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-899336139", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "4d7b0316-9278-41a0-bbbc-01764ef3318b"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:05.414423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:41:05.415209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:05.424086 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee813a2a-9681-46cd-b58c-ccbf74c77132 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1274 microversion: 2.1 time: 0.260319 Aug 04 04:41:05.426555 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2003/3902] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:05 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:05.460194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:05.460832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:05.468072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.468516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.469593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.470230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.011813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:06.030643 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f2f3134-af83-4eab-b9dc-0f7586aeb6cf tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1494 microversion: 2.1 time: 0.586513 Aug 04 04:41:06.031635 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2004/3903] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:05 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1494 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:06.037993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:06.040263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:06.054849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.056475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.058794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.063939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.072080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:06.640128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:06.659972 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc408e58-4344-4be0-aa5c-180d6671cfe9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.626475 Aug 04 04:41:06.665032 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2005/3904] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:06 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:06.679656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:06.680580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:06.693418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.694707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.696016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.696696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.000147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:41:07.001215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:41:07.001958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:41:07.002564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:41:07.003230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:41:07.039147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.040893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.042027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.045371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.051242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:07.064855 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c2839539-e297-4c45-87b8-4ec752af003f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1280 microversion: 2.1 time: 0.394158 Aug 04 04:41:07.065758 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2006/3905] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:06 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:07.087043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2f0bae26-fd68-4854-bc2e-ff1c945ca745 req-51d0401b-5eb5-48d0-afe2-8e3e3ffecbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd441d2-4e11-4b19-a1ce-a38078be6687", "name": "network-vif-deleted", "tag": "63e49ed8-c3d0-4299-9915-d540df37edba"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:07.133265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2f0bae26-fd68-4854-bc2e-ff1c945ca745 req-51d0401b-5eb5-48d0-afe2-8e3e3ffecbb2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.134652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2f0bae26-fd68-4854-bc2e-ff1c945ca745 req-51d0401b-5eb5-48d0-afe2-8e3e3ffecbb2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.142492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:07.155400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:07.161054 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2f0bae26-fd68-4854-bc2e-ff1c945ca745 req-51d0401b-5eb5-48d0-afe2-8e3e3ffecbb2 service nova] Creating event network-vif-deleted:63e49ed8-c3d0-4299-9915-d540df37edba for instance cfd441d2-4e11-4b19-a1ce-a38078be6687 on n-h1-851337-5 Aug 04 04:41:07.174686 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2f0bae26-fd68-4854-bc2e-ff1c945ca745 req-51d0401b-5eb5-48d0-afe2-8e3e3ffecbb2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104763 Aug 04 04:41:07.177682 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2007/3906] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:07.181521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:07.185679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:07.187325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:07.190755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:07.218819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.220010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.221445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.222121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.270116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.270569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.271046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lazy-loading 'fault' on Instance uuid cfd441d2-4e11-4b19-a1ce-a38078be6687 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:41:07.289696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d2fe549-0f39-4f9c-b62f-e73f64770938 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.961171 Aug 04 04:41:07.298195 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1900/3907] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:41:07.313244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-457cb314-a15c-4151-ae48-83c8279bc3ea tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:07.314786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-457cb314-a15c-4151-ae48-83c8279bc3ea tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:07.354122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ca81b2ec24bd1b139bb817a47bb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda3ffc4b73a4d41921e0f80babed85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:07.379757 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83a44364-85f3-4fd4-a638-4b8afda7a94a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 200 len: 1297 microversion: 2.1 time: 0.200398 Aug 04 04:41:07.385817 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2008/3908] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:07 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:07.417437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:07.418111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:07.448496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-457cb314-a15c-4151-ae48-83c8279bc3ea tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:07.462194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.463140 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-457cb314-a15c-4151-ae48-83c8279bc3ea tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1208 microversion: 2.1 time: 0.157465 Aug 04 04:41:07.464185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.474858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.474858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.476475 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1901/3909] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:07 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1208 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:07.682740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:07.683328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:07.697217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.699343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.702541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.705423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.732776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:07.743636 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d4d2622b-2e06-4763-b862-c5fe27c20713 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1590 microversion: 2.1 time: 0.356068 Aug 04 04:41:07.744504 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2009/3910] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:07 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1590 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:07.937373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:07.949615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-594b85d2-f8c6-458d-a212-fe2ec0541b3a tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.270555 Aug 04 04:41:07.949615 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1902/3911] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:07 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:08.090381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.091846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:08.092985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f963d1cc-e789-401c-8f63-791a5cb89dbd tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Action: 'create', calling method: .version_select at 0x7f191a63f940>, body: {"keypair": {"name": "tempest-keypair-2027320388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbY55Y7hg9h8bGF3X1q8YGjJHYge6eRoq1utsTZz1R+yUJGUTWtxvz0P09ywdo5pgqbKGHHrcqbQ08IkCi9RtjzkrCm4S0tGCuo8ep+9OC8I0gvHcYVqnCRpg/Ygug1DA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:08.104883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.105353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.108813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.109553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.125235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f963d1cc-e789-401c-8f63-791a5cb89dbd tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:08.134061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f963d1cc-e789-401c-8f63-791a5cb89dbd tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for user 481e21219b5046b797dd8b4743d584ff and project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:08.173912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f963d1cc-e789-401c-8f63-791a5cb89dbd tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266545 Aug 04 04:41:08.175243 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2010/3912] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:08.188559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e32fed4-5850-4b2d-9a58-018b7e0f0cd7 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f191a4c45e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.198188 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e32fed4-5850-4b2d-9a58-018b7e0f0cd7 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-2027320388" status: 200 len: 498 microversion: 2.1 time: 0.015247 Aug 04 04:41:08.206594 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2011/3913] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2027320388 => generated 498 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:08.218293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d04ced28-3155-41f8-ad43-643430ba930f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f191a1dcdc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.249075 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d04ced28-3155-41f8-ad43-643430ba930f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027320388" status: 202 len: 0 microversion: 2.1 time: 0.040798 Aug 04 04:41:08.260998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2012/3914] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027320388 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:08.267487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e670de70-e69e-4ead-a7b1-b67453014602 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Action: 'create', calling method: .version_select at 0x7f191a2dc430>, body: {"keypair": {"name": "tempest-keypair-767120735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQKP2iK3kkfcYs8rCL3AyD+XuHcX/UHB6Xt73JmMLpiE9I9maY2moihC49URPhKTBoSxqYBgpdtwKtbFAsR4MXuQD6034rdqjCJYc0TN73Da8AuDTPeBl2dtnICWA+yiA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:08.288398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e670de70-e69e-4ead-a7b1-b67453014602 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:08.296704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e670de70-e69e-4ead-a7b1-b67453014602 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for user 481e21219b5046b797dd8b4743d584ff and project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:08.335357 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e670de70-e69e-4ead-a7b1-b67453014602 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072515 Aug 04 04:41:08.345351 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2013/3915] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:08.358485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1006954c-3d2d-42e8-9f93-977eaf66a7ef tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f191a4f9f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.369072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:08.390826 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1006954c-3d2d-42e8-9f93-977eaf66a7ef tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767120735" status: 202 len: 0 microversion: 2.1 time: 0.044291 Aug 04 04:41:08.398556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2014/3916] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 04:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767120735 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:08.409086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c89b93a0-55fb-40fc-829c-b64f1b9dd8cc tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Action: 'create', calling method: .version_select at 0x7f191a49e280>, body: {"keypair": {"name": "tempest-keypair-1225048083", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:08.438351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c89b93a0-55fb-40fc-829c-b64f1b9dd8cc tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:08.445704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c89b93a0-55fb-40fc-829c-b64f1b9dd8cc tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for user 481e21219b5046b797dd8b4743d584ff and project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:08.519805 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c89b93a0-55fb-40fc-829c-b64f1b9dd8cc tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.116156 Aug 04 04:41:08.521476 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2015/3917] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:08 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:08.526936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.528883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cfd441d2-4e11-4b19-a1ce-a38078be6687] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:08.540767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.541529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.549765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.550602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.583630 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Instance cfd441d2-4e11-4b19-a1ce-a38078be6687 could not be found. Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 HTTP/1.1 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance cfd441d2-4e11-4b19-a1ce-a38078be6687 could not be found. Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'cfd441d2-4e11-4b19-a1ce-a38078be6687'} Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfd441d2-4e11-4b19-a1ce-a38078be6687 could not be found. Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfd441d2-4e11-4b19-a1ce-a38078be6687 could not be found. Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.591344 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfd441d2-4e11-4b19-a1ce-a38078be6687 could not be found. Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Instance cfd441d2-4e11-4b19-a1ce-a38078be6687 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-10500b4c-0f41-4fac-91fb-35cf5fa62454 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687" status: 404 len: 111 microversion: 2.1 time: 0.070367 Aug 04 04:41:08.596332 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2016/3918] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/servers/cfd441d2-4e11-4b19-a1ce-a38078be6687 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:08.598571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.599240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:08.605797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.607269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.608452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.609301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.649668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:08.659367 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21c03bf3-526b-4669-a36e-b630865eb770 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1280 microversion: 2.1 time: 0.573292 Aug 04 04:41:08.664280 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1903/3919] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1280 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:08.675211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7572fd4d-4eed-4caf-a986-a6ce5fc63cb0 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f191a03b820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.708699 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7572fd4d-4eed-4caf-a986-a6ce5fc63cb0 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225048083" status: 202 len: 0 microversion: 2.1 time: 0.042655 Aug 04 04:41:08.710922 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1904/3920] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225048083 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:08.724496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4e09e83-765b-4d13-a0a0-e6fcba2b03cd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a65f550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.768875 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e4e09e83-765b-4d13-a0a0-e6fcba2b03cd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Image not found. Aug 04 04:41:08.769034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4e09e83-765b-4d13-a0a0-e6fcba2b03cd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 HTTP/1.1 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '86070204-907d-4a67-87da-6fca0712de32'} Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 86070204-907d-4a67-87da-6fca0712de32 to delete Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 86070204-907d-4a67-87da-6fca0712de32 could not be found. Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.772969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:41:08.777619 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.782317 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00823703-b352-4afa-9f39-cedae21957fb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1260 microversion: 2.1 time: 0.184433 Aug 04 04:41:08.782317 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2017/3921] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:08.783920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4e09e83-765b-4d13-a0a0-e6fcba2b03cd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:08.784989 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4e09e83-765b-4d13-a0a0-e6fcba2b03cd tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32" status: 404 len: 62 microversion: 2.1 time: 0.072134 Aug 04 04:41:08.789028 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1905/3922] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] DELETE /compute/v2.1/images/86070204-907d-4a67-87da-6fca0712de32 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:41:08.792797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57b562dc-ef23-4226-983c-832e712cf30f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Action: 'create', calling method: .version_select at 0x7f191a1dc700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-477101925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqryUGR0HhsH3F9KwnGiKUv6KsJq5yrIGpwpAhNyyuYCU/l7+t2vk63p3v0DCwbg5COOpTtI7NNWIIdtARn8edwX2DtZiNYeyDSrt5RA0hz/Xr2FhQzhiidylWqbEy69A=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:08.797078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.797849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:08.805344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.806071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.807188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.807824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.827187 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 HTTP/1.1 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '810afe59-9e7b-4b78-a7fa-8ffd88e7cc61'} Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:08.829649 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.835071 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.836280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-57b562dc-ef23-4226-983c-832e712cf30f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:08.837570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:08.838650 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38eab0c4-044c-4f95-94d6-1ca027996eb8 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 404 len: 111 microversion: 2.1 time: 0.046947 Aug 04 04:41:08.839446 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1906/3923] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:08 2022] DELETE /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:08.844475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-57b562dc-ef23-4226-983c-832e712cf30f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for user 481e21219b5046b797dd8b4743d584ff and project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:08.867910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.869149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:08.880212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.881299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.882428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.883155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.913507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57b562dc-ef23-4226-983c-832e712cf30f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.130335 Aug 04 04:41:08.914905 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2018/3924] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:08.930826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 HTTP/1.1 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '810afe59-9e7b-4b78-a7fa-8ffd88e7cc61'} Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.939149 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:08.946198 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:08.946198 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:08.946198 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:08.946198 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:08.946198 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. Aug 04 04:41:08.946198 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:08.948938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07e6f68d-9bd7-4e3a-a1f5-0c85c44a8a9a tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Action: 'create', calling method: .version_select at 0x7f191a49e280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-61173980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8uQ2Z9+59N01YVf1edc0eUQ6iKFjZnH2ikI6tRU/fURi619SRTkziay/Am1VYMYO/3Tohiaa3/wSthh167xm+uQnhGaD2r7gGs4hCGKIXvmxhIo1UtqlabDyiFIAKC7A=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:08.951248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Instance 810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:08.955504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4be7d8e-bce4-4771-8ef7-f46209f0bc70 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61" status: 404 len: 111 microversion: 2.1 time: 0.104399 Aug 04 04:41:08.959210 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1907/3925] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/servers/810afe59-9e7b-4b78-a7fa-8ffd88e7cc61 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:08.974880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0621fb90-7e26-4f9f-b022-10f18d776908 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a23a820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.996136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-07e6f68d-9bd7-4e3a-a1f5-0c85c44a8a9a tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:09.005405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-07e6f68d-9bd7-4e3a-a1f5-0c85c44a8a9a tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for user 481e21219b5046b797dd8b4743d584ff and project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:09.018657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0621fb90-7e26-4f9f-b022-10f18d776908 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Image not found. Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0621fb90-7e26-4f9f-b022-10f18d776908 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 HTTP/1.1 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '056c5aac-5c28-4cbb-ac47-b7001777c2f7'} Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 056c5aac-5c28-4cbb-ac47-b7001777c2f7 to delete Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 056c5aac-5c28-4cbb-ac47-b7001777c2f7 could not be found. Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.020589 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:41:09.025313 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.030101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0621fb90-7e26-4f9f-b022-10f18d776908 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:09.032909 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0621fb90-7e26-4f9f-b022-10f18d776908 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7" status: 404 len: 62 microversion: 2.1 time: 0.069313 Aug 04 04:41:09.035586 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1908/3926] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] DELETE /compute/v2.1/images/056c5aac-5c28-4cbb-ac47-b7001777c2f7 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:41:09.043920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.044894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.047433 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-07e6f68d-9bd7-4e3a-a1f5-0c85c44a8a9a tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.120335 Aug 04 04:41:09.048427 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2019/3927] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:09.053277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.054048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.054637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.055189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.055642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.056312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.082446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.082899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.083724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.084166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.123709 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 HTTP/1.1 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'cd663b6c-197e-408d-9802-63aaf5ae81d3'} Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:09.125471 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-daf98774-1551-4721-b9f2-ec8e02718817 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 404 len: 111 microversion: 2.1 time: 0.077386 Aug 04 04:41:09.134465 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2020/3928] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:09 2022] DELETE /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:09.143333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-382fd267-06cb-4037-a21e-bc86f5eeb39d tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Action: 'create', calling method: .version_select at 0x7f191a1dc160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1714365892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVRH7l2UlC/fMkNOljE+HD3pLtxmNI69N5TG/UTqOHc+uXopuxSpXdnX/Itxp0ynNC51qyKJxe36bN7DNjBwdp4ztBSrjF8FB/yHcKKQ94KlLoQeJZ6vIJdNQ7sybUB3g=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:09.181770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-382fd267-06cb-4037-a21e-bc86f5eeb39d tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:09.201382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-382fd267-06cb-4037-a21e-bc86f5eeb39d tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Getting quotas for user 481e21219b5046b797dd8b4743d584ff and project 230d1dbc3ca046a8ae457dfcc56f4b67. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:09.264591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:09.267384 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-382fd267-06cb-4037-a21e-bc86f5eeb39d tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.129737 Aug 04 04:41:09.276303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2021/3929] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:09.280646 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca6300fd-e53d-4a5b-b381-3720c8749b2d tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.240787 Aug 04 04:41:09.281524 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1909/3930] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:09.293505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.295501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: cd663b6c-197e-408d-9802-63aaf5ae81d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.298979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63753543-10f7-47e2-875d-fe7a4918903c tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f1923aa9a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.303634 n-d-851337-5 devstack@n-api.service[119342]: WARNING oslo_db.sqlalchemy.utils [None req-63753543-10f7-47e2-875d-fe7a4918903c tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 04:41:09.312995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.315497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.319308 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63753543-10f7-47e2-875d-fe7a4918903c tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.036646 Aug 04 04:41:09.320501 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1910/3931] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:09.332244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.332715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.333102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f785fd4d-b4c0-4ee4-ae82-25151b8cefca tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f191a03bf70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.358913 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f785fd4d-b4c0-4ee4-ae82-25151b8cefca tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1714365892" status: 202 len: 0 microversion: 2.1 time: 0.030231 Aug 04 04:41:09.360238 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1911/3932] 10.222.0.69 () {58 vars in 1278 bytes} [Thu Aug 4 04:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1714365892 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:09.371152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c3a34bb-5c3b-4953-8ee8-b8f7bb8e8d8f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f191a5ae670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.375263 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 HTTP/1.1 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'cd663b6c-197e-408d-9802-63aaf5ae81d3'} Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.379667 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Instance cd663b6c-197e-408d-9802-63aaf5ae81d3 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b34f3cba-a89d-4c38-8f7e-9312d1d5ebec tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3" status: 404 len: 111 microversion: 2.1 time: 0.101376 Aug 04 04:41:09.385868 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2022/3933] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/servers/cd663b6c-197e-408d-9802-63aaf5ae81d3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:09.408395 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c3a34bb-5c3b-4953-8ee8-b8f7bb8e8d8f tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-61173980" status: 202 len: 0 microversion: 2.1 time: 0.042562 Aug 04 04:41:09.410727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-532dad86-ff49-497b-ba43-9975d8231c5c req-d9cc2d4c-c00e-4250-96d0-c7c236919c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336", "tag": "6247e3ec-46ba-464d-ab51-1a9778b1b7ac"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:09.412477 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1912/3934] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-61173980 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:09.419421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36b1835c-085f-4408-8b4b-c8de6f82d4b3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '.version_select at 0x7f191a633430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.429920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-532dad86-ff49-497b-ba43-9975d8231c5c req-d9cc2d4c-c00e-4250-96d0-c7c236919c54 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.430684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-532dad86-ff49-497b-ba43-9975d8231c5c req-d9cc2d4c-c00e-4250-96d0-c7c236919c54 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.446512 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-532dad86-ff49-497b-ba43-9975d8231c5c req-d9cc2d4c-c00e-4250-96d0-c7c236919c54 service nova] Creating event network-changed:6247e3ec-46ba-464d-ab51-1a9778b1b7ac for instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 on n-h1-851337-5 Aug 04 04:41:09.455097 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-532dad86-ff49-497b-ba43-9975d8231c5c req-d9cc2d4c-c00e-4250-96d0-c7c236919c54 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071916 Aug 04 04:41:09.456458 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2023/3935] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:09.458671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-36b1835c-085f-4408-8b4b-c8de6f82d4b3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Image not found. Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36b1835c-085f-4408-8b4b-c8de6f82d4b3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 HTTP/1.1 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: exception: Image not found. Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '18722a1d-26e4-479d-99ed-06869d3b5b97'} Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 18722a1d-26e4-479d-99ed-06869d3b5b97 to delete Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 18722a1d-26e4-479d-99ed-06869d3b5b97 could not be found. Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.460862 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 04:41:09.467508 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.471495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36b1835c-085f-4408-8b4b-c8de6f82d4b3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Image not found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:09.471753 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-36b1835c-085f-4408-8b4b-c8de6f82d4b3 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97" status: 404 len: 62 microversion: 2.1 time: 0.055950 Aug 04 04:41:09.473980 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1913/3936] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] DELETE /compute/v2.1/images/18722a1d-26e4-479d-99ed-06869d3b5b97 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:41:09.474915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ae28178-a38c-4792-9f70-251531b3cad6 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] Calling method '.version_select at 0x7f191a1dc700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.495878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.501637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.519461 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ae28178-a38c-4792-9f70-251531b3cad6 tempest-KeyPairsV2TestJSON-1054638187 tempest-KeyPairsV2TestJSON-1054638187-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-477101925" status: 202 len: 0 microversion: 2.1 time: 0.058307 Aug 04 04:41:09.523382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.524354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.525390 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2024/3937] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-477101925 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:09.528023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.530342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.552072 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f HTTP/1.1 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'fda976a3-dfdf-4c91-a785-81aac0a7913f'} Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:09.554787 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48f7314c-74fb-482e-ba79-7567a0adee80 tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 404 len: 111 microversion: 2.1 time: 0.078995 Aug 04 04:41:09.559995 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1914/3938] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:09 2022] DELETE /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:09.570157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.571196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] [instance: fda976a3-dfdf-4c91-a785-81aac0a7913f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.580828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.581426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.582605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.583186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.611750 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] HTTP exception thrown: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Request method failure captured: Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f HTTP/1.1 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60ztq1wwIRgV_AyWD5lfAfBtrls6TVmTvv1qI-yqcMtRXH-7sC9XvAX5nGHhPBgs6lXbc3aWQzCNy-nf_jOA817VQUIxggaiqFXMD7OHSYLweojJtmOo_2ayQzeW9TYT9QKiPhkyJAeILdTPh_q4DURcha68jY4exn7H1FbsBdDrq-Y Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cda3ffc4b73a4d41921e0f80babed85d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cda3ffc4b73a4d41921e0f80babed85d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cda3ffc4b73a4d41921e0f80babed85d Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ImagesTestJSON-1478534715 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: bb9ca81b2ec24bd1b139bb817a47bb29 Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ImagesTestJSON-1478534715-project Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'fda976a3-dfdf-4c91-a785-81aac0a7913f'} Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.615990 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:09.623619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:09.623619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:09.623619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:09.623619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:09.623619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. Aug 04 04:41:09.623619 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:09.626315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] Returning 404 to user: Instance fda976a3-dfdf-4c91-a785-81aac0a7913f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:09.627445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a8e241d-ce9d-487d-a546-b9bc8f93b23a tempest-ImagesTestJSON-1478534715 tempest-ImagesTestJSON-1478534715-project] 10.222.0.69 "GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f" status: 404 len: 111 microversion: 2.1 time: 0.064820 Aug 04 04:41:09.628828 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2025/3939] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/servers/fda976a3-dfdf-4c91-a785-81aac0a7913f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:09.685419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.686075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.699287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.706106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.707800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.708206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.803141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.804336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.813963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.815357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.816420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.817264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.901205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:09.913429 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-583a5209-055a-4a75-8fc8-bbcc97768700 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1280 microversion: 2.1 time: 0.233006 Aug 04 04:41:09.926921 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1915/3940] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:09.937178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:09.947482 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-462de321-c4c7-47bf-bdcc-91af6cf5b611 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1266 microversion: 2.1 time: 0.147933 Aug 04 04:41:09.959340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2026/3941] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:10.301873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:10.302466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:10.308863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.309581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.310388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.310830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.888191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:10.902670 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11b6b144-1bf5-491f-8c94-54ba2e574064 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.604487 Aug 04 04:41:10.904017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1916/3942] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:10 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:10.937570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:10.938907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:10.947669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:10.975348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:10.976050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:10.989581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.995019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.995019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.995322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.996324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.996772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.007351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.007994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.238515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:11.248077 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82702e1a-24f0-4541-a30f-23fed6ba2dfe tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1266 microversion: 2.1 time: 0.279855 Aug 04 04:41:11.261659 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1917/3943] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:10 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:11.527843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:11.538690 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-611318b4-e1f4-4ecc-a7eb-c69cca3f5cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.606789 Aug 04 04:41:11.551641 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2027/3944] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:10 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:11.831305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ce12f910-2cbc-4b6b-a7f0-ebd0ea5f272f req-4c1ac2b5-cd4a-4933-a760-47096e55ad8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697f0c15-0ac4-4599-9876-635732b63ac5", "tag": "42a02d7d-ebd5-4636-84b3-5397091cbe8e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:11.848440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ce12f910-2cbc-4b6b-a7f0-ebd0ea5f272f req-4c1ac2b5-cd4a-4933-a760-47096e55ad8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.849478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ce12f910-2cbc-4b6b-a7f0-ebd0ea5f272f req-4c1ac2b5-cd4a-4933-a760-47096e55ad8a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.872268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ce12f910-2cbc-4b6b-a7f0-ebd0ea5f272f req-4c1ac2b5-cd4a-4933-a760-47096e55ad8a service nova] Creating event network-changed:42a02d7d-ebd5-4636-84b3-5397091cbe8e for instance 697f0c15-0ac4-4599-9876-635732b63ac5 on n-h2-851337-5 Aug 04 04:41:11.891914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ce12f910-2cbc-4b6b-a7f0-ebd0ea5f272f req-4c1ac2b5-cd4a-4933-a760-47096e55ad8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066714 Aug 04 04:41:11.895359 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1918/3945] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:11.924664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:11.925565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:11.932397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.933171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.933968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.935145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.269799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:12.270760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:12.278600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.279720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.280788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.281732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.839442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:12.861713 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27872185-487d-43f4-b824-b440cf5c077f tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.940983 Aug 04 04:41:12.866378 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2028/3946] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:11 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:12.868198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:12.886652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:12.886843 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb8dec76-124b-4af6-b53e-2d8417a78b33 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.621517 Aug 04 04:41:12.888026 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1919/3947] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:12 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:12.888321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:12.899827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.903147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.904718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.908222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.501998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:13.519783 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-193a569d-9c29-4825-8de6-0c4eef83e8e9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.649799 Aug 04 04:41:13.520799 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2029/3948] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:12 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:13.892340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:13.894301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:13.906282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.907605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.908892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.909634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.912586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:13.913976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:13.931548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.932352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.936621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.937329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.417583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:14.423480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:14.460121 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff665395-b415-4264-b60a-9505544f39b6 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.553791 Aug 04 04:41:14.474988 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2030/3949] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:13 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:14.475222 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1282afd8-0cb0-44da-9414-814b86e6c351 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1483 microversion: 2.1 time: 0.577773 Aug 04 04:41:14.475222 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1920/3950] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:13 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1483 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:14.477297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e19323a8-8f57-4aa7-8323-1bf8ad6d442d req-0e320ff5-61ca-4dc1-9aeb-4d7e350e9c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c03c2e6-81e9-4d79-863b-ad9db5388753", "tag": "71ec6369-aa7d-42d2-9005-6ddfeaacc7d4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:14.498554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f285b151-2817-4728-9b16-17140d6d172e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:14.499500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f285b151-2817-4728-9b16-17140d6d172e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:14.510040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e19323a8-8f57-4aa7-8323-1bf8ad6d442d req-0e320ff5-61ca-4dc1-9aeb-4d7e350e9c3e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.512965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e19323a8-8f57-4aa7-8323-1bf8ad6d442d req-0e320ff5-61ca-4dc1-9aeb-4d7e350e9c3e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.513545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f285b151-2817-4728-9b16-17140d6d172e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.515602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f285b151-2817-4728-9b16-17140d6d172e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.517726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f285b151-2817-4728-9b16-17140d6d172e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.521407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f285b151-2817-4728-9b16-17140d6d172e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.588104 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e19323a8-8f57-4aa7-8323-1bf8ad6d442d req-0e320ff5-61ca-4dc1-9aeb-4d7e350e9c3e service nova] Creating event network-changed:71ec6369-aa7d-42d2-9005-6ddfeaacc7d4 for instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 on n-h1-851337-5 Aug 04 04:41:14.614682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e19323a8-8f57-4aa7-8323-1bf8ad6d442d req-0e320ff5-61ca-4dc1-9aeb-4d7e350e9c3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139657 Aug 04 04:41:14.619199 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2031/3951] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:14.644252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:14.645522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:14.671781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.672523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.674384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.675106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.756310 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f285b151-2817-4728-9b16-17140d6d172e tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "POST /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9/action" status: 202 len: 0 microversion: 2.1 time: 0.262092 Aug 04 04:41:14.760209 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1921/3952] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:14 2022] POST /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:14.776830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:14.780898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:14.798544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.801920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.803423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.805384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:15.670849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:15.680016 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60f65b98-45c2-4e24-ae3a-16ff46ccb1d4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1491 microversion: 2.1 time: 0.915831 Aug 04 04:41:15.687803 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1922/3953] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:14 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1491 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:15.704131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:15.705036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:15.721554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:15.722281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:15.723299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:15.734810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:15.783233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:15.850942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:15.863708 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e0f6163d-08de-4749-a528-6f9ec4bf06ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 1.239657 Aug 04 04:41:15.868422 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2032/3954] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:14 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:16.532632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:16.541118 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2d97ac1-bd31-4686-93e3-ba4df01590ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.849113 Aug 04 04:41:16.541715 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1923/3955] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:15 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:16.716429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:16.717238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:16.726154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.726662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.728033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.728966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.891411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:16.892251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:16.898806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.899372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.900218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.900724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.096212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:17.245016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:17.257417 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8cd7f530-4594-4517-8f1d-10d1744b09cc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1491 microversion: 2.1 time: 0.545547 Aug 04 04:41:17.258604 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2033/3956] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:16 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1491 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:17.277769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2d5aa404-26b5-4f19-85f0-1670337c6e10 req-be66e9aa-38da-4a1b-8dbb-ec8d04aec656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa61a71-3608-4c76-97bb-e93b36304ad4", "tag": "389a5991-b3b5-4528-8a21-17b7a3ad105d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:17.288967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2d5aa404-26b5-4f19-85f0-1670337c6e10 req-be66e9aa-38da-4a1b-8dbb-ec8d04aec656 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.289767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2d5aa404-26b5-4f19-85f0-1670337c6e10 req-be66e9aa-38da-4a1b-8dbb-ec8d04aec656 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.303473 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2d5aa404-26b5-4f19-85f0-1670337c6e10 req-be66e9aa-38da-4a1b-8dbb-ec8d04aec656 service nova] Creating event network-changed:389a5991-b3b5-4528-8a21-17b7a3ad105d for instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 on n-h1-851337-5 Aug 04 04:41:17.310166 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2d5aa404-26b5-4f19-85f0-1670337c6e10 req-be66e9aa-38da-4a1b-8dbb-ec8d04aec656 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049461 Aug 04 04:41:17.311482 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2034/3957] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:17.407746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:17.417637 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c62ae51b-f221-45e1-8948-67f37dda42e8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.531594 Aug 04 04:41:17.431757 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1924/3958] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:16 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:17.563015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:17.563979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:17.570721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.571434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.572408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.573007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.958629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ed5ab303-acf0-4682-ad4a-caa0d232cd20 req-78c17e2c-cd64-4eb9-8f11-2e97bb15cfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697f0c15-0ac4-4599-9876-635732b63ac5", "name": "network-vif-plugged", "status": "completed", "tag": "42a02d7d-ebd5-4636-84b3-5397091cbe8e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:17.969460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=29 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:17.974465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:17.987199 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2993f7d9-7a47-479c-ac87-0b6e368d6146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.428766 Aug 04 04:41:17.992279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ed5ab303-acf0-4682-ad4a-caa0d232cd20 req-78c17e2c-cd64-4eb9-8f11-2e97bb15cfd5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.995468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ed5ab303-acf0-4682-ad4a-caa0d232cd20 req-78c17e2c-cd64-4eb9-8f11-2e97bb15cfd5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:18.004708 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2035/3959] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:17 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:18.021661 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ed5ab303-acf0-4682-ad4a-caa0d232cd20 req-78c17e2c-cd64-4eb9-8f11-2e97bb15cfd5 service nova] Creating event network-vif-plugged:42a02d7d-ebd5-4636-84b3-5397091cbe8e for instance 697f0c15-0ac4-4599-9876-635732b63ac5 on n-h2-851337-5 Aug 04 04:41:18.030041 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ed5ab303-acf0-4682-ad4a-caa0d232cd20 req-78c17e2c-cd64-4eb9-8f11-2e97bb15cfd5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075397 Aug 04 04:41:18.031475 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1925/3960] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:18.315867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:18.322114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:18.347714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:18.348708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:18.351689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:18.352332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:18.440322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:18.442190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:18.454064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:18.463258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:18.463750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:18.464555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:18.464996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.159384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:19.162373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.170089 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-114ccac5-b0d1-4abe-b508-d4fbb41ffcf9 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1491 microversion: 2.1 time: 0.887280 Aug 04 04:41:19.170936 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2036/3961] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:18 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1491 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:19.176135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:19.177163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:19.183583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.184961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.186207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.186758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.229403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=54 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.252661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:19.261239 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34ae3e7f-90dc-4a16-8bab-1a39a3183634 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.827156 Aug 04 04:41:19.265341 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1926/3962] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:18 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:20.197690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:20.198622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:20.218259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.220581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.222897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.223924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.257512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:20.276881 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-844e3797-9bdd-402c-bca8-7ee219a0a6d0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 1.103236 Aug 04 04:41:20.296643 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2037/3963] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:19 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:20.319197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:20.319849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:20.346895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.347408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.348979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.349616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.845322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:20.853238 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-78c6ef6e-874c-42b8-adac-a01b99b25b36 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1497 microversion: 2.1 time: 0.662043 Aug 04 04:41:20.854473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1927/3964] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:20 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1497 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:20.879865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:20.880692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:20.888038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.888859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.890079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.890813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.922470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:41:21.043495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:21.056766 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6beb8ee8-0d43-4616-b0fe-b9a1ce6b11ca tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.758514 Aug 04 04:41:21.068113 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2038/3965] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:20 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:21.125083 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27e94a7a-8c46-4dfc-a076-2ea450f3b5f8 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 204 len: 0 microversion: 2.1 time: 0.249356 Aug 04 04:41:21.127133 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1928/3966] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:20 2022] DELETE /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:21.136594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:21.138142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:21.148944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:21.150783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:21.152094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:21.154628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:21.305642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:21.306357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:21.319406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:21.319851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:21.329637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:21.331336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:21.787838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:21.797125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:21.803192 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f0464bae-0e3c-4cf4-96cc-c37b7bc81408 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.671860 Aug 04 04:41:21.807203 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2039/3967] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:21 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:21.810089 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0de3b95b-bf2b-4eda-a1bb-c149a10a43eb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.509234 Aug 04 04:41:21.824401 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1929/3968] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:21 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:22.081291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:22.082085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:22.094602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.095247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.096157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.096704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.974220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:22.988189 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9ac4c88-1702-42da-a7ad-277ea624b60b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.910549 Aug 04 04:41:22.990273 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2040/3969] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:22 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:22.998573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:22.999237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:23.016102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.016564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:23.028039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.028768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:23.036780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca9fd349-1ee7-4b02-8577-7453b2840976 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f191aa20160>, body: {"keypair": {"name": "tempest-keypair-1343864677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKu9yU7L7DErK0HEw6hzf77WK5hohMD2yd0Irhg5xOp5WUXe8QBDM3SgWWTPW9SwlOUokNFndWVpDhqxp3VnfbROMGIept/se2iV+Z7VgnDiXC0g9FlVy+eqyRzcJh52Q=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:23.075568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ca9fd349-1ee7-4b02-8577-7453b2840976 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:23.087755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ca9fd349-1ee7-4b02-8577-7453b2840976 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:23.118892 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca9fd349-1ee7-4b02-8577-7453b2840976 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.307153 Aug 04 04:41:23.119900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1930/3970] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Aug 4 04:41:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 309 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 04 04:41:23.133591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:23.134249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:23.146873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.147358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:23.148153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.148600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:23.546821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:23.554838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a17ff9ca-e403-47da-912c-05287798d40f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.433712 Aug 04 04:41:23.558320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:23.567289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ac81f836-4e92-4529-b666-4ce0370262dc tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.575911 Aug 04 04:41:23.568301 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2041/3971] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:22 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:23.575996 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1931/3972] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:23 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:23.581402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-94657587-43d1-4026-9873-34e9f339516f tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f191a49ea60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:23.592935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:23.595081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-94657587-43d1-4026-9873-34e9f339516f tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-1343864677" status: 200 len: 513 microversion: 2.2 time: 0.024222 Aug 04 04:41:23.596396 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2042/3973] 10.222.0.69 () {60 vars in 1258 bytes} [Thu Aug 4 04:41:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1343864677 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:23.608968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91f2f53c-93e0-428f-bdbf-639783b3ac1f tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f191a633ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:23.644068 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91f2f53c-93e0-428f-bdbf-639783b3ac1f tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343864677" status: 204 len: 0 microversion: 2.2 time: 0.040510 Aug 04 04:41:23.645329 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1932/3974] 10.222.0.69 () {60 vars in 1261 bytes} [Thu Aug 4 04:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343864677 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:23.657616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88cef0ef-67f7-46b8-af08-2b71462b22a8 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f191a7ea820>, body: {"keypair": {"name": "tempest-keypair-1664280632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCG4tlBWOnQ140+Tv/veOrVa4/j0nxFIzPY1LTbRwObpX/k0Z+CFoAdy8gn8cvdh7Buafhh1CJAtFO0BEgyCdaz0jBuKOCy6W0Acvh88DFTNhQEDPWANgvgojxq0zgjBw=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:23.701820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-88cef0ef-67f7-46b8-af08-2b71462b22a8 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:23.725985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-88cef0ef-67f7-46b8-af08-2b71462b22a8 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:23.807840 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-88cef0ef-67f7-46b8-af08-2b71462b22a8 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.154218 Aug 04 04:41:23.821152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6863cbd6-1ff7-4124-ac64-936e1fbdb0a9 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f191a00cd30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:23.829604 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2043/3975] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Aug 4 04:41:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:41:23.868435 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6863cbd6-1ff7-4124-ac64-936e1fbdb0a9 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664280632" status: 204 len: 0 microversion: 2.2 time: 0.051935 Aug 04 04:41:23.869933 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1933/3976] 10.222.0.69 () {60 vars in 1261 bytes} [Thu Aug 4 04:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664280632 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:23.884832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aed7c8ae-2c22-43e8-9403-bcb404c0287b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f191a2dc940>, body: {"keypair": {"name": "tempest-keypair-873347090", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:23.922910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-aed7c8ae-2c22-43e8-9403-bcb404c0287b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:23.939425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-aed7c8ae-2c22-43e8-9403-bcb404c0287b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:24.005052 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aed7c8ae-2c22-43e8-9403-bcb404c0287b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.126052 Aug 04 04:41:24.018294 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2044/3977] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Aug 4 04:41:23 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:41:24.018994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:24.019956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:24.029369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.031562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.034290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.035952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.037388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48cabc12-4695-4922-a43d-e5e430fffbf0 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f191a4d7e50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:24.101274 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48cabc12-4695-4922-a43d-e5e430fffbf0 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873347090" status: 204 len: 0 microversion: 2.2 time: 0.074643 Aug 04 04:41:24.102106 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2045/3978] 10.222.0.69 () {60 vars in 1258 bytes} [Thu Aug 4 04:41:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873347090 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:24.127844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a942c87-fc4e-481c-b9cd-dc5e9dd5e2f7 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f191a32c3a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2120924106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ/YH+p/AEzxM7kz4Zd56bDzi42yKePHJGvHeZsbn3jlGbgJLJnswYw0r2ztRF3Zi8N/08b52Sg7tzHHYXLmwuSnrjcmUc8JoWk/0XKdVXGEfIjfMEn+aV9OdNM3VVABQ=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:24.163768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5a942c87-fc4e-481c-b9cd-dc5e9dd5e2f7 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:24.203919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5a942c87-fc4e-481c-b9cd-dc5e9dd5e2f7 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:24.266683 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a942c87-fc4e-481c-b9cd-dc5e9dd5e2f7 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.153563 Aug 04 04:41:24.267341 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2046/3979] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Aug 4 04:41:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:41:24.288790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d29b6c28-d7c1-4896-ba71-584a7b697df4 req-bae92aa6-44ad-4394-9962-fa279082208f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c03c2e6-81e9-4d79-863b-ad9db5388753", "name": "network-vif-plugged", "status": "completed", "tag": "71ec6369-aa7d-42d2-9005-6ddfeaacc7d4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:24.311906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d29b6c28-d7c1-4896-ba71-584a7b697df4 req-bae92aa6-44ad-4394-9962-fa279082208f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.312671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d29b6c28-d7c1-4896-ba71-584a7b697df4 req-bae92aa6-44ad-4394-9962-fa279082208f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.328183 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d29b6c28-d7c1-4896-ba71-584a7b697df4 req-bae92aa6-44ad-4394-9962-fa279082208f service nova] Creating event network-vif-plugged:71ec6369-aa7d-42d2-9005-6ddfeaacc7d4 for instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 on n-h1-851337-5 Aug 04 04:41:24.333679 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d29b6c28-d7c1-4896-ba71-584a7b697df4 req-bae92aa6-44ad-4394-9962-fa279082208f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056831 Aug 04 04:41:24.334897 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2047/3980] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:24.341993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-15f082c1-dbbd-49b2-858c-3f28be455e54 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f191a49e160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-179950417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgL9lOb8TQt3t0a2TMsb2sNR4GY7E5aW3G1oWBlaXOW9R0mwNhAr0W+CR7/XnmckyQB1IdQQ6e/Z/XUcUMBb8qLAgxJesHjnI2C+ZALVxyDhMJ9QG9AJ8U+nXOAEw1Llg=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:24.381217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-15f082c1-dbbd-49b2-858c-3f28be455e54 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:24.388049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-15f082c1-dbbd-49b2-858c-3f28be455e54 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:24.468204 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-15f082c1-dbbd-49b2-858c-3f28be455e54 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.131716 Aug 04 04:41:24.477628 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2048/3981] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Aug 4 04:41:24 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:41:24.486652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ed0a1789-1892-4213-ad5d-b2c5a873834b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f191a2299d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-751206241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhslVI47g456qHtFl4Qp219KnIZ7xJYQutOdhs/O50DFrfS9nwKb7v34IrjgMlhktGuDtW5Q75VW/bcliswJmvDgwwrMQh0KDE9bu3AP9axRSP6SGAnDZJ+Y23tRmx19g=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:24.537376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ed0a1789-1892-4213-ad5d-b2c5a873834b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:24.560565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ed0a1789-1892-4213-ad5d-b2c5a873834b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:24.637020 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ed0a1789-1892-4213-ad5d-b2c5a873834b tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.157064 Aug 04 04:41:24.638579 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2049/3982] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Aug 4 04:41:24 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:41:24.654145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:24.655266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:24.671569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.672038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.676603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.677063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.837208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:24.848853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-782efd3e-b096-4c39-9fe0-d0ae762d1d79 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.834530 Aug 04 04:41:24.850072 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1934/3983] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:24 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:24.855569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:24.857136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:24.874182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.874828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.875674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.876527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:25.164009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:25.172156 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61756885-074d-4495-9d0e-717447c92355 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.532061 Aug 04 04:41:25.172893 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2050/3984] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:24 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:25.177561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b5dc460-d3f1-4ad5-a884-0daec59c2f7a tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f191a229670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:25.181586 n-d-851337-5 devstack@n-api.service[119343]: WARNING oslo_db.sqlalchemy.utils [None req-9b5dc460-d3f1-4ad5-a884-0daec59c2f7a tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 04:41:25.187458 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b5dc460-d3f1-4ad5-a884-0daec59c2f7a tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.013433 Aug 04 04:41:25.188032 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2051/3985] 10.222.0.69 () {60 vars in 1177 bytes} [Thu Aug 4 04:41:25 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:25.295860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9487d5dd-5096-46ab-8e03-b61959a4b477 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a33b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-584461086", "description": "tempest-description-1870722851"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:25.744960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:25.755360 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e828b88b-996e-4ce4-ad16-60be85208c31 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 200 len: 1503 microversion: 2.1 time: 0.904006 Aug 04 04:41:25.756366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1935/3986] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:24 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 1503 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:25.763111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3cb536b9-6344-4994-ad66-771b74a361d4 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f1919f6c040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:25.787340 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3cb536b9-6344-4994-ad66-771b74a361d4 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-751206241" status: 204 len: 0 microversion: 2.2 time: 0.028748 Aug 04 04:41:25.788343 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1936/3987] 10.222.0.69 () {60 vars in 1318 bytes} [Thu Aug 4 04:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-751206241 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:25.804349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6425c8c-0ef7-48ce-997a-6b1616c72b9d tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f1919f9d280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:25.832497 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6425c8c-0ef7-48ce-997a-6b1616c72b9d tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-179950417" status: 204 len: 0 microversion: 2.2 time: 0.039449 Aug 04 04:41:25.834818 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1937/3988] 10.222.0.69 () {60 vars in 1318 bytes} [Thu Aug 4 04:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-179950417 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:25.845346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9efbd1ff-ed11-4e11-8421-832360338fba tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f1919f615e0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:25.878764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9efbd1ff-ed11-4e11-8421-832360338fba tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2120924106" status: 204 len: 0 microversion: 2.2 time: 0.038571 Aug 04 04:41:25.887224 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1938/3989] 10.222.0.69 () {60 vars in 1321 bytes} [Thu Aug 4 04:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2120924106 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:25.892963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:25.893597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:25.900411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:25.900868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:25.901725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:25.902169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.469672 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9487d5dd-5096-46ab-8e03-b61959a4b477 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.280353 Aug 04 04:41:26.483114 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2052/3990] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:41:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:26.491536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:26.493312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3693ac6f-a5aa-42b5-999a-9010d3533d4c tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f191a63f310>, body: {"keypair": {"name": "tempest-keypair-733093308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAL+X20I/7y6qVTTpPJSvJ2ghGnUFNKYQeF/DeuKZsIbrwCA6YmpTva2AMOhvy8Fee+cKXMHSiNlNmah/fl8SNSVEjsHjcE91TsX85YnowS+c19pvmnQvwm45EvLv0Kgw=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:26.500336 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e12a2df9-dd8b-4a39-98d2-4b4b497a15a7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1322 microversion: 2.1 time: 0.611740 Aug 04 04:41:26.500942 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1939/3991] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:25 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:26.526051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:26.526974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:26.549389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.549851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.551287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.551738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.574542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3693ac6f-a5aa-42b5-999a-9010d3533d4c tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:26.595628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3693ac6f-a5aa-42b5-999a-9010d3533d4c tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:26.700799 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3693ac6f-a5aa-42b5-999a-9010d3533d4c tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.215432 Aug 04 04:41:26.701571 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2053/3992] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Aug 4 04:41:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 04:41:26.710176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1b5eb934-432d-444d-81a1-7780412bdff8 req-c92add09-3d9f-43e9-a5c2-4252797ab3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2ebd01-eee6-4750-a7b7-877df63a57f9", "name": "network-vif-deleted", "tag": "c35ce392-f594-4608-aa36-60276dc081a5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:26.736935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b5eb934-432d-444d-81a1-7780412bdff8 req-c92add09-3d9f-43e9-a5c2-4252797ab3fe service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.738558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1b5eb934-432d-444d-81a1-7780412bdff8 req-c92add09-3d9f-43e9-a5c2-4252797ab3fe service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.778050 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1b5eb934-432d-444d-81a1-7780412bdff8 req-c92add09-3d9f-43e9-a5c2-4252797ab3fe service nova] Creating event network-vif-deleted:c35ce392-f594-4608-aa36-60276dc081a5 for instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 on n-h2-851337-5 Aug 04 04:41:26.786680 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1b5eb934-432d-444d-81a1-7780412bdff8 req-c92add09-3d9f-43e9-a5c2-4252797ab3fe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083507 Aug 04 04:41:26.789360 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2054/3993] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:26.796856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b62353ee-9e40-4033-939b-21e1032d4656 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a1dc820>, body: {"security_group_rule": {"parent_group_id": "3997d7fc-1298-44bd-9981-000c063f27a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:27.136732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:27.154894 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60579ce4-2e3f-43c9-9f6e-40654d45be47 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.638727 Aug 04 04:41:27.155737 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1940/3994] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:26 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:27.175096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e9ad167d-d1b7-43ff-89b8-2b11b17eac26 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f1919f87940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:27.196715 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e9ad167d-d1b7-43ff-89b8-2b11b17eac26 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-733093308" status: 200 len: 512 microversion: 2.2 time: 0.039879 Aug 04 04:41:27.197919 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1941/3995] 10.222.0.69 () {60 vars in 1255 bytes} [Thu Aug 4 04:41:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-733093308 => generated 512 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:27.208097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:27.210712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 6c2ebd01-eee6-4750-a7b7-877df63a57f9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:27.226273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.236001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.238460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.239197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.264994 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] HTTP exception thrown: Instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 could not be found. Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Request method failure captured: Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 HTTP/1.1 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60151rdpAsAXx9nsy7n3xLuZ5Y5O0dKwFQwJFd-6FzcgtVPeG5kW3IHDhQbYFH1Kfv4GVF6OyZ8LalX2vR6yKdud0oqrDhnbPmL79-wW6H_zI9HMhqz9LMydwajM3kfrYdgCi21_LGcJW2iDoNyX_xtq5ZFbTwucQTl0MugAOLd6nZ0 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 9488df2de5f2402596ad614ca0132778 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueTestJSON-1805908128 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9488df2de5f2402596ad614ca0132778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9488df2de5f2402596ad614ca0132778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9488df2de5f2402596ad614ca0132778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9488df2de5f2402596ad614ca0132778", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueTestJSON-1805908128 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 9488df2de5f2402596ad614ca0132778 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueTestJSON-1805908128 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueTestJSON-1805908128-project Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c39dc10490454d4a9f5c39507a469bb0 Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueTestJSON-1805908128-project Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 could not be found. Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6c2ebd01-eee6-4750-a7b7-877df63a57f9'} Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 could not be found. Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 could not be found. Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:27.267318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:27.273199 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:27.273199 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:27.273199 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:27.273199 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:27.273199 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:27.273199 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 could not be found. Aug 04 04:41:27.273199 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:27.275323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Returning 404 to user: Instance 6c2ebd01-eee6-4750-a7b7-877df63a57f9 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:27.276593 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-343baa05-f8d5-46a3-b273-cf4eade689b0 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9" status: 404 len: 111 microversion: 2.1 time: 0.077376 Aug 04 04:41:27.277352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1942/3996] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:27 2022] GET /compute/v2.1/servers/6c2ebd01-eee6-4750-a7b7-877df63a57f9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:27.286475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce353faf-b1c6-473e-8b41-2b39e53b18ad tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f19239b5f70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:27.291312 n-d-851337-5 devstack@n-api.service[119342]: WARNING oslo_db.sqlalchemy.utils [None req-ce353faf-b1c6-473e-8b41-2b39e53b18ad tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 04:41:27.297994 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce353faf-b1c6-473e-8b41-2b39e53b18ad tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.019325 Aug 04 04:41:27.298856 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1943/3997] 10.222.0.69 () {60 vars in 1177 bytes} [Thu Aug 4 04:41:27 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:27.305157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:27.305894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:27.313775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.314472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.315806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.316460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.351516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:41:27.505265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-94a6325c-4ac6-41a0-9e0f-8c7cba1825ed tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "DELETE /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 204 len: 0 microversion: 2.1 time: 0.203944 Aug 04 04:41:27.508189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1944/3998] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:27 2022] DELETE /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:27.515411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec0da6a5-974d-4c2b-a0b0-6a92859f8880 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f1923ab9a60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:27.519507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b62353ee-9e40-4033-939b-21e1032d4656 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.728570 Aug 04 04:41:27.520281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2055/3999] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:27.533480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:27.534352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:27.541082 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec0da6a5-974d-4c2b-a0b0-6a92859f8880 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-733093308" status: 204 len: 0 microversion: 2.2 time: 0.031103 Aug 04 04:41:27.542751 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1945/4000] 10.222.0.69 () {60 vars in 1258 bytes} [Thu Aug 4 04:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-733093308 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:27.549105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.549641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:27.550797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:27.553021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.554535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.556507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.563532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.564414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.565700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:27.566390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.942674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:27.955210 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53516a4e-c834-43ea-ab93-3912392340da tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1517 microversion: 2.1 time: 0.410382 Aug 04 04:41:27.971867 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1946/4001] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:27 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1517 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:27.975561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:27.984493 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a03c0d6c-cee9-4252-a8a2-fd726c4e8958 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1490 microversion: 2.1 time: 0.455373 Aug 04 04:41:27.988537 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2056/4002] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:27 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1490 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:27.992141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2caf167e-79b0-4fa3-9377-0695413bedcb tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f19239828b0>, body: {"security_group_rule": {"parent_group_id": "3997d7fc-1298-44bd-9981-000c063f27a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:27.996032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Action: 'create', calling method: .version_select at 0x7f192005a3a0>, body: {"keypair": {"name": "tempest-keypair-1397101321", "type": "x509"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:28.040447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:28.055526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:28.085772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.processutils [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmps4cge00u/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps4cge00u/temp.key -subj /CN=99e0956e14444e11b5e0bc5c903e4123 -extensions v3_req_client {{(pid=119343) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 04:41:28.156696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-2caf167e-79b0-4fa3-9377-0695413bedcb tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: This rule already exists in group 3997d7fc-1298-44bd-9981-000c063f27a1 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2caf167e-79b0-4fa3-9377-0695413bedcb tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 138 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: {"security_group_rule": {"parent_group_id": "3997d7fc-1298-44bd-9981-000c063f27a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: exception: This rule already exists in group 3997d7fc-1298-44bd-9981-000c063f27a1 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3997d7fc-1298-44bd-9981-000c063f27a1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3997d7fc-1298-44bd-9981-000c063f27a1 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3997d7fc-1298-44bd-9981-000c063f27a1 Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:28.159100 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:28.164968 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:28.164968 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:28.164968 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3997d7fc-1298-44bd-9981-000c063f27a1 Aug 04 04:41:28.164968 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:28.172619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2caf167e-79b0-4fa3-9377-0695413bedcb tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 400 to user: This rule already exists in group 3997d7fc-1298-44bd-9981-000c063f27a1 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:28.176471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2caf167e-79b0-4fa3-9377-0695413bedcb tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.198176 Aug 04 04:41:28.177391 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1947/4003] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:27 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:41:28.185826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:28.191360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:28.207674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.208560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.209597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.210262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.214780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:28.243027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lazy-loading 'flavor' on Instance uuid 4c03c2e6-81e9-4d79-863b-ad9db5388753 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:41:28.401147 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-71ef737f-2249-4232-b2a5-3aa435f06e62 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action" status: 200 len: 32 microversion: 2.1 time: 0.222080 Aug 04 04:41:28.402145 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1948/4004] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:28 2022] POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:41:28.419400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:28.420582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:28.431169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.439299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.440432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.442941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.859897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:28.870607 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d942b09e-06db-4c89-9d3f-9f9d5374b8cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.466062 Aug 04 04:41:28.871323 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1949/4005] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:28 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:28.894364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e60df7ba-8679-44de-81f8-52b19154c9db tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Calling method '.version_select at 0x7f191a644d30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.140014 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e60df7ba-8679-44de-81f8-52b19154c9db tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-group-rules/befacd8c-b4dc-43f0-bcc0-35aef98160dc" status: 202 len: 0 microversion: 2.1 time: 0.266909 Aug 04 04:41:29.140673 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1950/4006] 10.222.0.69 () {58 vars in 1287 bytes} [Thu Aug 4 04:41:28 2022] DELETE /compute/v2.1/os-security-group-rules/befacd8c-b4dc-43f0-bcc0-35aef98160dc => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:29.149691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.155106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:29.167414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.168038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.170318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.170780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.199014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.processutils [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmps4cge00u/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps4cge00u/temp.key -subj /CN=99e0956e14444e11b5e0bc5c903e4123 -extensions v3_req_client" returned: 0 in 1.111s {{(pid=119343) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 04:41:29.204522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.processutils [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmps4cge00u/temp.key -password pass: {{(pid=119343) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 04:41:29.250694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.processutils [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] CMD "openssl pkcs12 -export -inkey /tmp/tmps4cge00u/temp.key -password pass:" returned: 0 in 0.046s {{(pid=119343) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 04:41:29.314514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:29.339427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:29.357042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Getting quotas for user 99e0956e14444e11b5e0bc5c903e4123 and project 4602447dcd5146ff93567f8671a109b6. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:29.397148 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c5a697eb-18e0-464b-b8a8-6946ac6ad623 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.407178 Aug 04 04:41:29.408212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:29.408647 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2057/4007] 10.222.0.69 () {62 vars in 1198 bytes} [Thu Aug 4 04:41:27 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1414 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:29.412344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c1addedc-8318-4625-8db9-3bcf0a4a34ad tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.269962 Aug 04 04:41:29.419001 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1951/4008] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:29 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:29.419001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.419001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:29.419436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e3671b62-eae1-4726-bdeb-9abc7d1b7300 req-4942004f-65e6-4b0e-9be7-9362b87b8278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa61a71-3608-4c76-97bb-e93b36304ad4", "name": "network-vif-plugged", "status": "completed", "tag": "389a5991-b3b5-4528-8a21-17b7a3ad105d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:29.430821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.431594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.435214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.436186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.440111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e3671b62-eae1-4726-bdeb-9abc7d1b7300 req-4942004f-65e6-4b0e-9be7-9362b87b8278 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.440698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e3671b62-eae1-4726-bdeb-9abc7d1b7300 req-4942004f-65e6-4b0e-9be7-9362b87b8278 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.456396 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e3671b62-eae1-4726-bdeb-9abc7d1b7300 req-4942004f-65e6-4b0e-9be7-9362b87b8278 service nova] Creating event network-vif-plugged:389a5991-b3b5-4528-8a21-17b7a3ad105d for instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 on n-h1-851337-5 Aug 04 04:41:29.465937 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e3671b62-eae1-4726-bdeb-9abc7d1b7300 req-4942004f-65e6-4b0e-9be7-9362b87b8278 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060814 Aug 04 04:41:29.466800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2058/4009] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:29.474201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-28766251-435d-41b0-aeab-309dbbf6dd87 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a1dcc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-993934372", "description": "tempest-description-1216124918"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:29.719453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:29.729482 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ade26171-ba2d-4bca-8266-2bd47c6d0257 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1490 microversion: 2.1 time: 0.314996 Aug 04 04:41:29.730411 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1952/4010] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:29 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1490 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:29.748734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-78e02856-b0bd-4991-ad47-783233ac05a4 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f191a250700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.758494 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-78e02856-b0bd-4991-ad47-783233ac05a4 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-1397101321" status: 200 len: 1534 microversion: 2.2 time: 0.013732 Aug 04 04:41:29.759439 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1953/4011] 10.222.0.69 () {60 vars in 1258 bytes} [Thu Aug 4 04:41:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1397101321 => generated 1534 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:29.774103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82ef61d0-fb5f-48a8-99e0-e6efadb2ea32 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f1919f19e50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.790872 n-d-851337-5 devstack@n-api.service[119342]: WARNING oslo_db.sqlalchemy.utils [None req-82ef61d0-fb5f-48a8-99e0-e6efadb2ea32 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 04:41:29.798145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82ef61d0-fb5f-48a8-99e0-e6efadb2ea32 tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.028113 Aug 04 04:41:29.804163 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1954/4012] 10.222.0.69 () {60 vars in 1177 bytes} [Thu Aug 4 04:41:29 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:29.813241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1834046-7af7-478e-b347-e9135764467a tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] Calling method '.version_select at 0x7f1923982ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.850834 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-28766251-435d-41b0-aeab-309dbbf6dd87 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.381918 Aug 04 04:41:29.851932 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2059/4013] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:41:29 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:29.873866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a1e09e3-c8ee-4efa-bf1f-9ff4cea65580 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f1923a57820>, body: {"security_group_rule": {"parent_group_id": "588451a7-0186-46b6-9a5b-e2e3a2d8040d", "ip_protocol": "tcp", "from_port": 1536641682, "to_port": 22}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:29.902848 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1834046-7af7-478e-b347-e9135764467a tempest-KeyPairsV22TestJSON-1590681103 tempest-KeyPairsV22TestJSON-1590681103-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397101321" status: 204 len: 0 microversion: 2.2 time: 0.095135 Aug 04 04:41:29.903532 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1955/4014] 10.222.0.69 () {60 vars in 1261 bytes} [Thu Aug 4 04:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397101321 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:41:29.912193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.914915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:29.927309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.930061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.930986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.931610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:30.060944 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-6a1e09e3-c8ee-4efa-bf1f-9ff4cea65580 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: Invalid port range 1536641682:22. Former value cannot be greater than the later Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a1e09e3-c8ee-4efa-bf1f-9ff4cea65580 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 146 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: {"security_group_rule": {"parent_group_id": "588451a7-0186-46b6-9a5b-e2e3a2d8040d", "ip_protocol": "tcp", "from_port": 1536641682, "to_port": 22}} Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid port range 1536641682:22. Former value cannot be greater than the later Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'security_group_rule': {'parent_group_id': '588451a7-0186-46b6-9a5b-e2e3a2d8040d', 'ip_protocol': 'tcp', 'from_port': 1536641682, 'to_port': 22}}} Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1536641682:22. Former value cannot be greater than the later Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1536641682:22. Former value cannot be greater than the later Aug 04 04:41:30.068922 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1536641682:22. Former value cannot be greater than the later Aug 04 04:41:30.075409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.079937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a1e09e3-c8ee-4efa-bf1f-9ff4cea65580 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 400 to user: Invalid port range 1536641682:22. Former value cannot be greater than the later {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:30.080857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a1e09e3-c8ee-4efa-bf1f-9ff4cea65580 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.219815 Aug 04 04:41:30.081491 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2060/4015] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:29 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:41:30.092037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2c3709c-41b8-4ff2-9659-f618babb1c28 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a33b3a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-979046527", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:30.102581 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f2c3709c-41b8-4ff2-9659-f618babb1c28 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: Security group id should be uuid Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2c3709c-41b8-4ff2-9659-f618babb1c28 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 130 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-979046527", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: exception: Security group id should be uuid Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-979046527', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:30.105780 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:30.117557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 04 04:41:30.117557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.117557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2c3709c-41b8-4ff2-9659-f618babb1c28 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 400 to user: Security group id should be uuid {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:30.117557 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2c3709c-41b8-4ff2-9659-f618babb1c28 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019187 Aug 04 04:41:30.117557 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2061/4016] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:30 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:30.122627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-597b35af-b05b-4f33-8e60-d0796a7f452f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f1923a57a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-214168551", "description": "tempest-description-1576724936"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:30.243555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:30.261225 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a746b460-3648-4595-9533-09b888857dc9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.348050 Aug 04 04:41:30.266345 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1956/4017] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:29 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:30.438150 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-597b35af-b05b-4f33-8e60-d0796a7f452f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.324361 Aug 04 04:41:30.439001 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2062/4018] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:41:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:30.440332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:30.440959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:30.452707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4bf77aab-a6bf-4eb7-8022-1ce6b44e960d tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a63f5e0>, body: {"security_group_rule": {"parent_group_id": "f1dc0582-33fb-464f-9b51-0977966e85f4", "ip_protocol": "tempest-999-638297299", "from_port": 22, "to_port": 22}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:30.453653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:30.455235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:30.457154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:30.458036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:30.567876 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4bf77aab-a6bf-4eb7-8022-1ce6b44e960d tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: Invalid IP protocol tempest-999-638297299. Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4bf77aab-a6bf-4eb7-8022-1ce6b44e960d tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 156 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: {"security_group_rule": {"parent_group_id": "f1dc0582-33fb-464f-9b51-0977966e85f4", "ip_protocol": "tempest-999-638297299", "from_port": 22, "to_port": 22}} Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid IP protocol tempest-999-638297299. Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f1dc0582-33fb-464f-9b51-0977966e85f4', 'ip_protocol': 'tempest-999-638297299', 'from_port': 22, 'to_port': 22}}} Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-638297299. Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-638297299. Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.571201 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-638297299. Aug 04 04:41:30.577247 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:30.580009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4bf77aab-a6bf-4eb7-8022-1ce6b44e960d tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 400 to user: Invalid IP protocol tempest-999-638297299. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:30.581088 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4bf77aab-a6bf-4eb7-8022-1ce6b44e960d tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.133257 Aug 04 04:41:30.582178 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2063/4019] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:30 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:30.596661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83d7a839-0b37-4e91-8445-ad94ebe2eece tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a229790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1375253172", "description": "tempest-description-844539756"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:30.875031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:30.887974 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f90c13c-b1ed-4f36-b029-6c92aa9fec19 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.456901 Aug 04 04:41:30.905201 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1957/4020] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:30 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:30.912248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:30.913342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:30.923636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:30.926100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:30.927511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:30.928383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:31.236130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83d7a839-0b37-4e91-8445-ad94ebe2eece tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.648759 Aug 04 04:41:31.244462 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2064/4021] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:41:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:31.263202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04d16475-8fa5-49b2-8778-2c91e7cc5cae tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f19239f0790>, body: {"security_group_rule": {"parent_group_id": "a2528839-086e-49cb-850b-6e4b8ce2f5b1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:31.266496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:31.279746 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fddf7096-8efd-4c3f-9831-b4b76ff3e60c tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1490 microversion: 2.1 time: 0.372986 Aug 04 04:41:31.294912 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1958/4022] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:30 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1490 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:31.302390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:31.303349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:31.310994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:31.311722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:31.312982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:31.313600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:31.416141 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-04d16475-8fa5-49b2-8778-2c91e7cc5cae tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04d16475-8fa5-49b2-8778-2c91e7cc5cae tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 138 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: {"security_group_rule": {"parent_group_id": "a2528839-086e-49cb-850b-6e4b8ce2f5b1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a2528839-086e-49cb-850b-6e4b8ce2f5b1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 04:41:31.418200 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 04:41:31.424332 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.431125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04d16475-8fa5-49b2-8778-2c91e7cc5cae tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:31.438231 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-04d16475-8fa5-49b2-8778-2c91e7cc5cae tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.180624 Aug 04 04:41:31.440355 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2065/4023] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:31 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:41:31.458287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22404c3c-87a3-4ca8-ab76-d747e2c1d993 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a2dc1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1109797789", "description": "tempest-description-191922319"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:31.741636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:31.755706 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9d22bf7b-1d22-4a8a-94eb-9eca44677a58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1308 microversion: 2.1 time: 0.459332 Aug 04 04:41:31.757031 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1959/4024] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:31 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:31.788652 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22404c3c-87a3-4ca8-ab76-d747e2c1d993 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.342077 Aug 04 04:41:31.791963 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2066/4025] 10.222.0.69 () {60 vars in 1180 bytes} [Thu Aug 4 04:41:31 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:31.817099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ddc80e06-c903-4f9e-b97f-b906ce7f10dd tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a633280>, body: {"security_group_rule": {"parent_group_id": "a593502f-5a05-4928-add4-b902f24d5e38", "ip_protocol": "tcp", "from_port": 22, "to_port": 1006078420}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:31.911607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:31.913801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:31.928157 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ddc80e06-c903-4f9e-b97f-b906ce7f10dd tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: Invalid port range 22:1006078420. Valid TCP ports should be between 1-65535 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ddc80e06-c903-4f9e-b97f-b906ce7f10dd tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 146 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: {"security_group_rule": {"parent_group_id": "a593502f-5a05-4928-add4-b902f24d5e38", "ip_protocol": "tcp", "from_port": 22, "to_port": 1006078420}} Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid port range 22:1006078420. Valid TCP ports should be between 1-65535 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a593502f-5a05-4928-add4-b902f24d5e38', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1006078420}}} Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1006078420. Valid TCP ports should be between 1-65535 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1006078420. Valid TCP ports should be between 1-65535 Aug 04 04:41:31.930816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1006078420. Valid TCP ports should be between 1-65535 Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ddc80e06-c903-4f9e-b97f-b906ce7f10dd tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 400 to user: Invalid port range 22:1006078420. Valid TCP ports should be between 1-65535 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ddc80e06-c903-4f9e-b97f-b906ce7f10dd tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.121285 Aug 04 04:41:31.937342 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1960/4026] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:31 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:41:31.951070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53c73f08-f0d4-4538-bbb3-e1860a7b16f9 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Action: 'create', calling method: .version_select at 0x7f191a36d160>, body: {"security_group_rule": {"parent_group_id": "c215b9fb-fefe-4051-b68a-c912f40f04ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:31.952542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:31.953920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:31.957344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:31.960799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.029431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-53c73f08-f0d4-4538-bbb3-e1860a7b16f9 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:41:32.030623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-53c73f08-f0d4-4538-bbb3-e1860a7b16f9 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Neutron security group c215b9fb-fefe-4051-b68a-c912f40f04ac not found {{(pid=119342) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 04:41:32.035804 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-53c73f08-f0d4-4538-bbb3-e1860a7b16f9 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist Aug 04 04:41:32.035804 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-9769476e-3691-4200-b99f-2e9a877fe316'] Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53c73f08-f0d4-4538-bbb3-e1860a7b16f9 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 138 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: {"security_group_rule": {"parent_group_id": "c215b9fb-fefe-4051-b68a-c912f40f04ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-9769476e-3691-4200-b99f-2e9a877fe316'] Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c215b9fb-fefe-4051-b68a-c912f40f04ac', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:41:32.038090 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9769476e-3691-4200-b99f-2e9a877fe316'] Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9769476e-3691-4200-b99f-2e9a877fe316'] Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9769476e-3691-4200-b99f-2e9a877fe316'] Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9769476e-3691-4200-b99f-2e9a877fe316'] Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53c73f08-f0d4-4538-bbb3-e1860a7b16f9 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 404 to user: Security group c215b9fb-fefe-4051-b68a-c912f40f04ac does not exist Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-9769476e-3691-4200-b99f-2e9a877fe316'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53c73f08-f0d4-4538-bbb3-e1860a7b16f9 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.100852 Aug 04 04:41:32.044221 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1961/4027] 10.222.0.69 () {60 vars in 1195 bytes} [Thu Aug 4 04:41:31 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:32.059027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-402d20b1-122f-40ee-989f-1bfe1604c29f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Calling method '.version_select at 0x7f191a266b80>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:32.128651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG neutronclient.v2_0.client [None req-402d20b1-122f-40ee-989f-1bfe1604c29f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist", "detail": ""}} {{(pid=119342) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 04:41:32.129358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-402d20b1-122f-40ee-989f-1bfe1604c29f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Neutron security group rule a08d0916-0311-4e16-afce-e8f42089e350 not found {{(pid=119342) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 04 04:41:32.129987 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-402d20b1-122f-40ee-989f-1bfe1604c29f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] HTTP exception thrown: Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist Aug 04 04:41:32.129987 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-8ba41825-cdc6-4681-905a-7090d3de805b'] Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-402d20b1-122f-40ee-989f-1bfe1604c29f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Request method failure captured: Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-security-group-rules/a08d0916-0311-4e16-afce-e8f42089e350 HTTP/1.1 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6030RiiCX6j5W3EDUthBR9tYKiYfM21DfuFQamG7uTnwclxNtYFRzDfyjFEDtPJwSRrT1JN_Bzy0myMUWUwP4elYgxox16a3RG4_0kta0_qSGpIk6J0cR0GPYDeUSOOlDVsXh69Lc6XN0vlYqRMcDfmQCvz420u7lqkTAZB-ScpT5M0 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87bb67bde2cb4ab896a4dbfc60c30392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87bb67bde2cb4ab896a4dbfc60c30392", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 87bb67bde2cb4ab896a4dbfc60c30392 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d665bf0b15684d2f83442e02a00936d6 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: exception: Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-8ba41825-cdc6-4681-905a-7090d3de805b'] Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a08d0916-0311-4e16-afce-e8f42089e350'} Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 04:41:32.132256 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba41825-cdc6-4681-905a-7090d3de805b'] Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba41825-cdc6-4681-905a-7090d3de805b'] Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba41825-cdc6-4681-905a-7090d3de805b'] Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba41825-cdc6-4681-905a-7090d3de805b'] Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-402d20b1-122f-40ee-989f-1bfe1604c29f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Returning 404 to user: Security group rule a08d0916-0311-4e16-afce-e8f42089e350 does not exist Aug 04 04:41:32.138109 n-d-851337-5 devstack@n-api.service[119342]: Neutron server returns request_ids: ['req-8ba41825-cdc6-4681-905a-7090d3de805b'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:32.142534 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-402d20b1-122f-40ee-989f-1bfe1604c29f tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-group-rules/a08d0916-0311-4e16-afce-e8f42089e350" status: 404 len: 199 microversion: 2.1 time: 0.089886 Aug 04 04:41:32.144771 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1962/4028] 10.222.0.69 () {58 vars in 1287 bytes} [Thu Aug 4 04:41:32 2022] DELETE /compute/v2.1/os-security-group-rules/a08d0916-0311-4e16-afce-e8f42089e350 => generated 199 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:32.151124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-158776a9-f873-4bb6-8599-0fcc7ac35bdd tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Calling method '.version_select at 0x7f191a36d280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:32.268094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:32.279317 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e5622f07-9f00-4a3d-abb8-e6a4e2955ba5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.370181 Aug 04 04:41:32.294027 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2067/4029] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:31 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:32.301222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:32.301935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:32.308956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.309708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.310685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.311322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.451335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39dc10490454d4a9f5c39507a469bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9488df2de5f2402596ad614ca0132778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:32.459044 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a886bc16-2089-4695-b6ed-79083ce019f4 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 200 len: 1448 microversion: 2.1 time: 0.161792 Aug 04 04:41:32.478365 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2068/4030] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:32 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 1448 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:32.523849 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-158776a9-f873-4bb6-8599-0fcc7ac35bdd tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/a593502f-5a05-4928-add4-b902f24d5e38" status: 202 len: 0 microversion: 2.1 time: 0.378124 Aug 04 04:41:32.534800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4421a77e-8b98-4ee3-ad22-3c3cb4012601 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Calling method '.version_select at 0x7f191a2dcd30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:32.535548 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1963/4031] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:41:32 2022] DELETE /compute/v2.1/os-security-groups/a593502f-5a05-4928-add4-b902f24d5e38 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:32.778198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:32.778817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:32.784958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=7 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:32.797424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.806321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.807164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.807930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.820329 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4421a77e-8b98-4ee3-ad22-3c3cb4012601 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/a2528839-086e-49cb-850b-6e4b8ce2f5b1" status: 202 len: 0 microversion: 2.1 time: 0.289947 Aug 04 04:41:32.821333 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2069/4032] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:41:32 2022] DELETE /compute/v2.1/os-security-groups/a2528839-086e-49cb-850b-6e4b8ce2f5b1 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:41:32.830684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ad9096c7-cdfb-4731-845c-42674895eabe req-f88452a4-8156-48ad-863a-ca86d21dda2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b2d356-9387-48cc-8afd-f39c6ecbf349", "name": "network-vif-deleted", "tag": "0c0aa630-fc30-45e4-8b65-f6156b694ebd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:32.857382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ad9096c7-cdfb-4731-845c-42674895eabe req-f88452a4-8156-48ad-863a-ca86d21dda2f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.857382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ad9096c7-cdfb-4731-845c-42674895eabe req-f88452a4-8156-48ad-863a-ca86d21dda2f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.889992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ad9096c7-cdfb-4731-845c-42674895eabe req-f88452a4-8156-48ad-863a-ca86d21dda2f service nova] Creating event network-vif-deleted:0c0aa630-fc30-45e4-8b65-f6156b694ebd for instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 on n-h1-851337-5 Aug 04 04:41:32.896316 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ad9096c7-cdfb-4731-845c-42674895eabe req-f88452a4-8156-48ad-863a-ca86d21dda2f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073116 Aug 04 04:41:32.898205 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2070/4033] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:32.905126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbe38926-0e81-4cb4-b3e4-818b19eb6054 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Calling method '.version_select at 0x7f19239f0310>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:33.098939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:33.256500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:33.268656 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a904d32d-5b79-4234-ba10-797b72b89079 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1489 microversion: 2.1 time: 0.492790 Aug 04 04:41:33.269221 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1964/4034] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:32 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1489 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:33.290716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:33.291755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:33.301146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.301880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.302835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.303464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.580995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:33.596939 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cbe38926-0e81-4cb4-b3e4-818b19eb6054 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/f1dc0582-33fb-464f-9b51-0977966e85f4" status: 202 len: 0 microversion: 2.1 time: 0.697088 Aug 04 04:41:33.600534 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2071/4035] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:41:32 2022] DELETE /compute/v2.1/os-security-groups/f1dc0582-33fb-464f-9b51-0977966e85f4 => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:33.603170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:33.604057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:33.608124 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e079faa-dddb-41cc-8f74-a9c3419eac73 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1490 microversion: 2.1 time: 0.322524 Aug 04 04:41:33.617096 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1965/4036] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:33 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1490 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:33.622970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:33.639586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.639996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.640778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.641223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.646413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] [instance: 93b2d356-9387-48cc-8afd-f39c6ecbf349] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:33.655633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.656390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.657348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.657964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.679964 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] HTTP exception thrown: Instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 could not be found. Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Request method failure captured: Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 HTTP/1.1 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60151rdpAsAXx9nsy7n3xLuZ5Y5O0dKwFQwJFd-6FzcgtVPeG5kW3IHDhQbYFH1Kfv4GVF6OyZ8LalX2vR6yKdud0oqrDhnbPmL79-wW6H_zI9HMhqz9LMydwajM3kfrYdgCi21_LGcJW2iDoNyX_xtq5ZFbTwucQTl0MugAOLd6nZ0 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 9488df2de5f2402596ad614ca0132778 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueTestJSON-1805908128 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9488df2de5f2402596ad614ca0132778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9488df2de5f2402596ad614ca0132778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9488df2de5f2402596ad614ca0132778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9488df2de5f2402596ad614ca0132778", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueTestJSON-1805908128 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 9488df2de5f2402596ad614ca0132778 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueTestJSON-1805908128 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueTestJSON-1805908128-project Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c39dc10490454d4a9f5c39507a469bb0 Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueTestJSON-1805908128-project Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 could not be found. Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '93b2d356-9387-48cc-8afd-f39c6ecbf349'} Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 could not be found. Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 could not be found. Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:33.681907 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:33.687764 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:33.687764 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:33.687764 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:33.687764 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:33.687764 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:33.687764 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 could not be found. Aug 04 04:41:33.687764 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:33.689318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] Returning 404 to user: Instance 93b2d356-9387-48cc-8afd-f39c6ecbf349 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:33.691921 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f91bc120-551f-4693-a63a-f411de4d1fb5 tempest-ServerRescueTestJSON-1805908128 tempest-ServerRescueTestJSON-1805908128-project] 10.222.0.69 "GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349" status: 404 len: 111 microversion: 2.1 time: 0.073484 Aug 04 04:41:33.692503 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1966/4037] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:33 2022] GET /compute/v2.1/servers/93b2d356-9387-48cc-8afd-f39c6ecbf349 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:33.711058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0c673cb-a61e-41f8-b6de-4a4ef3d4860b tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Calling method '.version_select at 0x7f191a1c7040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:34.487823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:34.499506 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d704b01-85df-4dea-a59c-1210bcc2d1ac tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.900393 Aug 04 04:41:34.501104 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2072/4038] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:33 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:34.521175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:34.522076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:34.529005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:34.529701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:34.530703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:34.531368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:34.918638 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0c673cb-a61e-41f8-b6de-4a4ef3d4860b tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/588451a7-0186-46b6-9a5b-e2e3a2d8040d" status: 202 len: 0 microversion: 2.1 time: 1.217749 Aug 04 04:41:34.919296 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1967/4039] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:41:33 2022] DELETE /compute/v2.1/os-security-groups/588451a7-0186-46b6-9a5b-e2e3a2d8040d => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:34.928826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2158bef6-96ae-484e-91d9-1feb621e6681 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] Calling method '.version_select at 0x7f19192db700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:35.062526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:35.071504 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f57a1175-cbff-4e4f-b84f-f67daaa7b71f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1489 microversion: 2.1 time: 0.567727 Aug 04 04:41:35.072607 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2073/4040] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:34 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1489 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:35.099259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:35.100526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:35.110222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.111120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.112136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.112826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.145760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:41:35.255894 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9a7715a-e0d4-4093-b727-00aea9616b1c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 204 len: 0 microversion: 2.1 time: 0.162726 Aug 04 04:41:35.256536 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2074/4041] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:35 2022] DELETE /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:41:35.273144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:35.274002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:35.281671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.282395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.283484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.284118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.652758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:35.666063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c32e76c3-9816-4f1c-b928-5d5313c6e579 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1495 microversion: 2.1 time: 0.400129 Aug 04 04:41:35.681617 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2075/4042] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:35 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1495 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:35.686446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:35.687117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:35.696673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.697126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.697913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.698355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.734258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:36.320768 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2158bef6-96ae-484e-91d9-1feb621e6681 tempest-SecurityGroupRulesNegativeTestJSON-1409114069 tempest-SecurityGroupRulesNegativeTestJSON-1409114069-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/3997d7fc-1298-44bd-9981-000c063f27a1" status: 202 len: 0 microversion: 2.1 time: 1.396458 Aug 04 04:41:36.327176 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1968/4043] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 04:41:34 2022] DELETE /compute/v2.1/os-security-groups/3997d7fc-1298-44bd-9981-000c063f27a1 => generated 0 bytes in 1403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:41:36.460128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:36.505951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-298fbb32-96d4-44f2-a18a-0a4b15869a13 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.833947 Aug 04 04:41:36.509873 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2076/4044] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:35 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:36.688996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:36.689617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:36.710763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:36.711762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:36.712894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:36.713565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:37.224668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:37.234580 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d981a8b8-817c-47d2-9acc-f31c601bbbb0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1495 microversion: 2.1 time: 0.549486 Aug 04 04:41:37.236094 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1969/4045] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:36 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1495 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:37.526898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:37.528051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:37.551656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:37.552428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:37.563076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:37.564250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.257795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:38.259793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:38.274773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.275540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.276530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.277176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.435818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:38.445089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:38.450859 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-851818d3-482d-4b5a-8dc3-79cea6df089a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.927688 Aug 04 04:41:38.454332 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bde1687e-e9be-41a6-a690-1f4c5acaa78d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 200 len: 1453 microversion: 2.1 time: 0.200315 Aug 04 04:41:38.460078 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1970/4046] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:38 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 1453 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:38.467625 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2077/4047] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:37 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:38.636775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9e956838-ce5e-4aba-8e49-00dd7380c0ab req-ff20f44d-e1ec-4678-b960-3940c9944c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa61a71-3608-4c76-97bb-e93b36304ad4", "name": "network-vif-deleted", "tag": "389a5991-b3b5-4528-8a21-17b7a3ad105d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:38.667354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9e956838-ce5e-4aba-8e49-00dd7380c0ab req-ff20f44d-e1ec-4678-b960-3940c9944c94 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.668364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9e956838-ce5e-4aba-8e49-00dd7380c0ab req-ff20f44d-e1ec-4678-b960-3940c9944c94 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.680888 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9e956838-ce5e-4aba-8e49-00dd7380c0ab req-ff20f44d-e1ec-4678-b960-3940c9944c94 service nova] Creating event network-vif-deleted:389a5991-b3b5-4528-8a21-17b7a3ad105d for instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 on n-h1-851337-5 Aug 04 04:41:38.693893 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9e956838-ce5e-4aba-8e49-00dd7380c0ab req-ff20f44d-e1ec-4678-b960-3940c9944c94 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059890 Aug 04 04:41:38.695317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1971/4048] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:39.475940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.480252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:39.483788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.484919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:39.489863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=32 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:39.497951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.498407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.499225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.499658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.503967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.504785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.506763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.508248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.536172 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 HTTP/1.1 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3fa61a71-3608-4c76-97bb-e93b36304ad4'} Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:39.543420 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bbe9b727-19af-49a1-8cb1-e4b4885e4144 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 404 len: 111 microversion: 2.1 time: 0.068152 Aug 04 04:41:39.548509 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1972/4049] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:39 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:41:39.559131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.559632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:39.575517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.576065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.576890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.577325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.631756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:41:39.693887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:39.802049 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-976b8398-5221-4c0e-b0ac-83b89af515cb tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 204 len: 0 microversion: 2.1 time: 0.246623 Aug 04 04:41:39.807371 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1973/4050] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:41:39 2022] DELETE /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:41:39.814087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.815923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:39.831658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.832402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.836374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.837099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.928070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:39.937026 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2f16036b-a702-4615-add1-4f3c5be06be2 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.467041 Aug 04 04:41:39.940407 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2078/4051] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:39 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:40.130368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:40.139335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-68671e8a-8a7e-41f4-a2ff-d84c72bc3b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1496 microversion: 2.1 time: 0.329953 Aug 04 04:41:40.153975 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1974/4052] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:39 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1496 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:40.961317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:40.962701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:40.980750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.982090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.983695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.985011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:41.163422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:41.164605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:41.178360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:41.178701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:41.179565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:41.179928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:41.586245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:41.603008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13420a1e-5c73-4c2d-bc37-6db8b553d71e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.646702 Aug 04 04:41:41.608990 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2079/4053] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:40 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:41.816463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:41.827333 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2e1ac7b1-4fd1-4ef1-bb41-c336f7d947ab tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1496 microversion: 2.1 time: 0.669390 Aug 04 04:41:41.827935 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1975/4054] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:41 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1496 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:42.628828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:42.629459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:42.645335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.645335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.645335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.652092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.852339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:42.853116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:42.868202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.868765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.869660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.870202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:43.093803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:43.133606 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45b4ee3a-bb5a-4d5d-974f-9cabd398c401 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 200 len: 1454 microversion: 2.1 time: 0.284262 Aug 04 04:41:43.134862 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1976/4055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:42 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:43.258650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-720e6479-1aae-4f05-abd8-de0122ee269e req-d956e5db-cf73-4976-b5f4-388845b95d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3126e50-1c58-4a26-85cb-f00febbf1e33", "name": "network-vif-deleted", "tag": "b320d013-37fd-4a66-a035-f70932afee57"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:43.283729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-720e6479-1aae-4f05-abd8-de0122ee269e req-d956e5db-cf73-4976-b5f4-388845b95d85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:43.284181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-720e6479-1aae-4f05-abd8-de0122ee269e req-d956e5db-cf73-4976-b5f4-388845b95d85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:43.306012 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-720e6479-1aae-4f05-abd8-de0122ee269e req-d956e5db-cf73-4976-b5f4-388845b95d85 service nova] Creating event network-vif-deleted:b320d013-37fd-4a66-a035-f70932afee57 for instance e3126e50-1c58-4a26-85cb-f00febbf1e33 on n-h2-851337-5 Aug 04 04:41:43.312882 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-720e6479-1aae-4f05-abd8-de0122ee269e req-d956e5db-cf73-4976-b5f4-388845b95d85 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058499 Aug 04 04:41:43.314208 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1977/4056] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:43.363446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:43.379134 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-536539f4-071c-4951-bfd9-a19d7bbf5a0c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.753437 Aug 04 04:41:43.380192 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2080/4057] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:42 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:44.157333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:44.158681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:44.174262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:44.177334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:44.178243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:44.180124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:44.220135 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 HTTP/1.1 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'e3126e50-1c58-4a26-85cb-f00febbf1e33'} Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:44.222144 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:44.227541 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:44.227541 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:44.227541 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:44.227541 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:44.227541 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:44.227541 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:41:44.227541 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:44.229319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:44.230410 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-580ee110-0825-451c-8e16-ae77be848f4d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 404 len: 111 microversion: 2.1 time: 0.078580 Aug 04 04:41:44.238475 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1978/4058] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:44 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:44.401217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:44.401849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:44.424228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:44.424683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:44.426881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:44.427612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:44.451154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-89878726", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "4d7b0316-9278-41a0-bbbc-01764ef3318b"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:44.550585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:41:45.335898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:45.346848 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c1f94ec-e137-4b38-8073-4de5a18e3f20 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.949432 Aug 04 04:41:45.348793 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2081/4059] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:44 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:45.810771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:41:45.814600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:41:45.815351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:41:45.821176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:41:45.822034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:41:45.853590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:45.854466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:45.856713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:45.857668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:45.885271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:45.892533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:45.907389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:45.909823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:45.987336 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c18662f6-cb93-4314-b8a7-97ddb97db809 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541035 Aug 04 04:41:45.989196 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1979/4060] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:41:46.003667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-97ee013b-7925-463f-a9a8-74ca8da9b12f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:46.005223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-97ee013b-7925-463f-a9a8-74ca8da9b12f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:46.108630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-97ee013b-7925-463f-a9a8-74ca8da9b12f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:46.117558 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-97ee013b-7925-463f-a9a8-74ca8da9b12f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1207 microversion: 2.1 time: 0.119726 Aug 04 04:41:46.118834 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2082/4061] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:45 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1207 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:46.377328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:46.379980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:46.397582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:46.399846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:46.403007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:46.405267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:46.785020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:46.793422 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0ff848b-9255-45fc-94d3-2b6e011d157b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.427021 Aug 04 04:41:46.810473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1980/4062] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:46 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:47.145322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:47.146618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:47.156830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.157732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:47.158806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.159598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:47.254205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:47.264326 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-267beb33-e953-4073-af59-3efd32a90f53 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1259 microversion: 2.1 time: 0.126693 Aug 04 04:41:47.265647 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2083/4063] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:47 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1259 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:47.817742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:47.819148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:47.826945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.827806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:47.828880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.829556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:48.161502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:48.173533 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-59d0590b-b054-4417-a8c4-987cf5ece92e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.359523 Aug 04 04:41:48.187157 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1981/4064] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:47 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:48.290841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:48.294907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:48.307676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:48.309226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:48.310272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:48.311145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:48.818930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:48.831570 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5271911e-2253-4f0c-886d-060ab5164ba8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1265 microversion: 2.1 time: 0.545655 Aug 04 04:41:48.833565 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2084/4065] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:48 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1265 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:49.031915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8cb766ab-a993-424a-98bc-afb42d2054e1 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Action: 'create', calling method: .version_select at 0x7f1919fff1f0>, body: {"keypair": {"name": "tempest-keypair-1667542884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEosJLVifBE1o2lFy+sWmkhyNf6Cu4LAzrQS3FIvUOO0FJz16+Az5ge0f2FpSOn4JKw9n8moVOI8bk8RbLiX+a3oVOMFjpKLm/OJptgB+lFq+iF3ft5tUDmIeT6jtEKSpg=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:49.069665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8cb766ab-a993-424a-98bc-afb42d2054e1 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Getting quotas for project 45f5e8955ab343c28d5c04bd1c24961d. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:49.096720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8cb766ab-a993-424a-98bc-afb42d2054e1 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Getting quotas for user 0279b1eff82c4cb2a1e67346d5726ae0 and project 45f5e8955ab343c28d5c04bd1c24961d. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:49.155770 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8cb766ab-a993-424a-98bc-afb42d2054e1 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.482649 Aug 04 04:41:49.162132 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1982/4066] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:49.196599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:49.197281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:49.208730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.211672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:49.213187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.215450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:49.702193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:49.715983 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-abdf9a63-d998-4756-9823-2ab5535deeef tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.523737 Aug 04 04:41:49.735155 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2085/4067] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:49 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:49.861023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:49.861929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:49.880991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.881831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:49.882862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.883724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:50.352630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:50.362001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2692f11-63ed-471a-a01c-59dac929a588 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 0.506541 Aug 04 04:41:50.364873 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1983/4068] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:49 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:50.744194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:50.746156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:50.768809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:50.771006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:50.772074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:50.772530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:51.377767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:51.391645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:51.392247 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b0a088a-70d3-4255-97c4-30c134300158 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1523 microversion: 2.1 time: 0.652055 Aug 04 04:41:51.392247 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2086/4069] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:50 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1523 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:51.393317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:51.403752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:51.405671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:51.409336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:51.410066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:52.049805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:52.068768 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-58584716-bbab-4b91-941d-981f56d4103b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 0.687101 Aug 04 04:41:52.076724 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1984/4070] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:51 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:52.414401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:52.415916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:52.427744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:52.428759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:52.430118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:52.436016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:52.547442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b7c1e60d-1bf3-4056-9c67-349687882967 req-71402e49-5c81-44a1-a4f5-c348aff366b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16711187-a00f-4f90-b363-6dedd924b978", "tag": "630df271-9598-4ace-81f3-f61afde699b4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:52.597746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b7c1e60d-1bf3-4056-9c67-349687882967 req-71402e49-5c81-44a1-a4f5-c348aff366b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:52.598474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b7c1e60d-1bf3-4056-9c67-349687882967 req-71402e49-5c81-44a1-a4f5-c348aff366b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:52.630512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b7c1e60d-1bf3-4056-9c67-349687882967 req-71402e49-5c81-44a1-a4f5-c348aff366b5 service nova] Creating event network-changed:630df271-9598-4ace-81f3-f61afde699b4 for instance 16711187-a00f-4f90-b363-6dedd924b978 on n-h1-851337-5 Aug 04 04:41:52.660098 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b7c1e60d-1bf3-4056-9c67-349687882967 req-71402e49-5c81-44a1-a4f5-c348aff366b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116709 Aug 04 04:41:52.661339 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1985/4071] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:53.099982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:53.100676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:53.112511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:53.114044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:53.119952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:53.121254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:53.899492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:53.902457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:53.919634 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7470064e-f490-4d77-807f-40cf31ba58d4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1503 microversion: 2.1 time: 1.510066 Aug 04 04:41:53.921852 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2087/4072] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:52 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1503 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:53.925341 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fe683ad9-6d4b-49e6-8a98-6bdc249579b3 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 0.827245 Aug 04 04:41:53.927255 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1986/4073] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:53 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:53.945448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:53.946271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:53.956833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:53.957568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:53.957734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-638074102", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9aad042d-c509-42c3-8d3d-de02cf5503f1"}], "security_groups": [{"name": "tempest-securitygroup--556615704"}], "key_name": "tempest-keypair-1667542884", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:53.958715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:53.959753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:54.287665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] validate_networks() for [('9aad042d-c509-42c3-8d3d-de02cf5503f1', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:41:54.438184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:54.447500 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0729e7db-7c86-428f-ae86-bf5864280cba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1515 microversion: 2.1 time: 0.505735 Aug 04 04:41:54.449559 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1987/4074] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:53 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1515 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:54.471958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88ade5bf-3d1a-4ca8-af21-fc9d5a80d4f6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:54.476606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-88ade5bf-3d1a-4ca8-af21-fc9d5a80d4f6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: ca41eb59-c41d-45c9-829a-3d06911de1c4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:54.484671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-88ade5bf-3d1a-4ca8-af21-fc9d5a80d4f6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Instance ca41eb59-c41d-45c9-829a-3d06911de1c4 could not be found. Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88ade5bf-3d1a-4ca8-af21-fc9d5a80d4f6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/ca41eb59-c41d-45c9-829a-3d06911de1c4/action HTTP/1.1 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 14 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: {"rescue": {}} Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance ca41eb59-c41d-45c9-829a-3d06911de1c4 could not be found. Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'ca41eb59-c41d-45c9-829a-3d06911de1c4', 'body': {'rescue': {}}} Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca41eb59-c41d-45c9-829a-3d06911de1c4 could not be found. Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca41eb59-c41d-45c9-829a-3d06911de1c4 could not be found. Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:54.491321 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:54.498063 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:54.498063 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:54.498063 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:54.498063 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:54.498063 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca41eb59-c41d-45c9-829a-3d06911de1c4 could not be found. Aug 04 04:41:54.498063 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:54.500260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88ade5bf-3d1a-4ca8-af21-fc9d5a80d4f6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 404 to user: Instance ca41eb59-c41d-45c9-829a-3d06911de1c4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:54.501414 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-88ade5bf-3d1a-4ca8-af21-fc9d5a80d4f6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/ca41eb59-c41d-45c9-829a-3d06911de1c4/action" status: 404 len: 111 microversion: 2.1 time: 0.035685 Aug 04 04:41:54.502685 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1988/4075] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:54 2022] POST /compute/v2.1/servers/ca41eb59-c41d-45c9-829a-3d06911de1c4/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:41:54.513729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73a6fe7f-ea4e-4166-bb8c-7de95d19b667 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:54.514592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73a6fe7f-ea4e-4166-bb8c-7de95d19b667 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:54.524972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a6fe7f-ea4e-4166-bb8c-7de95d19b667 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:54.527617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a6fe7f-ea4e-4166-bb8c-7de95d19b667 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:54.528776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a6fe7f-ea4e-4166-bb8c-7de95d19b667 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:54.530035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a6fe7f-ea4e-4166-bb8c-7de95d19b667 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:54.638513 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73a6fe7f-ea4e-4166-bb8c-7de95d19b667 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action" status: 202 len: 0 microversion: 2.1 time: 0.127962 Aug 04 04:41:54.640486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1989/4076] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:54 2022] POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:54.673876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:54.674875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:54.684786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:54.686083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:54.688269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:54.689047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.182673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:55.190750 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12a02262-a1e5-48d9-b758-15cf0a38426e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1520 microversion: 2.1 time: 0.537109 Aug 04 04:41:55.216463 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1990/4077] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:54 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:55.221575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:55.224707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:55.231517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.232243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.233203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.233809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.586012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:55.605478 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ed995a4-5b90-4f0f-8579-c7d8c82f2328 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 0.385559 Aug 04 04:41:55.607413 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1991/4078] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:55 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:55.767097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Getting quotas for project 45f5e8955ab343c28d5c04bd1c24961d. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:55.780904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Getting quotas for user 0279b1eff82c4cb2a1e67346d5726ae0 and project 45f5e8955ab343c28d5c04bd1c24961d. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:55.820301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:41:55.821469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:41:55.822499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:41:55.823166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:41:55.824327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:41:55.846313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.848245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.850134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.851711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.900731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Getting quotas for project 45f5e8955ab343c28d5c04bd1c24961d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:55.913619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Getting quotas for user 0279b1eff82c4cb2a1e67346d5726ae0 and project 45f5e8955ab343c28d5c04bd1c24961d. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:55.932059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:55.936040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:56.013699 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-edf81a87-ee5c-47b9-b0f6-e3d029077cca tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.087473 Aug 04 04:41:56.015265 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2088/4079] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:41:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:41:56.030752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b83124e-9a39-47a8-93ef-e1522f6723f4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:56.031728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3b83124e-9a39-47a8-93ef-e1522f6723f4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:56.037597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:56.162515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3b83124e-9a39-47a8-93ef-e1522f6723f4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:56.173964 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b83124e-9a39-47a8-93ef-e1522f6723f4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1269 microversion: 2.1 time: 0.148803 Aug 04 04:41:56.176823 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1992/4080] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:56 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:56.221382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:56.222920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:56.232329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:56.232799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:56.234312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:56.234776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:56.628823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:56.629454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:56.663796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:56.664649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:56.665707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:56.671288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.438109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:57.449487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c476ef97-66cd-4a7a-a2ae-876b8e7acdce tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1500 microversion: 2.1 time: 1.240528 Aug 04 04:41:57.450112 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2089/4081] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:56 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1500 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:57.481536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:57.483101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:57.499889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.504725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.505861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.506506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.652598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:57.687675 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f44aad2-2037-4937-90ce-561588f7b863 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 1.062633 Aug 04 04:41:57.710683 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1993/4082] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:56 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:57.735746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:57.738648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:57.746217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.746944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.747943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.748581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.774844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:57.788346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lazy-loading 'flavor' on Instance uuid 697f0c15-0ac4-4599-9876-635732b63ac5 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:41:57.819337 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Cannot 'rescue' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state paused Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action HTTP/1.1 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 14 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: {"rescue": {}} Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: exception: Cannot 'rescue' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state paused Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '697f0c15-0ac4-4599-9876-635732b63ac5', 'body': {'rescue': {}}} Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 in vm_state paused. Cannot rescue while the instance is in this state. Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state paused Aug 04 04:41:57.821543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state paused Aug 04 04:41:57.828068 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:41:57.829901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 409 to user: Cannot 'rescue' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state paused {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:57.830983 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bc52594-44d7-4827-80ee-2a11e8747dbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action" status: 409 len: 144 microversion: 2.1 time: 0.118997 Aug 04 04:41:57.835583 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1994/4083] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:57 2022] POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action => generated 144 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:41:57.841499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2dedc52e-d07f-49fd-beca-bcf7a54e3d3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:57.842308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2dedc52e-d07f-49fd-beca-bcf7a54e3d3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:57.849233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dedc52e-d07f-49fd-beca-bcf7a54e3d3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.849682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dedc52e-d07f-49fd-beca-bcf7a54e3d3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.850641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dedc52e-d07f-49fd-beca-bcf7a54e3d3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.851111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2dedc52e-d07f-49fd-beca-bcf7a54e3d3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.915439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:57.926621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d286655a-a1ef-488c-8f7c-30c51ddc7805 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1321 microversion: 2.1 time: 0.471331 Aug 04 04:41:57.930902 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2090/4084] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:57 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:58.000334 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2dedc52e-d07f-49fd-beca-bcf7a54e3d3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action" status: 202 len: 0 microversion: 2.1 time: 0.162963 Aug 04 04:41:58.001628 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1995/4085] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:57 2022] POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:58.009496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:58.010562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:58.017471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.018488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:58.019506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.020394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:58.405732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:58.414725 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-136318b1-1b35-4d7c-a84f-a110d0c9bea9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1507 microversion: 2.1 time: 0.408985 Aug 04 04:41:58.436324 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2091/4086] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:58 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:58.735247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:58.736549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:58.765947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.766635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:58.783024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.784159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:58.950633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:58.951385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:58.969451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.976021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:58.977419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.978190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.174924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:59.191892 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9956d1e2-b1c7-48f0-810b-996da6b5714c tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1327 microversion: 2.1 time: 0.245875 Aug 04 04:41:59.205790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2092/4087] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:58 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1327 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:59.215721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:59.233159 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4006bbc-4f17-40a4-8132-89bbea8f161d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 0.505674 Aug 04 04:41:59.239118 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1996/4088] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:58 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:59.442730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:59.444483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:59.446663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:59.462603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.463506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.465483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.466125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.929137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:59.937751 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-89df814d-0c15-4450-bd8e-5c5801bd5829 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1515 microversion: 2.1 time: 0.499664 Aug 04 04:41:59.938373 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2093/4089] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:59 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1515 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:00.217349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:00.219390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:00.238076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:00.238551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:00.251516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:00.252052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:00.260785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:00.262191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:00.281865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:00.282718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:00.284862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:00.286222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:00.775811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:00.790276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c1f92a08-be21-4215-9eb8-397497dc048b tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1394 microversion: 2.1 time: 0.577719 Aug 04 04:42:00.793040 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1997/4090] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:00 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1394 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:00.924173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:00.928309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:00.943100 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-318d2d2b-081a-4e9f-883f-180155eb3ffc tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 0.687352 Aug 04 04:42:00.947194 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2094/4091] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:00 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:01.125529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1357499660", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:01.138487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ce36ad35-b521-4b4f-a2b2-aeb5b8d8fb2e req-79315f26-2a46-44b8-8025-383570884d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16711187-a00f-4f90-b363-6dedd924b978", "name": "network-vif-plugged", "status": "completed", "tag": "630df271-9598-4ace-81f3-f61afde699b4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:01.158107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ce36ad35-b521-4b4f-a2b2-aeb5b8d8fb2e req-79315f26-2a46-44b8-8025-383570884d66 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:01.162101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ce36ad35-b521-4b4f-a2b2-aeb5b8d8fb2e req-79315f26-2a46-44b8-8025-383570884d66 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:01.200726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ce36ad35-b521-4b4f-a2b2-aeb5b8d8fb2e req-79315f26-2a46-44b8-8025-383570884d66 service nova] Creating event network-vif-plugged:630df271-9598-4ace-81f3-f61afde699b4 for instance 16711187-a00f-4f90-b363-6dedd924b978 on n-h1-851337-5 Aug 04 04:42:01.213742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ce36ad35-b521-4b4f-a2b2-aeb5b8d8fb2e req-79315f26-2a46-44b8-8025-383570884d66 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081583 Aug 04 04:42:01.214411 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2095/4092] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:01.257868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] validate_networks() for [('85c40f96-139b-4f20-8c81-0af600a45095', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:01.819327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:01.820412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:01.837898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:01.838352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:01.847239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:01.848075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:02.373251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:02.381629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-324b757e-f17b-4a0e-8ade-6e2aadf044a4 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1394 microversion: 2.1 time: 0.568866 Aug 04 04:42:02.382235 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2096/4093] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:01 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1394 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:02.408636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:02.413036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:02.435127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:02.435846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:02.437426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:02.439723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:03.670412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:03.682121 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-52eaaa66-a0ab-48cd-b6fd-50c96469b01a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1307 microversion: 2.1 time: 1.282174 Aug 04 04:42:03.696725 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2097/4094] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:02 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1307 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:03.704376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:03.708371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:03.716475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:03.717479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:03.718532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:03.719816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:03.756741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lazy-loading 'flavor' on Instance uuid 697f0c15-0ac4-4599-9876-635732b63ac5 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:03.872978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9f5bd78-bd14-4b50-8090-cf067b16a401 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action" status: 200 len: 32 microversion: 2.1 time: 0.174420 Aug 04 04:42:03.875343 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2098/4095] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:42:03 2022] POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:42:03.881794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:03.882855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:03.891810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:03.892411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:03.893608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:03.894249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:03.938827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:03.940361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:03.941170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:03.942387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:03.943482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:03.952264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:03.976737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:03.977870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:03.979266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:03.980082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:04.013412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Getting quotas for project fe04c0b897454f3e876924b534321a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:04.020587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Getting quotas for user d0082ba0fe0e448cb2871b2b14c4f39d and project fe04c0b897454f3e876924b534321a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:04.039728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:04.042373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:04.118406 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f3767e70-0974-4823-9de2-72c5e1d6adaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.323898 Aug 04 04:42:04.127443 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1998/4096] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:42:04.154460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d0df3bc9-87fe-4c86-a125-68143189860a req-0f76bf21-c65b-4e26-a5c2-602b1f502b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34697b3b-2bc9-4393-a3c4-5e13376463cc", "tag": "818ca695-e83f-4189-9050-fc7ed22004ae"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:04.168995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d0df3bc9-87fe-4c86-a125-68143189860a req-0f76bf21-c65b-4e26-a5c2-602b1f502b28 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:04.169716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d0df3bc9-87fe-4c86-a125-68143189860a req-0f76bf21-c65b-4e26-a5c2-602b1f502b28 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:04.198237 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d0df3bc9-87fe-4c86-a125-68143189860a req-0f76bf21-c65b-4e26-a5c2-602b1f502b28 service nova] Creating event network-changed:818ca695-e83f-4189-9050-fc7ed22004ae for instance 34697b3b-2bc9-4393-a3c4-5e13376463cc on n-h2-851337-5 Aug 04 04:42:04.204648 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d0df3bc9-87fe-4c86-a125-68143189860a req-0f76bf21-c65b-4e26-a5c2-602b1f502b28 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068412 Aug 04 04:42:04.205614 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 1999/4097] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:04.214356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:04.217615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:04.230636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:04.231478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:04.233663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:04.234586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:04.586825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:04.652352 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4306b1ea-0e40-48dd-bf8b-0f75df7e428a tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1394 microversion: 2.1 time: 0.758229 Aug 04 04:42:04.655546 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2099/4098] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:03 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1394 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:04.683453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-50ad3b94-3ba6-43d0-99b9-325be33ceaaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:04.686143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-50ad3b94-3ba6-43d0-99b9-325be33ceaaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:04.915468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:04.929164 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc819a6e-b380-40e4-8321-9ef5542de781 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.721441 Aug 04 04:42:04.929766 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2000/4099] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:04 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:04.940983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-50ad3b94-3ba6-43d0-99b9-325be33ceaaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:04.942621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:04.943379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:04.951371 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-50ad3b94-3ba6-43d0-99b9-325be33ceaaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1217 microversion: 2.1 time: 0.290234 Aug 04 04:42:04.951970 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2100/4100] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:04 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:04.968172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:04.971390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:04.972320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:04.972871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:05.234056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:05.256714 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-647523ba-0279-46cf-94b8-0259cbd6e169 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1488 microversion: 2.1 time: 0.315766 Aug 04 04:42:05.256714 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2001/4101] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:04 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1488 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:05.271304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0e839ef5-1ae0-4cc0-9cdf-8f8b824aeb54 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:05.274412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0e839ef5-1ae0-4cc0-9cdf-8f8b824aeb54 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:05.292425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e839ef5-1ae0-4cc0-9cdf-8f8b824aeb54 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:05.292909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e839ef5-1ae0-4cc0-9cdf-8f8b824aeb54 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:05.298346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e839ef5-1ae0-4cc0-9cdf-8f8b824aeb54 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:05.299520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e839ef5-1ae0-4cc0-9cdf-8f8b824aeb54 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:05.493539 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0e839ef5-1ae0-4cc0-9cdf-8f8b824aeb54 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "PUT /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1083 microversion: 2.1 time: 0.226647 Aug 04 04:42:05.494749 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2101/4102] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:42:05 2022] PUT /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1083 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:05.534163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:05.536363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:05.544309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:05.544948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:05.546074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:05.547631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:05.596168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2056843435", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "056bf185-3c5d-41e9-b15d-34218e1777ad"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:05.722860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] validate_networks() for [('056bf185-3c5d-41e9-b15d-34218e1777ad', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:05.866137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:06.234435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:06.244375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8545cc21-83ea-4205-a5c9-62cac399de4a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1509 microversion: 2.1 time: 0.718473 Aug 04 04:42:06.255010 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2102/4103] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:05 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1509 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:06.271833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:06.273070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:06.287637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:06.288181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:06.292921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:06.298155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.225463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:07.234702 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-667ac233-9dd2-44dd-953b-e5e52814a361 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1394 microversion: 2.1 time: 0.977797 Aug 04 04:42:07.249000 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2103/4104] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:06 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1394 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:07.254861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:07.256045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:07.264280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.265331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.266331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.267139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.280176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:07.280702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:07.281289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:07.282035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:07.282559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:07.308724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.309388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.311518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.312459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.358502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Getting quotas for project 3b7afde2602e450c8d380308a297d248. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:07.368159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Getting quotas for user cb951e84333a4022aa3f1a2b5908f769 and project 3b7afde2602e450c8d380308a297d248. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:07.395346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:07.400942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:07.526724 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-19f582b7-8c6f-4ea3-b91c-aec818d5657b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012262 Aug 04 04:42:07.530653 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2002/4105] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:42:07.548845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:07.552940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:07.598916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.602907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.605254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.609031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.642798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:07.659936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-001b6298-680d-4d91-8aa8-783b80c45099 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.409192 Aug 04 04:42:07.661193 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2104/4106] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:07 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:07.666022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:07.674849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:07.690137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.691115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.692093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:07.692705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:07.786848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:07.798287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1cdefadf-0e8d-4f8b-a86e-a28d6ed7ac98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1275 microversion: 2.1 time: 0.263213 Aug 04 04:42:07.799572 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2003/4107] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:07 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:07.814550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c36d7cdc-f074-4b71-b736-dcd5180a75dc tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:07.816107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c36d7cdc-f074-4b71-b736-dcd5180a75dc tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:08.132053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c36d7cdc-f074-4b71-b736-dcd5180a75dc tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:08.141581 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c36d7cdc-f074-4b71-b736-dcd5180a75dc tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1217 microversion: 2.1 time: 0.331164 Aug 04 04:42:08.142639 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2004/4108] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:07 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:08.256381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:08.257497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:08.278980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.279720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:08.281518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.282878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:08.412945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:08.425961 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a72f604-9b1a-4218-a651-2321a94fd6ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1509 microversion: 2.1 time: 0.759557 Aug 04 04:42:08.432261 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2105/4109] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:07 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1509 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:08.449033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:08.451461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:08.465628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.466465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:08.467555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.471648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:08.550317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:08.836123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7a8639c-bfd6-4c7e-8763-7f7dcebf7b30 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 204 len: 0 microversion: 2.1 time: 0.391778 Aug 04 04:42:08.837713 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2106/4110] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:08 2022] DELETE /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:08.850088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:08.853732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:08.872961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.878550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:08.879818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.881958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:08.909757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:08.922216 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dfffd2de-37dc-4da5-9748-c228f6200f84 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1394 microversion: 2.1 time: 0.668407 Aug 04 04:42:08.924333 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2005/4111] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:08 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1394 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:08.941065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:08.942614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:08.953546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.954011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:08.954796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:08.955262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.306669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:09.317449 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b592bebf-dc06-404e-90e2-057cd2c66c22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.474311 Aug 04 04:42:09.321986 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2107/4112] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:08 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:09.334207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:09.336050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:09.358258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.358739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.365625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.367283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.417689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:09.437054 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c23239d4-954d-4857-ab01-c8c548b5b79e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1317 microversion: 2.1 time: 0.511420 Aug 04 04:42:09.451020 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2006/4113] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:08 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:09.456425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:09.457064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:09.472776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.473232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.480212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.480984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.616252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:09.631768 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3e50cd50-e65f-4d73-b3ac-83dfeceb4e8a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1221 microversion: 2.1 time: 0.179247 Aug 04 04:42:09.632574 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2007/4114] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:09 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:09.711509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:09.719291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:09.722306 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-34cd71c3-62a6-43c6-a3f0-8a30db1806fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1515 microversion: 2.1 time: 0.398897 Aug 04 04:42:09.723773 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2108/4115] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:09 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:09.944160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:09.945490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:09.953058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.953806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.954977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.955609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.086156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-efadea19-26ea-4419-8e79-5e1de6f583d0 req-9bf1583a-6946-4382-9017-002dab9f85f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34697b3b-2bc9-4393-a3c4-5e13376463cc", "name": "network-vif-plugged", "status": "completed", "tag": "818ca695-e83f-4189-9050-fc7ed22004ae"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:10.112065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-efadea19-26ea-4419-8e79-5e1de6f583d0 req-9bf1583a-6946-4382-9017-002dab9f85f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.113175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-efadea19-26ea-4419-8e79-5e1de6f583d0 req-9bf1583a-6946-4382-9017-002dab9f85f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.148926 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-efadea19-26ea-4419-8e79-5e1de6f583d0 req-9bf1583a-6946-4382-9017-002dab9f85f4 service nova] Creating event network-vif-plugged:818ca695-e83f-4189-9050-fc7ed22004ae for instance 34697b3b-2bc9-4393-a3c4-5e13376463cc on n-h2-851337-5 Aug 04 04:42:10.157504 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-efadea19-26ea-4419-8e79-5e1de6f583d0 req-9bf1583a-6946-4382-9017-002dab9f85f4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081206 Aug 04 04:42:10.168731 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2109/4116] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:42:10.193530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:10.202519 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63dc762c-7978-425d-b462-eaa17a1f86f6 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1394 microversion: 2.1 time: 0.262508 Aug 04 04:42:10.203590 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2008/4117] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:09 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1394 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:10.342762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:10.343871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:10.350749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.351246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.352044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.352491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.469535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:10.472353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:10.485077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.485682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.486591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.487167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.682178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:10.705884 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-82826c1e-c04a-4ba4-8182-dbe8b55cf920 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.367726 Aug 04 04:42:10.706367 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2110/4118] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:10 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:10.727376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:10.728186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:10.773395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.773861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.774662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.775182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.814413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:10.829748 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-adfa6462-6527-4321-a295-5c658a988866 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1317 microversion: 2.1 time: 0.372910 Aug 04 04:42:10.831026 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2009/4119] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:10 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:10.846460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:10.847310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:10.860309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.860776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.861583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.862029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.894897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:10.902921 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a96d3a8e-c8e1-4200-99b6-b100773c902a tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1269 microversion: 2.1 time: 0.195387 Aug 04 04:42:10.903888 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2111/4120] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:10 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:10.989090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c1e9b7ad-e0cc-4a0a-be6d-3214dbd095ca req-31c35b71-30d5-4ac3-befa-5d2cbb8b7c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f5eefa-1541-4941-bfbf-f885d2caff54", "tag": "559baab8-11cc-496b-bd08-390c3d4213d2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:11.002553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c1e9b7ad-e0cc-4a0a-be6d-3214dbd095ca req-31c35b71-30d5-4ac3-befa-5d2cbb8b7c5c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.003283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c1e9b7ad-e0cc-4a0a-be6d-3214dbd095ca req-31c35b71-30d5-4ac3-befa-5d2cbb8b7c5c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.023537 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c1e9b7ad-e0cc-4a0a-be6d-3214dbd095ca req-31c35b71-30d5-4ac3-befa-5d2cbb8b7c5c service nova] Creating event network-changed:559baab8-11cc-496b-bd08-390c3d4213d2 for instance f4f5eefa-1541-4941-bfbf-f885d2caff54 on n-h2-851337-5 Aug 04 04:42:11.031336 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c1e9b7ad-e0cc-4a0a-be6d-3214dbd095ca req-31c35b71-30d5-4ac3-befa-5d2cbb8b7c5c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046979 Aug 04 04:42:11.032777 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2112/4121] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:42:11.227012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:11.228246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:11.248419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.249782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.252803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.253556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.376432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:11.391046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a7addad2-fb66-4583-9501-eb8b0c75a146 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1515 microversion: 2.1 time: 0.558498 Aug 04 04:42:11.395291 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2010/4122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:10 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1515 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:11.731937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:11.734048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:11.739196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:11.750123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.750668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.765666 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c2301020-8d47-4c4e-963d-256b20f1876e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1394 microversion: 2.1 time: 0.544877 Aug 04 04:42:11.766288 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2113/4123] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:11 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1394 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:11.774174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.774975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.850326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:11.850968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:11.858222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.858677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.859495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.859938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.149590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:12.162443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e44c97f4-865f-4eed-8006-df398ba54cb8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.434729 Aug 04 04:42:12.163070 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2011/4124] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:11 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:12.172102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:12.173013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:12.192408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.192869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.197232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.198617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.296707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:12.310863 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a39ee3d-a11f-4475-a917-fb21fd1bcb24 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1317 microversion: 2.1 time: 0.464205 Aug 04 04:42:12.312340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2114/4125] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:11 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:12.360027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:12.368968 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5fcb9d90-78bd-4ef0-92f1-535b5e40c8f0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1275 microversion: 2.1 time: 0.204828 Aug 04 04:42:12.369784 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2012/4126] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:12 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:12.420765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:12.421871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:12.437118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.437726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.438642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.441139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.513870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.515553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.516918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lazy-loading 'fault' on Instance uuid 16711187-a00f-4f90-b363-6dedd924b978 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:12.574395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:12.583377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87ba5082-2135-4808-a17c-097ee7d9c9fd tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 200 len: 1318 microversion: 2.1 time: 0.173842 Aug 04 04:42:12.587602 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2115/4127] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:12 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:12.787163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:12.789375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:12.800748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.800748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.801531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.802162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.808665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:13.090649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d034d11f-3da1-4661-94b5-1a3d2f7cc8dc req-13da08a8-92e5-4698-9001-9f1596f8e7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16711187-a00f-4f90-b363-6dedd924b978", "name": "network-vif-deleted", "tag": "630df271-9598-4ace-81f3-f61afde699b4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:13.100940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d034d11f-3da1-4661-94b5-1a3d2f7cc8dc req-13da08a8-92e5-4698-9001-9f1596f8e7ab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.101655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d034d11f-3da1-4661-94b5-1a3d2f7cc8dc req-13da08a8-92e5-4698-9001-9f1596f8e7ab service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.114874 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d034d11f-3da1-4661-94b5-1a3d2f7cc8dc req-13da08a8-92e5-4698-9001-9f1596f8e7ab service nova] Creating event network-vif-deleted:630df271-9598-4ace-81f3-f61afde699b4 for instance 16711187-a00f-4f90-b363-6dedd924b978 on n-h1-851337-5 Aug 04 04:42:13.121815 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d034d11f-3da1-4661-94b5-1a3d2f7cc8dc req-13da08a8-92e5-4698-9001-9f1596f8e7ab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036059 Aug 04 04:42:13.123050 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2116/4128] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:42:13.123850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:13.144702 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c7c5a36-d406-4594-9652-be3dc59c9f07 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1576 microversion: 2.1 time: 0.362368 Aug 04 04:42:13.146355 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2013/4129] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:12 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1576 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:13.175859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-267a6b6f-1697-41a5-acd5-9ceac59f00db tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:13.177286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-267a6b6f-1697-41a5-acd5-9ceac59f00db tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:13.185897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:13.186530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:13.199189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.199652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.200448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.200888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.219205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267a6b6f-1697-41a5-acd5-9ceac59f00db tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.220651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267a6b6f-1697-41a5-acd5-9ceac59f00db tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.223803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267a6b6f-1697-41a5-acd5-9ceac59f00db tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.224426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-267a6b6f-1697-41a5-acd5-9ceac59f00db tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.789821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-267a6b6f-1697-41a5-acd5-9ceac59f00db tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.623657 Aug 04 04:42:13.790904 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2117/4130] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:42:13 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc/os-interface => generated 285 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:13.814635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:13.827108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:13.829532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Searching by: {'deleted': False, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:42:13.841733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.843776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.845886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.847052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.881428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:42:13.916065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b73b6672-dc12-4c46-b811-d675d50c36aa tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.122585 Aug 04 04:42:13.924500 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2118/4131] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:42:13 2022] GET /compute/v2.1/servers => generated 340 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:13.930460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:13.931239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:13.937996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.938578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.939630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.940172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.974910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:13.985050 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-90b348f2-e310-4108-b8ce-14caf953677e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.803572 Aug 04 04:42:13.986226 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2014/4132] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:13 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:13.991615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:13.992509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:13.999645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.000528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.001552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.002149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.487291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:14.495812 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6b28795d-bf2b-443b-813d-5ced3e7d2337 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1317 microversion: 2.1 time: 0.569461 Aug 04 04:42:14.496662 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2119/4133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:13 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:14.501805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:14.502727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:14.509990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.510800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.511859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.512909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.530481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:14.537681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:42:14.544242 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f2b4a112-7018-4d37-8326-8b79e73ffea5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1317 microversion: 2.1 time: 0.556637 Aug 04 04:42:14.545103 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2015/4134] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:13 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 HTTP/1.1 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '16711187-a00f-4f90-b363-6dedd924b978'} Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:14.548924 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:14.554130 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:14.554130 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:14.554130 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:14.554130 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:14.554130 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:14.554130 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:42:14.554130 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:14.559892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:14.564638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:14.565510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Searching by: {'deleted': False, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:42:14.567978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:14.568872 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa783761-b819-4742-9e3c-8bf88ce45a7e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 404 len: 111 microversion: 2.1 time: 0.071007 Aug 04 04:42:14.569567 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2120/4135] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:14 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:14.574008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.574800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.575856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.576549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.629195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:42:14.686376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=27 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:14.692023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:14.705247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.706098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.765367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-161385763", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "4d7b0316-9278-41a0-bbbc-01764ef3318b"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:14.836422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] validate_networks() for [('4d7b0316-9278-41a0-bbbc-01764ef3318b', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:14.946497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:15.191786 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-513d35aa-81cb-4924-a48f-640b81d6ec7f tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.645385 Aug 04 04:42:15.192873 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2016/4136] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:42:14 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:15.199571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:15.200291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:15.211145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:15.212039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:15.213153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:15.213835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:15.779230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:15.788402 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0802e94e-9d17-4c2e-ad92-3906c076ae22 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.594120 Aug 04 04:42:15.789254 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2017/4137] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:15 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:15.794254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-43eb39b9-104b-4d76-a862-fc72349e19a8 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:15.803240 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-43eb39b9-104b-4d76-a862-fc72349e19a8 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012535 Aug 04 04:42:15.804181 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2018/4138] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:42:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:15.811433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d05c5024-75dd-4358-8406-1077323b2720 req-55a06a0d-de8d-4599-8b78-9a5cef62be0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73464631-4169-491f-95dd-2d5c14750b2c", "tag": "f8ef1b08-27f4-414a-a64e-c664b46bbbe4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:15.824074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d05c5024-75dd-4358-8406-1077323b2720 req-55a06a0d-de8d-4599-8b78-9a5cef62be0b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:15.824776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d05c5024-75dd-4358-8406-1077323b2720 req-55a06a0d-de8d-4599-8b78-9a5cef62be0b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:15.835956 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d05c5024-75dd-4358-8406-1077323b2720 req-55a06a0d-de8d-4599-8b78-9a5cef62be0b service nova] Creating event network-changed:f8ef1b08-27f4-414a-a64e-c664b46bbbe4 for instance 73464631-4169-491f-95dd-2d5c14750b2c on n-h1-851337-5 Aug 04 04:42:15.841193 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d05c5024-75dd-4358-8406-1077323b2720 req-55a06a0d-de8d-4599-8b78-9a5cef62be0b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035445 Aug 04 04:42:15.844773 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2019/4139] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:15.853194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:15.854520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:15.861071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:15.861533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:15.862904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:15.863389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.676259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:16.676754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:16.677163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:16.677575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:16.678271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:16.690202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.691339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.692855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.693588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.718635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:16.724479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Getting quotas for user 01894b2212e04421934b244df3485a27 and project 79092f807f9a42b19d2c90d9e806764b. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:16.729462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:16.739312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:16.742358 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c9bfdbe-f099-43db-b768-c26717594cd2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1317 microversion: 2.1 time: 0.896068 Aug 04 04:42:16.742533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:16.746995 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2020/4140] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:15 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:16.759319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:16.760677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:16.770753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.771226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.772201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.772810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.835140 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d22d486-f81a-4b66-a66c-0585d9e2b420 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.073516 Aug 04 04:42:16.845554 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2121/4141] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:42:16.852889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:16.853614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:16.863299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.864106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.866350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.867118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.897796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:17.001709 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4cac4899-9c70-4b09-b745-d144beba4b7a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 204 len: 0 microversion: 2.1 time: 0.153973 Aug 04 04:42:17.005929 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2122/4142] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:16 2022] DELETE /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:17.014107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:17.014899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:17.024491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.025146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.027910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.028806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.043980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:17.057655 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7735b5de-158c-4e75-adeb-02d8b7cb57a5 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1317 microversion: 2.1 time: 0.311934 Aug 04 04:42:17.058643 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2021/4143] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:16 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:17.067373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-488c438d-2de5-4676-8156-13af8a1f978e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:17.068111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-488c438d-2de5-4676-8156-13af8a1f978e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:17.201932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-488c438d-2de5-4676-8156-13af8a1f978e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:17.217711 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-488c438d-2de5-4676-8156-13af8a1f978e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1208 microversion: 2.1 time: 0.157222 Aug 04 04:42:17.232276 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2022/4144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:17 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1208 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:17.238214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:17.239134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:17.247578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.250407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.252952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.253666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.566423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:17.583654 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d0d36f6-0adf-4db9-a158-b013b37bc82b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.575408 Aug 04 04:42:17.584273 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2123/4145] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:17 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:17.589459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:17.590541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:17.596975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.597660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.598647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.599290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.687016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:17.698141 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a321992-0de9-42dd-a72b-c8d74453fb63 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1714 microversion: 2.1 time: 0.462564 Aug 04 04:42:17.699419 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2023/4146] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:17 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1714 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:17.705665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e70edca4-7cd9-45aa-a541-535170c41a1f req-20f7cdb4-8959-4cba-a6bf-95e4ce114255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34697b3b-2bc9-4393-a3c4-5e13376463cc", "tag": "818ca695-e83f-4189-9050-fc7ed22004ae"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:17.720206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e70edca4-7cd9-45aa-a541-535170c41a1f req-20f7cdb4-8959-4cba-a6bf-95e4ce114255 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.720671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e70edca4-7cd9-45aa-a541-535170c41a1f req-20f7cdb4-8959-4cba-a6bf-95e4ce114255 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.739895 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e70edca4-7cd9-45aa-a541-535170c41a1f req-20f7cdb4-8959-4cba-a6bf-95e4ce114255 service nova] Creating event network-changed:818ca695-e83f-4189-9050-fc7ed22004ae for instance 34697b3b-2bc9-4393-a3c4-5e13376463cc on n-h2-851337-5 Aug 04 04:42:17.748388 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e70edca4-7cd9-45aa-a541-535170c41a1f req-20f7cdb4-8959-4cba-a6bf-95e4ce114255 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047265 Aug 04 04:42:17.750136 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2024/4147] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:17.773210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:17.774301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:17.782788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.784116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.784777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.785248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.915470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:17.945262 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9208aa9-38bb-4b37-9920-61d951cb1174 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1576 microversion: 2.1 time: 0.359916 Aug 04 04:42:17.966419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2124/4148] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:17 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1576 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:18.014168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:18.024824 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82b82389-b3ac-4bdc-b38a-90b43d035590 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1317 microversion: 2.1 time: 0.258361 Aug 04 04:42:18.039925 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2025/4149] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:17 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:18.083263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:18.084701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:18.092514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.094348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.095874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.096563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.234357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-82892861-89b2-410b-8e6a-c834a6e4399b req-e5526caa-e779-4ad6-8af0-9898c8e658b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f5eefa-1541-4941-bfbf-f885d2caff54", "name": "network-vif-plugged", "status": "completed", "tag": "559baab8-11cc-496b-bd08-390c3d4213d2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:18.253117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-82892861-89b2-410b-8e6a-c834a6e4399b req-e5526caa-e779-4ad6-8af0-9898c8e658b1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.253572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-82892861-89b2-410b-8e6a-c834a6e4399b req-e5526caa-e779-4ad6-8af0-9898c8e658b1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.274248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-82892861-89b2-410b-8e6a-c834a6e4399b req-e5526caa-e779-4ad6-8af0-9898c8e658b1 service nova] Creating event network-vif-plugged:559baab8-11cc-496b-bd08-390c3d4213d2 for instance f4f5eefa-1541-4941-bfbf-f885d2caff54 on n-h2-851337-5 Aug 04 04:42:18.281425 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-82892861-89b2-410b-8e6a-c834a6e4399b req-e5526caa-e779-4ad6-8af0-9898c8e658b1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052228 Aug 04 04:42:18.282360 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2026/4150] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:18.289214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:18.289913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:18.298126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.298583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.299418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.300320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.468485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:18.482528 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1da8745a-a405-4480-8164-060145e85c74 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1212 microversion: 2.1 time: 0.198689 Aug 04 04:42:18.494985 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2027/4151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:18 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1212 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:18.531651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:18.544989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9db07d69-b374-4c18-bba8-9e9f02517c8c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1317 microversion: 2.1 time: 0.468087 Aug 04 04:42:18.545967 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2125/4152] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:18 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:18.609200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:18.609763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:18.618409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.619103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.620616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.621152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.727114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:18.728265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:18.743769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.744455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.747052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.747694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.027400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:19.039082 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f204e9cb-ca12-4d64-b955-0440452f2a87 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1501 microversion: 2.1 time: 0.433650 Aug 04 04:42:19.040931 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2028/4153] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:18 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1501 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:19.051210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:19.052132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.058827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.059685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.060674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.061301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.087124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:19.091503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:19.099484 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-576a59b3-0f34-4060-9a1a-3908538e2f77 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1714 microversion: 2.1 time: 0.382203 Aug 04 04:42:19.100075 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2126/4154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:18 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1714 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:19.119402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e90417ba-755b-413c-a813-d91c1a40250e"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:19.124682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.134279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.135063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.136055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.136699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.172821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Cannot 'attach_volume' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state rescued Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/os-volume_attachments HTTP/1.1 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 74 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: {"volumeAttachment": {"volumeId": "e90417ba-755b-413c-a813-d91c1a40250e"}} Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'attach_volume' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state rescued Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '697f0c15-0ac4-4599-9876-635732b63ac5', 'body': {'volumeAttachment': {'volumeId': 'e90417ba-755b-413c-a813-d91c1a40250e'}}} Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 04:42:19.175310 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state rescued Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state rescued Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 409 to user: Cannot 'attach_volume' instance 697f0c15-0ac4-4599-9876-635732b63ac5 while it is in vm_state rescued {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aed91112-e5c3-41a3-b25c-e2c23241582f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.075504 Aug 04 04:42:19.184616 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2127/4155] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:42:19 2022] POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/os-volume_attachments => generated 152 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:42:19.202660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-14a1c935-04e0-4c31-b7cd-d6577d43b790 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:19.206428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-14a1c935-04e0-4c31-b7cd-d6577d43b790 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.211306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:19.224510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a1c935-04e0-4c31-b7cd-d6577d43b790 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.226097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a1c935-04e0-4c31-b7cd-d6577d43b790 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.230585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a1c935-04e0-4c31-b7cd-d6577d43b790 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.231989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a1c935-04e0-4c31-b7cd-d6577d43b790 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.339903 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-14a1c935-04e0-4c31-b7cd-d6577d43b790 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action" status: 202 len: 0 microversion: 2.1 time: 0.148251 Aug 04 04:42:19.341986 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2128/4156] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:42:19 2022] POST /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:19.359197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:19.360416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.380273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.380848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.381940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.382465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.509180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:19.519321 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a13450e-ce48-48da-bdf4-90c7e69b76e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1317 microversion: 2.1 time: 0.475121 Aug 04 04:42:19.531015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2029/4157] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:19 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:19.531015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:19.531015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.537738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.538539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.539527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.539965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.644695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:19.654791 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-319f5ab5-f550-49ac-bebc-4a87253212ca tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1260 microversion: 2.1 time: 0.129907 Aug 04 04:42:19.655794 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2030/4158] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:19 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1260 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:19.678047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:19.679945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.690559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.691046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.692854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.693361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.705760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:19.718586 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01e3fc5b-45e7-4e90-ae6f-01ab6cba7d76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1509 microversion: 2.1 time: 0.370522 Aug 04 04:42:19.733892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2129/4159] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:19 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1509 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:19.996343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:20.005639 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fbdf0d57-f2cc-4ee1-bb77-0aaccfb450d0 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1317 microversion: 2.1 time: 0.335152 Aug 04 04:42:20.006532 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2031/4160] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:19 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:20.123211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:20.123838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:20.132843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.133319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:20.134727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.136115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:20.546793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:20.549205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:20.558382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:20.561222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.562973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:20.564958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.565618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:20.814919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:20.826210 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-819eace1-608c-46e8-b0ec-025e86b7b980 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1714 microversion: 2.1 time: 0.708092 Aug 04 04:42:20.826812 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2130/4161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:20 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1714 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:20.831941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-093a29b3-620b-471b-afa5-472f01171350 req-19b6d1a3-ac02-4560-991d-709a55682c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73464631-4169-491f-95dd-2d5c14750b2c", "name": "network-vif-plugged", "status": "completed", "tag": "f8ef1b08-27f4-414a-a64e-c664b46bbbe4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:20.845494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-093a29b3-620b-471b-afa5-472f01171350 req-19b6d1a3-ac02-4560-991d-709a55682c37 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.845948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-093a29b3-620b-471b-afa5-472f01171350 req-19b6d1a3-ac02-4560-991d-709a55682c37 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:20.858535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-093a29b3-620b-471b-afa5-472f01171350 req-19b6d1a3-ac02-4560-991d-709a55682c37 service nova] Creating event network-vif-plugged:f8ef1b08-27f4-414a-a64e-c664b46bbbe4 for instance 73464631-4169-491f-95dd-2d5c14750b2c on n-h1-851337-5 Aug 04 04:42:20.864368 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-093a29b3-620b-471b-afa5-472f01171350 req-19b6d1a3-ac02-4560-991d-709a55682c37 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036005 Aug 04 04:42:20.865403 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2131/4162] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:20.872023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:20.872727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:20.882262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.883451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:20.886777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.888105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.045406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:21.055089 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf6a1c2a-0442-411b-b407-47890143b2d1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1266 microversion: 2.1 time: 0.187827 Aug 04 04:42:21.055933 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2132/4163] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:20 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:21.079287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:21.079907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:21.087054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.087738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.088748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.089421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.187716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:21.211723 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-685411c5-108a-4291-b5db-ac58df02fcd8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.670148 Aug 04 04:42:21.212763 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2032/4164] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:20 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:21.221532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:21.230928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:21.247338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.249424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.250305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.251536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.256052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:21.439897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:21.450398 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19034d39-57ec-4d90-88ae-0a8f058b9ef8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1509 microversion: 2.1 time: 0.374754 Aug 04 04:42:21.453855 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2133/4165] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:21 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:21.459844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-991339231", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:21.487584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:21.498514 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c690c5d4-927f-4145-808a-6bf8b1a98628 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1317 microversion: 2.1 time: 0.282857 Aug 04 04:42:21.499359 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2033/4166] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:21 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:21.536257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] validate_networks() for [('85c40f96-139b-4f20-8c81-0af600a45095', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:21.847971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:21.848582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:21.856896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.857361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.858162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.858606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.965084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:21.965518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:21.966026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:21.966656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:21.967322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:21.976888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.977338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.978334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:21.978775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.000169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Getting quotas for project fe04c0b897454f3e876924b534321a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:22.006838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Getting quotas for user d0082ba0fe0e448cb2871b2b14c4f39d and project fe04c0b897454f3e876924b534321a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:22.021788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:22.024388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:22.028477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:22.037866 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0f81fa58-b53d-48e6-b898-732ba7bd8ad7 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1714 microversion: 2.1 time: 0.193865 Aug 04 04:42:22.039505 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2034/4167] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:21 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1714 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:22.078658 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6183e01-49a3-4c1a-b39a-b0e50373d945 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625312 Aug 04 04:42:22.084920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2134/4168] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:42:22.087742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:22.089176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:22.091827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-451c3e4a-75aa-4a89-b483-58dc821aa6ff tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:22.092910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-451c3e4a-75aa-4a89-b483-58dc821aa6ff tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:22.097674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.098486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.099558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.100227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.166153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-451c3e4a-75aa-4a89-b483-58dc821aa6ff tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:22.175857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-451c3e4a-75aa-4a89-b483-58dc821aa6ff tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1216 microversion: 2.1 time: 0.088946 Aug 04 04:42:22.177207 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2135/4169] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:22 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:22.200347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:22.208945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd9d5a68-670d-4af3-995f-287327af6a25 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1266 microversion: 2.1 time: 0.131490 Aug 04 04:42:22.211852 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2035/4170] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:22 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:22.473884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:22.475128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:22.482597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.483067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.483939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.484420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.521857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:22.522703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:22.530011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.530850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.532048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.532711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.774607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:22.790538 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63b6eea9-731b-483a-b069-e7b3952177c4 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1317 microversion: 2.1 time: 0.273316 Aug 04 04:42:22.791523 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2036/4171] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:22 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:22.805143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:22.815096 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa46a349-02bd-4a0d-a013-888e93073642 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1509 microversion: 2.1 time: 0.344746 Aug 04 04:42:22.816206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2136/4172] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:22 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:23.066913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:23.066913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:23.076125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.077008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.078091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.078732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.199559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:23.200446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:23.209699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.210147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.210986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.211406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.292292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:23.301617 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d830a965-323c-4e31-b6f8-093af76f0555 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1276 microversion: 2.1 time: 0.108201 Aug 04 04:42:23.302450 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2137/4173] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:23 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:23.322422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:23.324038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:23.331675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:23.332747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.333779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.334278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.334827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.344576 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ae771007-5297-4027-b383-2d86d3944388 tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1714 microversion: 2.1 time: 0.284930 Aug 04 04:42:23.349978 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2037/4174] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:23 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1714 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:23.441143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:23.449127 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-68110eb5-16c6-4229-864c-62e5f5d44c4b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1266 microversion: 2.1 time: 0.130599 Aug 04 04:42:23.449721 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2138/4175] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:23 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:23.815938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:23.816827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:23.826821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.828101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.829537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.830695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.842189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:23.846983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:23.881249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.887421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.888905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.892725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.318607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:24.332383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50218969-c50f-42ea-965f-476a27ce8b4c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1507 microversion: 2.1 time: 0.519852 Aug 04 04:42:24.348643 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2038/4176] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:23 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1507 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:24.360983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:24.364032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:24.375356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.375921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.376809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.377329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.452337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:24.499160 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-608d3b71-39c3-457d-b1c5-40b35f62c376 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1509 microversion: 2.1 time: 0.643094 Aug 04 04:42:24.501616 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2139/4177] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:23 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1509 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:24.522350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:24.531977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:24.558421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.559614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.564627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.565789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.585627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:24.690107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:24.691184 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43b5db3a-b8ea-4cbf-89d2-90b91597e884 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c/os-instance-actions/req-19f582b7-8c6f-4ea3-b91c-aec818d5657b" status: 200 len: 313 microversion: 2.1 time: 0.183948 Aug 04 04:42:24.691799 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2140/4178] 10.222.0.69 () {58 vars in 1419 bytes} [Thu Aug 4 04:42:24 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c/os-instance-actions/req-19f582b7-8c6f-4ea3-b91c-aec818d5657b => generated 313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:24.696484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:24.697257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:24.718645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.719520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.720454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.721037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.724867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:24.760737 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53cea638-0f8c-4adb-af0d-4156360ad863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1286 microversion: 2.1 time: 0.409857 Aug 04 04:42:24.763913 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2039/4179] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:24 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1286 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:24.784174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-39ed761c-de98-4c10-a8d6-9aecd906c2c6 req-ab0b855f-da1b-4580-8625-6a042fc6a1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336", "name": "network-vif-deleted", "tag": "6247e3ec-46ba-464d-ab51-1a9778b1b7ac"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:24.815345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-39ed761c-de98-4c10-a8d6-9aecd906c2c6 req-ab0b855f-da1b-4580-8625-6a042fc6a1f1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.817213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-39ed761c-de98-4c10-a8d6-9aecd906c2c6 req-ab0b855f-da1b-4580-8625-6a042fc6a1f1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.844283 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-39ed761c-de98-4c10-a8d6-9aecd906c2c6 req-ab0b855f-da1b-4580-8625-6a042fc6a1f1 service nova] Creating event network-vif-deleted:6247e3ec-46ba-464d-ab51-1a9778b1b7ac for instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 on n-h1-851337-5 Aug 04 04:42:24.852714 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-39ed761c-de98-4c10-a8d6-9aecd906c2c6 req-ab0b855f-da1b-4580-8625-6a042fc6a1f1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086972 Aug 04 04:42:24.856924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2040/4180] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:24.863964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:24.865303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:24.892927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.893416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.894501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.894875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.941494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328d218b620478bb1185a7e8be226b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67a3f69800c4b0384d6a10580c4d220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:24.950689 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-157967cf-e9e4-41bc-9478-2b869687e15a tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 200 len: 1363 microversion: 2.1 time: 0.257681 Aug 04 04:42:24.951658 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2141/4181] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:24 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:24.956529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f05e1f2-0887-4e80-a2bc-f8979e58306b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:24.959228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f05e1f2-0887-4e80-a2bc-f8979e58306b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:24.966334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f05e1f2-0887-4e80-a2bc-f8979e58306b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.967128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f05e1f2-0887-4e80-a2bc-f8979e58306b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.968174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f05e1f2-0887-4e80-a2bc-f8979e58306b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.968821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f05e1f2-0887-4e80-a2bc-f8979e58306b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:25.074868 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f05e1f2-0887-4e80-a2bc-f8979e58306b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "POST /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c/action" status: 202 len: 0 microversion: 2.1 time: 0.121529 Aug 04 04:42:25.075768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:25.076598 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2142/4182] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:42:24 2022] POST /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:25.089931 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d6891ab-5c40-4bbd-8b1e-31221a6ce55d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.230957 Aug 04 04:42:25.090665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:25.090835 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2041/4183] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:24 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:25.091901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:25.099674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:25.100654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:25.101628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:25.102215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:25.326184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:25.335218 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1363a2c4-f82f-40a8-bf3c-731628141337 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1509 microversion: 2.1 time: 0.254047 Aug 04 04:42:25.336039 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2143/4184] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:25 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:25.528563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:25.529325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:25.536269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:25.536961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:25.538151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:25.538764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:25.694463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:25.705827 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7de44dcd-c95e-43a7-bc76-b703cb39de09 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1515 microversion: 2.1 time: 0.181283 Aug 04 04:42:25.706775 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2042/4185] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:25 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:25.805919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:25.806463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:25.824547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:25.824989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:25.825781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:25.826223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:25.829318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:25.946585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:25.960863 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5efffc8-7f02-4185-912c-2730a12a8170 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1274 microversion: 2.1 time: 0.158552 Aug 04 04:42:25.962099 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2144/4186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:25 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:25.998458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:25.999456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] [instance: ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:26.011265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.012562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:26.014397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.015054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:26.055794 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] HTTP exception thrown: Instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 could not be found. Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Request method failure captured: Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 HTTP/1.1 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6026L2JWssGMvxCoCh8FHLdYMkCgzXDBSbfFbhyyEKTpXE5Gcdb2-B2RLsdTgPrykxkWrSFEgnftnprD-XTqYiIGJcGWrAoLjp5mDD14sfC5lD1vQ8NiQG8gvm_pQAbdM5oXt5De-ZDjuLeBarwXhFSRtNaVVbwln8GxStMDP48FOJM Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: b67a3f69800c4b0384d6a10580c4d220 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestManualDisk-1060788591 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b67a3f69800c4b0384d6a10580c4d220"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b67a3f69800c4b0384d6a10580c4d220"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b67a3f69800c4b0384d6a10580c4d220"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b67a3f69800c4b0384d6a10580c4d220", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestManualDisk-1060788591 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: b67a3f69800c4b0384d6a10580c4d220 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestManualDisk-1060788591 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestManualDisk-1060788591-project Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: a328d218b620478bb1185a7e8be226b5 Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestManualDisk-1060788591-project Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 could not be found. Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336'} Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 could not be found. Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 could not be found. Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:26.058343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:26.062353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:26.062353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:26.062353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:26.062353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:26.062353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:26.062353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 could not be found. Aug 04 04:42:26.062353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:26.064379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Returning 404 to user: Instance ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:26.065447 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03d41f7b-5b3b-4f6b-a759-cb1a78dd74cc tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336" status: 404 len: 111 microversion: 2.1 time: 0.079153 Aug 04 04:42:26.066693 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2043/4187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:25 2022] GET /compute/v2.1/servers/ae9cc66d-3cf0-42e5-b7b6-b6afa5fe4336 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:26.077783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ba84650-6718-4ca3-bdea-ab2c6448813c tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] Calling method '.version_select at 0x7f192399f160>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:26.102631 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ba84650-6718-4ca3-bdea-ab2c6448813c tempest-ServersTestManualDisk-1060788591 tempest-ServersTestManualDisk-1060788591-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816921511" status: 202 len: 0 microversion: 2.1 time: 0.031286 Aug 04 04:42:26.103542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2145/4188] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:42:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816921511 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:26.132305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:26.133388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:26.149131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.152833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:26.156526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.157198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:26.379190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:26.380566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:26.436064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.438708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:26.442899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.445541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:26.533681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:26.546590 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a2f44c08-946a-4f9e-a238-9ed7960cb6f4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.421416 Aug 04 04:42:26.547426 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2044/4189] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:26 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:26.827739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:26.839017 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c66715a0-48e1-4cbf-afd2-22020b7846df tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1509 microversion: 2.1 time: 0.485471 Aug 04 04:42:26.839643 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2146/4190] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:26 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:26.983378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:26.984108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:26.991569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.992933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:26.993917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:26.995110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:27.080403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:27.089300 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e63d370-27bb-4bbb-acf2-ad7191016b05 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1274 microversion: 2.1 time: 0.110710 Aug 04 04:42:27.093921 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2045/4191] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:26 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:27.568616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:27.569241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:27.578526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:27.579037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:27.579838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:27.580259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:27.870601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:27.871739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:27.874449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:27.890180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:27.890821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:27.891766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:27.898917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:28.085684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:28.100029 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-293fc66b-37cc-40cc-8e4a-fcc1a3c2f8e8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.535152 Aug 04 04:42:28.114813 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2147/4192] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:27 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:28.127709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6a96c4fe-2adc-4ef0-ae4c-96e8dada655e req-8b137733-9b3e-4ac4-9e58-0dc7835c700d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6dcd04-47b4-41e2-98a1-13f1c5054aee", "tag": "e749d2e9-91ac-4541-9da1-b22c99756655"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:28.147982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a96c4fe-2adc-4ef0-ae4c-96e8dada655e req-8b137733-9b3e-4ac4-9e58-0dc7835c700d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:28.152324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a96c4fe-2adc-4ef0-ae4c-96e8dada655e req-8b137733-9b3e-4ac4-9e58-0dc7835c700d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:28.191262 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6a96c4fe-2adc-4ef0-ae4c-96e8dada655e req-8b137733-9b3e-4ac4-9e58-0dc7835c700d service nova] Creating event network-changed:e749d2e9-91ac-4541-9da1-b22c99756655 for instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee on n-h1-851337-5 Aug 04 04:42:28.207527 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6a96c4fe-2adc-4ef0-ae4c-96e8dada655e req-8b137733-9b3e-4ac4-9e58-0dc7835c700d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090400 Aug 04 04:42:28.208753 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2148/4193] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:28.216237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:28.232114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:28.242556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:28.243058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:28.243927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:28.245242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:28.893156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:28.906344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd414ba0-825f-47b3-9250-5cdd506fa633 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1514 microversion: 2.1 time: 1.041004 Aug 04 04:42:28.924977 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2046/4194] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:27 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1514 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:28.934467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42a3f3be-7ab6-4195-bf66-6ffee6a593e7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'create', calling method: .version_select at 0x7f1918fb2d30>, body: {"keypair": {"name": "tempest-keypair-1988990903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb1D1FnVYzDWkO1qBsyUMgDMSkjaK23y9L5hYTU1Feq+OhNhg4/DcI3vBfJg+od7QQstKKZo1l9XM2hYLZlSBSaNOqQhh9eSG8PeLcF+X2nSZENlsZI1IppOX5Ir0jm4w=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:28.973067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-42a3f3be-7ab6-4195-bf66-6ffee6a593e7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for project 089163f805e44913b469df4e8c9e85ec. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:28.979488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-42a3f3be-7ab6-4195-bf66-6ffee6a593e7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for user 42e55434a6d24f20b0f95a3b57d06c42 and project 089163f805e44913b469df4e8c9e85ec. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:29.012961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:29.026947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7587f757-981e-4b38-adec-bf924ba94f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1316 microversion: 2.1 time: 0.813834 Aug 04 04:42:29.029989 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2149/4195] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:28 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1316 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:29.033074 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42a3f3be-7ab6-4195-bf66-6ffee6a593e7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106864 Aug 04 04:42:29.034154 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2047/4196] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:42:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:29.124688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:29.125731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:29.138944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:29.139680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:29.140799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:29.141391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:29.633369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:29.650135 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74256ef3-ff9f-4c3f-bf66-79ea233407e2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.531645 Aug 04 04:42:29.651135 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2150/4197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:29 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:29.934773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:29.941277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:29.950225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:29.950681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:29.951503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:29.952109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.050330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:30.059145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:30.068304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.069593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.070639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.071294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.531700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:30.541937 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-84ad68a5-907f-4f7b-922a-9de8f405159c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1507 microversion: 2.1 time: 0.612510 Aug 04 04:42:30.543750 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2048/4198] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:29 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:30.564390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca8c9bcd-a6d1-4df2-8d67-3c8bf8ceee6c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '.version_select at 0x7f1918f2f4c0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:30.566784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca8c9bcd-a6d1-4df2-8d67-3c8bf8ceee6c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:30.576543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca8c9bcd-a6d1-4df2-8d67-3c8bf8ceee6c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.576935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca8c9bcd-a6d1-4df2-8d67-3c8bf8ceee6c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.577748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca8c9bcd-a6d1-4df2-8d67-3c8bf8ceee6c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.578594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca8c9bcd-a6d1-4df2-8d67-3c8bf8ceee6c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.594650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:30.610753 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-238cc3e8-a9fd-4839-a44a-d1a32c319a4f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1316 microversion: 2.1 time: 0.564081 Aug 04 04:42:30.628793 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2151/4199] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:30 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:30.672352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:30.673786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:30.679273 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca8c9bcd-a6d1-4df2-8d67-3c8bf8ceee6c tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.119165 Aug 04 04:42:30.683267 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2049/4200] 10.222.0.69 () {58 vars in 1296 bytes} [Thu Aug 4 04:42:30 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c/os-instance-actions => generated 611 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:30.683393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.683818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.684615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.687137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.700077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:30.706873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:30.719979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.720767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.721747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.723535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.774099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:30.879370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:30.944176 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd23a46f-732d-4781-a0bb-51290c8c721e tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "DELETE /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 204 len: 0 microversion: 2.1 time: 0.247575 Aug 04 04:42:30.945907 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2050/4201] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:30 2022] DELETE /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:30.954147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2c9537e3-85dc-4fc7-a670-725df9ee3f8f req-b7dbed00-dc0f-4d2a-be26-87d8bca71ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7794d0ad-cbee-4a0d-87fd-7c231567bc5d", "tag": "c7e66864-d757-4bdf-aecd-148c4a69cae8"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:30.968016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2c9537e3-85dc-4fc7-a670-725df9ee3f8f req-b7dbed00-dc0f-4d2a-be26-87d8bca71ab3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:30.968820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2c9537e3-85dc-4fc7-a670-725df9ee3f8f req-b7dbed00-dc0f-4d2a-be26-87d8bca71ab3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:30.993441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2c9537e3-85dc-4fc7-a670-725df9ee3f8f req-b7dbed00-dc0f-4d2a-be26-87d8bca71ab3 service nova] Creating event network-changed:c7e66864-d757-4bdf-aecd-148c4a69cae8 for instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d on n-h2-851337-5 Aug 04 04:42:31.005907 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2c9537e3-85dc-4fc7-a670-725df9ee3f8f req-b7dbed00-dc0f-4d2a-be26-87d8bca71ab3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057251 Aug 04 04:42:31.008677 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2051/4202] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:31.021274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:31.023914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:31.038607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:31.039414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:31.040456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:31.041825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:31.160180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:31.174897 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-246e88b1-52cf-437c-8d45-f0f81e7350ac tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.504744 Aug 04 04:42:31.174897 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2152/4203] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:30 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:31.423729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:31.439573 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6a4cc4da-4221-441f-806c-1711751586c6 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1513 microversion: 2.1 time: 0.429409 Aug 04 04:42:31.440201 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2052/4204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:31 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1513 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:31.634154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:31.635324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:31.647617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:31.648098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:31.648895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:31.649474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:31.988380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:32.171549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:32.194097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:32.196044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:32.206718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:32.207473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:32.210485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:32.211175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:32.321937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:32.331726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-537478aa-5405-4f34-a0c2-6058db78830f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1316 microversion: 2.1 time: 0.701634 Aug 04 04:42:32.332830 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2153/4205] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:31 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:32.464025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:32.464941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:32.475011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:32.475810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:32.476940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:32.477837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:32.530976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:32.542465 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4949e43d-9247-4ca3-97a7-355bbe31fbe2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.352022 Aug 04 04:42:32.563018 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2053/4206] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:32 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:32.875303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-849520893", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbe23b09-1a2f-43e8-b59c-a662e93f0661"}], "security_groups": [{"name": "tempest-securitygroup--125010856"}], "key_name": "tempest-keypair-1988990903", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:32.974764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:32.985559 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a81c270-001c-440a-8ab9-08af8e111e02 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1513 microversion: 2.1 time: 0.528423 Aug 04 04:42:32.987752 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2154/4207] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:32 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1513 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:33.164449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] validate_networks() for [('fbe23b09-1a2f-43e8-b59c-a662e93f0661', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:33.379457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:33.383403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:33.395537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:33.396262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:33.397812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:33.398918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:33.984669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:33.999645 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61f63c78-2601-4d0e-9840-53a433dc9ee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1316 microversion: 2.1 time: 0.643573 Aug 04 04:42:34.000324 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2155/4208] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:33 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1316 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:34.019942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:34.020838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:34.030065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.030759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.031799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.032465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.901295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:34.902924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:34.904180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:34.904866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:34.905826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:34.940200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:34.950849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.951706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.952803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.953811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.977295 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3115eb76-66e7-4d3f-8e77-72c8d36b9196 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.960987 Aug 04 04:42:34.980050 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2156/4209] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:34 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:34.992103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:34.992962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:35.005502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for project 089163f805e44913b469df4e8c9e85ec. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:35.011039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.011926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.012893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.014509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Getting quotas for user 42e55434a6d24f20b0f95a3b57d06c42 and project 089163f805e44913b469df4e8c9e85ec. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:35.015229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.033676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:35.037987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:35.112792 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e89807aa-f929-4687-b0be-260cd1029f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.242013 Aug 04 04:42:35.114858 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2054/4210] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:42:35.126044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:35.127872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:35.140302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.142282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.143381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.147143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.239876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb951e84333a4022aa3f1a2b5908f769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7afde2602e450c8d380308a297d248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:35.252110 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-07092e6d-f2ba-4829-96bf-53952068393b tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 200 len: 1471 microversion: 2.1 time: 0.266087 Aug 04 04:42:35.252741 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2157/4211] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:34 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:35.267053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ab6d3c15-c2a8-44d4-b7b9-f12569565a0d req-ee32ed73-0a4e-4646-8989-b900ae2e7510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73464631-4169-491f-95dd-2d5c14750b2c", "name": "network-vif-deleted", "tag": "f8ef1b08-27f4-414a-a64e-c664b46bbbe4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:35.284790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ab6d3c15-c2a8-44d4-b7b9-f12569565a0d req-ee32ed73-0a4e-4646-8989-b900ae2e7510 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.285252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ab6d3c15-c2a8-44d4-b7b9-f12569565a0d req-ee32ed73-0a4e-4646-8989-b900ae2e7510 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.299641 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ab6d3c15-c2a8-44d4-b7b9-f12569565a0d req-ee32ed73-0a4e-4646-8989-b900ae2e7510 service nova] Creating event network-vif-deleted:f8ef1b08-27f4-414a-a64e-c664b46bbbe4 for instance 73464631-4169-491f-95dd-2d5c14750b2c on n-h1-851337-5 Aug 04 04:42:35.310572 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ab6d3c15-c2a8-44d4-b7b9-f12569565a0d req-ee32ed73-0a4e-4646-8989-b900ae2e7510 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056557 Aug 04 04:42:35.311555 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2158/4212] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:35.333443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3319e0fa-2b0b-42f9-9e39-10a69fdc81b6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:35.334187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3319e0fa-2b0b-42f9-9e39-10a69fdc81b6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:35.506207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3319e0fa-2b0b-42f9-9e39-10a69fdc81b6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:35.518171 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3319e0fa-2b0b-42f9-9e39-10a69fdc81b6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1245 microversion: 2.1 time: 0.205332 Aug 04 04:42:35.520865 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2159/4213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:35 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:35.721740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:35.733979 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c84c7da-1532-4834-a846-3c0350550eac tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1316 microversion: 2.1 time: 0.617112 Aug 04 04:42:35.734733 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2055/4214] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:35 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:36.002069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:36.002699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:36.013103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.013885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.014857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.015501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.278996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:36.279957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] [instance: 73464631-4169-491f-95dd-2d5c14750b2c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:36.300522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.301093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.302009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.302459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.344248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] HTTP exception thrown: Instance 73464631-4169-491f-95dd-2d5c14750b2c could not be found. Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Request method failure captured: Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c HTTP/1.1 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604dxWtBbIZ1wQeRLZXHI3yTnbl3W55aF69wcoJbpCfAQMeXmBfKMG0YDCkLKBlKOK9XoSc94uFjLYkdfzEpo-ciHSLPCVNSeZAYtCWiqHMvtXrK0Lh4aFrsjGU2752tMcSGqFsyTgwUdQUUitIDXEMI_JpVwCBs5lBRB25zTA7-GvM Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 3b7afde2602e450c8d380308a297d248 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-InstanceActionsTestJSON-949419811 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b7afde2602e450c8d380308a297d248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3b7afde2602e450c8d380308a297d248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3b7afde2602e450c8d380308a297d248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3b7afde2602e450c8d380308a297d248", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-InstanceActionsTestJSON-949419811 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 3b7afde2602e450c8d380308a297d248 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-InstanceActionsTestJSON-949419811 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-InstanceActionsTestJSON-949419811-project Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: cb951e84333a4022aa3f1a2b5908f769 Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-InstanceActionsTestJSON-949419811-project Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 73464631-4169-491f-95dd-2d5c14750b2c could not be found. Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '73464631-4169-491f-95dd-2d5c14750b2c'} Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73464631-4169-491f-95dd-2d5c14750b2c could not be found. Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73464631-4169-491f-95dd-2d5c14750b2c could not be found. Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:36.346011 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73464631-4169-491f-95dd-2d5c14750b2c could not be found. Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] Returning 404 to user: Instance 73464631-4169-491f-95dd-2d5c14750b2c could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:36.349293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d38e31cf-acc5-488f-9778-0ef440039e68 tempest-InstanceActionsTestJSON-949419811 tempest-InstanceActionsTestJSON-949419811-project] 10.222.0.69 "GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c" status: 404 len: 111 microversion: 2.1 time: 0.077714 Aug 04 04:42:36.352252 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2056/4215] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:36 2022] GET /compute/v2.1/servers/73464631-4169-491f-95dd-2d5c14750b2c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:36.361292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0e26385c-c1f1-4238-a9d0-a9f80a49f8ca req-e71db334-4fd9-4833-a449-bbc61e2e0577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7794d0ad-cbee-4a0d-87fd-7c231567bc5d", "name": "network-vif-plugged", "status": "completed", "tag": "c7e66864-d757-4bdf-aecd-148c4a69cae8"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:36.374600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0e26385c-c1f1-4238-a9d0-a9f80a49f8ca req-e71db334-4fd9-4833-a449-bbc61e2e0577 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.375455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0e26385c-c1f1-4238-a9d0-a9f80a49f8ca req-e71db334-4fd9-4833-a449-bbc61e2e0577 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.390747 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0e26385c-c1f1-4238-a9d0-a9f80a49f8ca req-e71db334-4fd9-4833-a449-bbc61e2e0577 service nova] Creating event network-vif-plugged:c7e66864-d757-4bdf-aecd-148c4a69cae8 for instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d on n-h2-851337-5 Aug 04 04:42:36.396948 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0e26385c-c1f1-4238-a9d0-a9f80a49f8ca req-e71db334-4fd9-4833-a449-bbc61e2e0577 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043387 Aug 04 04:42:36.401976 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2057/4216] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:36.541140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:36.542242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:36.549788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.550470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.551438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.552771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.624100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:36.639592 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e281788-d9c1-4371-9217-507b622f9b31 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.642142 Aug 04 04:42:36.643003 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2160/4217] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:35 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:36.757665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:36.758453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:36.767590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.769248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.770770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.784263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.799880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:36.807811 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-959faa3a-af42-48db-9d12-e0ae87b8ba35 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1297 microversion: 2.1 time: 0.271745 Aug 04 04:42:36.812522 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2058/4218] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:36 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1297 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:37.371156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:37.380479 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1c038db-e70b-4910-a19d-99487b0e1b82 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1316 microversion: 2.1 time: 0.628155 Aug 04 04:42:37.381336 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2161/4219] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:36 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:37.670613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:37.671795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:37.681199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.682420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.683373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.683946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.834114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:37.834650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:37.841082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.841722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.842647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.843253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.041472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:38.058034 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4da3d7d-1d21-4332-a4cf-31b63fac968e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1303 microversion: 2.1 time: 0.228338 Aug 04 04:42:38.072294 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2162/4220] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:37 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:38.408461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:38.409133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:38.417593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.418041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.418852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.419317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.609218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:38.631141 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2c43c5f3-cbeb-474e-83ab-bd2f028011d2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.969495 Aug 04 04:42:38.633583 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2059/4221] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:37 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:38.638467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-aaf83efb-4d55-4a3f-b729-78e35d29d786 req-bb3e48d8-fce7-4029-8169-fd2bdf2c09c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6dcd04-47b4-41e2-98a1-13f1c5054aee", "name": "network-vif-plugged", "status": "completed", "tag": "e749d2e9-91ac-4541-9da1-b22c99756655"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:38.667357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aaf83efb-4d55-4a3f-b729-78e35d29d786 req-bb3e48d8-fce7-4029-8169-fd2bdf2c09c5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.668041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aaf83efb-4d55-4a3f-b729-78e35d29d786 req-bb3e48d8-fce7-4029-8169-fd2bdf2c09c5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.698105 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-aaf83efb-4d55-4a3f-b729-78e35d29d786 req-bb3e48d8-fce7-4029-8169-fd2bdf2c09c5 service nova] Creating event network-vif-plugged:e749d2e9-91ac-4541-9da1-b22c99756655 for instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee on n-h1-851337-5 Aug 04 04:42:38.712461 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-aaf83efb-4d55-4a3f-b729-78e35d29d786 req-bb3e48d8-fce7-4029-8169-fd2bdf2c09c5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077565 Aug 04 04:42:38.713696 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2060/4222] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:39.010415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:39.021376 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3420e368-49d8-4c5e-b650-c9815b1d6dc7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1504 microversion: 2.1 time: 0.618287 Aug 04 04:42:39.021977 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2163/4223] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:38 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1504 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:39.042992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.043515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:39.050009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.050461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.051430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.051877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.080469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.081092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:39.087722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.088185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.089007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.089448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.093814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:39.106800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:39.205296 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6715af68-09aa-4f5a-a0da-d4336c7877b0 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 204 len: 0 microversion: 2.1 time: 0.166563 Aug 04 04:42:39.206279 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2061/4224] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:39 2022] DELETE /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:39.215757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.216602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:39.224201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.224958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.225941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.226636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.827426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:39.837532 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a5070c6b-d062-47df-aacc-6d90392f7c45 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.761393 Aug 04 04:42:39.852383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:39.852861 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2164/4225] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:39 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:39.859276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.860273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:39.862867 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02f95b75-c85a-4b38-a039-ce9cd2b701d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1510 microversion: 2.1 time: 0.651928 Aug 04 04:42:39.864287 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2062/4226] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:39 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1510 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:39.868517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.869510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.870305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.870741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.874383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-70c4d24f-7001-44ff-a632-cdbe57a4769a req-2562fa9c-08b0-4075-b45e-8d0048b78197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfd2e6-5f04-4b21-b641-cc235321dc06", "tag": "7cc6be0b-3dc7-4f8b-91d7-4a80eb827025"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:39.882320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:39.905728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-70c4d24f-7001-44ff-a632-cdbe57a4769a req-2562fa9c-08b0-4075-b45e-8d0048b78197 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.907200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-70c4d24f-7001-44ff-a632-cdbe57a4769a req-2562fa9c-08b0-4075-b45e-8d0048b78197 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.926936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-70c4d24f-7001-44ff-a632-cdbe57a4769a req-2562fa9c-08b0-4075-b45e-8d0048b78197 service nova] Creating event network-changed:7cc6be0b-3dc7-4f8b-91d7-4a80eb827025 for instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 on n-h1-851337-5 Aug 04 04:42:39.933721 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-70c4d24f-7001-44ff-a632-cdbe57a4769a req-2562fa9c-08b0-4075-b45e-8d0048b78197 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067538 Aug 04 04:42:39.934542 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2063/4227] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:40.235835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:40.245118 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-47cf42d8-7951-4738-9412-055d733b9f06 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1308 microversion: 2.1 time: 0.391338 Aug 04 04:42:40.258630 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2165/4228] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:39 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:40.864219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:40.865695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:40.873030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.873769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.874901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.875519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.892248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:40.893387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:40.904347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.904998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.906056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.911807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.242323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:41.249449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:41.254218 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b083da24-69fd-4e85-8ab4-12a75fe0a18a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.395136 Aug 04 04:42:41.255395 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2064/4229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:40 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:41.265736 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2b80af70-965c-4c80-a642-6dcc8a4ff58c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1510 microversion: 2.1 time: 0.380394 Aug 04 04:42:41.273263 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2166/4230] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:40 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:41.275614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:41.278283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:41.287633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.288912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.290436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.291096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.561977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:41.582375 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc8a2c2c-fa65-459d-8e76-72e343502b3c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1490 microversion: 2.1 time: 0.314997 Aug 04 04:42:41.583047 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2065/4231] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:41 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1490 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:41.604010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b837f5e1-a386-48f1-9a4b-e65b70a599a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1512057785"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:41.607181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b837f5e1-a386-48f1-9a4b-e65b70a599a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:41.625280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b837f5e1-a386-48f1-9a4b-e65b70a599a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.625860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b837f5e1-a386-48f1-9a4b-e65b70a599a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.627512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b837f5e1-a386-48f1-9a4b-e65b70a599a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.627965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b837f5e1-a386-48f1-9a4b-e65b70a599a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.768072 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b837f5e1-a386-48f1-9a4b-e65b70a599a4 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "PUT /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1076 microversion: 2.1 time: 0.168491 Aug 04 04:42:41.775813 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2167/4232] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:42:41 2022] PUT /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1076 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:41.796595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:41.797234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:41.816745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.819604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.821695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.824266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.282346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.285068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.301403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:42.303745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.304521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.307503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.312664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.473213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:42.487448 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15bbb0e5-22b4-4b77-9069-3055fe60157d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1502 microversion: 2.1 time: 0.700918 Aug 04 04:42:42.489442 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2066/4233] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:41 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1502 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:42.495666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.496562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.503569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.504429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.505599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.506240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.679204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:42.685049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:42.690614 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bcb76d38-abcb-429b-b742-ee3e988ad1c6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 200 len: 1468 microversion: 2.1 time: 0.199276 Aug 04 04:42:42.691720 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2067/4234] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:42 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 1468 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:42.695252 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e3a06df8-6db9-4df0-9cfb-0566eab4bb82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.422233 Aug 04 04:42:42.695835 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2168/4235] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:42 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:42.708082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.711483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.719450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.720167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.721103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.721813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.970732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-fa797410-59d6-40ff-b85f-f6c8c4cc8088 req-96122b24-4349-4084-8ba0-c163bc116fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7794d0ad-cbee-4a0d-87fd-7c231567bc5d", "name": "network-vif-deleted", "tag": "c7e66864-d757-4bdf-aecd-148c4a69cae8"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:42.992177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fa797410-59d6-40ff-b85f-f6c8c4cc8088 req-96122b24-4349-4084-8ba0-c163bc116fa8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.994906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fa797410-59d6-40ff-b85f-f6c8c4cc8088 req-96122b24-4349-4084-8ba0-c163bc116fa8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.010830 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-fa797410-59d6-40ff-b85f-f6c8c4cc8088 req-96122b24-4349-4084-8ba0-c163bc116fa8 service nova] Creating event network-vif-deleted:c7e66864-d757-4bdf-aecd-148c4a69cae8 for instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d on n-h2-851337-5 Aug 04 04:42:43.028020 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-fa797410-59d6-40ff-b85f-f6c8c4cc8088 req-96122b24-4349-4084-8ba0-c163bc116fa8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061771 Aug 04 04:42:43.028644 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2169/4236] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:42:43.107123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:43.116227 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7db4e3bf-45e9-4aa6-9848-6ff13a00bb70 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1502 microversion: 2.1 time: 0.423157 Aug 04 04:42:43.131588 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2068/4237] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:42 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1502 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:43.139720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dca7f002-e55a-4844-ac6c-9b646b468f98 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:43.149481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dca7f002-e55a-4844-ac6c-9b646b468f98 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.150322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dca7f002-e55a-4844-ac6c-9b646b468f98 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.179297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dca7f002-e55a-4844-ac6c-9b646b468f98 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:42:43.236009 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dca7f002-e55a-4844-ac6c-9b646b468f98 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "POST /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee/action" status: 202 len: 0 microversion: 2.1 time: 0.101446 Aug 04 04:42:43.236620 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2170/4238] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:42:43 2022] POST /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:43.245873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:43.246548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:43.252959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.254082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.255137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.255705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.277175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:43.546197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:43.559574 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc8f98e6-86f4-4793-971b-7f40600b3862 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.318022 Aug 04 04:42:43.560500 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2069/4239] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:43 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:43.723488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:43.724652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:43.725890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:43.729222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:43.743543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.745717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.746486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.747446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.748011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.749299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.751008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.751544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.790203 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d HTTP/1.1 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '7794d0ad-cbee-4a0d-87fd-7c231567bc5d'} Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:43.792059 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:43.795506 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62b08d0d-5284-41ef-968a-03c1686af795 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 404 len: 111 microversion: 2.1 time: 0.084600 Aug 04 04:42:43.796681 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2171/4240] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:43 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:43.807325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:43.807938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:43.814484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.815179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.816091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.816417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.137840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:44.150877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-143920db-082f-41f5-a622-d4722e15f0bd tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.436004 Aug 04 04:42:44.156642 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2070/4241] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:43 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:44.235913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:44.251663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e66e683-d49c-4f57-a393-ebb407a3129e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.448092 Aug 04 04:42:44.262978 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2172/4242] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:43 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:44.456763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8cd4fd32-e80d-413d-872c-a494089ec226 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8cd4fd32-e80d-413d-872c-a494089ec226 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 163 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": 12345, "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 12345 Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:42:44.461015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 04:42:44.464882 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.467820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8cd4fd32-e80d-413d-872c-a494089ec226 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:44.469017 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8cd4fd32-e80d-413d-872c-a494089ec226 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.016582 Aug 04 04:42:44.470081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2071/4243] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:44 2022] POST /compute/v2.1/servers => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:42:44.482056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:44.482748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:44.489976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.490989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.491970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.492663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.581760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:44.583114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:44.592649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.593476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.594583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.595265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.867664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:44.883114 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46edbb5a-5ea1-4482-83ba-1cd2eba116ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.404934 Aug 04 04:42:44.883955 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2173/4244] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:44 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:44.905606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:44.906475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:44.913191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:44.915144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.915669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.916644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.917293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.929872 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-716afcb4-1039-4d5e-ac04-8ada95828e9d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.352585 Aug 04 04:42:44.932586 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2072/4245] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:44 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:45.191096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:45.199511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:45.202540 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5fb47a1c-3452-4292-8d1f-fd81b02bf765 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.300827 Aug 04 04:42:45.203256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:45.203641 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2174/4246] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:44 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:45.215027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:45.215027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:45.229737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:45.229737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:45.231536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:45.233124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:45.609363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:45.631635 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55de4cff-8a4f-4cf7-9746-ae0f30340b11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.452079 Aug 04 04:42:45.667636 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2073/4247] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:45 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:45.952682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:45.953310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:45.962474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:45.975134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:45.975847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:45.976991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:45.980326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:46.236323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:46.251629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-be852377-86ca-4fb0-9939-0bcaaece7c3e tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.302840 Aug 04 04:42:46.252260 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2175/4248] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:45 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:46.658389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:46.659184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:46.674887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:46.675401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:46.678496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:46.680193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:47.236841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:47.245605 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15cb01ee-815e-4238-87d5-6a06c10b1ace tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.592566 Aug 04 04:42:47.246504 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2074/4249] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:46 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:47.274147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:47.275444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:47.283463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:47.284260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:47.285272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:47.285906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:47.723584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:47.742043 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c6d63ad5-369c-484b-a806-3fd0e01a553b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.471927 Aug 04 04:42:47.752048 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2176/4250] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:47 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:48.199652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83b892d5-4908-4831-8463-d61d61e9837c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1287119383", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bd3c63df-8eba-495e-a5a0-c7bba8018ed4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:48.272116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:48.272754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:48.283832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-83b892d5-4908-4831-8463-d61d61e9837c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Block Device bd3c63df-8eba-495e-a5a0-c7bba8018ed4 is not bootable. Aug 04 04:42:48.284118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.285126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.286175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.286829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83b892d5-4908-4831-8463-d61d61e9837c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 358 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1287119383", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bd3c63df-8eba-495e-a5a0-c7bba8018ed4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: exception: Block Device bd3c63df-8eba-495e-a5a0-c7bba8018ed4 is not bootable. Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1287119383', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'bd3c63df-8eba-495e-a5a0-c7bba8018ed4'}], 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device bd3c63df-8eba-495e-a5a0-c7bba8018ed4 is not bootable. Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:48.291992 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device bd3c63df-8eba-495e-a5a0-c7bba8018ed4 is not bootable. Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device bd3c63df-8eba-495e-a5a0-c7bba8018ed4 is not bootable. Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83b892d5-4908-4831-8463-d61d61e9837c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Block Device bd3c63df-8eba-495e-a5a0-c7bba8018ed4 is not bootable. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83b892d5-4908-4831-8463-d61d61e9837c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.099670 Aug 04 04:42:48.298783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2075/4251] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:42:48.303936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:48.304492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:48.317160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.319497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.321181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.323081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.765774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:48.781757 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e36fba37-edab-46d6-93cc-acf405bd758c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.512097 Aug 04 04:42:48.782371 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2177/4252] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:48 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:48.801322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:48.804604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:48.816908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.819462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.820802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.823448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.934169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:48.943613 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7aa52b05-0947-4595-9896-3922845b0114 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.644214 Aug 04 04:42:48.944424 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2076/4253] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:48 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:48.972687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:48.973395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:48.989326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.997391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.998524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.999006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:49.439711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:49.450007 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51faad45-5e0e-4703-9e54-67089e69dd13 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.661609 Aug 04 04:42:49.466428 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2178/4254] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:48 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:49.541577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:49.560896 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8bc7702-f274-4746-949c-7a85995636a5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.593142 Aug 04 04:42:49.562485 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2077/4255] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:48 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:49.807360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:49.808224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:49.820826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:49.825051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:49.826092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:49.826440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:50.398658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:50.411471 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1c3cd154-0a13-4ea4-9b9e-820b0eb7970f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.605699 Aug 04 04:42:50.412305 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2179/4256] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:49 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:50.473470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:50.474595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:50.482144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:50.482598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:50.483412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:50.483854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:50.912894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4b5c28df-f76a-44fe-8514-1a2226ab9540 req-51a9435a-4322-4c5b-8665-fa078e69f39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cfd2e6-5f04-4b21-b641-cc235321dc06", "name": "network-vif-plugged", "status": "completed", "tag": "7cc6be0b-3dc7-4f8b-91d7-4a80eb827025"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:50.936082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4b5c28df-f76a-44fe-8514-1a2226ab9540 req-51a9435a-4322-4c5b-8665-fa078e69f39d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:50.936813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4b5c28df-f76a-44fe-8514-1a2226ab9540 req-51a9435a-4322-4c5b-8665-fa078e69f39d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:50.984444 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4b5c28df-f76a-44fe-8514-1a2226ab9540 req-51a9435a-4322-4c5b-8665-fa078e69f39d service nova] Creating event network-vif-plugged:7cc6be0b-3dc7-4f8b-91d7-4a80eb827025 for instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 on n-h1-851337-5 Aug 04 04:42:50.992097 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4b5c28df-f76a-44fe-8514-1a2226ab9540 req-51a9435a-4322-4c5b-8665-fa078e69f39d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087437 Aug 04 04:42:50.994442 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2180/4257] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:51.127270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:51.140740 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-981a4863-21cf-4dad-9ee6-a14e2885368f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.670675 Aug 04 04:42:51.143696 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2078/4258] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:50 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:51.443259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:51.444506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:51.460672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.460947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.461734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.469506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.472738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:51.622379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:51.631255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:51.633071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Searching by: {'deleted': False, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:42:51.672261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.672893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.674037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.674647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.731223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:42:51.799142 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e50ee424-4903-4bca-a23c-ff5287023609 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.180577 Aug 04 04:42:51.800910 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2079/4259] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:42:51 2022] GET /compute/v2.1/servers => generated 333 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:51.825575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:51.837920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:51.839088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Searching by: {'deleted': False, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:42:51.847234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.847683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.848469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.850888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.879246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:51.898035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:42:51.899078 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e5c4651-7a13-4540-bc34-56f82f3a39ea tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.468840 Aug 04 04:42:51.904335 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2181/4260] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:51 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:51.963234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:51.970980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.979211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.167302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:52.167931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:52.174522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.175211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.175995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.176434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.189462 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2b8f10e-50d4-44e5-a235-29303ec20137 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.379179 Aug 04 04:42:52.204790 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2080/4261] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:42:51 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:52.219090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-559b3430-592a-4bfa-b3a7-609aada51746 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:52.237405 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-559b3430-592a-4bfa-b3a7-609aada51746 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023231 Aug 04 04:42:52.239081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2081/4262] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:42:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:42:52.449619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:52.457843 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe3c2b82-2559-4825-aec2-7cf0fb1cf437 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.295623 Aug 04 04:42:52.478656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4ca6385-dee5-4deb-a1ba-5c52f9321bb9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-391998479", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "destination_type": "local"}, {"source_type": "volume", "uuid": "ff70db39-5ab3-4a5b-8bcf-aa867322b5aa", "destination_type": "invalid"}], "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4ca6385-dee5-4deb-a1ba-5c52f9321bb9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 494 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-391998479", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "destination_type": "local"}, {"source_type": "volume", "uuid": "ff70db39-5ab3-4a5b-8bcf-aa867322b5aa", "destination_type": "invalid"}], "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-391998479', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ff70db39-5ab3-4a5b-8bcf-aa867322b5aa', 'destination_type': 'invalid'}], 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:52.484283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 04:42:52.487340 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:42:52.490079 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2182/4263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:52 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:52.491358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4ca6385-dee5-4deb-a1ba-5c52f9321bb9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:52.493025 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4ca6385-dee5-4deb-a1ba-5c52f9321bb9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019982 Aug 04 04:42:52.494650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2082/4264] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:52 2022] POST /compute/v2.1/servers => generated 155 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:42:52.508291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:52.510755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:52.521253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.521945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.523108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.523956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.657639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:52.658232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:52.681461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.681925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.686714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.687495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.754881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:52.935973 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5619d2ce-b9b0-4e22-9a49-ee484be0c05e tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "DELETE /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 204 len: 0 microversion: 2.1 time: 0.285782 Aug 04 04:42:52.939052 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2083/4265] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:52 2022] DELETE /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:52.955517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:52.956857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:52.969761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.970468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.971500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.972097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.534283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:53.544565 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5356751d-5bce-4cb8-b45e-7f552f4d0984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 1.043822 Aug 04 04:42:53.549307 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2183/4266] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:52 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:53.567775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:53.569283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:53.578491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:53.586208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.586679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.589066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.589563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9144d210-fd44-469b-ae32-0b2a2c5d6974 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1370 microversion: 2.1 time: 0.641694 Aug 04 04:42:53.590247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.594116 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2084/4267] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:52 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1370 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:53.603502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:53.604513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:53.622757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.623261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.624071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.624530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.318636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:54.330390 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bea8bd33-ba4a-4d08-99f6-e24be2387341 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1701 microversion: 2.1 time: 0.777827 Aug 04 04:42:54.335631 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2184/4268] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:53 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1701 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:54.341360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:54.347176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:54.360680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.361276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.366649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.368588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.450730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:54.462977 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e81bf15-97da-47a3-94d2-212c7a0c9dc1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.866887 Aug 04 04:42:54.463585 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2085/4269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:53 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:54.622527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:54.623196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:54.636553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.637029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.637812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.638460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.196994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:55.213912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-53196ac4-c734-497d-9cfc-0f0edcd3e74f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.874179 Aug 04 04:42:55.214670 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2185/4270] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:54 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:55.355242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62c9b3e4-d400-44dc-af47-1ec0e070178b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2008463149", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62c9b3e4-d400-44dc-af47-1ec0e070178b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 492 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2008463149", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2008463149', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:55.366814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 04:42:55.369541 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:55.372256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62c9b3e4-d400-44dc-af47-1ec0e070178b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:55.378379 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62c9b3e4-d400-44dc-af47-1ec0e070178b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.028302 Aug 04 04:42:55.382641 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2186/4271] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:55 2022] POST /compute/v2.1/servers => generated 624 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:42:55.391928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:55.392811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:55.416093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.416631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.417316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.417908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.435283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:55.444903 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-960c77c4-48c7-4afa-829a-98e706edb87e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1565 microversion: 2.1 time: 0.826593 Aug 04 04:42:55.445376 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2086/4272] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:54 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1565 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:55.460657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:55.469087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:55.481640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.485577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.496999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.498280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.548443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:56.320800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0279b1eff82c4cb2a1e67346d5726ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f5e8955ab343c28d5c04bd1c24961d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:56.338041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11f0f5d7-6363-4a8e-84aa-8af7ef171e10 tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 200 len: 1701 microversion: 2.1 time: 0.953979 Aug 04 04:42:56.340070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2187/4273] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:55 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 1701 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:56.355682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-86d78299-68a7-4edc-8ab4-41959315463a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:56.356651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-86d78299-68a7-4edc-8ab4-41959315463a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:56.373881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86d78299-68a7-4edc-8ab4-41959315463a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:56.375984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86d78299-68a7-4edc-8ab4-41959315463a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:56.377560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86d78299-68a7-4edc-8ab4-41959315463a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:56.379427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86d78299-68a7-4edc-8ab4-41959315463a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.355322 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-86d78299-68a7-4edc-8ab4-41959315463a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.013633 Aug 04 04:42:57.358689 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2188/4274] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:42:56 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-interface => generated 285 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:57.367846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:57.371817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:57.378894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.379734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.381282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.381928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.396882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:57.411075 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6ceccac2-d212-4d16-a0fb-393a92a67677 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 1.964552 Aug 04 04:42:57.413603 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2087/4275] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:55 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:57.427139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-99615df2-644d-4c26-b0c0-e14c2dd13ffb req-9e9ebdde-4cbe-4e2e-8ab1-6794a4c12820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34697b3b-2bc9-4393-a3c4-5e13376463cc", "name": "network-vif-deleted", "tag": "818ca695-e83f-4189-9050-fc7ed22004ae"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:57.450755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-99615df2-644d-4c26-b0c0-e14c2dd13ffb req-9e9ebdde-4cbe-4e2e-8ab1-6794a4c12820 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.453524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-99615df2-644d-4c26-b0c0-e14c2dd13ffb req-9e9ebdde-4cbe-4e2e-8ab1-6794a4c12820 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.481576 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-99615df2-644d-4c26-b0c0-e14c2dd13ffb req-9e9ebdde-4cbe-4e2e-8ab1-6794a4c12820 service nova] Creating event network-vif-deleted:818ca695-e83f-4189-9050-fc7ed22004ae for instance 34697b3b-2bc9-4393-a3c4-5e13376463cc on n-h2-851337-5 Aug 04 04:42:57.489395 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-99615df2-644d-4c26-b0c0-e14c2dd13ffb req-9e9ebdde-4cbe-4e2e-8ab1-6794a4c12820 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074289 Aug 04 04:42:57.491500 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2088/4276] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:57.500914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-550247927", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "c4c79f0f-4a7d-482d-91c9-d588c6ad407e"}, {"uuid": "85772965-3131-4c18-8738-66b61479fe5e"}, {"uuid": "c4c79f0f-4a7d-482d-91c9-d588c6ad407e"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:57.573805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] validate_networks() for [('c4c79f0f-4a7d-482d-91c9-d588c6ad407e', None, None, None, None, None), ('85772965-3131-4c18-8738-66b61479fe5e', None, None, None, None, None), ('c4c79f0f-4a7d-482d-91c9-d588c6ad407e', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:58.398345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:58.406584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2404f7dd-ce67-4e12-9a2a-3ae05daa8473 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 1.046168 Aug 04 04:42:58.418436 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2189/4277] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:57 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:58.432007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:58.432860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] [instance: 34697b3b-2bc9-4393-a3c4-5e13376463cc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:58.452616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.453372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.454180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.454625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.482552 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] HTTP exception thrown: Instance 34697b3b-2bc9-4393-a3c4-5e13376463cc could not be found. Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Request method failure captured: Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc HTTP/1.1 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604MxgXWM2ngFNBflLnHJbCWaXIJGOlhIZ2SkGGfu9TKGF1HkXQZkuefulPlLi02QU8EAfGmBwbFNPsAMUthTJnK1T5CfdE2ePQmdP-YiQF4uavsrzUseJd7YuRRAHztY7tDYT2dMD2DuppPsCwzKkdQL1bPfWC4RXTk3hjXYJjvuDY Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 45f5e8955ab343c28d5c04bd1c24961d Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-23814642 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/45f5e8955ab343c28d5c04bd1c24961d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/45f5e8955ab343c28d5c04bd1c24961d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/45f5e8955ab343c28d5c04bd1c24961d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_45f5e8955ab343c28d5c04bd1c24961d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-23814642 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 45f5e8955ab343c28d5c04bd1c24961d Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-23814642 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-23814642-project Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0279b1eff82c4cb2a1e67346d5726ae0 Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-23814642-project Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 34697b3b-2bc9-4393-a3c4-5e13376463cc could not be found. Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '34697b3b-2bc9-4393-a3c4-5e13376463cc'} Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34697b3b-2bc9-4393-a3c4-5e13376463cc could not be found. Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34697b3b-2bc9-4393-a3c4-5e13376463cc could not be found. Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:58.484158 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:58.487973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:58.487973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:58.487973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:58.487973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:58.487973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34697b3b-2bc9-4393-a3c4-5e13376463cc could not be found. Aug 04 04:42:58.487973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:42:58.491336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Returning 404 to user: Instance 34697b3b-2bc9-4393-a3c4-5e13376463cc could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:58.492339 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d6a6011a-15a2-4de5-af8d-9b69f816debe tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc" status: 404 len: 111 microversion: 2.1 time: 0.072532 Aug 04 04:42:58.496688 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2190/4278] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:58 2022] GET /compute/v2.1/servers/34697b3b-2bc9-4393-a3c4-5e13376463cc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:58.506527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:58.507407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:58.522995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.523692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.531254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.531932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.543904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:59.566654 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a292ef57-ed26-4eec-a847-963b374d6b98 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 1.068381 Aug 04 04:42:59.572238 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2191/4279] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:58 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:59.578370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad41cbae-5218-495d-9d14-d2fe1b67500d tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] Calling method '.version_select at 0x7f1919677430>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:59.603004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad41cbae-5218-495d-9d14-d2fe1b67500d tempest-ServersTestJSON-23814642 tempest-ServersTestJSON-23814642-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667542884" status: 202 len: 0 microversion: 2.1 time: 0.028819 Aug 04 04:42:59.603830 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2192/4280] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667542884 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:59.609810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:59.611883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:59.621548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.622457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.634965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.635536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:00.724165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:00.736515 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad46c62d-cb7c-49a5-9f93-78987e735997 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 1.131175 Aug 04 04:43:00.737583 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2193/4281] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:59 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:00.745612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9aa53b24-1e50-45ea-949d-da853aa3b749 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9aa53b24-1e50-45ea-949d-da853aa3b749 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 416 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:00.751622 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:43:00.754333 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:00.757075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9aa53b24-1e50-45ea-949d-da853aa3b749 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:00.757075 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9aa53b24-1e50-45ea-949d-da853aa3b749 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018046 Aug 04 04:43:00.762411 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2194/4282] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:00 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:43:00.767684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:00.768331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:00.776892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:00.777351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:00.778199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:00.778801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.356161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:01.378385 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-680aa58e-e64b-4ca4-819e-d9af9da1d056 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.614707 Aug 04 04:43:01.379363 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2195/4283] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:00 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:01.398126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4acce0e3-155c-469e-8efb-747598438faa req-ef2b57e5-8a64-4492-abed-489ab51d76c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfd2e6-5f04-4b21-b641-cc235321dc06", "tag": "7cc6be0b-3dc7-4f8b-91d7-4a80eb827025"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:01.414057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4acce0e3-155c-469e-8efb-747598438faa req-ef2b57e5-8a64-4492-abed-489ab51d76c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.414716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4acce0e3-155c-469e-8efb-747598438faa req-ef2b57e5-8a64-4492-abed-489ab51d76c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.436262 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4acce0e3-155c-469e-8efb-747598438faa req-ef2b57e5-8a64-4492-abed-489ab51d76c4 service nova] Creating event network-changed:7cc6be0b-3dc7-4f8b-91d7-4a80eb827025 for instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 on n-h1-851337-5 Aug 04 04:43:01.443999 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4acce0e3-155c-469e-8efb-747598438faa req-ef2b57e5-8a64-4492-abed-489ab51d76c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049189 Aug 04 04:43:01.445277 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2196/4284] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:01.452779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:01.454221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:01.463890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.464866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.465853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.466598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.789120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:43:01.789605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:43:01.790657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:43:01.791107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:43:01.791529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:43:01.815996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.816948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.824800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.827113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.836220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:01.849259 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44b724df-3ac0-4ee8-b339-395b6410688e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.401819 Aug 04 04:43:01.854781 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2197/4285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:01 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:01.897272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:01.901969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:01.933297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.933819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.937924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.939231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Getting quotas for project 22077b0e9e6d4231ba48cfd8f19e75db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:43:01.939907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.953731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Getting quotas for user 59674072d54342d790a9334becf72778 and project 22077b0e9e6d4231ba48cfd8f19e75db. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:43:01.978293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:43:01.981327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:43:02.072234 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bec83f40-ddd6-4b14-9fd3-ef828820ebee tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.577549 Aug 04 04:43:02.080443 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2089/4286] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:43:02.086455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ed5a3b7-b503-4974-8e12-41e1c9fc7ae4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-666953153", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": -1, "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:02.103487 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3ed5a3b7-b503-4974-8e12-41e1c9fc7ae4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Flavor -1 could not be found. Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ed5a3b7-b503-4974-8e12-41e1c9fc7ae4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 205 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-666953153", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": -1, "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: exception: Flavor -1 could not be found. Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-666953153', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': -1, 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:02.105451 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ed5a3b7-b503-4974-8e12-41e1c9fc7ae4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:02.109343 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ed5a3b7-b503-4974-8e12-41e1c9fc7ae4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.026194 Aug 04 04:43:02.110386 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2090/4287] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:02 2022] POST /compute/v2.1/servers => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:02.117759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b28f3911-527a-4a50-b7da-151f9501d498 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:02.119299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b28f3911-527a-4a50-b7da-151f9501d498 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:02.249683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b28f3911-527a-4a50-b7da-151f9501d498 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:02.260146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b28f3911-527a-4a50-b7da-151f9501d498 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1212 microversion: 2.1 time: 0.147138 Aug 04 04:43:02.273549 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2091/4288] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:02 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:02.273549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:02.273549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:02.298272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.298825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.299719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.300161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.588546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:02.605101 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-88e08438-312a-4eaf-a174-eb2fc13ac9f9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.724032 Aug 04 04:43:02.605959 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2198/4289] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:01 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:02.698341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:02.708068 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0d27f144-edaf-42fb-9c6f-925ee37da32f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.444119 Aug 04 04:43:02.721331 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2092/4290] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:02 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:02.737411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:02.739361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:02.751174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.754798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.756730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.757571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.028425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:03.037528 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffdca6fc-c13a-4f13-87c5-55844a8a4a79 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.307370 Aug 04 04:43:03.040097 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2199/4291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:02 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:03.132814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-018bd6ac-af54-434a-a962-03db7788bf30 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1671781536", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-018bd6ac-af54-434a-a962-03db7788bf30 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 173 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1671781536", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1671781536', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi -1 Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:43:03.139917 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-018bd6ac-af54-434a-a962-03db7788bf30 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-018bd6ac-af54-434a-a962-03db7788bf30 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.013139 Aug 04 04:43:03.144048 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2093/4292] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:03 2022] POST /compute/v2.1/servers => generated 145 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:43:03.152930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:03.153564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:03.166225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.167141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.168221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.172354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.283466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:03.284261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:03.300536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.301082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.302180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.302631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.463120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:03.473943 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4fdbbcfe-8e0d-45c4-a93f-593a3a1af154 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.327460 Aug 04 04:43:03.479291 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2200/4293] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:03 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:03.503852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:03.505096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:03.517638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.519516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.521568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.523118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:03.523972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.534611 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03984a88-f228-4cf3-ad93-c9becc59da05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1208 microversion: 2.1 time: 0.256900 Aug 04 04:43:03.540107 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2094/4294] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:03 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1208 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:03.634319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:03.635536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:03.661702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.666341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.667942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.669949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.423905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:04.433478 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42d703a8-0de5-41d5-8f51-7fd0eeb35850 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.804132 Aug 04 04:43:04.434688 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2095/4295] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:03 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:04.548148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:04.561457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:04.562185 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d7d9d61-825e-4daf-8535-de0eee3bf6d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 1.062258 Aug 04 04:43:04.562496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:04.563366 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2201/4296] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:03 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:04.600339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.601251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.603897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.604569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.675113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b5c0d1fc-45ac-4ea4-a0ff-bee791a07554 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1385220046", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:04.685358 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b5c0d1fc-45ac-4ea4-a0ff-bee791a07554 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b5c0d1fc-45ac-4ea4-a0ff-bee791a07554 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 216 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1385220046", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1385220046', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:04.687496 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:04.691537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:04.691537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:04.691537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:04.691537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:04.691537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:04.691537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 04:43:04.691537 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:04.695583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b5c0d1fc-45ac-4ea4-a0ff-bee791a07554 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:04.697212 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b5c0d1fc-45ac-4ea4-a0ff-bee791a07554 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033066 Aug 04 04:43:04.698388 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2202/4297] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:04 2022] POST /compute/v2.1/servers => generated 123 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:43:04.709504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:04.723587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:04.726227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:04.728504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.735408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.736242 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-88cb13fc-9e76-461a-9467-8c6ac0cfd35a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1270 microversion: 2.1 time: 0.178579 Aug 04 04:43:04.736633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.750915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.752232 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2096/4298] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:04 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:04.777819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:05.162382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:05.184170 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b46a49e7-66a8-4bf4-a12e-7f8539137461 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.477133 Aug 04 04:43:05.191127 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2203/4299] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:04 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:05.211765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:05.212890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:05.223943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.224610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.225634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.226221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.458261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:05.459025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:05.490472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.491471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.494186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.503620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.669427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:05.681913 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-394e2051-4ffd-4905-9e0a-fb0763d33745 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.475825 Aug 04 04:43:05.701709 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2097/4300] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:05 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:05.759787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:05.760399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:05.773938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.775996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.776861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.777308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.828549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:05.837969 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-212b41c1-ce18-4efb-96c4-f26e087b8b0d tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.385276 Aug 04 04:43:05.838563 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2204/4301] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:05 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:05.843733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-277248d9-c880-4c2a-8d13-11068b14a291 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-971172872", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-key-867352407", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:05.877152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:05.890195 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f73ec8b-2e69-4f81-b44c-6e317308ca2b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1270 microversion: 2.1 time: 0.135891 Aug 04 04:43:05.891083 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2098/4302] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:05 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:05.910085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-277248d9-c880-4c2a-8d13-11068b14a291 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] validate_networks() for [('85c40f96-139b-4f20-8c81-0af600a45095', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:43:06.390824 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-277248d9-c880-4c2a-8d13-11068b14a291 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Invalid key_name provided. Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-277248d9-c880-4c2a-8d13-11068b14a291 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 245 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-971172872", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-key-867352407", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid key_name provided. Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-971172872', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'key_name': 'tempest-key-867352407', 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-867352407 not found for user d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:06.392834 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 04 04:43:06.396124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:06.398081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-277248d9-c880-4c2a-8d13-11068b14a291 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid key_name provided. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:06.400068 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-277248d9-c880-4c2a-8d13-11068b14a291 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.559573 Aug 04 04:43:06.401605 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2205/4303] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:05 2022] POST /compute/v2.1/servers => generated 70 bytes in 562 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:06.409878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:06.410601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:06.422102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.422822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.424069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.425410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.861409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:06.862035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:06.875496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.876693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.877691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.879477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.987291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:07.000360 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7aaba50e-359e-4822-8c20-b94ca6ea4049 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.594555 Aug 04 04:43:07.015783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2099/4304] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:06 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:07.044981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:07.045631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:07.054587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.055074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.055894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.059600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.557865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:07.570057 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9aa6ae93-3d34-40f9-bbf8-a90aa4131eae tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1312 microversion: 2.1 time: 0.559820 Aug 04 04:43:07.570654 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2100/4305] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:07 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1312 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:07.575556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:07.576165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:07.594711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.595193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.595982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.596422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.658456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:07.675616 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9ee2a77-e48d-410e-bdbe-2850e0d1aef0 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.819920 Aug 04 04:43:07.677056 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2206/4306] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:06 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:07.767766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-370347375", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "47d4b315-4c1e-43e0-b0d6-df24ac9e76da"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:07.848321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] validate_networks() for [('47d4b315-4c1e-43e0-b0d6-df24ac9e76da', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:43:08.152881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:08.162241 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7303f904-b45e-4122-baa9-68aee3dbc470 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.590137 Aug 04 04:43:08.163001 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2101/4307] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:07 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:08.274835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc223cb0-912a-4c20-9c50-558c7227d800 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-391888127", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:08.445912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.security_group_api [None req-cc223cb0-912a-4c20-9c50-558c7227d800 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Neutron security group does_not_exist not found {{(pid=119342) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 04 04:43:08.447300 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-cc223cb0-912a-4c20-9c50-558c7227d800 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc223cb0-912a-4c20-9c50-558c7227d800 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 257 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-391888127", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-391888127', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 04 04:43:08.463290 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 04 04:43:08.466681 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:08.472435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc223cb0-912a-4c20-9c50-558c7227d800 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:08.473625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc223cb0-912a-4c20-9c50-558c7227d800 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.202680 Aug 04 04:43:08.474738 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2102/4308] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:08 2022] POST /compute/v2.1/servers => generated 106 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:43:08.483237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:08.484227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:08.491486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.492264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:08.493892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.494546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.244141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:09.261785 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32353f9c-27c8-47ca-ad49-083d8234fb46 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.779151 Aug 04 04:43:09.278800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2103/4309] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:08 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:09.290970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:09.293670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:09.305696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:09.309239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.312134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.313119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.313715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.360479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:43:09.361231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:43:09.361383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:43:09.361818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:43:09.362226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:43:09.379310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.391153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.392497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.393148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.456122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Getting quotas for project 75f2bc0977a34dc9b7777a08cd275900. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:43:09.479206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Getting quotas for user f89fcfd69c6844c293e36909ec0722c9 and project 75f2bc0977a34dc9b7777a08cd275900. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:43:09.531389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:43:09.533908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:43:09.657606 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bdac870c-2f0e-4e35-983d-2f920f803c13 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.978804 Aug 04 04:43:09.657962 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2207/4310] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:43:09.682915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:09.683910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:09.701314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.701774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.702576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.703046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.996161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:10.012619 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3cbd2287-edab-45ca-95a6-8cddc4b4bbad tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1512 microversion: 2.1 time: 0.344065 Aug 04 04:43:10.013393 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2208/4311] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:09 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:10.030292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:10.033875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:10.037005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:10.045707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.046589 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-307477f5-47fc-452b-b19c-5414840b8685 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1333 microversion: 2.1 time: 0.766209 Aug 04 04:43:10.048228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:10.054885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.055673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:10.060568 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2104/4312] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:09 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1333 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:10.067096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21295dc8-0eb1-419a-afa2-25e9edd954d2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:10.072380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-21295dc8-0eb1-419a-afa2-25e9edd954d2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:10.224461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-21295dc8-0eb1-419a-afa2-25e9edd954d2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:10.238844 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21295dc8-0eb1-419a-afa2-25e9edd954d2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1224 microversion: 2.1 time: 0.177068 Aug 04 04:43:10.240473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2105/4313] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:10 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1224 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:10.410623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:10.425828 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3fa94f7-3cd0-4f7d-b934-77d3657203eb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.403505 Aug 04 04:43:10.427113 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2209/4314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:10 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:10.449313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-052348e7-a89b-4357-900e-a6336dfce4d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:10.451148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-052348e7-a89b-4357-900e-a6336dfce4d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 784f34f7-d7d2-4f7d-bd57-0a4521b7f831] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:10.464343 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-052348e7-a89b-4357-900e-a6336dfce4d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 784f34f7-d7d2-4f7d-bd57-0a4521b7f831 could not be found. Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-052348e7-a89b-4357-900e-a6336dfce4d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/784f34f7-d7d2-4f7d-bd57-0a4521b7f831 HTTP/1.1 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 784f34f7-d7d2-4f7d-bd57-0a4521b7f831 could not be found. Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '784f34f7-d7d2-4f7d-bd57-0a4521b7f831'} Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784f34f7-d7d2-4f7d-bd57-0a4521b7f831 could not be found. Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784f34f7-d7d2-4f7d-bd57-0a4521b7f831 could not be found. Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:10.465886 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784f34f7-d7d2-4f7d-bd57-0a4521b7f831 could not be found. Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-052348e7-a89b-4357-900e-a6336dfce4d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 784f34f7-d7d2-4f7d-bd57-0a4521b7f831 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-052348e7-a89b-4357-900e-a6336dfce4d9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "DELETE /compute/v2.1/servers/784f34f7-d7d2-4f7d-bd57-0a4521b7f831" status: 404 len: 111 microversion: 2.1 time: 0.024027 Aug 04 04:43:10.474046 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2106/4315] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:10 2022] DELETE /compute/v2.1/servers/784f34f7-d7d2-4f7d-bd57-0a4521b7f831 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:10.478602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:10.480057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:10.490802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.501127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:10.504172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.508407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:10.873681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:10.891499 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9acb8fc4-b4ac-47c1-924d-041b8355f8be tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.417559 Aug 04 04:43:10.892790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2210/4316] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:10 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:10.928697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:10.931079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:10.943549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.944935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:10.946269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.946738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.035051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:11.040470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:11.056795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.059136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.063941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.064842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.311470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:11.340769 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-afbbde42-aa48-4455-8b99-8ffc142e30af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.426398 Aug 04 04:43:11.347409 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2107/4317] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:10 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:11.355894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:11.356744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:11.377419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.378269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.379266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.379856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.480511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:11.496104 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b1490165-d0c1-4db9-808a-07bb7c17ce87 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1489 microversion: 2.1 time: 0.466029 Aug 04 04:43:11.497554 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2211/4318] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:11 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1489 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:11.507872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:11.511664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:11.532219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:11.536757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.538927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.542802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.545297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.690626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:11.725249 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb3ed933-cefb-40b5-a99d-e3226479f724 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1282 microversion: 2.1 time: 0.226295 Aug 04 04:43:11.726484 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2212/4319] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:11 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:11.732494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-620d8870-1ead-4cf7-88e5-08cd9b2a1187 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:11.733231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-620d8870-1ead-4cf7-88e5-08cd9b2a1187 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 04:43:11.733978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-620d8870-1ead-4cf7-88e5-08cd9b2a1187 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-620d8870-1ead-4cf7-88e5-08cd9b2a1187 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 9223372036854775808 could not be found. Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '9223372036854775808'} Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:11.736088 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:11.739536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:11.739536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:11.739536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:11.739536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 04 04:43:11.739536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:11.742882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-620d8870-1ead-4cf7-88e5-08cd9b2a1187 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:11.744862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-620d8870-1ead-4cf7-88e5-08cd9b2a1187 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016347 Aug 04 04:43:11.751013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2213/4320] 10.222.0.69 () {58 vars in 1188 bytes} [Thu Aug 4 04:43:11 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:43:11.757655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b405472-56d5-46bc-a5f5-dc2c05b022bf tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-59411697"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:11.761738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b405472-56d5-46bc-a5f5-dc2c05b022bf tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:11.770643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b405472-56d5-46bc-a5f5-dc2c05b022bf tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.771255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b405472-56d5-46bc-a5f5-dc2c05b022bf tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.772049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b405472-56d5-46bc-a5f5-dc2c05b022bf tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.772490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b405472-56d5-46bc-a5f5-dc2c05b022bf tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.855249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:11.856631 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b405472-56d5-46bc-a5f5-dc2c05b022bf tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "PUT /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1060 microversion: 2.1 time: 0.102956 Aug 04 04:43:11.857509 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2214/4321] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:43:11 2022] PUT /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1060 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:11.864783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:11.866210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:11.874065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.874787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.876073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.876694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.986288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:11.996505 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85aaec23-85ee-4033-908f-adf2a68c69ff tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.646315 Aug 04 04:43:11.998001 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2108/4322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:11 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:12.003404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:12.004247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:12.012338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.013106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.014085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.014788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.233628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:12.244428 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-118e66a8-1de9-4c66-83e2-e3829f06c97f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.385232 Aug 04 04:43:12.245750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2215/4323] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:11 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:12.270890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:12.272106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:12.279322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.280702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.286824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.287544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.338017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:12.346006 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad11d344-a430-401f-a61b-762ea0aae82c tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1487 microversion: 2.1 time: 0.346594 Aug 04 04:43:12.349434 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2109/4324] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:11 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1487 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:12.369584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:12.370188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:12.376379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.376971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.377917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.378032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.567271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:12.577741 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3cbe5795-b069-4801-b0b0-ae0b453eaf13 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.312751 Aug 04 04:43:12.578326 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2216/4325] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:12 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:12.599399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6feb952-d98a-469d-bcc9-30ca98d0281b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:12.600069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6feb952-d98a-469d-bcc9-30ca98d0281b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Failed to fetch instance by id -1 {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 04:43:12.600791 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f6feb952-d98a-469d-bcc9-30ca98d0281b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance -1 could not be found. Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6feb952-d98a-469d-bcc9-30ca98d0281b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance -1 could not be found. Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '-1'} Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:12.603791 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:12.607755 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:12.607755 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:12.607755 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 04 04:43:12.607755 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:12.608918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6feb952-d98a-469d-bcc9-30ca98d0281b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:12.610004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6feb952-d98a-469d-bcc9-30ca98d0281b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014903 Aug 04 04:43:12.610739 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2217/4326] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:43:12 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:43:12.620707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:12.621549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:12.629517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.630301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.631363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.632010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.652145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:12.668212 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-489b9f09-19c7-4cf0-a395-6ce0a4c964f1 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1487 microversion: 2.1 time: 0.303130 Aug 04 04:43:12.679692 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2110/4327] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:12 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1487 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:12.701639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:12.703972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:12.715599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.716574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.717610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.718267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.781288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:12.790441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:43:12.962397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b89f42c7-c7bb-43e2-9b90-9437516934ef tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 204 len: 0 microversion: 2.1 time: 0.265664 Aug 04 04:43:12.969357 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2111/4328] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:12 2022] DELETE /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:43:12.977841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-878dbcbe-abe4-4599-85ab-c07d36f18595 req-e2518d18-81d2-4c81-8b57-7236cb478e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "tag": "8f5fa943-bd3e-421e-b952-349fdcbd8ed7"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:12.981413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:12.991181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-878dbcbe-abe4-4599-85ab-c07d36f18595 req-e2518d18-81d2-4c81-8b57-7236cb478e01 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.991935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-878dbcbe-abe4-4599-85ab-c07d36f18595 req-e2518d18-81d2-4c81-8b57-7236cb478e01 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.007001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-878dbcbe-abe4-4599-85ab-c07d36f18595 req-e2518d18-81d2-4c81-8b57-7236cb478e01 service nova] Creating event network-changed:8f5fa943-bd3e-421e-b952-349fdcbd8ed7 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:13.009986 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-597d91a0-78e1-4480-a31d-d96857f290e7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.394536 Aug 04 04:43:13.012661 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2218/4329] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:12 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:13.017680 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-878dbcbe-abe4-4599-85ab-c07d36f18595 req-e2518d18-81d2-4c81-8b57-7236cb478e01 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046018 Aug 04 04:43:13.018564 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2112/4330] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:13.026683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:13.027556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:13.039889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:13.039889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:13.050058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.050671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.050794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.051167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.051942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.052093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.052451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.056507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.186746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:13.198415 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8bf7d69c-8c1a-4dd6-a2ab-555e21b9e0f2 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1282 microversion: 2.1 time: 0.182224 Aug 04 04:43:13.200293 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2219/4331] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:13 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:13.211001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:13.212983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:13.221166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.222562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.223667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.224123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.360138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:13.370449 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db7acd3b-57cc-49d0-a8b3-60211123f7d7 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1493 microversion: 2.1 time: 0.350651 Aug 04 04:43:13.371056 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2113/4332] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:13 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1493 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:13.375797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:13.376548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:13.383807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.384432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.386064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.386698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.528448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:13.537516 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d9191f1-31fa-4e3f-afc9-cae502abd7e5 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.334119 Aug 04 04:43:13.538452 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2220/4333] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:13 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:13.662018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:13.671462 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1a8c0684-a4b0-4319-b483-c41161f76bb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.299139 Aug 04 04:43:13.672165 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2114/4334] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:13 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:13.693524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e20fe11b-8011-4cf6-b60a-4e44b259ad91 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:13.694089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e20fe11b-8011-4cf6-b60a-4e44b259ad91 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 0757e586-578d-4243-9105-9d48a8a54b2f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:13.700985 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e20fe11b-8011-4cf6-b60a-4e44b259ad91 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 0757e586-578d-4243-9105-9d48a8a54b2f could not be found. Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e20fe11b-8011-4cf6-b60a-4e44b259ad91 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/0757e586-578d-4243-9105-9d48a8a54b2f/action HTTP/1.1 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 19 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: {"forceDelete": {}} Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0757e586-578d-4243-9105-9d48a8a54b2f could not be found. Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0757e586-578d-4243-9105-9d48a8a54b2f', 'body': {'forceDelete': {}}} Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0757e586-578d-4243-9105-9d48a8a54b2f could not be found. Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0757e586-578d-4243-9105-9d48a8a54b2f could not be found. Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:13.704646 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:13.708439 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:13.708439 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:13.708439 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0757e586-578d-4243-9105-9d48a8a54b2f could not be found. Aug 04 04:43:13.708439 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:13.708439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e20fe11b-8011-4cf6-b60a-4e44b259ad91 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 0757e586-578d-4243-9105-9d48a8a54b2f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:13.708439 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e20fe11b-8011-4cf6-b60a-4e44b259ad91 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/0757e586-578d-4243-9105-9d48a8a54b2f/action" status: 404 len: 111 microversion: 2.1 time: 0.017362 Aug 04 04:43:13.708439 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2221/4335] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:13 2022] POST /compute/v2.1/servers/0757e586-578d-4243-9105-9d48a8a54b2f/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:13.716177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:13.716801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:13.723694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.724150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.724957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.725383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.935856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:13.944876 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5bc2baa-060a-416f-b7ee-381e83bc390e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.232427 Aug 04 04:43:13.945672 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2115/4336] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:13 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:13.968637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:13.970174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:13.979775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.980570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:13.981566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:13.982230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.221377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:14.223266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:14.228640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:14.231605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.232986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.234059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.234716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.251265 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1160c369-529b-42e9-b9cb-708f6f3b787a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.286991 Aug 04 04:43:14.265697 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2222/4337] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:13 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:14.278861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe9083c3-4947-4361-9b7d-d964606b8d2a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:14.281315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe9083c3-4947-4361-9b7d-d964606b8d2a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 6249a0c9-d333-480f-9b55-959cfa398a26] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:14.289489 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-fe9083c3-4947-4361-9b7d-d964606b8d2a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 6249a0c9-d333-480f-9b55-959cfa398a26 could not be found. Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe9083c3-4947-4361-9b7d-d964606b8d2a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/6249a0c9-d333-480f-9b55-959cfa398a26/action HTTP/1.1 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 39 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: {"os-getConsoleOutput": {"length": 10}} Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6249a0c9-d333-480f-9b55-959cfa398a26 could not be found. Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6249a0c9-d333-480f-9b55-959cfa398a26', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6249a0c9-d333-480f-9b55-959cfa398a26 could not be found. Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6249a0c9-d333-480f-9b55-959cfa398a26 could not be found. Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:14.298697 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6249a0c9-d333-480f-9b55-959cfa398a26 could not be found. Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe9083c3-4947-4361-9b7d-d964606b8d2a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 6249a0c9-d333-480f-9b55-959cfa398a26 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:14.303973 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe9083c3-4947-4361-9b7d-d964606b8d2a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/6249a0c9-d333-480f-9b55-959cfa398a26/action" status: 404 len: 111 microversion: 2.1 time: 0.028175 Aug 04 04:43:14.307502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2223/4338] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:14 2022] POST /compute/v2.1/servers/6249a0c9-d333-480f-9b55-959cfa398a26/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:14.313698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:14.314558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:14.323367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.324034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.324971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.325606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.341239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:14.355061 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e9e4e31-7545-40e2-85d3-3e318af2ac29 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1282 microversion: 2.1 time: 0.138204 Aug 04 04:43:14.356100 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2116/4339] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:14 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:14.392645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:14.393268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:14.400736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.401217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.402004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.402618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.802681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:14.824361 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63863d3a-1ea9-4647-88a7-d66e34f5ff1a tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1493 microversion: 2.1 time: 0.436413 Aug 04 04:43:14.825220 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2117/4340] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:14 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1493 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:14.829494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:14.830056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:14.840232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:14.846108 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0150e14-76fd-4672-846f-bb83c74ec2f6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.537072 Aug 04 04:43:14.855060 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2224/4341] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:14 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:14.874730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:14.875013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:14.877516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.877988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.878798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.879765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.887656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.890463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.896508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:14.897210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:14.912011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:15.410127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:15.418294 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7382b76-ba45-4893-8661-c9eb8e3cc921 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.548197 Aug 04 04:43:15.418616 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2225/4342] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:14 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:15.423595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-22696299-b416-4000-8ae6-a5cebcf62223 req-e7d726a4-5b12-4615-8c05-5b8c119cdeee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "tag": "5e28c7ff-bffc-411b-b9e6-4aaa962da826"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:15.444113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22696299-b416-4000-8ae6-a5cebcf62223 req-e7d726a4-5b12-4615-8c05-5b8c119cdeee service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:15.444569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22696299-b416-4000-8ae6-a5cebcf62223 req-e7d726a4-5b12-4615-8c05-5b8c119cdeee service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:15.466172 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-22696299-b416-4000-8ae6-a5cebcf62223 req-e7d726a4-5b12-4615-8c05-5b8c119cdeee service nova] Creating event network-changed:5e28c7ff-bffc-411b-b9e6-4aaa962da826 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:15.472584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-22696299-b416-4000-8ae6-a5cebcf62223 req-e7d726a4-5b12-4615-8c05-5b8c119cdeee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052662 Aug 04 04:43:15.473710 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2226/4343] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:15.489691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:15.490875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:15.501113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:15.501874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:15.502930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:15.503650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:15.906181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:15.918280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93446831-bea4-4634-8df3-c7881e818981 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 1.091633 Aug 04 04:43:15.919303 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2118/4344] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:14 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:15.925365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e06508fb-44b0-4dba-bdf1-f5e0c16c2398 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:15.926931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e06508fb-44b0-4dba-bdf1-f5e0c16c2398 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 3cb46514-e038-4dad-b7ff-50387f2ac886] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:15.933594 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e06508fb-44b0-4dba-bdf1-f5e0c16c2398 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 3cb46514-e038-4dad-b7ff-50387f2ac886 could not be found. Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e06508fb-44b0-4dba-bdf1-f5e0c16c2398 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/3cb46514-e038-4dad-b7ff-50387f2ac886 HTTP/1.1 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3cb46514-e038-4dad-b7ff-50387f2ac886 could not be found. Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3cb46514-e038-4dad-b7ff-50387f2ac886'} Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb46514-e038-4dad-b7ff-50387f2ac886 could not be found. Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb46514-e038-4dad-b7ff-50387f2ac886 could not be found. Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:15.938816 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:15.942946 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:15.942946 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:15.942946 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:15.942946 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb46514-e038-4dad-b7ff-50387f2ac886 could not be found. Aug 04 04:43:15.942946 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:15.944409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e06508fb-44b0-4dba-bdf1-f5e0c16c2398 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 3cb46514-e038-4dad-b7ff-50387f2ac886 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:15.945491 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e06508fb-44b0-4dba-bdf1-f5e0c16c2398 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/3cb46514-e038-4dad-b7ff-50387f2ac886" status: 404 len: 111 microversion: 2.1 time: 0.024588 Aug 04 04:43:15.947230 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2119/4345] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:15 2022] GET /compute/v2.1/servers/3cb46514-e038-4dad-b7ff-50387f2ac886 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:15.952172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:15.953110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:15.962936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:15.963829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:15.965030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:15.965684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.108822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:16.121373 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7d95411-60bc-4955-ae42-e00d46419e7b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 200 len: 1451 microversion: 2.1 time: 0.172807 Aug 04 04:43:16.125744 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2120/4346] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:15 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:16.134320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:16.134937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:16.158923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:16.159474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.163557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:16.164020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.265942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:16.274882 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fff7f3c5-9944-47c0-99f4-ad7f8645f6b7 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.799095 Aug 04 04:43:16.275520 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2227/4347] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:15 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:16.459722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8c53dc02-11aa-47fe-a1b9-67cf7fc2dd3c req-a1483184-2826-4dee-ab63-6dd909594615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6dcd04-47b4-41e2-98a1-13f1c5054aee", "name": "network-vif-deleted", "tag": "e749d2e9-91ac-4541-9da1-b22c99756655"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:16.484222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8c53dc02-11aa-47fe-a1b9-67cf7fc2dd3c req-a1483184-2826-4dee-ab63-6dd909594615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:16.485010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8c53dc02-11aa-47fe-a1b9-67cf7fc2dd3c req-a1483184-2826-4dee-ab63-6dd909594615 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.499641 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8c53dc02-11aa-47fe-a1b9-67cf7fc2dd3c req-a1483184-2826-4dee-ab63-6dd909594615 service nova] Creating event network-vif-deleted:e749d2e9-91ac-4541-9da1-b22c99756655 for instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee on n-h1-851337-5 Aug 04 04:43:16.504717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8c53dc02-11aa-47fe-a1b9-67cf7fc2dd3c req-a1483184-2826-4dee-ab63-6dd909594615 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058258 Aug 04 04:43:16.505331 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2228/4348] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:43:16.577940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:16.590650 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-860d48c1-dad1-4946-bb7c-237c56542982 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.463711 Aug 04 04:43:16.591299 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2121/4349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:16 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:16.620753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:16.621822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:16.635701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:16.636554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.637936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:16.638698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.850675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:16.860516 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fa05f528-138f-4c9d-aea9-4d30ddf33f29 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.246940 Aug 04 04:43:16.861135 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2229/4350] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:16 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:16.933517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49d2b4da-8480-4601-9fcd-06ab1e2dc0e5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-897207994", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:16.947714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:16.949261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:16.957177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:16.957727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.959058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:16.959936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49d2b4da-8480-4601-9fcd-06ab1e2dc0e5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 237 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-897207994", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-897207994', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.962432 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:16.967041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49d2b4da-8480-4601-9fcd-06ab1e2dc0e5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:16.970044 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-49d2b4da-8480-4601-9fcd-06ab1e2dc0e5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036533 Aug 04 04:43:16.974552 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2122/4351] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:16 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:43:16.983189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:16.985883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.007130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.007848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.009637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.010203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.319119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:17.328826 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a4baae57-c3e2-4383-8482-4207f3a99044 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.385680 Aug 04 04:43:17.329650 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2230/4352] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:16 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:17.342519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:17.347754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.348393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.354690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.355240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.356350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.356825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.361906 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0acebfb3-a8a0-48db-b660-008bd25aff86 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.380469 Aug 04 04:43:17.362526 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2123/4353] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:16 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:17.375730 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee HTTP/1.1 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'bb6dcd04-47b4-41e2-98a1-13f1c5054aee'} Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.379733 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.385126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.385126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.385126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.385126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:17.385126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:17.385126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.385126 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.388043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:17.389154 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-168cb451-5aff-4abe-b2d4-e285154aa1fa tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 404 len: 111 microversion: 2.1 time: 0.045214 Aug 04 04:43:17.389329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.390308 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2231/4354] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:17 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:17.398060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.406300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.406722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.407317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.407623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.409334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.416258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.416985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.418921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.419807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.420914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.683313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:17.688646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:17.691817 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51c8ff57-f3ba-435a-8b10-d579f0000b43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.300153 Aug 04 04:43:17.692869 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2232/4355] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:17 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:17.701133 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd2db189-2162-4d40-a076-b4dda549d8e0 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.324181 Aug 04 04:43:17.702658 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2124/4356] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:17 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:17.715871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.721911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.729879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.730360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.731475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.731907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.747529 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee HTTP/1.1 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'bb6dcd04-47b4-41e2-98a1-13f1c5054aee'} Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:17.749091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19d0632f-9ff0-4183-aba7-a4d2f92e7bc8 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 404 len: 111 microversion: 2.1 time: 0.056527 Aug 04 04:43:17.752645 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2233/4357] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:17 2022] DELETE /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:17.760408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.761194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: bb6dcd04-47b4-41e2-98a1-13f1c5054aee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.772986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.773717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.775594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.776552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.808661 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee HTTP/1.1 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'bb6dcd04-47b4-41e2-98a1-13f1c5054aee'} Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.811660 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance bb6dcd04-47b4-41e2-98a1-13f1c5054aee could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8395e00e-6218-4c54-b0ab-2845806903ae tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee" status: 404 len: 111 microversion: 2.1 time: 0.058024 Aug 04 04:43:17.819546 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2125/4358] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:17 2022] GET /compute/v2.1/servers/bb6dcd04-47b4-41e2-98a1-13f1c5054aee => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:17.825887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.827209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.833804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.834987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.835762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.836985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.854509 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 HTTP/1.1 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '16711187-a00f-4f90-b363-6dedd924b978'} Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:17.856460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-651598c1-3280-41a4-9cd3-9acbc3ded72b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 404 len: 111 microversion: 2.1 time: 0.039390 Aug 04 04:43:17.861950 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2234/4359] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:17 2022] DELETE /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:43:17.869115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.869792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 16711187-a00f-4f90-b363-6dedd924b978] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.876595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.877047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.877932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.878823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.887709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64ff1a20-5487-4351-8f74-7f10d93c98d2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2053955214", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64ff1a20-5487-4351-8f74-7f10d93c98d2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 235 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2053955214", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2053955214', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.903967 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 04:43:17.907840 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.913511 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.913698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64ff1a20-5487-4351-8f74-7f10d93c98d2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 HTTP/1.1 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '16711187-a00f-4f90-b363-6dedd924b978'} Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.916083 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.920205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.920205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.920205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.920205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:17.920205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:17.920205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. Aug 04 04:43:17.920205 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.922280 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64ff1a20-5487-4351-8f74-7f10d93c98d2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031118 Aug 04 04:43:17.922841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 16711187-a00f-4f90-b363-6dedd924b978 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:17.924274 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dcd5f524-5bf6-4239-9c26-1ac9c5f72f84 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978" status: 404 len: 111 microversion: 2.1 time: 0.060294 Aug 04 04:43:17.925215 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2126/4360] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:17 2022] GET /compute/v2.1/servers/16711187-a00f-4f90-b363-6dedd924b978 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:17.929413 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2235/4361] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:17 2022] POST /compute/v2.1/servers => generated 133 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:43:17.933052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.934315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.938597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:17.939411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:17.943127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.943793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.944795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.945384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.960890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.962320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.963299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:17.963885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:17.986090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 HTTP/1.1 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '3fa61a71-3608-4c76-97bb-e93b36304ad4'} Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:17.989296 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:17.994214 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:17.996656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:17.997695 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13397bd8-0d5b-4b8c-a1a5-a89938509f63 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 404 len: 111 microversion: 2.1 time: 0.064501 Aug 04 04:43:18.001257 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2236/4362] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:17 2022] DELETE /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:18.004987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-33555098-32c1-4643-9ac1-09dbe1793e91 req-08dad3c3-ae96-45c7-82d8-733868caf9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "tag": "5fe9fa0d-745c-4180-a6e5-1b72e9df3a84"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:18.018913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-33555098-32c1-4643-9ac1-09dbe1793e91 req-08dad3c3-ae96-45c7-82d8-733868caf9bf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.021208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-33555098-32c1-4643-9ac1-09dbe1793e91 req-08dad3c3-ae96-45c7-82d8-733868caf9bf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.038235 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-33555098-32c1-4643-9ac1-09dbe1793e91 req-08dad3c3-ae96-45c7-82d8-733868caf9bf service nova] Creating event network-changed:5fe9fa0d-745c-4180-a6e5-1b72e9df3a84 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:18.045202 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-33555098-32c1-4643-9ac1-09dbe1793e91 req-08dad3c3-ae96-45c7-82d8-733868caf9bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044215 Aug 04 04:43:18.047114 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2237/4363] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:18.057198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.058175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3fa61a71-3608-4c76-97bb-e93b36304ad4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.068545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.069275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.070451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.071759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.094897 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 HTTP/1.1 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '3fa61a71-3608-4c76-97bb-e93b36304ad4'} Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.096867 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.103444 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.103444 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.103444 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.103444 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:18.103444 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:18.103444 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. Aug 04 04:43:18.103444 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.106804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 3fa61a71-3608-4c76-97bb-e93b36304ad4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:18.107978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-613bb5b8-9970-4920-846a-eabddc6fe135 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4" status: 404 len: 111 microversion: 2.1 time: 0.059356 Aug 04 04:43:18.109356 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2238/4364] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:18 2022] GET /compute/v2.1/servers/3fa61a71-3608-4c76-97bb-e93b36304ad4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:18.120306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.121117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.131149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.132705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.134802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.137078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.164152 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 HTTP/1.1 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'e3126e50-1c58-4a26-85cb-f00febbf1e33'} Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:18.168799 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06634ff0-e9b7-4b59-bcf0-ce89b51b5e83 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 404 len: 111 microversion: 2.1 time: 0.056537 Aug 04 04:43:18.176804 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2239/4365] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:18 2022] DELETE /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:18.185936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.187171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: e3126e50-1c58-4a26-85cb-f00febbf1e33] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.203290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.205075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.206350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.207170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.252036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:18.252417 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 HTTP/1.1 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'e3126e50-1c58-4a26-85cb-f00febbf1e33'} Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.256987 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.261510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.261510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.261510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.261510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:18.261510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:18.261510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. Aug 04 04:43:18.261510 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.263624 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e57944a-28e5-4891-9ddc-6fec281ca623 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.336310 Aug 04 04:43:18.265088 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2127/4366] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:17 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:18.265607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance e3126e50-1c58-4a26-85cb-f00febbf1e33 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:18.266523 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0bd0c7fd-5033-488f-a2e2-e4e185fbc826 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33" status: 404 len: 111 microversion: 2.1 time: 0.090913 Aug 04 04:43:18.267953 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2240/4367] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:18 2022] GET /compute/v2.1/servers/e3126e50-1c58-4a26-85cb-f00febbf1e33 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:18.284226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.286207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.287968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.288739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.295730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.296622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.297631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.298215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.300769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.301515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.305383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.306487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.347410 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 HTTP/1.1 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'c8e291d8-f13d-4d04-9b03-1b21cfe7b894'} Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:18.349533 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.354591 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.356661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:18.358720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dcd5c361-7597-44bf-9baa-7ec88ee78c8b tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 404 len: 111 microversion: 2.1 time: 0.082876 Aug 04 04:43:18.362866 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2128/4368] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:18 2022] DELETE /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:43:18.370643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.372137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.380591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.381390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.382575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.383876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.651594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:18.661237 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-49fdb7c4-5980-4d83-a764-821861db7c7e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.378569 Aug 04 04:43:18.667204 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2241/4369] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:18 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:18.680320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.680596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c8e291d8-f13d-4d04-9b03-1b21cfe7b894] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.694035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.694478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.695297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.695941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.710822 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 HTTP/1.1 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'c8e291d8-f13d-4d04-9b03-1b21cfe7b894'} Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.712920 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.716493 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.716493 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.716493 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.716493 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:18.716493 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:18.716493 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. Aug 04 04:43:18.716493 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.717779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance c8e291d8-f13d-4d04-9b03-1b21cfe7b894 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:18.718811 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56ceb542-4a88-4242-9e6e-5ff3aa6644d5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894" status: 404 len: 111 microversion: 2.1 time: 0.056073 Aug 04 04:43:18.719548 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2242/4370] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:18 2022] GET /compute/v2.1/servers/c8e291d8-f13d-4d04-9b03-1b21cfe7b894 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:18.728061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f7380d87-ff1d-4e08-98cd-537297f61487 req-083a2fc9-820a-49c9-9a41-ec26d720fc1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc87ace5-5bff-42c7-8346-76415313267d", "tag": "b8ad582d-b9c4-4d21-81c0-360cc5580725"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:18.739200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f7380d87-ff1d-4e08-98cd-537297f61487 req-083a2fc9-820a-49c9-9a41-ec26d720fc1a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.739933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f7380d87-ff1d-4e08-98cd-537297f61487 req-083a2fc9-820a-49c9-9a41-ec26d720fc1a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.752474 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f7380d87-ff1d-4e08-98cd-537297f61487 req-083a2fc9-820a-49c9-9a41-ec26d720fc1a service nova] Creating event network-changed:b8ad582d-b9c4-4d21-81c0-360cc5580725 for instance cc87ace5-5bff-42c7-8346-76415313267d on n-h2-851337-5 Aug 04 04:43:18.760009 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f7380d87-ff1d-4e08-98cd-537297f61487 req-083a2fc9-820a-49c9-9a41-ec26d720fc1a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038887 Aug 04 04:43:18.761168 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2243/4371] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:18.767012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cad89ff-f587-40a6-ab40-fa2cd5fa64af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:18.767929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6cad89ff-f587-40a6-ab40-fa2cd5fa64af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 5bfa5c98-76a0-4c78-ae57-ef1631cdbd11] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.774723 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-6cad89ff-f587-40a6-ab40-fa2cd5fa64af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 5bfa5c98-76a0-4c78-ae57-ef1631cdbd11 could not be found. Aug 04 04:43:18.777226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cad89ff-f587-40a6-ab40-fa2cd5fa64af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/5bfa5c98-76a0-4c78-ae57-ef1631cdbd11/action HTTP/1.1 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 13 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: {"pause": {}} Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5bfa5c98-76a0-4c78-ae57-ef1631cdbd11 could not be found. Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5bfa5c98-76a0-4c78-ae57-ef1631cdbd11', 'body': {'pause': {}}} Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfa5c98-76a0-4c78-ae57-ef1631cdbd11 could not be found. Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfa5c98-76a0-4c78-ae57-ef1631cdbd11 could not be found. Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.781790 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.785370 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:18.785370 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:18.785370 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfa5c98-76a0-4c78-ae57-ef1631cdbd11 could not be found. Aug 04 04:43:18.785370 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.787197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cad89ff-f587-40a6-ab40-fa2cd5fa64af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 5bfa5c98-76a0-4c78-ae57-ef1631cdbd11 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:18.787327 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cb279069-f1c0-449c-ab1a-8ba98b4f5eea tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.421211 Aug 04 04:43:18.787931 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2129/4372] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:18 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:18.791791 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6cad89ff-f587-40a6-ab40-fa2cd5fa64af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/5bfa5c98-76a0-4c78-ae57-ef1631cdbd11/action" status: 404 len: 111 microversion: 2.1 time: 0.027005 Aug 04 04:43:18.793309 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2244/4373] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:18 2022] POST /compute/v2.1/servers/5bfa5c98-76a0-4c78-ae57-ef1631cdbd11/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:18.798243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.799539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.807538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.809241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.810046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.810584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.810696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.811486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.817196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.817980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.819013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.819641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.836914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d HTTP/1.1 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3a42991e-15c5-4f6e-ab07-db25663a2f3d'} Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:18.838824 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:18.842438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:18.843939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:18.844987 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c5c97365-2a0e-4914-8716-075e8d630829 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 404 len: 111 microversion: 2.1 time: 0.044856 Aug 04 04:43:18.845984 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2130/4374] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:18 2022] DELETE /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:18.853278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:18.853899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:18.860454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.860986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:18.861838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:18.862443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.305459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:19.315767 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-209d323e-7091-401d-bfbe-fd3a0ffe8e63 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.521115 Aug 04 04:43:19.330796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2245/4375] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:18 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:19.335985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:19.337215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: 3a42991e-15c5-4f6e-ab07-db25663a2f3d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:19.343895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.344866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.345864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.346505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.361328 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d HTTP/1.1 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '3a42991e-15c5-4f6e-ab07-db25663a2f3d'} Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:19.363317 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.367069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.367069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:19.367069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:19.367069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:19.367069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:19.367069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. Aug 04 04:43:19.367069 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.369428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance 3a42991e-15c5-4f6e-ab07-db25663a2f3d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:19.370311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f521d45b-f887-4eb3-81bc-4a508409ec27 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d" status: 404 len: 111 microversion: 2.1 time: 0.038206 Aug 04 04:43:19.370862 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2246/4376] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:19 2022] GET /compute/v2.1/servers/3a42991e-15c5-4f6e-ab07-db25663a2f3d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:19.372743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:19.376432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:19.379400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2bed2e96-e45e-4076-bbac-3e0a58011fd2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:19.380039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2bed2e96-e45e-4076-bbac-3e0a58011fd2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: b2718ff9-cc77-4a75-9491-d3ca98717aa2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:19.381917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ddf13c6-071b-46fd-b65c-8d979d5ebcbe tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.534611 Aug 04 04:43:19.389764 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2bed2e96-e45e-4076-bbac-3e0a58011fd2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2bed2e96-e45e-4076-bbac-3e0a58011fd2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2 HTTP/1.1 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b2718ff9-cc77-4a75-9491-d3ca98717aa2'} Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:19.391678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.395165 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.395165 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:19.395165 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:19.395165 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:19.395165 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:19.395165 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.395165 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.396555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2bed2e96-e45e-4076-bbac-3e0a58011fd2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:19.396880 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2131/4377] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:18 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:19.397740 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2bed2e96-e45e-4076-bbac-3e0a58011fd2 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2" status: 404 len: 111 microversion: 2.1 time: 0.022652 Aug 04 04:43:19.398726 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2247/4378] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:19 2022] DELETE /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:19.407625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:19.408574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:19.410190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd1cd76a-bca9-4282-8e3a-3263220838b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:19.411030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd1cd76a-bca9-4282-8e3a-3263220838b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: b2718ff9-cc77-4a75-9491-d3ca98717aa2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:19.419198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.419918 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-dd1cd76a-bca9-4282-8e3a-3263220838b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.420294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.421305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.422184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd1cd76a-bca9-4282-8e3a-3263220838b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2 HTTP/1.1 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b2718ff9-cc77-4a75-9491-d3ca98717aa2'} Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:19.422720 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:19.426569 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:19.426569 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:19.426569 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:19.426569 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. Aug 04 04:43:19.426569 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:19.426569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd1cd76a-bca9-4282-8e3a-3263220838b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance b2718ff9-cc77-4a75-9491-d3ca98717aa2 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:19.426569 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd1cd76a-bca9-4282-8e3a-3263220838b5 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2" status: 404 len: 111 microversion: 2.1 time: 0.019334 Aug 04 04:43:19.431392 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2248/4379] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:19 2022] GET /compute/v2.1/servers/b2718ff9-cc77-4a75-9491-d3ca98717aa2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:43:19.447042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:19.448021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:19.460232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:19.462433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.462996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.464281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.464742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.497649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:43:19.514512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:19.610676 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8e77997-d6fc-4d1e-8716-c4beb1cede58 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 204 len: 0 microversion: 2.1 time: 0.177699 Aug 04 04:43:19.615111 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2249/4380] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:19 2022] DELETE /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:43:19.632459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:19.633425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:19.642757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.643196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.644490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.645184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.881105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:19.889508 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6c4a0d0-7317-4de3-9350-7b8761353f36 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.487159 Aug 04 04:43:19.890584 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2132/4381] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:19 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:19.898172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:19.899144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:19.909238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.909796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:19.910695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:19.911355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:20.146425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:20.156969 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43c0d5a8-0bae-44cc-8f13-08a8a0439ae9 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1479 microversion: 2.1 time: 0.539812 Aug 04 04:43:20.157690 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2250/4382] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:19 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1479 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:20.170296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c1054c8-3d4b-40c8-b20b-8e1b44496345 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:20.171493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c1054c8-3d4b-40c8-b20b-8e1b44496345 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:20.184483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c1054c8-3d4b-40c8-b20b-8e1b44496345 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:20.185440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c1054c8-3d4b-40c8-b20b-8e1b44496345 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:20.187053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c1054c8-3d4b-40c8-b20b-8e1b44496345 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:20.189585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c1054c8-3d4b-40c8-b20b-8e1b44496345 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:20.229718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:20.290594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:20.307698 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c1054c8-3d4b-40c8-b20b-8e1b44496345 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 202 len: 0 microversion: 2.1 time: 0.148017 Aug 04 04:43:20.308806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2251/4383] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:20 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:43:20.315094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:20.318772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:20.319585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:20.327808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5bde6e5-0c6f-4c46-8e5b-877e28b958b0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.435800 Aug 04 04:43:20.328592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:20.329078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:20.329558 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2133/4384] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:19 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:20.330251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:20.330784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:20.348478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:20.349501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:20.360657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:20.361491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:20.362421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:20.363175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:20.667806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:20.671669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:20.679981 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14d5b43a-760e-49d3-b195-6640c76082c8 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.345899 Aug 04 04:43:20.680587 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2134/4385] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:20 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:20.687886 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f729d72b-5359-480e-9a64-36098660868a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1510 microversion: 2.1 time: 0.374432 Aug 04 04:43:20.688698 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2252/4386] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:20 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:21.182504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:21.183173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:21.190163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:21.190614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:21.191425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:21.191861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:21.349512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:21.350122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:21.357226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:21.357998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:21.358999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:21.359636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:21.497115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:21.513454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-baf5fca9-acb9-4a8f-9b3f-45e4b8380e19 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1479 microversion: 2.1 time: 0.335368 Aug 04 04:43:21.514998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2253/4387] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:21 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1479 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:21.701020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:21.708388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:21.717055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:21.717654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:21.718508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:21.719042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.216514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:22.228764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8018a5d8-7a5d-4ae5-b4d6-66f90679c977 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.882410 Aug 04 04:43:22.229514 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2135/4388] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:21 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:22.235481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:22.236487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:22.249675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.250403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.251427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.254587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.461902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:22.472008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8f46910-3f55-436d-9db0-d51f1efaaa0c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.775077 Aug 04 04:43:22.472608 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2254/4389] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:21 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:22.535619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:22.536602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:22.544130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.544585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.546313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.546944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.686985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:22.703468 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7656f5ed-a076-4b08-93d5-c74b9dc73d63 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1490 microversion: 2.1 time: 0.472347 Aug 04 04:43:22.707387 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2136/4390] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:22 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1490 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:22.728557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:22.730376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:22.738604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.739493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.741648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.742403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.780752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Cannot 'pause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state paused Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action HTTP/1.1 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 13 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: {"pause": {}} Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: exception: Cannot 'pause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state paused Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'pause': {}}} Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 in vm_state paused. Cannot pause while the instance is in this state. Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state paused Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:22.783741 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:22.788683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:22.788683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:22.788683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:22.788683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state paused Aug 04 04:43:22.788683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:22.790336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 409 to user: Cannot 'pause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state paused {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:22.792365 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c1b5be67-3144-4e5d-a624-179f6ae394e6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 409 len: 143 microversion: 2.1 time: 0.068554 Aug 04 04:43:22.797560 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2137/4391] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:22 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 143 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 04:43:22.805901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cb693d08-25ed-4eda-908a-fa8c2c001af3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:22.806726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cb693d08-25ed-4eda-908a-fa8c2c001af3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:22.815135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb693d08-25ed-4eda-908a-fa8c2c001af3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.815945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb693d08-25ed-4eda-908a-fa8c2c001af3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.817600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb693d08-25ed-4eda-908a-fa8c2c001af3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.818290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cb693d08-25ed-4eda-908a-fa8c2c001af3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.918133 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cb693d08-25ed-4eda-908a-fa8c2c001af3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 202 len: 0 microversion: 2.1 time: 0.118006 Aug 04 04:43:22.918862 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2138/4392] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:22 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:43:22.932425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:22.934402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:22.935981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:22.946030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.946614 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77ad8a04-2a06-4604-8105-5d35d0d52d3f tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1479 microversion: 2.1 time: 0.414774 Aug 04 04:43:22.946740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.947583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:22.948240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:22.962450 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2255/4393] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:22 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1479 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:23.251825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:23.252865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:23.265191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:23.266630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:23.269025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:23.269928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:23.589481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:23.604869 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e0df2b3-4fe5-403f-85db-541108d6c6bf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1497 microversion: 2.1 time: 0.677608 Aug 04 04:43:23.605806 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2139/4394] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:22 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1497 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:23.629280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-344e39a6-1d8d-497d-bf7e-4cf17becd139 req-df67dadf-eed9-4562-a16b-5ce805279ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2da970f-9222-4cef-89a6-0920cd4378d0", "name": "network-vif-deleted", "tag": "86d1a786-3553-434e-82af-0c6c7fbded9f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:23.668134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-344e39a6-1d8d-497d-bf7e-4cf17becd139 req-df67dadf-eed9-4562-a16b-5ce805279ea5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:23.668785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-344e39a6-1d8d-497d-bf7e-4cf17becd139 req-df67dadf-eed9-4562-a16b-5ce805279ea5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:23.696334 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-344e39a6-1d8d-497d-bf7e-4cf17becd139 req-df67dadf-eed9-4562-a16b-5ce805279ea5 service nova] Creating event network-vif-deleted:86d1a786-3553-434e-82af-0c6c7fbded9f for instance c2da970f-9222-4cef-89a6-0920cd4378d0 on n-h2-851337-5 Aug 04 04:43:23.705674 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-344e39a6-1d8d-497d-bf7e-4cf17becd139 req-df67dadf-eed9-4562-a16b-5ce805279ea5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098366 Aug 04 04:43:23.706610 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2140/4395] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:23.711825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:23.714625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:23.732503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:23.733190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:23.734128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:23.734715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:23.859476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:23.878943 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27730903-6500-4a1b-b521-eae72b7f4e6b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.632250 Aug 04 04:43:23.887793 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2256/4396] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:23 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:23.974293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:23.975048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:23.988180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:23.989014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:23.990173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:23.996832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:24.065982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:24.066596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:24.067209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lazy-loading 'fault' on Instance uuid c2da970f-9222-4cef-89a6-0920cd4378d0 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:43:24.138755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01894b2212e04421934b244df3485a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79092f807f9a42b19d2c90d9e806764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:24.144722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:24.147720 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9dbb7001-9cbf-4eb9-9b16-e91503bc6c43 tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 200 len: 1282 microversion: 2.1 time: 0.176717 Aug 04 04:43:24.152459 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2257/4397] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:23 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 1282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:24.158945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76cd8073-78ff-4887-a496-a081c8dd5787 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.451007 Aug 04 04:43:24.159958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2141/4398] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:23 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:24.631105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:24.631970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:24.640375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:24.640834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:24.641616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:24.642052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:24.910769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:24.911491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:24.916264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:24.937629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d77bf904-358a-437f-a717-8c7433cd4f7f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.307435 Aug 04 04:43:24.943515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:24.944861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:24.947121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:24.952681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:24.955714 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2258/4399] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:24 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:24.964459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:24.965669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:24.975360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:24.977355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:24.978472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:24.979221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.389559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:25.405100 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4c7daa7b-7328-4557-ad32-a52da1fe132b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.448027 Aug 04 04:43:25.409170 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2259/4400] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:24 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:25.433521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:25.434147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] [instance: c2da970f-9222-4cef-89a6-0920cd4378d0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:25.441458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.442154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.443803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.444970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.462173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] HTTP exception thrown: Instance c2da970f-9222-4cef-89a6-0920cd4378d0 could not be found. Aug 04 04:43:25.472670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Request method failure captured: Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 HTTP/1.1 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi601UWqdiqeN_qkVqQ2nzY3ctt0u3jpkUt4q05v7c8LJTTf9iPqjRc3w-EVH0r3xEsxSw0SgIS5n1dAgMx0UDAyp5rejvv10c8wgrhLY5xEFIVgE76yL_wKDUZdGA1MYMQL3uQGXM7_W3ulBZRI_gHtJEdIBZeObLLeeH3s0Soha0Zv4 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79092f807f9a42b19d2c90d9e806764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79092f807f9a42b19d2c90d9e806764b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestJSON-1631474133 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 79092f807f9a42b19d2c90d9e806764b Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestJSON-1631474133 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 01894b2212e04421934b244df3485a27 Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestJSON-1631474133-project Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance c2da970f-9222-4cef-89a6-0920cd4378d0 could not be found. Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'c2da970f-9222-4cef-89a6-0920cd4378d0'} Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2da970f-9222-4cef-89a6-0920cd4378d0 could not be found. Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2da970f-9222-4cef-89a6-0920cd4378d0 could not be found. Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:25.474007 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.478115 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:25.478115 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:25.478115 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:25.478115 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:25.478115 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:25.478115 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2da970f-9222-4cef-89a6-0920cd4378d0 could not be found. Aug 04 04:43:25.478115 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.480062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] Returning 404 to user: Instance c2da970f-9222-4cef-89a6-0920cd4378d0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:25.481398 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-79fda716-e533-4937-b3e6-bc95241479db tempest-ServersTestJSON-1631474133 tempest-ServersTestJSON-1631474133-project] 10.222.0.69 "GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0" status: 404 len: 111 microversion: 2.1 time: 0.070915 Aug 04 04:43:25.482580 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2260/4401] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:25 2022] GET /compute/v2.1/servers/c2da970f-9222-4cef-89a6-0920cd4378d0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:25.499501 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b28f7735-aa56-4d92-a37e-abf06a1faf42 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.579482 Aug 04 04:43:25.499501 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2142/4402] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:24 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:25.500533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:25.501211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:25.508493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:25.513943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:25.516002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.516696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.517669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.519195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.523928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:25.536286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.540113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.541228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.542224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.561135 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d/action HTTP/1.1 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 28 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: {"reboot": {"type": "SOFT"}} Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '7794d0ad-cbee-4a0d-87fd-7c231567bc5d', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:25.563718 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:25.567239 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:25.570139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:25.571477 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8aed300a-b2bc-41a7-a46b-440002607e73 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d/action" status: 404 len: 111 microversion: 2.1 time: 0.068627 Aug 04 04:43:25.572985 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2261/4403] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:25 2022] POST /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:25.581086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:25.581742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:25.589342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.590101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:25.590917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:25.591396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:26.470456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:26.474781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:26.485391 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-297bcf05-0bdb-424f-8442-c79ebf355669 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.908144 Aug 04 04:43:26.489098 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7bf7f0aa-c1e8-43e4-a552-50195603e05d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.997638 Aug 04 04:43:26.491291 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2143/4404] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:25 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:26.492947 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2262/4405] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:25 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:26.518212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:26.519286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:26.528335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:26.528982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:26.529685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:26.530298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:26.530853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:26.531439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:26.543440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:26.543610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:26.544306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:26.544899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:26.919833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:26.936701 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab939f67-82f2-40e6-97ce-ef23bb802282 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.424657 Aug 04 04:43:26.938161 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2144/4406] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:26 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:26.969858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:26.978047 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c06278d3-dd28-4630-a393-7f3e1c94869b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.451916 Aug 04 04:43:26.991476 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2263/4407] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:26 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:27.002035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffb581a4-1f3f-4941-a5cd-a2a3457261f7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:27.004714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ffb581a4-1f3f-4941-a5cd-a2a3457261f7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: cbcd4675-0e66-454a-a734-2210537f782c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:27.011643 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ffb581a4-1f3f-4941-a5cd-a2a3457261f7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance cbcd4675-0e66-454a-a734-2210537f782c could not be found. Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffb581a4-1f3f-4941-a5cd-a2a3457261f7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/cbcd4675-0e66-454a-a734-2210537f782c/action HTTP/1.1 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 28 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: {"reboot": {"type": "SOFT"}} Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance cbcd4675-0e66-454a-a734-2210537f782c could not be found. Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'cbcd4675-0e66-454a-a734-2210537f782c', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcd4675-0e66-454a-a734-2210537f782c could not be found. Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcd4675-0e66-454a-a734-2210537f782c could not be found. Aug 04 04:43:27.013818 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcd4675-0e66-454a-a734-2210537f782c could not be found. Aug 04 04:43:27.018077 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.019756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ffb581a4-1f3f-4941-a5cd-a2a3457261f7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance cbcd4675-0e66-454a-a734-2210537f782c could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:27.020944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ffb581a4-1f3f-4941-a5cd-a2a3457261f7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/cbcd4675-0e66-454a-a734-2210537f782c/action" status: 404 len: 111 microversion: 2.1 time: 0.025237 Aug 04 04:43:27.030677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:27.031333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:27.036260 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2145/4408] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:26 2022] POST /compute/v2.1/servers/cbcd4675-0e66-454a-a734-2210537f782c/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:27.038727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.039725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.040582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.041030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.286945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:27.303035 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b443806e-769d-498a-982d-a3ec0a6ab38a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.274782 Aug 04 04:43:27.319051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2264/4409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:27 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:27.327325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:27.328195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:27.343914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.345078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.346066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.347369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.520156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:27.521610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:27.528422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.529217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.530276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.530930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.657779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:27.673313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a15de5c-8543-44e9-a460-75d159b5e808 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.349641 Aug 04 04:43:27.675674 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2146/4410] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:27 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:27.697292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:27.705342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:27.730241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.731173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.732431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.733236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.749320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d/action HTTP/1.1 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 65 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '7794d0ad-cbee-4a0d-87fd-7c231567bc5d', 'body': {'rebuild': {'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0'}}} Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 04:43:27.751372 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:43:27.754895 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:27.757265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:27.758383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a722d75-220a-4269-a765-b392fd7a7c1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d/action" status: 404 len: 111 microversion: 2.1 time: 0.065137 Aug 04 04:43:27.759557 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2147/4411] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:27 2022] POST /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:43:27.767712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:27.768865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:27.776071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.777149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.778170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.778838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:27.784987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:27.796578 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8733772b-67c1-4989-a451-2c45db4e854b tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.280470 Aug 04 04:43:27.801236 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2265/4412] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:27 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:27.963431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:27.964557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:27.998308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:27.999743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.003286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.004315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.040524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:28.061765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03d8b9b4-556f-4a21-8e20-ddcd0907859e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.298033 Aug 04 04:43:28.064130 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2148/4413] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:27 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:28.085160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:28.087425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:28.095371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.096084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.097152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.097884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.293995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:28.305325 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c6642c6b-72ac-4471-ba72-2ab86475bcab tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.350046 Aug 04 04:43:28.306119 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2266/4414] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:27 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:28.409729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:28.418939 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-33a7ebc5-00f2-4e63-bdca-a560974e6231 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.338388 Aug 04 04:43:28.424931 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2149/4415] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:28 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:28.447302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01c71129-f8c9-4722-91c2-04e1769d2f85 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:28.450258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01c71129-f8c9-4722-91c2-04e1769d2f85 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:28.456286 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-01c71129-f8c9-4722-91c2-04e1769d2f85 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb could not be found. Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01c71129-f8c9-4722-91c2-04e1769d2f85 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb/action HTTP/1.1 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 65 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb could not be found. Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb', 'body': {'rebuild': {'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0'}}} Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb could not be found. Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 04:43:28.457979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb could not be found. Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb could not be found. Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01c71129-f8c9-4722-91c2-04e1769d2f85 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01c71129-f8c9-4722-91c2-04e1769d2f85 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb/action" status: 404 len: 111 microversion: 2.1 time: 0.017247 Aug 04 04:43:28.461863 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2267/4416] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:28 2022] POST /compute/v2.1/servers/960a5ec0-c55f-4cfb-8ff1-7df3cbe4adbb/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:28.469219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:28.470045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:28.476844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.477441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.478332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.479308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.503541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:28.767602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:28.779248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a1066a4-5e09-4e85-b4be-718508dbefd4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.314650 Aug 04 04:43:28.783035 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2150/4417] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:28 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:28.807655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:28.808276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:28.827769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.828240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.830137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.831813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:28.832772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.836803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:28.857213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:28.873540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.874344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:28.875508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:28.878074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:29.348432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:29.376092 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-59dcb0ae-b044-474b-b66a-f08900709429 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.570352 Aug 04 04:43:29.377394 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2268/4418] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:28 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:29.391805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:29.391805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:29.421284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:29.421756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:29.422572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:29.423037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:29.423792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:29.437669 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f5d633b2-b06e-49a0-91b6-910ff1b40a0a tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.617186 Aug 04 04:43:29.443089 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2151/4419] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:28 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:29.454492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02bc578f-d240-4ae5-a038-bdfb0e1f5b6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:29.455486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02bc578f-d240-4ae5-a038-bdfb0e1f5b6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 70d2dd64-8183-434d-a12b-bdc3ca7ee053] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:29.472223 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-02bc578f-d240-4ae5-a038-bdfb0e1f5b6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 70d2dd64-8183-434d-a12b-bdc3ca7ee053 could not be found. Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02bc578f-d240-4ae5-a038-bdfb0e1f5b6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/70d2dd64-8183-434d-a12b-bdc3ca7ee053/action HTTP/1.1 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 15 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: {"restore": {}} Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 70d2dd64-8183-434d-a12b-bdc3ca7ee053 could not be found. Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '70d2dd64-8183-434d-a12b-bdc3ca7ee053', 'body': {'restore': {}}} Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d2dd64-8183-434d-a12b-bdc3ca7ee053 could not be found. Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d2dd64-8183-434d-a12b-bdc3ca7ee053 could not be found. Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:29.478156 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:29.482836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:29.482836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:29.482836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d2dd64-8183-434d-a12b-bdc3ca7ee053 could not be found. Aug 04 04:43:29.482836 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:29.486587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02bc578f-d240-4ae5-a038-bdfb0e1f5b6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 70d2dd64-8183-434d-a12b-bdc3ca7ee053 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:29.490528 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02bc578f-d240-4ae5-a038-bdfb0e1f5b6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/70d2dd64-8183-434d-a12b-bdc3ca7ee053/action" status: 404 len: 111 microversion: 2.1 time: 0.046041 Aug 04 04:43:29.496832 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2152/4420] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:29 2022] POST /compute/v2.1/servers/70d2dd64-8183-434d-a12b-bdc3ca7ee053/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:29.505138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:29.505966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:29.515079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:29.521948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:29.523073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:29.524623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:30.069887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:30.082311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ac8018ce-7f0c-4daa-99ce-fee992d3a276 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.703706 Aug 04 04:43:30.088679 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2269/4421] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:29 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:30.099071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-311fde6a-c23d-46d4-8279-b91f49b9ca42 req-06cb7a30-8619-4168-ad4a-fcf9963b1a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "name": "network-vif-plugged", "status": "completed", "tag": "8f5fa943-bd3e-421e-b952-349fdcbd8ed7"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:30.120975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-311fde6a-c23d-46d4-8279-b91f49b9ca42 req-06cb7a30-8619-4168-ad4a-fcf9963b1a69 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:30.121782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-311fde6a-c23d-46d4-8279-b91f49b9ca42 req-06cb7a30-8619-4168-ad4a-fcf9963b1a69 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:30.151606 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-311fde6a-c23d-46d4-8279-b91f49b9ca42 req-06cb7a30-8619-4168-ad4a-fcf9963b1a69 service nova] Creating event network-vif-plugged:8f5fa943-bd3e-421e-b952-349fdcbd8ed7 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:30.164469 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-311fde6a-c23d-46d4-8279-b91f49b9ca42 req-06cb7a30-8619-4168-ad4a-fcf9963b1a69 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074148 Aug 04 04:43:30.168565 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2270/4422] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:30.185172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:30.209228 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1527895-b50f-4046-bb7f-be1d7c680563 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.708165 Aug 04 04:43:30.228383 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2153/4423] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:29 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:30.237135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:30.238099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:30.250850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:30.254134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:30.255830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:30.257185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:30.271929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:30.462348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:30.463306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:30.475934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:30.479521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:30.480467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:30.483302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:31.417847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:31.435368 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6aeb294d-d00c-4b63-a10b-439f56369b27 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 1.202318 Aug 04 04:43:31.451625 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2271/4424] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:30 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:31.464185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:31.464944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:31.473693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:31.474351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:31.483645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:31.484942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:31.515647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:31.526266 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a0e5d96-6b0c-41b9-a548-6a06d4571fc1 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 1.070671 Aug 04 04:43:31.528251 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2154/4425] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:30 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:31.727887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1094480150", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:31.796111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] validate_networks() for [('9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:43:32.020594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:32.037476 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4c315094-f374-4e4c-822e-b0bfd308be36 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.583673 Aug 04 04:43:32.042819 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2272/4426] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:31 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:32.049349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:32.050341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:32.058776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:32.059583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:32.060781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:32.061647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:32.099406 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Cannot 'restore' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action HTTP/1.1 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 15 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: {"restore": {}} Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'restore' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'restore': {}}} Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 in vm_state active. Cannot restore while the instance is in this state. Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:32.102414 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:32.106212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:32.106212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:32.106212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:32.106212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:32.106212 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:32.107988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 409 to user: Cannot 'restore' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:32.109110 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65ae7120-5a28-458c-a6be-ede7ad927bbb tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 409 len: 145 microversion: 2.1 time: 0.064246 Aug 04 04:43:32.110374 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2273/4427] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:32 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 145 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:43:32.120486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:32.121160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:32.128126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:32.128760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:32.129556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:32.130678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:32.598750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:32.624701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-edce99f1-bc71-43a1-9045-e014c2337bc3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.505492 Aug 04 04:43:32.628557 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2274/4428] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:32 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:32.636847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d39d985b-5daa-4fd2-a134-7596551b37d4 req-fd79bb79-7ade-4004-a8e8-7df37dde82a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "name": "network-vif-plugged", "status": "completed", "tag": "5e28c7ff-bffc-411b-b9e6-4aaa962da826"}, {"server_uuid": "cc87ace5-5bff-42c7-8346-76415313267d", "name": "network-vif-plugged", "status": "completed", "tag": "b8ad582d-b9c4-4d21-81c0-360cc5580725"}, {"server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "name": "network-vif-plugged", "status": "completed", "tag": "5fe9fa0d-745c-4180-a6e5-1b72e9df3a84"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:32.650504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d39d985b-5daa-4fd2-a134-7596551b37d4 req-fd79bb79-7ade-4004-a8e8-7df37dde82a2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:32.651132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d39d985b-5daa-4fd2-a134-7596551b37d4 req-fd79bb79-7ade-4004-a8e8-7df37dde82a2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:32.680205 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d39d985b-5daa-4fd2-a134-7596551b37d4 req-fd79bb79-7ade-4004-a8e8-7df37dde82a2 service nova] Creating event network-vif-plugged:5e28c7ff-bffc-411b-b9e6-4aaa962da826 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:32.680853 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d39d985b-5daa-4fd2-a134-7596551b37d4 req-fd79bb79-7ade-4004-a8e8-7df37dde82a2 service nova] Creating event network-vif-plugged:b8ad582d-b9c4-4d21-81c0-360cc5580725 for instance cc87ace5-5bff-42c7-8346-76415313267d on n-h2-851337-5 Aug 04 04:43:32.681591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d39d985b-5daa-4fd2-a134-7596551b37d4 req-fd79bb79-7ade-4004-a8e8-7df37dde82a2 service nova] Creating event network-vif-plugged:5fe9fa0d-745c-4180-a6e5-1b72e9df3a84 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:32.699227 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d39d985b-5daa-4fd2-a134-7596551b37d4 req-fd79bb79-7ade-4004-a8e8-7df37dde82a2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.069191 Aug 04 04:43:32.699850 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2275/4429] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:32.730880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:32.731695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:32.760974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:32.764161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:32.765032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:32.765506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:33.151909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:43:33.153007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:43:33.153654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:43:33.154274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:43:33.154881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:43:33.174680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:33.175417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:33.176463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:33.177223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:33.218500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:43:33.237725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for user 0e04770e8fd84cff82e73ffd27b8a50a and project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:43:33.263214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:43:33.266117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:43:33.277396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:33.291621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3761158d-9afe-449f-8e66-55517130b47c tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.587686 Aug 04 04:43:33.293638 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2276/4430] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:32 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:33.302712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:33.310252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:33.330308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:33.331118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:33.332117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:33.332761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:33.408567 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-047fa581-eb0e-4afd-8833-e1a20a65909a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878958 Aug 04 04:43:33.415495 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2155/4431] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:43:33.420976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:33.421807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:33.430372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:33.443235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:33.444270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:33.444752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:33.907462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:33.919080 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c783a50c-593e-4dab-9e74-98085e79d5f3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.621428 Aug 04 04:43:33.934276 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2277/4432] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:33 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:33.946794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04552a1a-3cf6-4672-a2d5-17266971eb36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:33.946794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-04552a1a-3cf6-4672-a2d5-17266971eb36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:34.018911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:34.034842 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a997c6d1-03c7-4389-951f-91d973cd960f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1354 microversion: 2.1 time: 0.617446 Aug 04 04:43:34.038582 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2156/4433] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:33 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1354 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:34.057391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-04552a1a-3cf6-4672-a2d5-17266971eb36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:34.059456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f535a21b-fba3-4d9e-8b1b-00da06c0a7aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:34.064438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f535a21b-fba3-4d9e-8b1b-00da06c0a7aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: df4d8351-8110-41ed-8d60-fa50d088a48a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:34.068392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-04552a1a-3cf6-4672-a2d5-17266971eb36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1215 microversion: 2.1 time: 0.132665 Aug 04 04:43:34.069545 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2278/4434] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:33 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:34.079613 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-f535a21b-fba3-4d9e-8b1b-00da06c0a7aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance df4d8351-8110-41ed-8d60-fa50d088a48a could not be found. Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f535a21b-fba3-4d9e-8b1b-00da06c0a7aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/df4d8351-8110-41ed-8d60-fa50d088a48a/action HTTP/1.1 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 14 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: {"resume": {}} Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance df4d8351-8110-41ed-8d60-fa50d088a48a could not be found. Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'df4d8351-8110-41ed-8d60-fa50d088a48a', 'body': {'resume': {}}} Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4d8351-8110-41ed-8d60-fa50d088a48a could not be found. Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4d8351-8110-41ed-8d60-fa50d088a48a could not be found. Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:34.097200 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:34.104838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:34.104838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:34.104838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4d8351-8110-41ed-8d60-fa50d088a48a could not be found. Aug 04 04:43:34.104838 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:34.114052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f535a21b-fba3-4d9e-8b1b-00da06c0a7aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance df4d8351-8110-41ed-8d60-fa50d088a48a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:34.116198 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f535a21b-fba3-4d9e-8b1b-00da06c0a7aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/df4d8351-8110-41ed-8d60-fa50d088a48a/action" status: 404 len: 111 microversion: 2.1 time: 0.075326 Aug 04 04:43:34.119184 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2157/4435] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:34 2022] POST /compute/v2.1/servers/df4d8351-8110-41ed-8d60-fa50d088a48a/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:34.138579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:34.139490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:34.154237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:34.154934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:34.155962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:34.157130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:34.336995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:34.338836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:34.358845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:34.359593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:34.360490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:34.364016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:34.761277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:34.770877 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c2804aa8-ae52-4ea9-8afb-a8ce43be7782 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.646963 Aug 04 04:43:34.772378 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2279/4436] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:34 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:34.796660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:34.797673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:34.806975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:34.807928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:34.809034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:34.809640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:35.083575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:35.097200 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c8f4a80-c391-4ffe-aba5-a37f95265ebd tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1324 microversion: 2.1 time: 0.783353 Aug 04 04:43:35.107459 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2158/4437] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:34 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1324 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:35.107459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:35.107459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:35.116435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:35.117456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:35.118475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:35.119149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:35.264639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:35.283106 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9aa4f6cf-fa1c-4301-a966-1fee32b10790 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.490176 Aug 04 04:43:35.295414 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2280/4438] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:34 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:35.303440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:35.304796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:35.311205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:35.311897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:35.312824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:35.313406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:35.967585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:35.977030 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0dabf4b5-4a55-4957-bf0c-b5e03ae8c1b0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1267 microversion: 2.1 time: 0.680244 Aug 04 04:43:35.978839 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2281/4439] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:35 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1267 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:35.985187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:35.986019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:35.994259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:35.995086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:35.997083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:35.997696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.026661 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Cannot 'resume' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action HTTP/1.1 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 14 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: {"resume": {}} Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'resume' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'resume': {}}} Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 in vm_state active. Cannot resume while the instance is in this state. Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:36.028643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:36.032554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:36.032554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:36.032554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:36.032554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:43:36.032554 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:36.033656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 409 to user: Cannot 'resume' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:36.034689 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2945bcfd-5ae5-4e59-88b3-ad9c57180eb7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 409 len: 144 microversion: 2.1 time: 0.054559 Aug 04 04:43:36.035797 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2282/4440] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:35 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 144 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:43:36.045534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:36.046149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:36.053921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.054774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.055729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.056161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.262609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:36.275835 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1aceb3f-9070-4eec-86bd-c5c718eb9621 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1804 microversion: 2.1 time: 1.176588 Aug 04 04:43:36.292800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2159/4441] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:35 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1804 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:36.302766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:36.303754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:36.310818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.311750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.312735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.313855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.396883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:36.415407 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2add04b6-dfbf-46dc-876c-81e3e8b8f78d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.373924 Aug 04 04:43:36.416008 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2283/4442] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:36 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:36.421763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-14a18914-5c0f-470a-b765-9da87e555ecf tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:36.421763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-14a18914-5c0f-470a-b765-9da87e555ecf tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:36.437134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a18914-5c0f-470a-b765-9da87e555ecf tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.437587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a18914-5c0f-470a-b765-9da87e555ecf tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.438394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a18914-5c0f-470a-b765-9da87e555ecf tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.438843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-14a18914-5c0f-470a-b765-9da87e555ecf tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.501852 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-14a18914-5c0f-470a-b765-9da87e555ecf tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0/ips" status: 200 len: 218 microversion: 2.1 time: 0.081675 Aug 04 04:43:36.511084 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2284/4443] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:43:36 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0/ips => generated 218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:36.516992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:36.517621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:36.524829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.525288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.527247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.527874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.625252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:36.634568 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2db9998-d29f-4cca-b761-dfa4449ce427 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1520 microversion: 2.1 time: 0.340587 Aug 04 04:43:36.655662 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2160/4444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:36 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:36.666892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:36.667708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:36.676229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.676868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.677878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.678611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.730893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:43:36.827920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:36.840854 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-363a237c-5864-4ec9-95b9-8b621bce3ddb tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "DELETE /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 204 len: 0 microversion: 2.1 time: 0.181654 Aug 04 04:43:36.842922 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2161/4445] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:36 2022] DELETE /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:43:36.845366 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-556d1702-a822-405b-a51b-3969e47c6d16 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.332040 Aug 04 04:43:36.850307 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2285/4446] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:36 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:36.863810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:36.864882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:36.866861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:36.867557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:36.876336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.885088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.885854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.886374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.888812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.889594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.895549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:36.896064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:36.998511 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] HTTP exception thrown: Action 999 not found Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Request method failure captured: Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d/os-instance-actions/999 HTTP/1.1 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605a0lyTSSeZBwOBOCNnD5vJpsjWDUFP5Y1DbRsapzflGy9x0bbeNZT_2mLAjx4vPGamOBB694HgLcyQItH0BFqZMlkbJ_5QL3TBAJJAIfH4YMxWS4NY4F8mzC9ThN_2mSaMmLiXf8O-DLtHOmKsvEtTLGEaZxMddk_ksT0E_-u6wPE Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 75f2bc0977a34dc9b7777a08cd275900 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_75f2bc0977a34dc9b7777a08cd275900", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 75f2bc0977a34dc9b7777a08cd275900 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-InstanceActionsNegativeTestJSON-346984208-project Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f89fcfd69c6844c293e36909ec0722c9 Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-346984208-project Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: exception: Action 999 not found Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'server_id': 'cc87ace5-5bff-42c7-8346-76415313267d', 'id': '999'} Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 04 04:43:37.019166 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.038551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Returning 404 to user: Action 999 not found {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:37.040090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2185fd3e-3c40-4974-a552-eeec794a3642 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.194979 Aug 04 04:43:37.041166 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2162/4447] 10.222.0.69 () {58 vars in 1308 bytes} [Thu Aug 4 04:43:36 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d/os-instance-actions/999 => generated 66 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:43:37.051844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:37.052571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:37.074062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.076037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:37.079258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.080893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:37.514380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:37.524311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c485617b-fb8d-414d-8c6b-d001e96e4a2d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1810 microversion: 2.1 time: 0.671431 Aug 04 04:43:37.527498 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2286/4448] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:36 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1810 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:37.536860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82cc68ff-c1cc-464a-a292-c4c6f3177c16 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '.version_select at 0x7f19195b6dc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:37.537538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-82cc68ff-c1cc-464a-a292-c4c6f3177c16 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: 19749e8e-ac9b-48f6-b87a-4b6eeedb86a0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:37.548170 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-82cc68ff-c1cc-464a-a292-c4c6f3177c16 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] HTTP exception thrown: Instance 19749e8e-ac9b-48f6-b87a-4b6eeedb86a0 could not be found. Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82cc68ff-c1cc-464a-a292-c4c6f3177c16 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Request method failure captured: Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/19749e8e-ac9b-48f6-b87a-4b6eeedb86a0/os-instance-actions HTTP/1.1 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605a0lyTSSeZBwOBOCNnD5vJpsjWDUFP5Y1DbRsapzflGy9x0bbeNZT_2mLAjx4vPGamOBB694HgLcyQItH0BFqZMlkbJ_5QL3TBAJJAIfH4YMxWS4NY4F8mzC9ThN_2mSaMmLiXf8O-DLtHOmKsvEtTLGEaZxMddk_ksT0E_-u6wPE Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 75f2bc0977a34dc9b7777a08cd275900 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_75f2bc0977a34dc9b7777a08cd275900", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 75f2bc0977a34dc9b7777a08cd275900 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-InstanceActionsNegativeTestJSON-346984208-project Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f89fcfd69c6844c293e36909ec0722c9 Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-346984208-project Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 19749e8e-ac9b-48f6-b87a-4b6eeedb86a0 could not be found. Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '19749e8e-ac9b-48f6-b87a-4b6eeedb86a0'} Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19749e8e-ac9b-48f6-b87a-4b6eeedb86a0 could not be found. Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:37.553405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19749e8e-ac9b-48f6-b87a-4b6eeedb86a0 could not be found. Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19749e8e-ac9b-48f6-b87a-4b6eeedb86a0 could not be found. Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.557952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82cc68ff-c1cc-464a-a292-c4c6f3177c16 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Returning 404 to user: Instance 19749e8e-ac9b-48f6-b87a-4b6eeedb86a0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:37.559463 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-82cc68ff-c1cc-464a-a292-c4c6f3177c16 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/19749e8e-ac9b-48f6-b87a-4b6eeedb86a0/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030069 Aug 04 04:43:37.560280 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2287/4449] 10.222.0.69 () {58 vars in 1296 bytes} [Thu Aug 4 04:43:37 2022] GET /compute/v2.1/servers/19749e8e-ac9b-48f6-b87a-4b6eeedb86a0/os-instance-actions => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:37.565752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b50c6065-01d7-4403-abe8-68a32e16a863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b50c6065-01d7-4403-abe8-68a32e16a863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 160 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "85c40f96-139b-4f20-8c81-0af600a45095"}]}} Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': '', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'networks': [{'uuid': '85c40f96-139b-4f20-8c81-0af600a45095'}]}}} Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '' Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:43:37.572123 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b50c6065-01d7-4403-abe8-68a32e16a863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:37.575812 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b50c6065-01d7-4403-abe8-68a32e16a863 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.012386 Aug 04 04:43:37.579400 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2288/4450] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:37 2022] POST /compute/v2.1/servers => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:43:37.584574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:37.585080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:37.593068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.593522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:37.594472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.594911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:37.621512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:37.635315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:43:37.636252 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3681c774-1a0c-4894-968a-4948564ff28b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1315 microversion: 2.1 time: 0.589536 Aug 04 04:43:37.641748 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2163/4451] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:37 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:37.657958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:37.658948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:37.674686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.676497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:37.677488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.677963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:37.778421 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 204 len: 0 microversion: 2.1 time: 0.198619 Aug 04 04:43:37.779936 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2289/4452] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:37 2022] DELETE /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:43:37.781579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:37.783414 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8e863e0-5a78-4407-9445-30c418507ed9 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002213 Aug 04 04:43:37.784216 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2290/4453] 10.222.0.69 () {56 vars in 886 bytes} [Thu Aug 4 04:43:37 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 04:43:37.790355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:37.791108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:37.798385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.799683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:37.800677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:37.801373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:38.081885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:38.096736 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b3ab291-b1ba-46d9-8534-b074e8b38ea3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.453402 Aug 04 04:43:38.100646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:38.102785 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2164/4454] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:37 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:38.108244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:38.116608 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cae3853f-3280-4ea4-8ca7-0b498d40a6f4 tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1526 microversion: 2.1 time: 0.330446 Aug 04 04:43:38.119820 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2291/4455] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:37 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1526 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:38.127601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:38.128234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:38.146047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:38.146634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:38.147721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:38.148221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:38.430181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f4d6e7f2-78f2-4538-920f-84bd2e22b482 req-353ca682-61c1-464f-a27b-a2268b8be3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886726ad-4d9d-408d-abb5-b6b22aa02893", "tag": "68762e4f-b0ac-4c5b-aaaf-abd8036ec4b5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:38.449923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f4d6e7f2-78f2-4538-920f-84bd2e22b482 req-353ca682-61c1-464f-a27b-a2268b8be3f3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:38.452259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f4d6e7f2-78f2-4538-920f-84bd2e22b482 req-353ca682-61c1-464f-a27b-a2268b8be3f3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:38.480042 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f4d6e7f2-78f2-4538-920f-84bd2e22b482 req-353ca682-61c1-464f-a27b-a2268b8be3f3 service nova] Creating event network-changed:68762e4f-b0ac-4c5b-aaaf-abd8036ec4b5 for instance 886726ad-4d9d-408d-abb5-b6b22aa02893 on n-h1-851337-5 Aug 04 04:43:38.486155 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f4d6e7f2-78f2-4538-920f-84bd2e22b482 req-353ca682-61c1-464f-a27b-a2268b8be3f3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060330 Aug 04 04:43:38.487289 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2292/4456] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:38.531657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:38.543077 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b306f876-dda4-4835-82e6-720696b5837b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.419288 Aug 04 04:43:38.547651 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2165/4457] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:38 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:38.555713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:38.556643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:38.570024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:38.570992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:38.572002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:38.572716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:38.573953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac364950-5d53-4f7e-90db-bb3b6a77150a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:38.574804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ac364950-5d53-4f7e-90db-bb3b6a77150a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: b60d74aa-5bd8-4a73-9399-213f91acf804] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:38.586985 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ac364950-5d53-4f7e-90db-bb3b6a77150a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance b60d74aa-5bd8-4a73-9399-213f91acf804 could not be found. Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac364950-5d53-4f7e-90db-bb3b6a77150a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/b60d74aa-5bd8-4a73-9399-213f91acf804/action HTTP/1.1 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 14 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: {"shelve": {}} Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance b60d74aa-5bd8-4a73-9399-213f91acf804 could not be found. Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b60d74aa-5bd8-4a73-9399-213f91acf804', 'body': {'shelve': {}}} Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60d74aa-5bd8-4a73-9399-213f91acf804 could not be found. Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60d74aa-5bd8-4a73-9399-213f91acf804 could not be found. Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:38.591604 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:38.596004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:38.596004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:38.596004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60d74aa-5bd8-4a73-9399-213f91acf804 could not be found. Aug 04 04:43:38.596004 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:38.596004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac364950-5d53-4f7e-90db-bb3b6a77150a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance b60d74aa-5bd8-4a73-9399-213f91acf804 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:38.597820 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ac364950-5d53-4f7e-90db-bb3b6a77150a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/b60d74aa-5bd8-4a73-9399-213f91acf804/action" status: 404 len: 111 microversion: 2.1 time: 0.028996 Aug 04 04:43:38.599973 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2166/4458] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:38 2022] POST /compute/v2.1/servers/b60d74aa-5bd8-4a73-9399-213f91acf804/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:38.609917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:38.613503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:38.634419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:38.636503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:38.641495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:38.642113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.105565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:39.108049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:39.117649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a0e974be-3c35-4cc6-95ef-a50f3e0c0f43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1810 microversion: 2.1 time: 0.570524 Aug 04 04:43:39.117649 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2293/4459] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:38 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1810 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:39.122086 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb6453c6-fec6-4477-9703-a65584a94b20 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.517835 Aug 04 04:43:39.123450 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2167/4460] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:38 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:39.144317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:39.144942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:39.151826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.152268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.153041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.153394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:39.153512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.154193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:39.165268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.165551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.166336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.166769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.549239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:39.559115 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9bbc7581-5456-48f6-a9a2-c82f337c12a5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1315 microversion: 2.1 time: 0.436479 Aug 04 04:43:39.560337 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2294/4461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:39 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:39.578664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:39.580025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:39.586739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.588271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.589594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.590223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.591297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89fcfd69c6844c293e36909ec0722c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f2bc0977a34dc9b7777a08cd275900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:39.595934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:39.610087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8f76aec-168b-4962-bc75-9b34f3622a4d tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 200 len: 1526 microversion: 2.1 time: 0.471332 Aug 04 04:43:39.610790 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2168/4462] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:39 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 1526 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:39.981078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:40.012783 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e4ef968-cb51-4ac8-befc-70a7061ef89e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.439401 Aug 04 04:43:40.033876 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2295/4463] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:39 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:40.048945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:40.050174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:40.066622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.067117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:40.067902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.070856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:40.122668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lazy-loading 'flavor' on Instance uuid f4f5eefa-1541-4941-bfbf-f885d2caff54 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:43:40.144970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:40.152302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:40.171292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.171755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:40.172593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.173031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:40.450216 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-86ec1863-4590-4bc9-980f-7cf295b5d601 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 202 len: 0 microversion: 2.1 time: 0.406924 Aug 04 04:43:40.455651 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2169/4464] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:40 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:43:40.753934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e8273143-c6e6-4897-9dcc-494b23c06dca tempest-ExtensionsTest-151111837 tempest-ExtensionsTest-151111837-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:40.756680 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e8273143-c6e6-4897-9dcc-494b23c06dca tempest-ExtensionsTest-151111837 tempest-ExtensionsTest-151111837-project] 10.222.0.69 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.302884 Aug 04 04:43:40.764486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2170/4465] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Aug 4 04:43:40 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:40.770098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:40.771688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:40.782374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.783039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:40.784038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.784879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.127628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:41.142637 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc01cb62-1d7c-4b4a-a1ad-2c91ebbea04a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1789 microversion: 2.1 time: 1.001368 Aug 04 04:43:41.143455 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2296/4466] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:40 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1789 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:41.148559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9ba324b9-574b-4f37-9576-380cbe96633f req-b8c1ffa0-1c24-4e44-bb2f-9130c97cee84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "name": "network-vif-deleted", "tag": "5fe9fa0d-745c-4180-a6e5-1b72e9df3a84"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:41.163104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9ba324b9-574b-4f37-9576-380cbe96633f req-b8c1ffa0-1c24-4e44-bb2f-9130c97cee84 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:41.163711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9ba324b9-574b-4f37-9576-380cbe96633f req-b8c1ffa0-1c24-4e44-bb2f-9130c97cee84 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.175816 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9ba324b9-574b-4f37-9576-380cbe96633f req-b8c1ffa0-1c24-4e44-bb2f-9130c97cee84 service nova] Creating event network-vif-deleted:5fe9fa0d-745c-4180-a6e5-1b72e9df3a84 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:41.184665 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9ba324b9-574b-4f37-9576-380cbe96633f req-b8c1ffa0-1c24-4e44-bb2f-9130c97cee84 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039770 Aug 04 04:43:41.185985 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2297/4467] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:41.207006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:41.208937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:41.229875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:41.231652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.232722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:41.233376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.251644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:41.262475 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d55e844-53d0-4254-8aef-0b7f915c6a2f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 0.496242 Aug 04 04:43:41.265336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2171/4468] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:40 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:41.277219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:41.279269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] [instance: cc87ace5-5bff-42c7-8346-76415313267d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:41.295930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:41.296729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.297775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:41.298364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.317285 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] HTTP exception thrown: Instance cc87ace5-5bff-42c7-8346-76415313267d could not be found. Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Request method failure captured: Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d HTTP/1.1 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605a0lyTSSeZBwOBOCNnD5vJpsjWDUFP5Y1DbRsapzflGy9x0bbeNZT_2mLAjx4vPGamOBB694HgLcyQItH0BFqZMlkbJ_5QL3TBAJJAIfH4YMxWS4NY4F8mzC9ThN_2mSaMmLiXf8O-DLtHOmKsvEtTLGEaZxMddk_ksT0E_-u6wPE Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 75f2bc0977a34dc9b7777a08cd275900 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/75f2bc0977a34dc9b7777a08cd275900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_75f2bc0977a34dc9b7777a08cd275900", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 75f2bc0977a34dc9b7777a08cd275900 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-346984208 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-InstanceActionsNegativeTestJSON-346984208-project Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f89fcfd69c6844c293e36909ec0722c9 Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-346984208-project Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance cc87ace5-5bff-42c7-8346-76415313267d could not be found. Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'cc87ace5-5bff-42c7-8346-76415313267d'} Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc87ace5-5bff-42c7-8346-76415313267d could not be found. Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc87ace5-5bff-42c7-8346-76415313267d could not be found. Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:41.319178 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc87ace5-5bff-42c7-8346-76415313267d could not be found. Aug 04 04:43:41.323576 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:43:41.325622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] Returning 404 to user: Instance cc87ace5-5bff-42c7-8346-76415313267d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:41.326385 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e2a6255-9fee-4419-9ba2-36ef69eb19aa tempest-InstanceActionsNegativeTestJSON-346984208 tempest-InstanceActionsNegativeTestJSON-346984208-project] 10.222.0.69 "GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d" status: 404 len: 111 microversion: 2.1 time: 0.059448 Aug 04 04:43:41.326987 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2172/4469] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:41 2022] GET /compute/v2.1/servers/cc87ace5-5bff-42c7-8346-76415313267d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:41.332191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-30984aae-c8e3-4edf-890f-ade4feae3ed6 tempest-ExtensionsTest-151111837 tempest-ExtensionsTest-151111837-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:41.334242 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-30984aae-c8e3-4edf-890f-ade4feae3ed6 tempest-ExtensionsTest-151111837 tempest-ExtensionsTest-151111837-project] 10.222.0.69 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005914 Aug 04 04:43:41.334946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2173/4470] 10.222.0.69 () {58 vars in 1134 bytes} [Thu Aug 4 04:43:41 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:43:41.660733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:41.669452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d025c975-b8f1-49a5-aa44-42f142b1840d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1315 microversion: 2.1 time: 0.482023 Aug 04 04:43:41.675331 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2298/4471] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:41 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:42.167831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:42.168892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:42.194628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.196052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:42.197272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.197984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:42.288882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:42.289563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:42.299700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.301732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:42.303531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.305131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:42.697320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:42.708558 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8f586930-25fc-49f1-99d8-a9e5532d9996 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1653 microversion: 2.1 time: 0.547217 Aug 04 04:43:42.709712 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2174/4472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:42 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1653 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:42.716770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:42.717742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:42.726834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.727485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:42.728456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.729112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:42.844057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:42.864474 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-39c202f6-fabe-40f6-839c-bd52b45dbb89 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 0.579710 Aug 04 04:43:42.870721 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2299/4473] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:42 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:43.181184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:43.209026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:43.239474 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-386a19c2-b707-488c-b2c5-d20f5b95d266 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1315 microversion: 2.1 time: 0.527814 Aug 04 04:43:43.259741 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2175/4474] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:42 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:43.325946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-27268960-f17b-42c4-a71e-fbca467c29b1 req-1c38c4b8-ea87-4400-83cd-78e30d4c89c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc87ace5-5bff-42c7-8346-76415313267d", "name": "network-vif-deleted", "tag": "b8ad582d-b9c4-4d21-81c0-360cc5580725"}, {"server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "name": "network-vif-deleted", "tag": "5e28c7ff-bffc-411b-b9e6-4aaa962da826"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:43.350502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-27268960-f17b-42c4-a71e-fbca467c29b1 req-1c38c4b8-ea87-4400-83cd-78e30d4c89c7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:43.351043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-27268960-f17b-42c4-a71e-fbca467c29b1 req-1c38c4b8-ea87-4400-83cd-78e30d4c89c7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:43.398294 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-27268960-f17b-42c4-a71e-fbca467c29b1 req-1c38c4b8-ea87-4400-83cd-78e30d4c89c7 service nova] Creating event network-vif-deleted:b8ad582d-b9c4-4d21-81c0-360cc5580725 for instance cc87ace5-5bff-42c7-8346-76415313267d on n-h2-851337-5 Aug 04 04:43:43.403956 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-27268960-f17b-42c4-a71e-fbca467c29b1 req-1c38c4b8-ea87-4400-83cd-78e30d4c89c7 service nova] Creating event network-vif-deleted:5e28c7ff-bffc-411b-b9e6-4aaa962da826 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:43.422404 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-27268960-f17b-42c4-a71e-fbca467c29b1 req-1c38c4b8-ea87-4400-83cd-78e30d4c89c7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097099 Aug 04 04:43:43.423688 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2300/4475] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:43.731603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:43.732142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:43.733969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:43.747293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:43.747767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:43.748569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:43.749073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:43.787294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:43.787936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:43.789163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lazy-loading 'fault' on Instance uuid 908eb1eb-98e9-4802-b854-655207aadfc0 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:43:43.902906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:43.907147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:43.923483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:43.926065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:43.928066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:43.930317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:43.947593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:43.958293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1feaec5d-551a-4d24-bff0-7a40678d265d tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 200 len: 1459 microversion: 2.1 time: 0.230810 Aug 04 04:43:43.964817 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2176/4476] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:43 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 1459 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:44.082884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:44.267722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:44.269040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:44.291329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:44.294596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:44.295855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:44.296511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:44.647047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:44.658721 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c0b562f0-3a11-4009-9588-90e32e6b8457 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 0.760650 Aug 04 04:43:44.669536 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2301/4477] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:43 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:44.786261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:44.800696 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d0e838de-0eab-4eb6-9656-db4104e0c535 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1315 microversion: 2.1 time: 0.537142 Aug 04 04:43:44.803786 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2177/4478] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:44 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:44.986303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:44.992743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:45.004211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:45.004905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:45.006777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:45.008053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:45.047523 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] HTTP exception thrown: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Request method failure captured: Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 HTTP/1.1 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605Lpx-KnH6ksBIfYkgcJ8xxAgXcfCJyAPy3bB3rqg_16aRuTy1h9OWPxFpjvE98tPjbKdcnjD2M7n1cCzVoZTkfi709lUAy-fNBtm7AD7so4XQC9kvKMyrl1MgXr7JJgu2A4rlSfo20F9XkrGMvy4e4TxocLE6QCpRUmzaYLLTPWz0 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22077b0e9e6d4231ba48cfd8f19e75db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestMultiNic-1800131880 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 59674072d54342d790a9334becf72778 Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '908eb1eb-98e9-4802-b854-655207aadfc0'} Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:45.049763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:45.054033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:45.054033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:45.054033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:45.054033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:45.054033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:45.054033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:43:45.054033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:45.056073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Returning 404 to user: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:45.057121 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-523b9f3b-e524-4b1e-b149-e9898b94fe10 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 404 len: 111 microversion: 2.1 time: 0.075058 Aug 04 04:43:45.058321 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2302/4479] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:44 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:45.452792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b3273132-aadc-4136-afe5-eda78a3d4bea req-3892cc17-67f6-4239-aa57-66a803791985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908eb1eb-98e9-4802-b854-655207aadfc0", "name": "network-vif-deleted", "tag": "8f5fa943-bd3e-421e-b952-349fdcbd8ed7"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:45.475754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b3273132-aadc-4136-afe5-eda78a3d4bea req-3892cc17-67f6-4239-aa57-66a803791985 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:45.478546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b3273132-aadc-4136-afe5-eda78a3d4bea req-3892cc17-67f6-4239-aa57-66a803791985 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:45.508140 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b3273132-aadc-4136-afe5-eda78a3d4bea req-3892cc17-67f6-4239-aa57-66a803791985 service nova] Creating event network-vif-deleted:8f5fa943-bd3e-421e-b952-349fdcbd8ed7 for instance 908eb1eb-98e9-4802-b854-655207aadfc0 on n-h2-851337-5 Aug 04 04:43:45.523477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b3273132-aadc-4136-afe5-eda78a3d4bea req-3892cc17-67f6-4239-aa57-66a803791985 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074167 Aug 04 04:43:45.526680 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2178/4480] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:45.695971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:45.696759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:45.712055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:45.712775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:45.714224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:45.716372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:46.137965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-5366a7c4-b313-4dcc-946c-70a12b09f317 req-786154a4-18fb-44d8-bde1-8e1af51b4d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886726ad-4d9d-408d-abb5-b6b22aa02893", "name": "network-vif-plugged", "status": "completed", "tag": "68762e4f-b0ac-4c5b-aaaf-abd8036ec4b5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:46.158089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5366a7c4-b313-4dcc-946c-70a12b09f317 req-786154a4-18fb-44d8-bde1-8e1af51b4d5d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:46.159000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5366a7c4-b313-4dcc-946c-70a12b09f317 req-786154a4-18fb-44d8-bde1-8e1af51b4d5d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:46.178542 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-5366a7c4-b313-4dcc-946c-70a12b09f317 req-786154a4-18fb-44d8-bde1-8e1af51b4d5d service nova] Creating event network-vif-plugged:68762e4f-b0ac-4c5b-aaaf-abd8036ec4b5 for instance 886726ad-4d9d-408d-abb5-b6b22aa02893 on n-h1-851337-5 Aug 04 04:43:46.187951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-5366a7c4-b313-4dcc-946c-70a12b09f317 req-786154a4-18fb-44d8-bde1-8e1af51b4d5d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.589015 Aug 04 04:43:46.189169 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2303/4481] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:46.200579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:46.201620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:46.210036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:46.211392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:46.212823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:46.213354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:46.807200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:46.820447 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50ed5731-6f5d-427c-a35a-4080ac902df3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 1.128501 Aug 04 04:43:46.821055 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2179/4482] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:45 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:46.923388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:46.944384 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4e1e3b4-2463-42f4-817a-e35f8d5e89e8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1315 microversion: 2.1 time: 0.751485 Aug 04 04:43:46.947909 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2304/4483] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:46 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:47.849071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:47.853643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:47.866486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:47.867114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:47.889300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:47.890011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:47.977089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:47.977713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:48.000917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:48.001820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:48.003458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:48.004113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:48.849512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:48.861514 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91d19447-0ac4-45ec-825b-7ccb0358d3c3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 1.022257 Aug 04 04:43:48.877005 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2180/4484] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:47 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:48.995949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:49.041811 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c103458-b60d-46f6-b295-c80fb3278bc5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1315 microversion: 2.1 time: 1.070115 Aug 04 04:43:49.044026 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2305/4485] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:47 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:49.886335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:49.891040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:49.901648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:49.902898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:49.904473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:49.905043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:50.079515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:50.080171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:50.102480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:50.104167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:50.105146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:50.105777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:50.921202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:50.933146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-286ee45a-7189-4a70-a5f0-a5232eefd025 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 1.050820 Aug 04 04:43:50.934322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2181/4486] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:49 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:51.126428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:51.148016 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dcba8b97-95be-4b77-8a3a-2290f5953043 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1501 microversion: 2.1 time: 1.080617 Aug 04 04:43:51.164920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2306/4487] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:50 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1501 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:51.173844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:51.174605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:51.182044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.182751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.183897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.184490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.216805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:43:51.330611 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-de6eefe2-eeda-46fd-85d7-048430811a91 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 204 len: 0 microversion: 2.1 time: 0.159759 Aug 04 04:43:51.347076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:51.348875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:51.355965 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2182/4488] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:51 2022] DELETE /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:43:51.364045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.364905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.366191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.366882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.917611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:51.937495 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea821e99-b48e-4526-ac74-34adb06dcc1d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1507 microversion: 2.1 time: 0.596768 Aug 04 04:43:51.939309 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2307/4489] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:51 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:51.965005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:51.968465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:51.982065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.982788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.983774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.984389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:52.356233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:52.370659 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f724149a-f5ee-4854-a614-89574d95585b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1532 microversion: 2.1 time: 0.415593 Aug 04 04:43:52.373524 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2183/4490] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:51 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1532 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:52.959168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:52.959819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:52.978322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:52.978771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:52.979586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:52.980025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:53.393672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:53.394273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:53.407807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:53.408423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:53.409438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:53.411573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:53.531097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:53.565731 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2dc96297-ff02-4568-a62d-c329a4fedbed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1507 microversion: 2.1 time: 0.605353 Aug 04 04:43:53.578881 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2308/4491] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:52 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1507 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:54.012943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-22b32c53-ff4a-4354-ab4a-6173ed23ce06 req-0aa73eff-a55c-4dbc-acb5-537ceb8c45cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f5eefa-1541-4941-bfbf-f885d2caff54", "name": "network-vif-plugged", "status": "completed", "tag": "559baab8-11cc-496b-bd08-390c3d4213d2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:54.032531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:54.033160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:54.038750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:54.041024 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c528a410-3624-4a57-8e01-9f95e38c4a1f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.651146 Aug 04 04:43:54.041611 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2184/4492] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:53 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:54.053407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22b32c53-ff4a-4354-ab4a-6173ed23ce06 req-0aa73eff-a55c-4dbc-acb5-537ceb8c45cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:54.062162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22b32c53-ff4a-4354-ab4a-6173ed23ce06 req-0aa73eff-a55c-4dbc-acb5-537ceb8c45cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:54.109070 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-22b32c53-ff4a-4354-ab4a-6173ed23ce06 req-0aa73eff-a55c-4dbc-acb5-537ceb8c45cb service nova] Creating event network-vif-plugged:559baab8-11cc-496b-bd08-390c3d4213d2 for instance f4f5eefa-1541-4941-bfbf-f885d2caff54 on n-h2-851337-5 Aug 04 04:43:54.123842 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-22b32c53-ff4a-4354-ab4a-6173ed23ce06 req-0aa73eff-a55c-4dbc-acb5-537ceb8c45cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115759 Aug 04 04:43:54.127298 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2309/4493] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:43:54.587412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:54.588031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:54.599241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:54.599724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:54.600537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:54.600974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:54.880632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:54.889139 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-357f5e44-25e6-4814-831a-41f4f1575fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 200 len: 1465 microversion: 2.1 time: 0.307318 Aug 04 04:43:54.910069 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2185/4494] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:54 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 1465 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:55.067910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:55.068742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:55.081675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.082069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.087285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.087999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.125664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0072ea73-1e52-4799-a79b-41958e8694b3 req-1ea7a522-102b-413a-a13d-846c7e1e0eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886726ad-4d9d-408d-abb5-b6b22aa02893", "name": "network-vif-deleted", "tag": "68762e4f-b0ac-4c5b-aaaf-abd8036ec4b5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:55.155375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0072ea73-1e52-4799-a79b-41958e8694b3 req-1ea7a522-102b-413a-a13d-846c7e1e0eeb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.156725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0072ea73-1e52-4799-a79b-41958e8694b3 req-1ea7a522-102b-413a-a13d-846c7e1e0eeb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.217440 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0072ea73-1e52-4799-a79b-41958e8694b3 req-1ea7a522-102b-413a-a13d-846c7e1e0eeb service nova] Creating event network-vif-deleted:68762e4f-b0ac-4c5b-aaaf-abd8036ec4b5 for instance 886726ad-4d9d-408d-abb5-b6b22aa02893 on n-h1-851337-5 Aug 04 04:43:55.231678 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0072ea73-1e52-4799-a79b-41958e8694b3 req-1ea7a522-102b-413a-a13d-846c7e1e0eeb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.632746 Aug 04 04:43:55.234180 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2310/4495] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:55.918611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:55.919389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:55.936462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.937381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.938598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.939338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.966525 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 HTTP/1.1 Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '886726ad-4d9d-408d-abb5-b6b22aa02893'} Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:43:55.973597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:55.977865 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:43:55.977865 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:43:55.977865 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:43:55.977865 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:43:55.977865 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:43:55.977865 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:43:55.977865 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:43:55.979809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:43:55.980700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-32262b9d-97c2-4261-ba77-72a43b538858 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 404 len: 111 microversion: 2.1 time: 0.067453 Aug 04 04:43:55.981293 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2311/4496] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:55 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:43:56.201019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-553137413", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:56.331364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] validate_networks() for [('9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:43:56.337072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:56.349871 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16bff5f6-f311-477b-8e7d-0e6339d6139d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 1.286954 Aug 04 04:43:56.352299 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2186/4497] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:55 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:57.378205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:57.380154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:57.396141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.398011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.399371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.399989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.557982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:43:57.558646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:43:57.559022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:43:57.559456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:43:57.559898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:43:57.605494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.605971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.606798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.617983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.672853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:43:57.695009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for user 0e04770e8fd84cff82e73ffd27b8a50a and project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:43:57.723112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:43:57.726237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:43:57.830031 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ec24c76-ccf9-4721-be56-ac9669abcbe1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634384 Aug 04 04:43:57.836764 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2312/4498] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:43:57.842031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-433d1c6a-8921-4fed-860d-d1adc0e08dfd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:57.842738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-433d1c6a-8921-4fed-860d-d1adc0e08dfd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:57.984554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:57.999289 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eee1fa19-f28b-468e-8470-be8d7dd74a8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.626591 Aug 04 04:43:58.001854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-433d1c6a-8921-4fed-860d-d1adc0e08dfd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:58.009460 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-433d1c6a-8921-4fed-860d-d1adc0e08dfd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1214 microversion: 2.1 time: 0.171773 Aug 04 04:43:58.012616 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2313/4499] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:57 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:58.016075 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2187/4500] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:57 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:58.057900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1624985634", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "1ab8d2ba-ac12-4171-a8b6-c8a2d68bc0ae"}, {"uuid": "b5d3c766-00a9-49b5-877a-adfd9600e52e"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:58.200175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] validate_networks() for [('1ab8d2ba-ac12-4171-a8b6-c8a2d68bc0ae', None, None, None, None, None), ('b5d3c766-00a9-49b5-877a-adfd9600e52e', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:43:59.025638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:59.027716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:59.042407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:59.049448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:59.050139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:59.051951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:59.054177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:00.073013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:00.087830 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9666a4ca-548a-4608-ae34-3de1d1ad2cc4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 1.064208 Aug 04 04:44:00.091121 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2188/4501] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:59 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:00.113848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:00.117043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:00.144974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:00.148083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:00.155937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:00.156558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.011497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:01.024130 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1924fed9-542b-4f6f-bb9b-09a104fc490f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1274 microversion: 2.1 time: 0.924182 Aug 04 04:44:01.025328 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2189/4502] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:00 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1274 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:01.122710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:01.124759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:01.137373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.137885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.138712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.139771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.626259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:44:01.627897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:44:01.629737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:44:01.629737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:44:01.629737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:44:01.639127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:01.664022 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0fea8252-fadb-4fe1-954f-fc70b03f1961 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.550461 Aug 04 04:44:01.681862 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2190/4503] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:01 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:01.686335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.688010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.689441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.692215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.714325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Getting quotas for project 22077b0e9e6d4231ba48cfd8f19e75db. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:44:01.722689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Getting quotas for user 59674072d54342d790a9334becf72778 and project 22077b0e9e6d4231ba48cfd8f19e75db. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:44:01.742852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:44:01.748951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:44:01.902315 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f99c123-8974-4d05-8e53-f7e91e6d952e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.848220 Aug 04 04:44:01.921368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e41b2592-7875-49c0-b534-1c8eb93472c4 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:01.921995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e41b2592-7875-49c0-b534-1c8eb93472c4 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:01.926026 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2314/4504] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:44:02.045401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:02.046039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:02.067748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.068894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:02.070282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.070732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:02.732720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e41b2592-7875-49c0-b534-1c8eb93472c4 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:02.748582 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e41b2592-7875-49c0-b534-1c8eb93472c4 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1213 microversion: 2.1 time: 0.830214 Aug 04 04:44:02.749334 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2191/4505] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:01 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1213 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:02.769774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:02.773065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:02.791966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.792434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:02.793245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.793788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.362784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:04.366602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:04.380825 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f54b9462-5db6-402c-8bc1-95c9ab20f58f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 1.629401 Aug 04 04:44:04.388737 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9875f8f-728b-4ee6-b8cb-918c15e59fa7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 2.347862 Aug 04 04:44:04.391035 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2192/4506] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:02 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:04.403874 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2315/4507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:02 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:04.415102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:04.421012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:04.424413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2f2d421d-b763-4dbb-ab21-edfa7bcb6d82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cf5e8bb-5c47-4ff1-977a-f4611564017e"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:04.427604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2f2d421d-b763-4dbb-ab21-edfa7bcb6d82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:04.437369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f2d421d-b763-4dbb-ab21-edfa7bcb6d82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.438064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f2d421d-b763-4dbb-ab21-edfa7bcb6d82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.440624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f2d421d-b763-4dbb-ab21-edfa7bcb6d82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.441249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2f2d421d-b763-4dbb-ab21-edfa7bcb6d82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.447484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.452511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.455109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.458702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.474306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:04.684599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:04.695830 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2204194f-af8c-47bc-b987-5331d03f5300 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1271 microversion: 2.1 time: 0.301723 Aug 04 04:44:04.697398 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2193/4508] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:04 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:05.117390 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2f2d421d-b763-4dbb-ab21-edfa7bcb6d82 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699141 Aug 04 04:44:05.121540 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2316/4509] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:44:04 2022] POST /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:05.415409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:05.416024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:05.433319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:05.434059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:05.458868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.471906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.474551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.476510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.478823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.479325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.487653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.488372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.966193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:05.974035 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd4f2315-ef78-456c-91db-6b0f8b5a193b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.563046 Aug 04 04:44:05.978800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2194/4510] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:05 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:05.988556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:06.007102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:06.048312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:06.051269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:06.055427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:06.058975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:06.207353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:06.219226 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6ad3294-c9b1-4e07-bbec-d1e968652eec tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 0.797122 Aug 04 04:44:06.236788 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2317/4511] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:05 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:06.324511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:06.337806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e029b5aa-71e0-465e-b0b6-bbfcf2345103 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1271 microversion: 2.1 time: 0.357777 Aug 04 04:44:06.352110 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2195/4512] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:05 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:06.995632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:06.996453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:07.013253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.017240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.018422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.020602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.245337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:07.245946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:07.261525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.268545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.270607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.274110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.787353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:07.796797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:07.797319 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-534c58df-2df3-4923-b360-b783a6d4d24f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 0.556674 Aug 04 04:44:07.806364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56414bf8-c747-40da-b26d-396f9bb8acaf tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.815752 Aug 04 04:44:07.810778 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2318/4513] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:06 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:07.824856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:07.828116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:07.831732 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2196/4514] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:07 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:07.847739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.848634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.850612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.854139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:08.125559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-09e94b2f-8c30-40aa-b4a9-afc941134dce req-2c047931-3d42-4836-9ed2-ba9a48e6ae25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4450dee8-d3be-49ce-8148-e3be79884e79", "tag": "887ad486-ec37-449e-a3c4-d6c11ac2b4f2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:08.154912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-09e94b2f-8c30-40aa-b4a9-afc941134dce req-2c047931-3d42-4836-9ed2-ba9a48e6ae25 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:08.155446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-09e94b2f-8c30-40aa-b4a9-afc941134dce req-2c047931-3d42-4836-9ed2-ba9a48e6ae25 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:08.187206 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-09e94b2f-8c30-40aa-b4a9-afc941134dce req-2c047931-3d42-4836-9ed2-ba9a48e6ae25 service nova] Creating event network-changed:887ad486-ec37-449e-a3c4-d6c11ac2b4f2 for instance 4450dee8-d3be-49ce-8148-e3be79884e79 on n-h1-851337-5 Aug 04 04:44:08.206591 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-09e94b2f-8c30-40aa-b4a9-afc941134dce req-2c047931-3d42-4836-9ed2-ba9a48e6ae25 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084244 Aug 04 04:44:08.207559 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2197/4515] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:08.827612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:08.830101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:08.868834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:08.885512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:08.886697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:08.892024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:08.997402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:09.008281 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-412f9106-b8c8-4be3-967c-dafbc8866e43 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1313 microversion: 2.1 time: 1.196074 Aug 04 04:44:09.021501 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2319/4516] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:07 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1313 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:09.033278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:09.043396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:09.068338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:09.069340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:09.070153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:09.070601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:09.675237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:09.685032 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-154bc64b-de2e-42a9-8af1-ac9afd2a9bb6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 0.865614 Aug 04 04:44:09.697662 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2198/4517] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:08 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:09.756027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:09.765026 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ec36dff-1a60-4520-a007-e4d18e37b7a2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.755074 Aug 04 04:44:09.765632 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2320/4518] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:09 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:10.031939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:10.033263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:10.050339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.050814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.052821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.053642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.513536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:10.525009 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-71770654-3933-4a0d-a32e-11f6a48d8dce tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1313 microversion: 2.1 time: 0.498668 Aug 04 04:44:10.527262 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2199/4519] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:10 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:10.726254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:10.727575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:10.741099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.741820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.742857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.748250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.793647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:10.794543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:10.807964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.813186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.816122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.817371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:11.703014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:11.735283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:11.856971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:11.859739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:11.877870 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67d19936-684c-4ba3-852d-7dd6dac4cef4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 1.080091 Aug 04 04:44:11.878079 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2535a95d-4468-42e8-98c5-38273dd6df80 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 1.157176 Aug 04 04:44:11.878541 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2200/4520] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:10 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:11.894994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2321/4521] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:10 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:11.899695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:11.905112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:11.929944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:11.931586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:11.934231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:11.937157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.342124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:12.358309 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0f3b188d-00aa-4e3c-bf93-56d4851c0f7b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1313 microversion: 2.1 time: 0.469615 Aug 04 04:44:12.359301 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2322/4522] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:11 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:12.903787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:12.904417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:12.908906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:12.914083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:12.914878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:12.921760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.922226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.923122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.923593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.930372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.937463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.938321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.938775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.431396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:13.439707 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32b62f3a-7993-4e1b-81e5-5317e492cff8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.539774 Aug 04 04:44:13.445766 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2201/4523] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:12 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:13.461305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:13.462319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:13.477342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:13.478140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.479247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:13.480030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.591815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:13.603520 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92982ecf-ce42-4f17-9c26-52cfff553f48 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 0.693905 Aug 04 04:44:13.604939 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2323/4524] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:12 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:13.808774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:13.821388 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b72b9593-6e1a-4e65-8839-e52750a38920 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1313 microversion: 2.1 time: 0.373972 Aug 04 04:44:13.822673 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2202/4525] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:13 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:14.470322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:14.472009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:14.489997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.497433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.500134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.500871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.627422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:14.628462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:14.651411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.656361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.671802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.672278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.686613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:15.309619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:15.321476 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91b81da4-93e7-4e7a-8ddb-09722acee3c2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.855883 Aug 04 04:44:15.331104 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2324/4526] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:14 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:15.336813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:15.348518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:15.371255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:15.376566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:15.379876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:15.380548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:15.802410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:15.828400 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d2887fb-1bee-4702-a332-07f3f5fab088 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 1.205795 Aug 04 04:44:15.830308 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2203/4527] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:14 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:15.912280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:15.924810 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62101fdb-7a67-40e4-a593-58d22ba3348a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.592301 Aug 04 04:44:15.926202 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2325/4528] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:15 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:16.356274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:16.356814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:16.363536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.372785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.376647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.380586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.824880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:16.849537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:16.851190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:16.868184 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5765fd4e-1e1f-42b0-9185-a450f2f4568c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.515576 Aug 04 04:44:16.871596 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2204/4529] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:16 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:16.913911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.916431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.920289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.921889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.946975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:16.947987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:16.961767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.962744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.964060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.966604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:17.387393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:17.401255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:17.402861 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f243a597-642d-4dc1-be99-3fce5610451c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 0.557036 Aug 04 04:44:17.418512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2326/4530] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:16 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:17.424383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7c68fa2-c203-45c1-8c3c-b0dd224161f1 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.481282 Aug 04 04:44:17.427701 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2205/4531] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:16 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:17.897106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:17.897727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:17.905141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.905916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:17.906925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.911640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.295159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:18.306971 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4cdc6242-e87e-4634-90f4-49a4093d6d4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.414353 Aug 04 04:44:18.321492 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2327/4532] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:17 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:18.424697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:18.425388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:18.434385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.445405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:18.446122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:18.449669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.452406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.455792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.473653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.475400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.477494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.479905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.518127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:19.519834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:19.534325 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-be80e243-e748-4f18-8273-41969eeec83f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 1.112466 Aug 04 04:44:19.534977 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2206/4533] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:18 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:19.536692 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c51bee8a-441c-4e39-8261-06854c333ad3 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 1.095422 Aug 04 04:44:19.539138 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2328/4534] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:18 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:19.545184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-de998975-a31e-4029-a277-ac0b0506a9ff req-ca0f2b81-c0cb-4571-bc1f-3fa0738ff1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb902f8-e77f-46dc-8c11-8314bcab00cd", "tag": "1a0a2711-7fd3-47e2-8dd3-f0614922c7b2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:19.559705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:19.562879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:19.572759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-de998975-a31e-4029-a277-ac0b0506a9ff req-ca0f2b81-c0cb-4571-bc1f-3fa0738ff1db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.573793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-de998975-a31e-4029-a277-ac0b0506a9ff req-ca0f2b81-c0cb-4571-bc1f-3fa0738ff1db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.578170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.578383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.583984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.590570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.681034 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-de998975-a31e-4029-a277-ac0b0506a9ff req-ca0f2b81-c0cb-4571-bc1f-3fa0738ff1db service nova] Creating event network-changed:1a0a2711-7fd3-47e2-8dd3-f0614922c7b2 for instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd on n-h2-851337-5 Aug 04 04:44:19.696573 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-de998975-a31e-4029-a277-ac0b0506a9ff req-ca0f2b81-c0cb-4571-bc1f-3fa0738ff1db service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154464 Aug 04 04:44:19.698140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2329/4535] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:19.717136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-fbb60b7b-8d50-4ce1-8e3d-7520ade972b9 req-894492fc-e0b9-4b89-820f-7167ed460c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4450dee8-d3be-49ce-8148-e3be79884e79", "name": "network-vif-plugged", "status": "completed", "tag": "887ad486-ec37-449e-a3c4-d6c11ac2b4f2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:19.732745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fbb60b7b-8d50-4ce1-8e3d-7520ade972b9 req-894492fc-e0b9-4b89-820f-7167ed460c3f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.732839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fbb60b7b-8d50-4ce1-8e3d-7520ade972b9 req-894492fc-e0b9-4b89-820f-7167ed460c3f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.747201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-fbb60b7b-8d50-4ce1-8e3d-7520ade972b9 req-894492fc-e0b9-4b89-820f-7167ed460c3f service nova] Creating event network-vif-plugged:887ad486-ec37-449e-a3c4-d6c11ac2b4f2 for instance 4450dee8-d3be-49ce-8148-e3be79884e79 on n-h1-851337-5 Aug 04 04:44:19.753061 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-fbb60b7b-8d50-4ce1-8e3d-7520ade972b9 req-894492fc-e0b9-4b89-820f-7167ed460c3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040129 Aug 04 04:44:19.754148 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2330/4536] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:20.092114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:20.102376 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-54f06d8e-4b76-43ff-905d-e0ae10f84967 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.552085 Aug 04 04:44:20.103536 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2207/4537] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:19 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:20.555900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:20.557582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:20.583251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.588512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.591323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.593053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.280880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0113e8a0-5f72-4bc5-a1c6-6dc94e427d31 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Action: 'create', calling method: .version_select at 0x7f1919595280>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:21.312277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0113e8a0-5f72-4bc5-a1c6-6dc94e427d31 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Getting quotas for project 644efec1433345b8b50a3f2fabbb1f94. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:44:21.328082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0113e8a0-5f72-4bc5-a1c6-6dc94e427d31 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Getting quotas for user d8bd9cca9bc54e75bcc4b38a71a8b0bc and project 644efec1433345b8b50a3f2fabbb1f94. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:44:21.372685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:21.383621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9d4f1656-b8ec-49c2-9ec4-783026eaa093 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1314 microversion: 2.1 time: 0.830093 Aug 04 04:44:21.386606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2208/4538] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:20 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:21.395137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:21.398555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:21.410394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.413201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0113e8a0-5f72-4bc5-a1c6-6dc94e427d31 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Getting quotas for project 644efec1433345b8b50a3f2fabbb1f94. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:44:21.413575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.414643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.418862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.422272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0113e8a0-5f72-4bc5-a1c6-6dc94e427d31 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Getting quotas for user d8bd9cca9bc54e75bcc4b38a71a8b0bc and project 644efec1433345b8b50a3f2fabbb1f94. Resources: {'server_groups'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:44:21.470223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:21.474122 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0113e8a0-5f72-4bc5-a1c6-6dc94e427d31 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.991594 Aug 04 04:44:21.474772 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2331/4539] 10.222.0.69 () {62 vars in 1214 bytes} [Thu Aug 4 04:44:20 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:44:21.481598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:21.482709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:21.491712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.492504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.493758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.494537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.883009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:21.889839 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2520b03-226d-413f-bba1-31e36f188f0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1527 microversion: 2.1 time: 0.413535 Aug 04 04:44:21.904724 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2332/4540] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:21 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1527 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:21.909959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e97c64a3-a30b-4fef-8e1e-c9d7d7c64fe8 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:21.922887 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e97c64a3-a30b-4fef-8e1e-c9d7d7c64fe8 tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.016545 Aug 04 04:44:21.923907 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2333/4541] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Aug 4 04:44:21 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:44:21.935889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4cd824b5-980b-4a89-8628-f75605de903b req-d30b9570-8728-467e-9228-384d894d3143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb902f8-e77f-46dc-8c11-8314bcab00cd", "tag": "eef1f495-2b62-4b03-b0fe-33dc8f79d138"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:21.949781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4cd824b5-980b-4a89-8628-f75605de903b req-d30b9570-8728-467e-9228-384d894d3143 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.950665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4cd824b5-980b-4a89-8628-f75605de903b req-d30b9570-8728-467e-9228-384d894d3143 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.965792 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4cd824b5-980b-4a89-8628-f75605de903b req-d30b9570-8728-467e-9228-384d894d3143 service nova] Creating event network-changed:eef1f495-2b62-4b03-b0fe-33dc8f79d138 for instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd on n-h2-851337-5 Aug 04 04:44:21.971408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4cd824b5-980b-4a89-8628-f75605de903b req-d30b9570-8728-467e-9228-384d894d3143 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039509 Aug 04 04:44:21.972308 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2334/4542] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:21.979483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b324d185-b1c8-4622-9ad9-455e421e626f tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:21.990173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b324d185-b1c8-4622-9ad9-455e421e626f tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/5a1398fd-51ef-416a-a232-e12d92e286a5" status: 200 len: 235 microversion: 2.64 time: 0.016339 Aug 04 04:44:21.998842 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2335/4543] 10.222.0.69 () {60 vars in 1304 bytes} [Thu Aug 4 04:44:21 2022] GET /compute/v2.1/os-server-groups/5a1398fd-51ef-416a-a232-e12d92e286a5 => generated 235 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:44:22.004739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e0116fb-939a-4181-b0d9-fab8153d9a2c tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:22.040543 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e0116fb-939a-4181-b0d9-fab8153d9a2c tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/5a1398fd-51ef-416a-a232-e12d92e286a5" status: 204 len: 0 microversion: 2.64 time: 0.039800 Aug 04 04:44:22.042169 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2336/4544] 10.222.0.69 () {60 vars in 1307 bytes} [Thu Aug 4 04:44:21 2022] DELETE /compute/v2.1/os-server-groups/5a1398fd-51ef-416a-a232-e12d92e286a5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:44:22.058742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36e55cb9-cf80-46b0-9968-e54a7ad0ee8c tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:22.070119 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-36e55cb9-cf80-46b0-9968-e54a7ad0ee8c tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] HTTP exception thrown: Instance group 5a1398fd-51ef-416a-a232-e12d92e286a5 could not be found. Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36e55cb9-cf80-46b0-9968-e54a7ad0ee8c tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Request method failure captured: Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-server-groups/5a1398fd-51ef-416a-a232-e12d92e286a5 HTTP/1.1 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi606klD5D66x5Ie6DUYw-cFN8ynIp-31T-nahWtUYzrUYYtgPhqrbZkvy1rF5x-B9CA5eZxKWtxloC35mrIHqU8tj83B1UAXodN2-t4mFiBvUgllYMVknqZfhcWokJoOshTYyRYYCdUV7mvxSN_CVGzHv8waOm4XUKnE1JuvnQnFCt8I Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.64 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 644efec1433345b8b50a3f2fabbb1f94 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerGroup264TestJSON-1987790383 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/644efec1433345b8b50a3f2fabbb1f94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/644efec1433345b8b50a3f2fabbb1f94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/644efec1433345b8b50a3f2fabbb1f94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_644efec1433345b8b50a3f2fabbb1f94", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerGroup264TestJSON-1987790383 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 644efec1433345b8b50a3f2fabbb1f94 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1987790383 Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerGroup264TestJSON-1987790383-project Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d8bd9cca9bc54e75bcc4b38a71a8b0bc Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerGroup264TestJSON-1987790383-project Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance group 5a1398fd-51ef-416a-a232-e12d92e286a5 could not be found. Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5a1398fd-51ef-416a-a232-e12d92e286a5'} Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5a1398fd-51ef-416a-a232-e12d92e286a5 could not be found. Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5a1398fd-51ef-416a-a232-e12d92e286a5 could not be found. Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:22.072979 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:22.077058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:22.077058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:22.077058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:22.077058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:22.077058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5a1398fd-51ef-416a-a232-e12d92e286a5 could not be found. Aug 04 04:44:22.077058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:22.079011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36e55cb9-cf80-46b0-9968-e54a7ad0ee8c tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] Returning 404 to user: Instance group 5a1398fd-51ef-416a-a232-e12d92e286a5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:22.080489 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36e55cb9-cf80-46b0-9968-e54a7ad0ee8c tempest-ServerGroup264TestJSON-1987790383 tempest-ServerGroup264TestJSON-1987790383-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/5a1398fd-51ef-416a-a232-e12d92e286a5" status: 404 len: 117 microversion: 2.64 time: 0.031496 Aug 04 04:44:22.082070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2337/4545] 10.222.0.69 () {60 vars in 1307 bytes} [Thu Aug 4 04:44:22 2022] DELETE /compute/v2.1/os-server-groups/5a1398fd-51ef-416a-a232-e12d92e286a5 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:44:22.122395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:22.133951 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3c04a721-5f0a-4441-9133-43826d6e57cc tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.745914 Aug 04 04:44:22.136824 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2209/4546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:21 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:22.411605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:22.412322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:22.420874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.421629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:22.422744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.423383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:22.452333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:22.847082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:22.857027 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73bf129c-efdd-4370-bf90-5ada2b929b6c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1500 microversion: 2.1 time: 0.450039 Aug 04 04:44:22.871073 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2338/4547] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:22 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1500 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:22.919036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:22.920458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:22.930575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.931262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:22.932237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.932838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.168967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:23.170245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:23.218522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:23.222301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.224045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:23.230402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.001442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:24.016219 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4443f8da-d46f-4372-9fa9-384cde31a20e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1509 microversion: 2.1 time: 1.107026 Aug 04 04:44:24.018209 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2210/4548] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:22 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1509 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:24.025648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:24.029821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:24.040650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.042175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.043368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.044049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.076373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lazy-loading 'flavor' on Instance uuid b8cfd2e6-5f04-4b21-b641-cc235321dc06 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:44:24.210996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:24.219968 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d57d5c8-474c-45a8-8fd1-40ce37481a1f tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 1.060587 Aug 04 04:44:24.229591 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2339/4549] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:23 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:24.400763 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-23e09d8f-2ba7-498e-abbb-3dc95854b892 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/action" status: 200 len: 32 microversion: 2.1 time: 0.380825 Aug 04 04:44:24.414719 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2211/4550] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:44:24 2022] POST /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/action => generated 32 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:44:24.418320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:24.421537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:24.449750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.451740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.452865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.453709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.848047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:24.879450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a0f37e19-7e54-4e1b-ba0d-53743797bd11 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.467549 Aug 04 04:44:24.880137 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2340/4551] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:24 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:25.041878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:25.042871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:25.079168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.083174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.085981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.086755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.249664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:25.250891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:25.257500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.258299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.259371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.260284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.614549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:25.624039 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7ade3c99-38f8-4318-9e8e-e707f88efb37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1509 microversion: 2.1 time: 0.587719 Aug 04 04:44:25.627838 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2212/4552] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:25 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:25.661609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-69cbd798-b4e4-46c4-a96e-4b996b4c95d9 req-80b4efb5-5802-49ec-b4db-e810df18d066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f5eefa-1541-4941-bfbf-f885d2caff54", "name": "network-vif-unplugged", "status": "completed", "tag": "559baab8-11cc-496b-bd08-390c3d4213d2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:25.688078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-69cbd798-b4e4-46c4-a96e-4b996b4c95d9 req-80b4efb5-5802-49ec-b4db-e810df18d066 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.688634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-69cbd798-b4e4-46c4-a96e-4b996b4c95d9 req-80b4efb5-5802-49ec-b4db-e810df18d066 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.706465 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-69cbd798-b4e4-46c4-a96e-4b996b4c95d9 req-80b4efb5-5802-49ec-b4db-e810df18d066 service nova] Creating event network-vif-unplugged:559baab8-11cc-496b-bd08-390c3d4213d2 for instance f4f5eefa-1541-4941-bfbf-f885d2caff54 on n-h2-851337-5 Aug 04 04:44:25.716859 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-69cbd798-b4e4-46c4-a96e-4b996b4c95d9 req-80b4efb5-5802-49ec-b4db-e810df18d066 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070726 Aug 04 04:44:25.722516 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2213/4553] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:25.742002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:25.753172 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bcbd83db-a812-4c32-9c1a-be13c2d51e95 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.507549 Aug 04 04:44:25.759015 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2341/4554] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:25 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:25.808692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d84d50dc-dde6-4002-a6bd-dfdbe022462e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "649fec64-4fa7-4ee7-8c71-a09f21772a85"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:25.811397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d84d50dc-dde6-4002-a6bd-dfdbe022462e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:25.819901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d84d50dc-dde6-4002-a6bd-dfdbe022462e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.820610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d84d50dc-dde6-4002-a6bd-dfdbe022462e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.821762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d84d50dc-dde6-4002-a6bd-dfdbe022462e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.822498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d84d50dc-dde6-4002-a6bd-dfdbe022462e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.903722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:25.905353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:25.914393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.915176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.916244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.918064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.205740 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d84d50dc-dde6-4002-a6bd-dfdbe022462e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401359 Aug 04 04:44:26.207022 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2214/4555] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:44:25 2022] POST /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:26.369819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:26.379837 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b92e60c-aef8-4fd2-a55b-8cf268074029 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.483254 Aug 04 04:44:26.380429 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2342/4556] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:25 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:26.653571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:26.654408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:26.692353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.693420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.694674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.695046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.776476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:26.777484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:26.793267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.799474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.800809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.801415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:27.057007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:27.072993 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4062af0-94a0-4d6f-9260-9d7671afb8ea tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1509 microversion: 2.1 time: 0.425021 Aug 04 04:44:27.086640 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2215/4557] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:26 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:27.109233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:27.123587 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d98de777-7d8d-45b3-9c3c-8e3f0679a67c tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.350653 Aug 04 04:44:27.125086 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2343/4558] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:26 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:27.402831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:27.403626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:27.413509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:27.414140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:27.414970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:27.415427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.085693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:28.096064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:28.097386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:28.119057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.119536 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd9d0e16-d6f5-4f5d-bd7d-cae51317c532 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.720939 Aug 04 04:44:28.120586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.122088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.126017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.126347 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2216/4559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:27 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:28.145493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:28.146581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:28.157860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.160126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.163198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.164214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.187685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:28.598064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:28.612041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d83de23b-9814-4dd0-aceb-7e2439cc1307 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1509 microversion: 2.1 time: 0.522068 Aug 04 04:44:28.623723 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2344/4560] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:28 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1509 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:28.751313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:28.769356 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c15bfcd5-3ae4-407d-8d09-b12b0a3db32a tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.628302 Aug 04 04:44:28.795159 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2217/4561] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:28 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:29.150128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:29.150893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:29.167908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.178191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:29.184308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.184980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:29.637368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:29.638501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:29.641424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=62 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:29.668255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.670599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:29.671995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.673870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:29.775325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:29.788457 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ea2734b-edb6-4a6b-a4a6-ab4b25255f3e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.643073 Aug 04 04:44:29.795121 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2345/4562] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:29 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:29.805983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:29.810333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:29.827727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.828237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:29.829103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.829952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.278201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:30.294479 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-08d993c9-bd6a-45c7-911a-74343b5b63e9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1452 microversion: 2.1 time: 0.658280 Aug 04 04:44:30.295437 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2218/4563] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:29 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1452 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:30.315744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:30.316617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:30.329361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.330184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.331230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.335062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.363169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:30.375846 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b5f0dbb-3735-4cd5-aba4-8fcac6377a59 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.579128 Aug 04 04:44:30.376554 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2346/4564] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:29 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:30.818320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:30.819334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:30.838181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.838644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.847857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.848331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:31.279252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:31.291976 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63dc2a84-b4d1-4335-b3ee-fc3a51a288dc tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1452 microversion: 2.1 time: 0.980091 Aug 04 04:44:31.292574 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2219/4565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:30 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1452 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:31.404694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:31.405758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:31.414781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:31.415589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:31.417809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:31.420184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:31.441061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:32.153718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:32.175476 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d1075823-f67e-41de-95a5-8dfe32f9ce3f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 1.362959 Aug 04 04:44:32.179204 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2347/4566] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:30 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:32.192454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:32.198646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:32.216901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.217369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.221717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.222849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.267592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lazy-loading 'flavor' on Instance uuid f4f5eefa-1541-4941-bfbf-f885d2caff54 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:44:32.297620 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Cannot 'shelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state shelved_offloaded Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action HTTP/1.1 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 14 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: {"shelve": {}} Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'shelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state shelved_offloaded Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'shelve': {}}} Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 04 04:44:32.306191 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state shelved_offloaded Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state shelved_offloaded Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 409 to user: Cannot 'shelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state shelved_offloaded {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:32.310828 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0134ede8-20cb-438c-8b2c-7a8d4b6b3be6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 409 len: 155 microversion: 2.1 time: 0.128717 Aug 04 04:44:32.312090 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2348/4567] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:44:32 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 155 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:44:32.315668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:32.332107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:32.333300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:32.334206 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-898aef47-f565-4d46-afb4-bb158f28e102 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.936150 Aug 04 04:44:32.344700 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2220/4568] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:31 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:32.360928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.361389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.367016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.368094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.578896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119343) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 04:44:32.794268 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ec9a79fd-cdc6-42c7-8aa8-6edf14f6e984 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 202 len: 0 microversion: 2.1 time: 0.474193 Aug 04 04:44:32.798391 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2349/4569] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:44:32 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:44:32.806988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:32.807611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:32.823939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.824386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.830709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.831351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.200952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:33.206427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:33.225387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.227395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.230033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.232116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.896871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:33.916995 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1aeceae-e002-40af-a792-39cf8ef72a93 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1460 microversion: 2.1 time: 1.114741 Aug 04 04:44:33.937848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2221/4570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:32 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1460 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:33.950930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:33.985496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:33.985805 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5df14d56-2de2-46f7-a38e-65e2fa413f77 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.786261 Aug 04 04:44:33.988960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:33.990072 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2350/4571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:33 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:34.007964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.012213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.013941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.015711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.456921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:34.471695 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc019169-4a71-4b48-9e6d-1b36c1444a54 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.527356 Aug 04 04:44:34.472888 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2222/4572] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:33 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:34.727787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-68003548-cd0d-4b0f-aa94-e1353f9efc9a req-265ad3bf-ea73-4d26-a9a3-3cf5fdc40412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb902f8-e77f-46dc-8c11-8314bcab00cd", "name": "network-vif-plugged", "status": "completed", "tag": "eef1f495-2b62-4b03-b0fe-33dc8f79d138"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:34.785704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-68003548-cd0d-4b0f-aa94-e1353f9efc9a req-265ad3bf-ea73-4d26-a9a3-3cf5fdc40412 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.786164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-68003548-cd0d-4b0f-aa94-e1353f9efc9a req-265ad3bf-ea73-4d26-a9a3-3cf5fdc40412 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.836914 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-68003548-cd0d-4b0f-aa94-e1353f9efc9a req-265ad3bf-ea73-4d26-a9a3-3cf5fdc40412 service nova] Creating event network-vif-plugged:eef1f495-2b62-4b03-b0fe-33dc8f79d138 for instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd on n-h2-851337-5 Aug 04 04:44:34.850484 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-68003548-cd0d-4b0f-aa94-e1353f9efc9a req-265ad3bf-ea73-4d26-a9a3-3cf5fdc40412 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134251 Aug 04 04:44:34.855083 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2351/4573] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:34.961309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:34.963659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:34.976282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.977320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.978409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.979275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:35.010259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:35.011790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:35.029379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:35.031596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:35.033521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:35.035850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.109776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:36.117689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:36.126193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c2e65147-5a73-4c0a-b5c2-998b9272eef7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 1.120905 Aug 04 04:44:36.126793 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2352/4574] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:35 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:36.134374 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d9751e1-699b-4e22-8561-442e93ea1a6d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1460 microversion: 2.1 time: 1.190146 Aug 04 04:44:36.140236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:36.143541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:36.150667 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2223/4575] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:34 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1460 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:36.151266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:36.151793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.153641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:36.155470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.512761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:36.524161 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-58036570-60e6-4e5b-bf37-8abd7a6140f2 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.396343 Aug 04 04:44:36.525082 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2353/4576] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:36 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:36.906212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f1880419-2664-4fba-8054-41ac4b8b79c5 req-c9e666da-30d1-4265-9d24-51a75462973d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb902f8-e77f-46dc-8c11-8314bcab00cd", "name": "network-vif-plugged", "status": "completed", "tag": "1a0a2711-7fd3-47e2-8dd3-f0614922c7b2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:36.926518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f1880419-2664-4fba-8054-41ac4b8b79c5 req-c9e666da-30d1-4265-9d24-51a75462973d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:36.927074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f1880419-2664-4fba-8054-41ac4b8b79c5 req-c9e666da-30d1-4265-9d24-51a75462973d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.938900 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f1880419-2664-4fba-8054-41ac4b8b79c5 req-c9e666da-30d1-4265-9d24-51a75462973d service nova] Creating event network-vif-plugged:1a0a2711-7fd3-47e2-8dd3-f0614922c7b2 for instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd on n-h2-851337-5 Aug 04 04:44:36.944445 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f1880419-2664-4fba-8054-41ac4b8b79c5 req-c9e666da-30d1-4265-9d24-51a75462973d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043185 Aug 04 04:44:36.945049 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2224/4577] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:37.150655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:37.150655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:37.157679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:37.159216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:37.165002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.165616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.166727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.168448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.169866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.170619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.171674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.172591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.512457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:37.528482 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1758b355-58ee-43b4-a20c-27820f03d12f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.374703 Aug 04 04:44:37.529556 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2225/4578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:37 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:37.548542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:37.549257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:37.566183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.567118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.568122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.569400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.595863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:37.602678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:37.610008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ae908d0-22a5-44f0-b7df-26967b127913 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.465348 Aug 04 04:44:37.610617 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2354/4579] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:37 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:37.882590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:37.898229 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-75dd2db0-f3ce-4b2c-861c-02c9b24bed53 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1334 microversion: 2.1 time: 0.355351 Aug 04 04:44:37.899742 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2226/4580] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:37 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1334 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:38.554653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:38.566766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:38.580014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.585147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.588194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.590600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.638749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:38.647991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:38.670399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.671033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.672121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.675771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.815843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:38.830555 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c69f868a-0a1a-41d0-ad95-178a89bb3314 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.281798 Aug 04 04:44:38.832108 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2355/4581] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:38 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:38.923153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:38.923995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:38.932277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.934416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.936294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.936748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:39.020534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:39.032266 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e15fdeb1-5c34-4283-90c4-da72e4bb32ab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.398091 Aug 04 04:44:39.051724 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2227/4582] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:38 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:39.606924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:39.617945 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9967ce18-7597-47ff-9ad0-02d1a965f96b tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1666 microversion: 2.1 time: 0.698592 Aug 04 04:44:39.620886 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2356/4583] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:38 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1666 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:39.670243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c516dbf5-f232-47be-a55a-935c60948913 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:39.671774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c516dbf5-f232-47be-a55a-935c60948913 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:39.710027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c516dbf5-f232-47be-a55a-935c60948913 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:39.710571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c516dbf5-f232-47be-a55a-935c60948913 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:39.711540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c516dbf5-f232-47be-a55a-935c60948913 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:39.712159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c516dbf5-f232-47be-a55a-935c60948913 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:39.857032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:39.858608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:39.866437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:39.867290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:39.868412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:39.869145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.189002 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c516dbf5-f232-47be-a55a-935c60948913 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd/ips" status: 200 len: 176 microversion: 2.1 time: 0.541386 Aug 04 04:44:40.190289 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2228/4584] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:44:39 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd/ips => generated 176 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:40.323197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:40.332059 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f06ba28-17c7-435f-a042-08da8c79026b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.479482 Aug 04 04:44:40.356512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2357/4585] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:39 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:40.361802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:40.362808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:40.377311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.381135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.383076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.383919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.532770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-956346102", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": "none"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:40.631612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:44:40.632047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:44:40.632564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:44:40.633059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:40.633565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:44:40.633565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:44:40.653309 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35c9aa1b-6e20-4d9e-98ae-209ebaf828e6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.293977 Aug 04 04:44:40.666979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2358/4586] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:40 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:40.667190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.667190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.667190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.667190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.678578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:40.679512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:40.704803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.705434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.706409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.706850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.716559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Getting quotas for project 7ea98ba3d0ee417e9f8aee8237beb741. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:44:40.733038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Getting quotas for user 040f59c45a8a4959910a9f4ea7307004 and project 7ea98ba3d0ee417e9f8aee8237beb741. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:44:40.773845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:44:40.778776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:44:40.781720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:44:40.877476 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50062595-5938-4076-b0c6-7224aede34d0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.684573 Aug 04 04:44:40.884729 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2229/4587] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:44:40.901989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d3f08901-df0f-45a8-bf73-d79174f89281 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:40.902854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d3f08901-df0f-45a8-bf73-d79174f89281 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:40.996018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d3f08901-df0f-45a8-bf73-d79174f89281 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:41.007978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d3f08901-df0f-45a8-bf73-d79174f89281 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:41.009425 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13ec33c5-f092-4207-9866-0328e766ec0e tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 204 len: 0 microversion: 2.1 time: 0.339017 Aug 04 04:44:41.010353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d3f08901-df0f-45a8-bf73-d79174f89281 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:41.010559 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2359/4588] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:44:40 2022] DELETE /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:44:41.011963 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d3f08901-df0f-45a8-bf73-d79174f89281 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1277 microversion: 2.57 time: 0.116030 Aug 04 04:44:41.023119 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2230/4589] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:40 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:41.038524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:41.040150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:41.049336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.050443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.051498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.052777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.346527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:41.354591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:41.355653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:41.359861 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-09bf3ae9-bd40-42e2-ba7b-86c9b72608fe tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1672 microversion: 2.1 time: 0.335274 Aug 04 04:44:41.360478 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2360/4590] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:41 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1672 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:41.374936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.375450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.378861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.380054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.611543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:41.626767 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-45d3e688-12f8-4ee2-919a-2528eca8cfe8 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.276222 Aug 04 04:44:41.629731 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2231/4591] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:41 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:41.694872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:41.697040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:41.721079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.721543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.722607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.723104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.985342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:41.985935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:41.994630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.995128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.995945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.996393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.028556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:44:42.199197 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b96be39-174e-423d-b7de-c2be1febcdfb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 204 len: 0 microversion: 2.1 time: 0.217062 Aug 04 04:44:42.201052 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2232/4592] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:44:41 2022] DELETE /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:44:42.218285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:42.222050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:42.240259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:42.244486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.247135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.250498 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-52a90bea-d155-4181-b2cd-aad2360a80a9 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.573223 Aug 04 04:44:42.250927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.251996 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2361/4593] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:41 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:42.253268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.270786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:42.272866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:42.286756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.287598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.289272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.289958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.436533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:42.446461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:42.448076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:42.449297 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ff92ec7-7e63-4971-883e-50da35b35755 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1281 microversion: 2.57 time: 0.247064 Aug 04 04:44:42.450125 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2233/4594] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:42 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:42.468148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:42.470430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:42.488095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.490319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.493002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.493474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.547553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:42.558581 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f348eb2f-c4b4-4b2a-993a-9d69c5c3f59b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1552 microversion: 2.1 time: 0.305416 Aug 04 04:44:42.571705 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2362/4595] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:42 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1552 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:42.653822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:42.654973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:42.673343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.674801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.679438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.680201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.844235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:42.854833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:42.886624 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ab43357e-d348-4397-b8df-b3ea5c7402f6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1672 microversion: 2.1 time: 0.435317 Aug 04 04:44:42.893036 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2234/4596] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:42 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1672 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:43.140762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:43.169705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-25a6c296-b9fd-484d-a1ce-3b95eab55b1e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.517559 Aug 04 04:44:43.170740 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2363/4597] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:42 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:43.274981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:43.275622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:43.291808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.294534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.295457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.304649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.474552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:43.475676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:43.482987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.483701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.485120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.485962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.563887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:43.587912 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8840b8d8-7e79-4757-a1cb-55302ff0368c tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.317637 Aug 04 04:44:43.615222 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2235/4598] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:43 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:43.617935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:43.630634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:43.631606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:43.632279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:43.637151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:43.639325 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd8156c0-e918-4d80-acb4-3ddb6183c8d7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1329 microversion: 2.57 time: 0.168658 Aug 04 04:44:43.643255 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2364/4599] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:43 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1329 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:43.668636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.669075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.671810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.672457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.915822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:43.917302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:43.918239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:43.928203 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f4b8c449-6236-4e00-b49d-46334f45224e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1552 microversion: 2.1 time: 0.303503 Aug 04 04:44:43.928791 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2236/4600] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:43 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1552 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:43.938640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.944263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.948332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:43.950089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.192062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:44.193499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:44.237640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.238083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.238891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.268791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.345142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:44.368857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-99767c70-586a-44e6-80a9-1b7cf34dafa6 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1672 microversion: 2.1 time: 0.458429 Aug 04 04:44:44.369419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2365/4601] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:43 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1672 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:44.610916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:44.611962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:44.641453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.647715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.653052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.655985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.836874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:44.850917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f83b33fa-9891-43bb-ba32-f4ee9fe8ba4b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.663278 Aug 04 04:44:44.856681 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2237/4602] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:44 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:44.890591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:44.891376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:44.929345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.930389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.932168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.934207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.296314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:45.315060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:45.317055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:45.324939 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-102b9383-0ab8-4414-a4dd-4ce16937beae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1347 microversion: 2.57 time: 0.459931 Aug 04 04:44:45.328379 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2238/4603] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:44 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1347 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:45.334013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c56eba93-522c-4a82-a558-fc7adc492a65 req-cdc4f512-f641-4744-b452-7f7f6897bcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb902f8-e77f-46dc-8c11-8314bcab00cd", "name": "network-vif-deleted", "tag": "1a0a2711-7fd3-47e2-8dd3-f0614922c7b2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:45.372980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:45.382428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c56eba93-522c-4a82-a558-fc7adc492a65 req-cdc4f512-f641-4744-b452-7f7f6897bcce service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.383221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c56eba93-522c-4a82-a558-fc7adc492a65 req-cdc4f512-f641-4744-b452-7f7f6897bcce service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.388841 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee2a92c8-ed8f-4410-80d2-79cae7bd418d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 0.780510 Aug 04 04:44:45.393727 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2366/4604] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:44 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:45.410046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:45.418458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:45.444538 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c56eba93-522c-4a82-a558-fc7adc492a65 req-cdc4f512-f641-4744-b452-7f7f6897bcce service nova] Creating event network-vif-deleted:1a0a2711-7fd3-47e2-8dd3-f0614922c7b2 for instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd on n-h2-851337-5 Aug 04 04:44:45.446554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.448411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.449263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.449760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.454836 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c56eba93-522c-4a82-a558-fc7adc492a65 req-cdc4f512-f641-4744-b452-7f7f6897bcce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125051 Aug 04 04:44:45.455674 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2239/4605] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:45.468243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:45.471355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:45.498180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.499007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.500488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.522273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.863306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:45.883610 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5e65d8a2-420f-4f4d-90cf-7d147715349b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1552 microversion: 2.1 time: 0.487263 Aug 04 04:44:45.885055 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2367/4606] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:45 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1552 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:45.901671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:45.910813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:45.918190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:45.933232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.933696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.934683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.937333 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a436a2ce-8f07-4053-83a8-9f80594dd0d0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1651 microversion: 2.1 time: 0.480223 Aug 04 04:44:45.937892 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2240/4607] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:45 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1651 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:45.940090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.229919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:46.241577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ac5fac2b-2e24-4b4c-86ab-5e05c4220bde tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.341396 Aug 04 04:44:46.247321 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2368/4608] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:45 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:46.359442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:46.360714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:46.388009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.388845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.392932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.396643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.424718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:46.430215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:46.449857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.451072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.454493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.459056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.712089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:46.746220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:46.748245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:46.749757 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-59909499-5941-4b8b-876b-ee9bafc5bdce tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1335 microversion: 2.57 time: 0.394727 Aug 04 04:44:46.750991 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2241/4609] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:46 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1335 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:46.931132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:46.932118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:46.944490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.955560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.964102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.964740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:47.673090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:47.688940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0dee949-22ae-4c1a-b456-63af6aec4939 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1510 microversion: 2.1 time: 0.775470 Aug 04 04:44:47.706567 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2242/4610] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:46 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1510 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:47.720478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:47.722423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:47.741105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:47.743203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:47.745811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:47.746478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:47.980048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:47.982556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:47.993700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73aba3bb-636d-4972-ac1f-4c14d4653c8f tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1736 microversion: 2.1 time: 1.572923 Aug 04 04:44:47.996817 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2369/4611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:46 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1736 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:48.009928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59674072d54342d790a9334becf72778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22077b0e9e6d4231ba48cfd8f19e75db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:48.011213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:48.012796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:48.040020 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85f3156f-9da3-46f6-a36d-88ff89008a87 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 200 len: 1298 microversion: 2.1 time: 0.332153 Aug 04 04:44:48.047483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.048311 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2243/4612] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:47 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 1298 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:48.068072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.072575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.073334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.077318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6107cc31-603d-4679-ab5f-4f7e43cd5199 req-ea1a4c22-e375-4483-b9e9-dc94c326f9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb902f8-e77f-46dc-8c11-8314bcab00cd", "name": "network-vif-deleted", "tag": "eef1f495-2b62-4b03-b0fe-33dc8f79d138"}, {"server_uuid": "4450dee8-d3be-49ce-8148-e3be79884e79", "name": "network-vif-deleted", "tag": "887ad486-ec37-449e-a3c4-d6c11ac2b4f2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:48.102709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6107cc31-603d-4679-ab5f-4f7e43cd5199 req-ea1a4c22-e375-4483-b9e9-dc94c326f9a7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.103455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6107cc31-603d-4679-ab5f-4f7e43cd5199 req-ea1a4c22-e375-4483-b9e9-dc94c326f9a7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.148543 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6107cc31-603d-4679-ab5f-4f7e43cd5199 req-ea1a4c22-e375-4483-b9e9-dc94c326f9a7 service nova] Creating event network-vif-deleted:eef1f495-2b62-4b03-b0fe-33dc8f79d138 for instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd on n-h2-851337-5 Aug 04 04:44:48.174655 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6107cc31-603d-4679-ab5f-4f7e43cd5199 req-ea1a4c22-e375-4483-b9e9-dc94c326f9a7 service nova] Creating event network-vif-deleted:887ad486-ec37-449e-a3c4-d6c11ac2b4f2 for instance 4450dee8-d3be-49ce-8148-e3be79884e79 on n-h1-851337-5 Aug 04 04:44:48.204603 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6107cc31-603d-4679-ab5f-4f7e43cd5199 req-ea1a4c22-e375-4483-b9e9-dc94c326f9a7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.154777 Aug 04 04:44:48.205228 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2244/4613] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:48.216539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:48.217247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:48.256033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.256499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.257288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.257724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.466729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:48.475775 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-430e96c2-df36-4381-8067-4d34baa17e8a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.476774 Aug 04 04:44:48.481792 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2370/4614] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:47 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:48.504050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:48.521285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:48.531055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:48.538897 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60e264e7-ea07-4e81-9408-22695acb866a tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1356 microversion: 2.57 time: 0.326322 Aug 04 04:44:48.540339 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2245/4615] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:48 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1356 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:48.566214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:48.569957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:48.583902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.584615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.585687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.586289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.724191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:48.727731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:48.745798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.746270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.747090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.756805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.816127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:44:48.820871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:44:48.821682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:44:48.828076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:44:48.829175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:44:48.952917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:48.968862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:48.975839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.978766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.980069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.983388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.084331 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a128ad3-1a9c-426f-970b-8d78f79efd6e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "POST /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb/action" status: 202 len: 1137 microversion: 2.57 time: 0.520528 Aug 04 04:44:49.087739 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2371/4616] 10.222.0.69 () {62 vars in 1320 bytes} [Thu Aug 4 04:44:48 2022] POST /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb/action => generated 1137 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 04:44:49.116789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:49.119535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:49.137159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.139473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.140215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.152295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.179962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:49.193641 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd30fccd-5f8c-48fd-83b6-836b935ee594 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1345 microversion: 2.1 time: 0.472821 Aug 04 04:44:49.197489 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2246/4617] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:48 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1345 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:49.232741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:49.234138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:49.258803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.260853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.261950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.263150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.285373 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] HTTP exception thrown: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Request method failure captured: Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd HTTP/1.1 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605Lpx-KnH6ksBIfYkgcJ8xxAgXcfCJyAPy3bB3rqg_16aRuTy1h9OWPxFpjvE98tPjbKdcnjD2M7n1cCzVoZTkfi709lUAy-fNBtm7AD7so4XQC9kvKMyrl1MgXr7JJgu2A4rlSfo20F9XkrGMvy4e4TxocLE6QCpRUmzaYLLTPWz0 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22077b0e9e6d4231ba48cfd8f19e75db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 59674072d54342d790a9334becf72778 Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '5bb902f8-e77f-46dc-8c11-8314bcab00cd'} Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:49.304344 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:44:49.308391 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:49.308391 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:49.308391 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:49.308391 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:49.308391 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:49.308391 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:49.308391 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:44:49.313005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Returning 404 to user: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:49.330781 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-864b3f10-83f9-4dd3-a2dd-a19f9cc0bc20 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 404 len: 111 microversion: 2.1 time: 0.121070 Aug 04 04:44:49.331686 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2247/4618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:49 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:44:49.354329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:49.355406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:49.370737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.373662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.374737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.377587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.806328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:49.823028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:49.824552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:49.825749 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0f787bc6-d8de-476f-9cb9-31df5e38aa13 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.490964 Aug 04 04:44:49.839340 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2248/4619] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:49 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:49.844400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:49.845106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:49.897528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.898520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.901067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.902030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:50.450703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:50.465315 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d9487ccd-b5ac-45ed-8cc9-6c45f6d94cd1 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.620431 Aug 04 04:44:50.466274 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2249/4620] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:49 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:50.472338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:50.485346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:50.498617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:50.502292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:50.503415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:50.508043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:50.555706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:50.572118 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-155bf791-35bc-4c3a-9e26-df9563764776 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1716 microversion: 2.1 time: 1.479044 Aug 04 04:44:50.575141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2372/4621] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:49 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1716 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:50.685105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:50.827348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:50.828158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:50.846774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:50.847706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:50.849621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:50.850243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.005862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:51.092744 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Cannot 'detach_volume' instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 while it is in vm_state rescued Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments/4cf5e8bb-5c47-4ff1-977a-f4611564017e HTTP/1.1 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'detach_volume' instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 while it is in vm_state rescued Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': 'b8cfd2e6-5f04-4b21-b641-cc235321dc06', 'id': '4cf5e8bb-5c47-4ff1-977a-f4611564017e'} Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 while it is in vm_state rescued Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:51.094416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:51.098833 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:51.098833 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:51.098833 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:51.098833 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:51.098833 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 while it is in vm_state rescued Aug 04 04:44:51.098833 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:51.102685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 409 to user: Cannot 'detach_volume' instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 while it is in vm_state rescued {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:51.104685 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6bdee4fd-621a-4a09-b5f9-ba23b38e8cc8 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments/4cf5e8bb-5c47-4ff1-977a-f4611564017e" status: 409 len: 152 microversion: 2.1 time: 0.281931 Aug 04 04:44:51.113367 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2373/4622] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:44:50 2022] DELETE /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments/4cf5e8bb-5c47-4ff1-977a-f4611564017e => generated 152 bytes in 291 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:44:51.136939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:51.142419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:51.158087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.158848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.159935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.164026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.231378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:51.248364 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-49c320be-6b5d-4e43-96dd-c88e00ad9797 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1345 microversion: 2.1 time: 0.780738 Aug 04 04:44:51.249374 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2250/4623] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:50 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1345 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:51.258983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-efb2a0e6-9dc6-4f94-b296-9b934c22bd37 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:51.267992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-efb2a0e6-9dc6-4f94-b296-9b934c22bd37 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:51.276420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efb2a0e6-9dc6-4f94-b296-9b934c22bd37 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.278364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efb2a0e6-9dc6-4f94-b296-9b934c22bd37 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.279372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efb2a0e6-9dc6-4f94-b296-9b934c22bd37 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.282830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efb2a0e6-9dc6-4f94-b296-9b934c22bd37 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.419604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:51.432224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:51.445718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:51.452178 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cef911db-6ade-4087-a1c9-b1b1cf1fb074 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.336725 Aug 04 04:44:51.457548 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2374/4624] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:51 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:51.465102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-efb2a0e6-9dc6-4f94-b296-9b934c22bd37 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/action" status: 202 len: 0 microversion: 2.1 time: 0.214380 Aug 04 04:44:51.481801 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2251/4625] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:44:51 2022] POST /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:44:51.495919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:51.501800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:51.538986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:51.540357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.540821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.543750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:51.559054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.559860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.568206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.573445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.577842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.579217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.642800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:52.677903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:52.690058 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-066d1e9a-5013-4a6c-9c48-6fc42295780b tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 1.187206 Aug 04 04:44:52.711242 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2252/4626] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:51 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:52.718048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:52.720882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:52.738728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:52.739627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:52.740950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:52.741473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:53.560765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:53.587945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-862f3d80-d401-4993-910e-b2fcd78f26f1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1345 microversion: 2.1 time: 0.867257 Aug 04 04:44:53.589029 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2253/4627] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:52 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1345 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:53.600596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:53.619144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-986289b3-07be-4413-a657-0ac89b836633 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1724 microversion: 2.1 time: 2.129105 Aug 04 04:44:53.621806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:53.622768 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2375/4628] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:51 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1724 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:53.623614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:53.638863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:53.639620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:53.640604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:53.641203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:53.712438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:53.713052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:53.732585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:53.733288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:53.734153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:53.734596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:54.013160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:54.026477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:54.028498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:54.033724 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7ce98f86-af94-459b-8b3c-e82562c152a8 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.443425 Aug 04 04:44:54.034689 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2254/4629] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:53 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:54.201787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:54.212042 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60f974ba-679e-4572-8123-1360acf17914 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.503278 Aug 04 04:44:54.224601 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2376/4630] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:53 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:54.612357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:54.613785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:54.635222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:54.635858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:54.648052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:54.648848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:54.650519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:54.650857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:54.669366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:54.669514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:54.681173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:54.681649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:54.993087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:55.011086 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-13169295-2b8e-4b1a-8f46-f1b6f564ae0f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1345 microversion: 2.1 time: 0.404909 Aug 04 04:44:55.024534 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2255/4631] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:54 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1345 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:55.062632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:55.063532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:55.076953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:55.077686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:55.081732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:55.082365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:55.334975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:55.352745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:55.354514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:55.355930 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c8fa60d-12a3-41cc-b28d-ce69c4126ca0 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.297931 Aug 04 04:44:55.358053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2256/4632] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:55 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:55.361425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:55.366904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:55.367800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:55.376343 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6aa48b3a-da1b-438e-8a0a-ab4d9fee53ba tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1724 microversion: 2.1 time: 0.732686 Aug 04 04:44:55.379132 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2377/4633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:54 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1724 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:55.382543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:55.386644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:55.388789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:55.390088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:55.391052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.039169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:56.040558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:56.057785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.058544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.059826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.061855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.148509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:56.166419 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6307fea-9811-4b6c-a814-9c0f01e1fc1d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.807197 Aug 04 04:44:56.181082 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2257/4634] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:55 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:56.329637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:56.342613 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7be2c8ab-4cf6-401b-a13a-8697c9d1195e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 200 len: 1345 microversion: 2.1 time: 0.309491 Aug 04 04:44:56.350105 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2378/4635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:56 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 1345 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:56.383099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:56.384379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:56.392109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.393262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.394229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.394851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.403622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:56.404606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:56.415947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.421216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.422479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.423589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.656729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:56.668201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:56.670008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:56.671646 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1b30527-4d53-40e7-a022-11f81d3c24f3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.295816 Aug 04 04:44:56.672420 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2258/4636] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:56 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:56.874345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:56.909508 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23982136-69eb-43a1-83f1-00e97f6f3231 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1724 microversion: 2.1 time: 0.507741 Aug 04 04:44:56.939622 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2379/4637] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:56 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1724 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:57.195259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:57.196571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:57.213713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.216393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.219522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.221593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.368800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:57.369385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:57.393197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.400100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.402655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.409240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.431586 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 HTTP/1.1 Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '4450dee8-d3be-49ce-8148-e3be79884e79'} Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:57.434269 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cbbd4005-1e2d-460b-b5bf-98dcf5841e37 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 404 len: 111 microversion: 2.1 time: 0.071840 Aug 04 04:44:57.438901 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2380/4638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:57 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:44:57.548282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:57.562504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1dd2658e-a5e0-4382-8422-a59527897dd7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.373490 Aug 04 04:44:57.566142 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2259/4639] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:57 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:57.665133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:57.669260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:57.682599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.683292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.684513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.685781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.695915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:57.696544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:57.705647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.706108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.706905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.711349 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79/os-volume_attachments HTTP/1.1 Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '4450dee8-d3be-49ce-8148-e3be79884e79'} Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:44:57.713565 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:44:57.717723 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:57.719768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.720437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:57.721320 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8811e861-c31f-4971-828d-45b393b514e9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063896 Aug 04 04:44:57.722130 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2381/4640] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:57 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:44:57.934984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:57.936400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:57.959250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.959932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.962628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.963204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.996123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:58.009975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:58.014839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:58.017070 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a071d719-180d-4218-8be8-0d4e076c0b22 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.325136 Aug 04 04:44:58.027606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2260/4641] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:57 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:44:58.113759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-756815618", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:58.210558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] validate_networks() for [('9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:44:58.536680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:58.558217 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c462522-b2e8-4591-87a0-7b5ae4ef87e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1730 microversion: 2.1 time: 0.630478 Aug 04 04:44:58.580572 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2382/4642] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:57 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1730 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:58.597832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:58.599364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:58.607199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.608633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:58.623697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.626507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:58.676517 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] HTTP exception thrown: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Request method failure captured: Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd HTTP/1.1 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605Lpx-KnH6ksBIfYkgcJ8xxAgXcfCJyAPy3bB3rqg_16aRuTy1h9OWPxFpjvE98tPjbKdcnjD2M7n1cCzVoZTkfi709lUAy-fNBtm7AD7so4XQC9kvKMyrl1MgXr7JJgu2A4rlSfo20F9XkrGMvy4e4TxocLE6QCpRUmzaYLLTPWz0 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22077b0e9e6d4231ba48cfd8f19e75db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 59674072d54342d790a9334becf72778 Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5bb902f8-e77f-46dc-8c11-8314bcab00cd'} Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:44:58.678711 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:58.682350 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:58.685447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Returning 404 to user: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:58.686582 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76289629-1194-4e81-9342-14eb50c1e0aa tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 404 len: 111 microversion: 2.1 time: 0.104595 Aug 04 04:44:58.687755 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2383/4643] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:44:58 2022] DELETE /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:44:58.694357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40f093b1-ea30-41ae-b914-d1e064daffbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:58.694861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40f093b1-ea30-41ae-b914-d1e064daffbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:58.701854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40f093b1-ea30-41ae-b914-d1e064daffbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.702205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40f093b1-ea30-41ae-b914-d1e064daffbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:58.703064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40f093b1-ea30-41ae-b914-d1e064daffbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.703512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40f093b1-ea30-41ae-b914-d1e064daffbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:58.934382 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40f093b1-ea30-41ae-b914-d1e064daffbc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.244967 Aug 04 04:44:58.944008 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2384/4644] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 04:44:58 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:58.950299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:58.951202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:58.963610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.964367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:58.966243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.966707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:59.862918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:59.893372 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40286c89-79cb-47de-a6f3-5d04d76cf901 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.947132 Aug 04 04:44:59.896174 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2385/4645] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:58 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:59.901593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:59.902274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 5bb902f8-e77f-46dc-8c11-8314bcab00cd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:59.911758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:59.912275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:59.914087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:59.914576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:59.938010 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] HTTP exception thrown: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Request method failure captured: Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd HTTP/1.1 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605Lpx-KnH6ksBIfYkgcJ8xxAgXcfCJyAPy3bB3rqg_16aRuTy1h9OWPxFpjvE98tPjbKdcnjD2M7n1cCzVoZTkfi709lUAy-fNBtm7AD7so4XQC9kvKMyrl1MgXr7JJgu2A4rlSfo20F9XkrGMvy4e4TxocLE6QCpRUmzaYLLTPWz0 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22077b0e9e6d4231ba48cfd8f19e75db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 59674072d54342d790a9334becf72778 Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5bb902f8-e77f-46dc-8c11-8314bcab00cd'} Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:59.939958 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:59.944464 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:59.944464 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:59.944464 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:59.944464 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:59.944464 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:59.944464 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. Aug 04 04:44:59.944464 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:44:59.946406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Returning 404 to user: Instance 5bb902f8-e77f-46dc-8c11-8314bcab00cd could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:59.948565 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4750562d-4983-43b4-a6ae-7076df4b8a45 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd" status: 404 len: 111 microversion: 2.1 time: 0.050345 Aug 04 04:44:59.949303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2386/4646] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:59 2022] GET /compute/v2.1/servers/5bb902f8-e77f-46dc-8c11-8314bcab00cd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:44:59.960458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:59.961574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:59.971471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:59.972334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:59.973944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:59.974572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.010273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:00.135221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:00.147663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:00.153323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:00.155141 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63a45691-1f09-4c48-abd8-7e119379a168 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.201490 Aug 04 04:45:00.172916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2387/4647] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:44:59 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:00.187862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:00.188654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:00.204822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.205987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.208591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.210256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.240247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:45:00.240955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:45:00.241317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:45:00.241736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:45:00.242156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:45:00.253522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.253982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.254826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.255321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.262265 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] HTTP exception thrown: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Request method failure captured: Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 HTTP/1.1 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605Lpx-KnH6ksBIfYkgcJ8xxAgXcfCJyAPy3bB3rqg_16aRuTy1h9OWPxFpjvE98tPjbKdcnjD2M7n1cCzVoZTkfi709lUAy-fNBtm7AD7so4XQC9kvKMyrl1MgXr7JJgu2A4rlSfo20F9XkrGMvy4e4TxocLE6QCpRUmzaYLLTPWz0 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22077b0e9e6d4231ba48cfd8f19e75db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestMultiNic-1800131880 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 59674072d54342d790a9334becf72778 Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '908eb1eb-98e9-4802-b854-655207aadfc0'} Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:00.271579 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Returning 404 to user: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e4605d84-9fac-456a-b326-112b3149a1e0 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "DELETE /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 404 len: 111 microversion: 2.1 time: 0.098987 Aug 04 04:45:00.280466 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2388/4648] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:45:00 2022] DELETE /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:00.292195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:00.292824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] [instance: 908eb1eb-98e9-4802-b854-655207aadfc0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:00.312524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.312977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.313783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.314220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.336248 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] HTTP exception thrown: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Request method failure captured: Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 HTTP/1.1 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605Lpx-KnH6ksBIfYkgcJ8xxAgXcfCJyAPy3bB3rqg_16aRuTy1h9OWPxFpjvE98tPjbKdcnjD2M7n1cCzVoZTkfi709lUAy-fNBtm7AD7so4XQC9kvKMyrl1MgXr7JJgu2A4rlSfo20F9XkrGMvy4e4TxocLE6QCpRUmzaYLLTPWz0 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22077b0e9e6d4231ba48cfd8f19e75db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22077b0e9e6d4231ba48cfd8f19e75db", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersTestMultiNic-1800131880 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 22077b0e9e6d4231ba48cfd8f19e75db Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersTestMultiNic-1800131880 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 59674072d54342d790a9334becf72778 Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersTestMultiNic-1800131880-project Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '908eb1eb-98e9-4802-b854-655207aadfc0'} Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:00.346182 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:00.351408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] Returning 404 to user: Instance 908eb1eb-98e9-4802-b854-655207aadfc0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:00.351962 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55353ae1-d270-4125-8f9a-96ff3b807d05 tempest-ServersTestMultiNic-1800131880 tempest-ServersTestMultiNic-1800131880-project] 10.222.0.69 "GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0" status: 404 len: 111 microversion: 2.1 time: 0.063544 Aug 04 04:45:00.357170 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2389/4649] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:00 2022] GET /compute/v2.1/servers/908eb1eb-98e9-4802-b854-655207aadfc0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:00.371584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:45:00.380189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for user 0e04770e8fd84cff82e73ffd27b8a50a and project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:45:00.421211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:45:00.430529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8a1e2936-2c54-4816-a27a-66779d734a74 req-75e2f8ec-9a11-4a67-b42c-3a8924360d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f5eefa-1541-4941-bfbf-f885d2caff54", "name": "network-vif-plugged", "status": "completed", "tag": "559baab8-11cc-496b-bd08-390c3d4213d2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:00.459194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:45:00.469261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8a1e2936-2c54-4816-a27a-66779d734a74 req-75e2f8ec-9a11-4a67-b42c-3a8924360d1f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.472131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8a1e2936-2c54-4816-a27a-66779d734a74 req-75e2f8ec-9a11-4a67-b42c-3a8924360d1f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.500206 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8a1e2936-2c54-4816-a27a-66779d734a74 req-75e2f8ec-9a11-4a67-b42c-3a8924360d1f service nova] Creating event network-vif-plugged:559baab8-11cc-496b-bd08-390c3d4213d2 for instance f4f5eefa-1541-4941-bfbf-f885d2caff54 on n-h2-851337-5 Aug 04 04:45:00.511933 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8a1e2936-2c54-4816-a27a-66779d734a74 req-75e2f8ec-9a11-4a67-b42c-3a8924360d1f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088158 Aug 04 04:45:00.513539 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2390/4650] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:00.604532 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-49986df7-a092-4d6a-a9c9-1db06e86a7b7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.494246 Aug 04 04:45:00.605872 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2261/4651] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:45:00.618344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fb14088d-6215-4e37-b87d-fc5cd15dd2b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:00.619360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fb14088d-6215-4e37-b87d-fc5cd15dd2b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:00.918751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:00.919410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:00.930997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.937055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.938063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.938709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:01.096360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fb14088d-6215-4e37-b87d-fc5cd15dd2b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:01.104629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fb14088d-6215-4e37-b87d-fc5cd15dd2b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec" status: 200 len: 1214 microversion: 2.1 time: 0.491288 Aug 04 04:45:01.116429 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2391/4652] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:00 2022] GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec => generated 1214 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:01.128546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7421e843-4dfa-4fe9-9269-301c2d5028cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:01.129114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7421e843-4dfa-4fe9-9269-301c2d5028cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:01.172112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7421e843-4dfa-4fe9-9269-301c2d5028cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:45:01.662505 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.scheduler.client.report [None req-7421e843-4dfa-4fe9-9269-301c2d5028cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Deleted allocations for instance f981cbd7-90eb-4d64-812b-4a7c908eefec Aug 04 04:45:01.673594 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-7421e843-4dfa-4fe9-9269-301c2d5028cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] Instance Mapping does not exist while attempting local delete cleanup. Aug 04 04:45:01.674861 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7421e843-4dfa-4fe9-9269-301c2d5028cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec" status: 204 len: 0 microversion: 2.1 time: 0.550634 Aug 04 04:45:01.676046 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2392/4653] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:45:01 2022] DELETE /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:45:01.681887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:01.682782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:01.693024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:01.693924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:01.695096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:01.695976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:01.898240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:01.907937 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-821fd511-ba15-409d-a6d2-405084e360c4 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.993269 Aug 04 04:45:01.909869 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2262/4654] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:00 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:01.961826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:01.975756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e857d3d2-885b-40f6-aa9a-47d2f203e28f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:01.977135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e857d3d2-885b-40f6-aa9a-47d2f203e28f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:01.986331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:01.993395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:01.997582 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a2f32bec-84aa-4d6f-8ed0-56e7873a2ea3 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.319352 Aug 04 04:45:01.998160 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e857d3d2-885b-40f6-aa9a-47d2f203e28f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e857d3d2-885b-40f6-aa9a-47d2f203e28f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec HTTP/1.1 Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f981cbd7-90eb-4d64-812b-4a7c908eefec'} Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:02.001222 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:02.005579 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:02.005579 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:02.005579 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:02.005579 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:45:02.005579 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:02.005886 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2393/4655] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:01 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:02.005962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e857d3d2-885b-40f6-aa9a-47d2f203e28f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:02.005962 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e857d3d2-885b-40f6-aa9a-47d2f203e28f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec" status: 404 len: 111 microversion: 2.1 time: 0.092288 Aug 04 04:45:02.005962 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2263/4656] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:01 2022] GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:02.138557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-258554820", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:02.245029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] validate_networks() for [('9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:45:02.929638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:02.930251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:02.942886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:02.947699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:02.971116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:02.974027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:03.391711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:03.400392 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d020afdc-6ea8-4288-a9ee-84fd0bd670da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1518 microversion: 2.1 time: 0.474591 Aug 04 04:45:03.410997 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2264/4657] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:02 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1518 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:03.410997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:03.410997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:03.416706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:03.416706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:03.416706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:03.416706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:03.764302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:03.774819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:03.776696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:03.778640 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c230010f-12e8-4343-ab13-fef54a33ff1e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.376118 Aug 04 04:45:03.780158 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2265/4658] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:03 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:04.358994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-adbe1555-56c3-4c61-990d-59524c2e7600 req-c8008063-1f3c-46fa-aebe-6e2c0e5559d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfd2e6-5f04-4b21-b641-cc235321dc06", "tag": "7cc6be0b-3dc7-4f8b-91d7-4a80eb827025"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:04.378386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-adbe1555-56c3-4c61-990d-59524c2e7600 req-c8008063-1f3c-46fa-aebe-6e2c0e5559d7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.383071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-adbe1555-56c3-4c61-990d-59524c2e7600 req-c8008063-1f3c-46fa-aebe-6e2c0e5559d7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.404231 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-adbe1555-56c3-4c61-990d-59524c2e7600 req-c8008063-1f3c-46fa-aebe-6e2c0e5559d7 service nova] Creating event network-changed:7cc6be0b-3dc7-4f8b-91d7-4a80eb827025 for instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 on n-h1-851337-5 Aug 04 04:45:04.411512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-adbe1555-56c3-4c61-990d-59524c2e7600 req-c8008063-1f3c-46fa-aebe-6e2c0e5559d7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276488 Aug 04 04:45:04.412714 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2266/4659] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:04.425711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:04.427868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:04.435071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.435832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.437075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.443451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.640312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:45:04.641902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:45:04.643870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:45:04.647770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:45:04.648447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:45:04.701698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.703547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.707958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.708689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.752951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:45:04.760161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for user 0e04770e8fd84cff82e73ffd27b8a50a and project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:45:04.779148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:45:04.781883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:45:04.836687 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-802abbb6-124a-49cb-8151-49405ddbf371 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.702956 Aug 04 04:45:04.837738 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2394/4660] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:45:04.842976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:04.844316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:04.852331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.854522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.856048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.856733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:05.439737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:05.462889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:05.465498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:05.467244 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d576c8f-d19a-4de9-8af2-bffa564dca0b tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.628136 Aug 04 04:45:05.468061 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2395/4661] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:04 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:05.480855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:05.490297 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-599dce1c-64ed-4e23-8d84-d0afd7a010b7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 1.069321 Aug 04 04:45:05.492987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:05.493929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:05.494230 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2267/4662] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:04 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:05.517172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:05.518080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:05.525583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:05.535868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:05.536461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:05.537473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:05.538103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:05.539014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:05.543142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:05.543641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:05.843687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:05.866327 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-810961b8-44c6-473a-ba42-1c2f99546acd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1218 microversion: 2.1 time: 0.395812 Aug 04 04:45:05.868360 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2396/4663] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:05 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1218 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:06.306625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:06.320640 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fc1da301-2c93-4229-a95e-5b3b920c79e3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.807288 Aug 04 04:45:06.321675 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2268/4664] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:05 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:06.369537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:06.370468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:06.383764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.384433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.385397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.387570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.495305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:06.496841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:06.509992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.510866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.513071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.514093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.781569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:06.801371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:06.803202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:06.804654 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1758901-29ed-424b-92bb-4b221503ae64 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.317499 Aug 04 04:45:06.805271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2269/4665] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:06 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:06.823341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-989a554f-5e9b-496f-9f0a-548774f318c2 req-23b88d4f-04b5-4826-8f5e-ee4657db0030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfd2e6-5f04-4b21-b641-cc235321dc06", "tag": "7cc6be0b-3dc7-4f8b-91d7-4a80eb827025"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:06.835020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-989a554f-5e9b-496f-9f0a-548774f318c2 req-23b88d4f-04b5-4826-8f5e-ee4657db0030 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.835721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-989a554f-5e9b-496f-9f0a-548774f318c2 req-23b88d4f-04b5-4826-8f5e-ee4657db0030 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.849020 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-989a554f-5e9b-496f-9f0a-548774f318c2 req-23b88d4f-04b5-4826-8f5e-ee4657db0030 service nova] Creating event network-changed:7cc6be0b-3dc7-4f8b-91d7-4a80eb827025 for instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 on n-h1-851337-5 Aug 04 04:45:06.854553 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-989a554f-5e9b-496f-9f0a-548774f318c2 req-23b88d4f-04b5-4826-8f5e-ee4657db0030 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047786 Aug 04 04:45:06.855556 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2270/4666] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:06.896181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:06.897522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:06.907169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.907879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.909381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.910200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.080952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:07.086260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:07.097468 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dedc0002-1c8c-4e2c-89f0-523a70e2a8ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1272 microversion: 2.1 time: 0.208882 Aug 04 04:45:07.098456 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2271/4667] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:06 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:07.101549 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55d194c7-2220-4df2-a72f-8cd6209478da tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.737258 Aug 04 04:45:07.102388 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2397/4668] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:06 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:07.136610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7dad9875-b2f5-459c-874b-99e14e6be618 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:07.157189 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7dad9875-b2f5-459c-874b-99e14e6be618 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 32f1063c-9b06-480a-b98f-90a2d8894c65 has no mapping to a cell. Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7dad9875-b2f5-459c-874b-99e14e6be618 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/32f1063c-9b06-480a-b98f-90a2d8894c65/action HTTP/1.1 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 15 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: {"os-stop": {}} Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 32f1063c-9b06-480a-b98f-90a2d8894c65 has no mapping to a cell. Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '32f1063c-9b06-480a-b98f-90a2d8894c65', 'body': {'os-stop': {}}} Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 32f1063c-9b06-480a-b98f-90a2d8894c65 has no mapping to a cell. Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:07.163075 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f1063c-9b06-480a-b98f-90a2d8894c65 has no mapping to a cell. Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f1063c-9b06-480a-b98f-90a2d8894c65 has no mapping to a cell. Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7dad9875-b2f5-459c-874b-99e14e6be618 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 32f1063c-9b06-480a-b98f-90a2d8894c65 has no mapping to a cell. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:07.168061 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7dad9875-b2f5-459c-874b-99e14e6be618 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/32f1063c-9b06-480a-b98f-90a2d8894c65/action" status: 404 len: 117 microversion: 2.1 time: 0.032096 Aug 04 04:45:07.174911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:07.175798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:07.179271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2272/4669] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:07 2022] POST /compute/v2.1/servers/32f1063c-9b06-480a-b98f-90a2d8894c65/action => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:07.186657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.187244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.188322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.189262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.571373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:07.588478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ea0b365-4b4e-40ea-8658-669d19f8f603 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.417382 Aug 04 04:45:07.599629 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2398/4670] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:07 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:07.620004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:07.620464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:07.630454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.631042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.633174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.633933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.639920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:07.830835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:07.831724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:07.845087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.846782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.849441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.850803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:08.426414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:08.436805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:08.439759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:08.441176 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c1cfae9-9c10-4657-a439-040a09839a20 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.616152 Aug 04 04:45:08.443138 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2399/4671] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:07 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:08.447907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:08.448698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:08.461467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:08.462787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:08.463784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:08.464383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:08.479299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:08.493130 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91a80b83-0d95-4940-a05e-dfc4231022d5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.879029 Aug 04 04:45:08.496314 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2273/4672] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:07 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:08.519624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7bc476bb-6562-4bd0-a61b-96940d2dadaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:08.521423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7bc476bb-6562-4bd0-a61b-96940d2dadaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: df5fa8f6-8746-42dc-861f-c1349a9db757] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:08.528679 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7bc476bb-6562-4bd0-a61b-96940d2dadaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance df5fa8f6-8746-42dc-861f-c1349a9db757 could not be found. Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7bc476bb-6562-4bd0-a61b-96940d2dadaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/df5fa8f6-8746-42dc-861f-c1349a9db757/action HTTP/1.1 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 15 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: {"suspend": {}} Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance df5fa8f6-8746-42dc-861f-c1349a9db757 could not be found. Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'df5fa8f6-8746-42dc-861f-c1349a9db757', 'body': {'suspend': {}}} Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5fa8f6-8746-42dc-861f-c1349a9db757 could not be found. Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5fa8f6-8746-42dc-861f-c1349a9db757 could not be found. Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:08.530474 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:08.535098 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:08.535098 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:08.535098 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5fa8f6-8746-42dc-861f-c1349a9db757 could not be found. Aug 04 04:45:08.535098 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:08.540650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7bc476bb-6562-4bd0-a61b-96940d2dadaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance df5fa8f6-8746-42dc-861f-c1349a9db757 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:08.541733 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7bc476bb-6562-4bd0-a61b-96940d2dadaa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/df5fa8f6-8746-42dc-861f-c1349a9db757/action" status: 404 len: 111 microversion: 2.1 time: 0.026771 Aug 04 04:45:08.542846 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2274/4673] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:08 2022] POST /compute/v2.1/servers/df5fa8f6-8746-42dc-861f-c1349a9db757/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:08.558295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:08.559329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:08.575039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:08.575837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:08.577036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:08.578064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:08.942825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:08.954404 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-07ace38f-f510-41dc-a124-ffc66ef7ace6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1314 microversion: 2.1 time: 0.510012 Aug 04 04:45:08.955691 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2400/4674] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:08 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:08.962782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:08.971409 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-06290fad-d0c8-471a-a922-bdbcfcbc8746 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.423899 Aug 04 04:45:08.979374 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2275/4675] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:08 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:09.001610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:09.002248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:09.009218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.009415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.010244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.010898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.468202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:09.468832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:09.486881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.487387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.488165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.488684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.806039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:09.815438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:09.824530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:09.825897 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92811481-673b-48ef-b94f-01f8dfbfbc2e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.363795 Aug 04 04:45:09.828824 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2276/4676] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:09 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:09.924801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:09.951371 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44ac605a-5d86-4736-b053-e944b87d96a7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.950625 Aug 04 04:45:09.953292 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2401/4677] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:08 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:09.973279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:09.974852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:09.983219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:09.984097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:09.986796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.987343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.988164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.989214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.999100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.001440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.003821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.005024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.018121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lazy-loading 'flavor' on Instance uuid f4f5eefa-1541-4941-bfbf-f885d2caff54 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:45:10.120359 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3da00f33-a4bb-44c2-87ca-7734ac56ca4c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 202 len: 0 microversion: 2.1 time: 0.151353 Aug 04 04:45:10.121803 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2277/4678] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:09 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:45:10.134019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:10.135589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:10.147276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.148636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.149713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.151152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.312293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:10.410511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:10.689917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:10.704079 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-854ac247-c4b6-41c2-a85f-f0c303898d53 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1314 microversion: 2.1 time: 0.725960 Aug 04 04:45:10.711371 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2402/4679] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:09 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:10.857210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:10.859013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:10.867267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.868416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.869721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.870806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.891445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:10.899958 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e6d494c-1057-440f-8caf-ee7d3d27928c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1513 microversion: 2.1 time: 0.773985 Aug 04 04:45:10.902536 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2278/4680] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:10 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1513 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:11.065815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-15053dc9-644f-405a-952e-18fbfaa682aa req-cbbd035d-8b16-45ef-948b-6f3b8fb7351c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0033f2-2ab6-4d46-b878-eacdb321ebc7", "tag": "b45bbc39-f774-4add-8197-d2869f6a9bed"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:11.084298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-15053dc9-644f-405a-952e-18fbfaa682aa req-cbbd035d-8b16-45ef-948b-6f3b8fb7351c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.086124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-15053dc9-644f-405a-952e-18fbfaa682aa req-cbbd035d-8b16-45ef-948b-6f3b8fb7351c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.121452 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-15053dc9-644f-405a-952e-18fbfaa682aa req-cbbd035d-8b16-45ef-948b-6f3b8fb7351c service nova] Creating event network-changed:b45bbc39-f774-4add-8197-d2869f6a9bed for instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 on n-h2-851337-5 Aug 04 04:45:11.127826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-15053dc9-644f-405a-952e-18fbfaa682aa req-cbbd035d-8b16-45ef-948b-6f3b8fb7351c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077648 Aug 04 04:45:11.130069 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2279/4681] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:11.203403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:11.216359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:11.218581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:11.221017 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d88fb22b-cb0d-4b3f-97d2-33b4a097a499 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.367783 Aug 04 04:45:11.223861 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2403/4682] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:10 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:45:11.737330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:11.738211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:11.752608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.754041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.755578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.756348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.947160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:11.951453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:11.976154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.977541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.979042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.979751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.542173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:12.556025 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-86256142-941c-4790-994f-96293c2629ff tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1314 microversion: 2.1 time: 0.826766 Aug 04 04:45:12.557741 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2280/4683] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:11 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:12.566164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:12.568544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:12.583870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.584619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.592026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.592861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.680267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:12.692058 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1efdc8d7-7883-4819-8dfd-a8cc7171fb43 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1496 microversion: 2.1 time: 0.766240 Aug 04 04:45:12.692702 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2404/4684] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:11 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1496 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:12.714547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:12.715198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:12.738626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.739216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.739901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.740338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.773015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lazy-loading 'flavor' on Instance uuid f4f5eefa-1541-4941-bfbf-f885d2caff54 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:45:12.788745 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Cannot 'suspend' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state suspended Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action HTTP/1.1 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 15 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: {"suspend": {}} Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'suspend' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state suspended Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'suspend': {}}} Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 04 04:45:12.790748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state suspended Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state suspended Aug 04 04:45:12.795585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:12.797379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 409 to user: Cannot 'suspend' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state suspended {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:12.798423 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2577a6a2-a478-43e4-bea6-8efcd9e71e1a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 409 len: 148 microversion: 2.1 time: 0.088709 Aug 04 04:45:12.802575 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2405/4685] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:12 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 148 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:45:12.808287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-49179d94-b526-4dca-baf5-459e4094996d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:12.809061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-49179d94-b526-4dca-baf5-459e4094996d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:12.819343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49179d94-b526-4dca-baf5-459e4094996d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.819911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49179d94-b526-4dca-baf5-459e4094996d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.821389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49179d94-b526-4dca-baf5-459e4094996d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.822135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49179d94-b526-4dca-baf5-459e4094996d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.893775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:12.906918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:12.908570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:12.909816 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-553726c7-3308-4e06-9937-265b8608939e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.350863 Aug 04 04:45:12.916117 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2281/4686] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:12 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:12.959292 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-49179d94-b526-4dca-baf5-459e4094996d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 202 len: 0 microversion: 2.1 time: 0.155102 Aug 04 04:45:12.963010 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2406/4687] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:12 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:45:12.971455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:12.993523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:13.037202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.037811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.041276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.041933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.427798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:13.438327 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b49f143e-a975-4edc-8816-fb7357f83dba tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1502 microversion: 2.1 time: 0.473255 Aug 04 04:45:13.459295 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2282/4688] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:12 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1502 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:13.585386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:13.586323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:13.605023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.605829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.606908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.607605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.942502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:13.943969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:13.958921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.959924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.961041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.961880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:14.168765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:14.184159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:14.188173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:14.189285 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c3d19bfc-1364-4218-8314-018a1f665079 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.251866 Aug 04 04:45:14.203708 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2283/4689] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:13 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:14.228001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:14.231645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:14.244201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1cb05ec6-043f-456e-8512-8c200caa998e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1314 microversion: 2.1 time: 0.665883 Aug 04 04:45:14.246461 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2407/4690] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:13 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:14.473398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:14.474863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:14.484088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:14.485018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:14.487092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:14.487698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.241433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:15.246656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:15.257635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:15.259252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:15.260284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:15.263757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:15.266164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.266982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.268198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.268799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.276729 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d293b22d-e630-42c5-b811-ddb24489a64e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1502 microversion: 2.1 time: 0.811816 Aug 04 04:45:15.306657 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2284/4691] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:14 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1502 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:15.325188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:15.326243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:15.342702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.344158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.346253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.346929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.586091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:15.595635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:15.597771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:15.600891 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-28fbb729-8133-493f-a25d-becbf7ee7527 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1365 microversion: 2.57 time: 0.387885 Aug 04 04:45:15.601485 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2408/4692] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:15 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:15.710579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:15.720784 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52975ff5-b424-422c-b7d3-8c596866962f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1314 microversion: 2.1 time: 0.412348 Aug 04 04:45:15.722376 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2285/4693] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:15 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:16.192566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1e0969d5-6754-4e14-af9e-e343b956cfd6 req-e4396e2f-d038-423c-af2b-98c9fb8036cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0033f2-2ab6-4d46-b878-eacdb321ebc7", "name": "network-vif-plugged", "status": "completed", "tag": "b45bbc39-f774-4add-8197-d2869f6a9bed"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:16.218080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1e0969d5-6754-4e14-af9e-e343b956cfd6 req-e4396e2f-d038-423c-af2b-98c9fb8036cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.227669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1e0969d5-6754-4e14-af9e-e343b956cfd6 req-e4396e2f-d038-423c-af2b-98c9fb8036cb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.250544 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1e0969d5-6754-4e14-af9e-e343b956cfd6 req-e4396e2f-d038-423c-af2b-98c9fb8036cb service nova] Creating event network-vif-plugged:b45bbc39-f774-4add-8197-d2869f6a9bed for instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 on n-h2-851337-5 Aug 04 04:45:16.261709 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1e0969d5-6754-4e14-af9e-e343b956cfd6 req-e4396e2f-d038-423c-af2b-98c9fb8036cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073093 Aug 04 04:45:16.270270 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2409/4694] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:16.303770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:16.305579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:16.313219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.314023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.315077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.316111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.626513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:16.627563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:16.643990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.645483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.647337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.647956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.758613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:16.769153 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bf74892f-30fc-4e51-8077-9a0c91a2ea5a tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1502 microversion: 2.1 time: 0.469271 Aug 04 04:45:16.770708 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2286/4695] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:16 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1502 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:16.775887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:16.776678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:16.783020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.783690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.784642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.785934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.844117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:16.858535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:16.860850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:16.864371 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ffd5be4-9b55-4467-a0c5-83aa80c4cb18 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1371 microversion: 2.57 time: 0.240909 Aug 04 04:45:16.866158 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2410/4696] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:16 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:45:17.105013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:17.113171 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6853d138-ec55-46cc-ba2c-7190d453530d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1314 microversion: 2.1 time: 0.341090 Aug 04 04:45:17.117479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2287/4697] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:16 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:17.791530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:17.793119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:17.803437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:17.804347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:17.805605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:17.807748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:17.897435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:17.899506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:17.914396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:17.915610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:17.917290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:17.918015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.092388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:18.106268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:18.107842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:18.109061 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7a6f46c-f79a-42e3-84d5-4582a5024d87 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1371 microversion: 2.57 time: 0.222004 Aug 04 04:45:18.109609 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2288/4698] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:17 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:18.135506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:18.139775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:18.140572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:18.149728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-abc2d7d4-9fe8-479d-80e9-0f3d3feacee5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.362317 Aug 04 04:45:18.151681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.152300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.153341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.153843 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2411/4699] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:17 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:18.153979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.183004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:18.183684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:18.222931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.223713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.228007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.228773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.432342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:18.436830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:18.445585 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb8d5af0-e51d-4629-9c23-2e2afbf39a1f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1314 microversion: 2.1 time: 0.311260 Aug 04 04:45:18.446189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2289/4700] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:18 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:18.598726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:18.608733 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-04b23273-25cc-4ff8-bfa9-759bfb9f87ae tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.431532 Aug 04 04:45:18.610745 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2412/4701] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:18 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:18.633222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e76713de-6c80-4a9b-adb2-fc46140ecc8d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:18.634000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e76713de-6c80-4a9b-adb2-fc46140ecc8d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 44d84b0b-af98-4b67-8d81-5dd60a7b74cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:18.641860 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e76713de-6c80-4a9b-adb2-fc46140ecc8d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 44d84b0b-af98-4b67-8d81-5dd60a7b74cf could not be found. Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e76713de-6c80-4a9b-adb2-fc46140ecc8d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/44d84b0b-af98-4b67-8d81-5dd60a7b74cf/action HTTP/1.1 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 15 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: {"unpause": {}} Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 44d84b0b-af98-4b67-8d81-5dd60a7b74cf could not be found. Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '44d84b0b-af98-4b67-8d81-5dd60a7b74cf', 'body': {'unpause': {}}} Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d84b0b-af98-4b67-8d81-5dd60a7b74cf could not be found. Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d84b0b-af98-4b67-8d81-5dd60a7b74cf could not be found. Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:18.643969 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:18.650367 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:18.650367 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:18.650367 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d84b0b-af98-4b67-8d81-5dd60a7b74cf could not be found. Aug 04 04:45:18.650367 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:18.652470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e76713de-6c80-4a9b-adb2-fc46140ecc8d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 44d84b0b-af98-4b67-8d81-5dd60a7b74cf could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:18.653504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e76713de-6c80-4a9b-adb2-fc46140ecc8d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/44d84b0b-af98-4b67-8d81-5dd60a7b74cf/action" status: 404 len: 111 microversion: 2.1 time: 0.025679 Aug 04 04:45:18.654585 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2290/4702] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:18 2022] POST /compute/v2.1/servers/44d84b0b-af98-4b67-8d81-5dd60a7b74cf/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:18.665372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:18.665372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:18.671819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.693705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.697950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.701881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.135557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.136949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.147888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.148385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.149176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.149610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.281285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.296517 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2746ed0b-f6dc-47f5-8302-9044f48c9620 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.630924 Aug 04 04:45:19.298685 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2413/4703] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:18 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:19.317787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.329563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.331455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.333648 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-220d0ce4-08c3-48d3-97e7-f4e4d5906e9e tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1356 microversion: 2.57 time: 0.203425 Aug 04 04:45:19.334698 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2291/4704] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:19 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:45:19.335608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.337922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.359950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.360407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.361199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.361642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.364923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.367109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.374028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.374787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.375805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.376429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.426553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:45:19.535724 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8328a1b2-07d6-4815-8ae1-e820f3f493f4 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "DELETE /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 204 len: 0 microversion: 2.57 time: 0.176183 Aug 04 04:45:19.537606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2292/4705] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:45:19 2022] DELETE /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:45:19.544478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.545839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.556392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.557763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.563663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.563795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.605076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.623663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6fed6ba-e42a-495e-abc1-49fb7c519a5f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.303485 Aug 04 04:45:19.624701 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2414/4706] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:19 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:19.651773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.652561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.662643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.663192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.664944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.665597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.805264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.824865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.828493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.832988 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a65f3337-2528-4073-abdd-7420ee0e5849 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1362 microversion: 2.57 time: 0.206257 Aug 04 04:45:19.833784 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2415/4707] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:19 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:19.841355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:19.842229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.851627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.855675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.856964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.857705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.896016 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Cannot 'unpause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action HTTP/1.1 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 15 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: {"unpause": {}} Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'unpause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'unpause': {}}} Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 in vm_state active. Cannot unpause while the instance is in this state. Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:19.899386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:19.906157 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:19.906157 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:19.906157 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:19.906157 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:19.906157 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:19.908414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 409 to user: Cannot 'unpause' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:19.909561 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46c26876-1fb8-4f9a-b36c-f53ee8697e0e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 409 len: 145 microversion: 2.1 time: 0.074599 Aug 04 04:45:19.913999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:19.915067 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2416/4708] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:19 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 145 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:45:19.921140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.922006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.926409 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c2e4691b-bc15-45c0-b40c-8f64496a4d82 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1499 microversion: 2.1 time: 0.384711 Aug 04 04:45:19.927510 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2293/4709] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:19 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1499 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:19.931739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.932791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.934388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.935728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.949340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81b6b1d7-a45f-48dc-b5f1-9ea1acc147b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:19.951048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81b6b1d7-a45f-48dc-b5f1-9ea1acc147b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.967422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b6b1d7-a45f-48dc-b5f1-9ea1acc147b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.977597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b6b1d7-a45f-48dc-b5f1-9ea1acc147b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.979707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b6b1d7-a45f-48dc-b5f1-9ea1acc147b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.980164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b6b1d7-a45f-48dc-b5f1-9ea1acc147b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.099986 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81b6b1d7-a45f-48dc-b5f1-9ea1acc147b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7/action" status: 202 len: 0 microversion: 2.1 time: 0.155609 Aug 04 04:45:20.100572 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2294/4710] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:19 2022] POST /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:45:20.109235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:20.109948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:20.117129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.117867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.118817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.119449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.437167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:20.446768 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3dd690cd-c7c6-493c-bcf3-b69ec8d9e0b6 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.530409 Aug 04 04:45:20.464945 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2417/4711] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:19 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:20.471807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:20.472705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:20.480474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.481172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.482130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.482729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.578896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:20.588116 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24434fa0-2c94-4432-ab3c-6f3cc88f0c99 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1504 microversion: 2.1 time: 0.483093 Aug 04 04:45:20.591619 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2295/4712] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:20 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:20.860611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:20.861238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:20.868789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.869490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.870435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.871057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:21.018004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:21.027439 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-259a01aa-4b38-4f7b-9324-ea3b6c20401c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.559434 Aug 04 04:45:21.029739 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2418/4713] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:20 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:21.031840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:21.042183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:21.043772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:21.045194 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-985efb78-c457-4947-b4b1-ee92b29c43f7 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1362 microversion: 2.57 time: 0.188590 Aug 04 04:45:21.046271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2296/4714] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:20 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:45:21.063120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13c8849c-819a-4765-a7be-4b94700b7ca5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:21.064113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13c8849c-819a-4765-a7be-4b94700b7ca5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 267e9a79-6d44-4a5d-82c4-ae15d80b5b9f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:21.073535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-13c8849c-819a-4765-a7be-4b94700b7ca5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 267e9a79-6d44-4a5d-82c4-ae15d80b5b9f could not be found. Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13c8849c-819a-4765-a7be-4b94700b7ca5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/267e9a79-6d44-4a5d-82c4-ae15d80b5b9f/action HTTP/1.1 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 18 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: {"unshelve": null} Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 267e9a79-6d44-4a5d-82c4-ae15d80b5b9f could not be found. Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '267e9a79-6d44-4a5d-82c4-ae15d80b5b9f', 'body': {'unshelve': None}} Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267e9a79-6d44-4a5d-82c4-ae15d80b5b9f could not be found. Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267e9a79-6d44-4a5d-82c4-ae15d80b5b9f could not be found. Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:21.075238 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267e9a79-6d44-4a5d-82c4-ae15d80b5b9f could not be found. Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13c8849c-819a-4765-a7be-4b94700b7ca5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 267e9a79-6d44-4a5d-82c4-ae15d80b5b9f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:21.079701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13c8849c-819a-4765-a7be-4b94700b7ca5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/267e9a79-6d44-4a5d-82c4-ae15d80b5b9f/action" status: 404 len: 111 microversion: 2.1 time: 0.021290 Aug 04 04:45:21.082610 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2419/4715] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:21 2022] POST /compute/v2.1/servers/267e9a79-6d44-4a5d-82c4-ae15d80b5b9f/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:21.087776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:21.088408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:21.094932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:21.096908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:21.097541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:21.098408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:21.098851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:21.614053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:21.615429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:21.626061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:21.626943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:21.628008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:21.628878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.108774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:22.125471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f3189f0c-0440-4379-83fb-888892303b37 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 1.042218 Aug 04 04:45:22.126090 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2297/4716] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:21 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:22.146759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:22.147751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:22.163670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.164617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.165773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.166813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.265105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.265578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.266044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lazy-loading 'fault' on Instance uuid 70180c23-0265-437c-a969-5c3a111d2edb {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:45:22.371940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:22.381994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b599ba1-6b59-4125-9019-b618097514d9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1484 microversion: 2.1 time: 0.772471 Aug 04 04:45:22.401417 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2420/4717] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:21 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1484 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:22.401417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:22.402047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:22.417576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.418220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.419437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:22.419583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.420287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.439544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:22.449596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040f59c45a8a4959910a9f4ea7307004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea98ba3d0ee417e9f8aee8237beb741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:22.452090 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b490b4dd-e268-402f-b642-7d324e7ffe69 tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 200 len: 1367 microversion: 2.57 time: 0.311912 Aug 04 04:45:22.470810 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2298/4718] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:22 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:45:22.480958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:22.483445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:22.498808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.501209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.502995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.506282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.544902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:45:22.735378 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4909384f-bc51-490f-be0d-6492f6411704 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 204 len: 0 microversion: 2.1 time: 0.262200 Aug 04 04:45:22.739126 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2299/4719] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:45:22 2022] DELETE /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:45:22.747064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:22.747991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:22.755155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.755713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.756790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.757337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.985430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:23.005765 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e585013c-7456-466d-b05a-d0a26eb300a3 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.612099 Aug 04 04:45:23.007028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2421/4720] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:22 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:23.030087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:23.031586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:23.041225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.041960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.043464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.044073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.085506 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Cannot 'unshelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action HTTP/1.1 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 18 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: {"unshelve": null} Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: exception: Cannot 'unshelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'unshelve': None}} Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 in vm_state active. Cannot unshelve while the instance is in this state. Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:45:23.088190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active Aug 04 04:45:23.092680 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.097007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 409 to user: Cannot 'unshelve' instance f4f5eefa-1541-4941-bfbf-f885d2caff54 while it is in vm_state active {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:23.098138 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2735fb89-7816-434d-a7cf-aa60bd39e2af tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action" status: 409 len: 146 microversion: 2.1 time: 0.072051 Aug 04 04:45:23.099275 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2422/4721] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:23 2022] POST /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54/action => generated 146 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:45:23.107629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:23.108495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:23.116547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.117355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.118332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.118919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.260389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:23.271145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1505ad22-0f1c-4028-9f86-2e82aab6a34b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1490 microversion: 2.1 time: 0.529161 Aug 04 04:45:23.271750 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2300/4722] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:22 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1490 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:23.477898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:23.478530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] [instance: 70180c23-0265-437c-a969-5c3a111d2edb] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:23.494873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.495241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.496255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.496703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.516925 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] HTTP exception thrown: Instance 70180c23-0265-437c-a969-5c3a111d2edb could not be found. Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Request method failure captured: Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb HTTP/1.1 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi6063I1x1Md9Nn0yXKSGdN-eYpTq0j2C2E_XofaeWH7wGx-bIPwCa-XiOWrX0dsl98ckwZ-cHEi2jaI7H6ypzML0PI3Nscg3QDg3MTBV09Q4YuEJ3KBWd4QOfi5GgYpQaSeFN-cME3GU0EwB-fz1S_EUecaAIHD9vJt2QVdEy-Oyl8ew Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.57 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 7ea98ba3d0ee417e9f8aee8237beb741 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerShowV257Test-602512448 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7ea98ba3d0ee417e9f8aee8237beb741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7ea98ba3d0ee417e9f8aee8237beb741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7ea98ba3d0ee417e9f8aee8237beb741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7ea98ba3d0ee417e9f8aee8237beb741", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerShowV257Test-602512448 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 7ea98ba3d0ee417e9f8aee8237beb741 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerShowV257Test-602512448 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerShowV257Test-602512448-project Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 040f59c45a8a4959910a9f4ea7307004 Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerShowV257Test-602512448-project Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 70180c23-0265-437c-a969-5c3a111d2edb could not be found. Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '70180c23-0265-437c-a969-5c3a111d2edb'} Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70180c23-0265-437c-a969-5c3a111d2edb could not be found. Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70180c23-0265-437c-a969-5c3a111d2edb could not be found. Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:23.518887 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70180c23-0265-437c-a969-5c3a111d2edb could not be found. Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] Returning 404 to user: Instance 70180c23-0265-437c-a969-5c3a111d2edb could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cbdd17fc-7ac9-4b48-9eec-e00a01bd6dae tempest-ServerShowV257Test-602512448 tempest-ServerShowV257Test-602512448-project] 10.222.0.69 "GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb" status: 404 len: 111 microversion: 2.57 time: 0.046738 Aug 04 04:45:23.527869 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2301/4723] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:45:23 2022] GET /compute/v2.1/servers/70180c23-0265-437c-a969-5c3a111d2edb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:45:23.566566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:23.577464 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-285f1bd3-b2ad-4b2e-8f84-68325f9988aa tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.474291 Aug 04 04:45:23.588589 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2423/4724] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:23 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:23.612922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:23.614332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:23.623439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.624165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.626123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.627054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.985343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:24.005226 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f2390b09-5a09-413d-9c36-74be2140372f tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.396667 Aug 04 04:45:24.007910 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2302/4725] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:23 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:24.027162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e535f0a6-e299-4c10-9944-531c24a582a9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1408944245_updated"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:24.030741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e535f0a6-e299-4c10-9944-531c24a582a9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: da7454ca-133e-4242-9cde-8a00010764f5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:24.050221 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e535f0a6-e299-4c10-9944-531c24a582a9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance da7454ca-133e-4242-9cde-8a00010764f5 could not be found. Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e535f0a6-e299-4c10-9944-531c24a582a9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/servers/da7454ca-133e-4242-9cde-8a00010764f5 HTTP/1.1 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 81 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1408944245_updated"}} Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance da7454ca-133e-4242-9cde-8a00010764f5 could not be found. Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'da7454ca-133e-4242-9cde-8a00010764f5', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1408944245_updated'}}} Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7454ca-133e-4242-9cde-8a00010764f5 could not be found. Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 04:45:24.052388 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7454ca-133e-4242-9cde-8a00010764f5 could not be found. Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7454ca-133e-4242-9cde-8a00010764f5 could not be found. Aug 04 04:45:24.056880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:24.058581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e535f0a6-e299-4c10-9944-531c24a582a9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance da7454ca-133e-4242-9cde-8a00010764f5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:24.059685 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e535f0a6-e299-4c10-9944-531c24a582a9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "PUT /compute/v2.1/servers/da7454ca-133e-4242-9cde-8a00010764f5" status: 404 len: 111 microversion: 2.1 time: 0.036711 Aug 04 04:45:24.060629 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2424/4726] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:45:24 2022] PUT /compute/v2.1/servers/da7454ca-133e-4242-9cde-8a00010764f5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:24.070512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:24.071491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:24.087223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.087933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.088904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.089518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.120256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:24.292166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:24.293183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:24.301755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.302582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.303649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.304322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.623932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:24.633840 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-977f45ea-275c-4d7f-bada-585f22d06cb2 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.568006 Aug 04 04:45:24.640487 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2303/4727] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:24 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:24.662182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:24.663105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:24.695666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.696085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.696959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.702105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.760761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:24.769990 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f905e200-5b98-4915-960c-657050e20393 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1490 microversion: 2.1 time: 0.481158 Aug 04 04:45:24.775675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2425/4728] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:24 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1490 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:25.443932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:25.457680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-77897a5d-2327-4efc-9f8b-4e420ced4b32 req-c44d160d-e3d9-4b8d-9ee4-7fd878954cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0033f2-2ab6-4d46-b878-eacdb321ebc7", "name": "network-vif-deleted", "tag": "b45bbc39-f774-4add-8197-d2869f6a9bed"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:25.462400 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a3ae9bfc-81ba-4460-a1f4-07b99514b67c tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.804403 Aug 04 04:45:25.475306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-77897a5d-2327-4efc-9f8b-4e420ced4b32 req-c44d160d-e3d9-4b8d-9ee4-7fd878954cd1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.478857 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2304/4729] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:24 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:25.483732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-77897a5d-2327-4efc-9f8b-4e420ced4b32 req-c44d160d-e3d9-4b8d-9ee4-7fd878954cd1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.504511 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-77897a5d-2327-4efc-9f8b-4e420ced4b32 req-c44d160d-e3d9-4b8d-9ee4-7fd878954cd1 service nova] Creating event network-vif-deleted:b45bbc39-f774-4add-8197-d2869f6a9bed for instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 on n-h2-851337-5 Aug 04 04:45:25.510033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6c19a6b-01fd-4e0a-b247-e64af762f1d7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:25.523375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-77897a5d-2327-4efc-9f8b-4e420ced4b32 req-c44d160d-e3d9-4b8d-9ee4-7fd878954cd1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070185 Aug 04 04:45:25.526595 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2426/4730] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6c19a6b-01fd-4e0a-b247-e64af762f1d7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 HTTP/1.1 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 280 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:25.529307 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 04:45:25.532596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:25.536265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6c19a6b-01fd-4e0a-b247-e64af762f1d7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:25.537414 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6c19a6b-01fd-4e0a-b247-e64af762f1d7 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "PUT /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 400 len: 619 microversion: 2.1 time: 0.040180 Aug 04 04:45:25.538596 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2305/4731] 10.222.0.69 () {60 vars in 1257 bytes} [Thu Aug 4 04:45:25 2022] PUT /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:45:25.547387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:25.548187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:25.557964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.558343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.559193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.559639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.797196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:25.797836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:25.821066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.821532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.822346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.822793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.891959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.892682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.893351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lazy-loading 'fault' on Instance uuid bf0033f2-2ab6-4d46-b878-eacdb321ebc7 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:45:26.256297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:26.271986 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38a331c2-ea2e-48e8-9dc8-a335b494003d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 200 len: 1304 microversion: 2.1 time: 0.474795 Aug 04 04:45:26.293445 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2306/4732] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:25 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 1304 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:26.432501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:26.443636 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f6c73a8-1477-4e20-9d02-3e20b77ec62d tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.900413 Aug 04 04:45:26.459307 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2427/4733] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:25 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:26.472771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:26.473412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:26.493305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:26.493777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:26.496319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:26.499785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:26.934069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:26.949078 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-97401296-7781-4202-963e-51554ec49a23 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.481351 Aug 04 04:45:26.951958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2307/4734] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:26 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:26.978061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65d65bc5-257c-4cde-8de9-dad56edfbba5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65d65bc5-257c-4cde-8de9-dad56edfbba5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: request: PUT /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 HTTP/1.1 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 24 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": ""}} Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54', 'body': {'server': {'name': ''}}} Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '' Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:45:26.982756 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 04:45:26.987526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:26.990295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65d65bc5-257c-4cde-8de9-dad56edfbba5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:26.991487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65d65bc5-257c-4cde-8de9-dad56edfbba5 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "PUT /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 400 len: 108 microversion: 2.1 time: 0.018461 Aug 04 04:45:26.996475 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2428/4735] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:45:26 2022] PUT /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:45:27.007434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:27.008131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:27.019962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.023044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.025329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.027236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.604323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:27.617139 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ac67fb25-7687-4912-93b5-2f3a4709571e tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1505 microversion: 2.1 time: 0.612335 Aug 04 04:45:27.618392 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2308/4736] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:26 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1505 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:27.631191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:27.631962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:27.648590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.650407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.657541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.658682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.676759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2734a941-f58f-4ad3-a6c9-a5db7803b7f2 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] Calling method '.version_select at 0x7f1919571ee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:27.681944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 HTTP/1.1 Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'bf0033f2-2ab6-4d46-b878-eacdb321ebc7'} Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:27.684092 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:27.688305 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:27.688305 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:27.688305 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:27.688305 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:27.688305 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:27.688305 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:45:27.688305 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:27.690141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:27.691865 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ff29e9e-9b69-4f91-a895-f523846496c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 404 len: 111 microversion: 2.1 time: 0.072243 Aug 04 04:45:27.692674 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2309/4737] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:27 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:27.828342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2125029152", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:27.852534 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2734a941-f58f-4ad3-a6c9-a5db7803b7f2 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793/defaults" status: 200 len: 371 microversion: 2.1 time: 0.587473 Aug 04 04:45:27.863892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2429/4738] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:45:27 2022] GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793/defaults => generated 371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:27.873866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5629167-3af4-4943-bf17-0cb2a7df27d0 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] Calling method '.version_select at 0x7f191a1cc700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:27.955933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] validate_networks() for [('9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:45:28.061084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5629167-3af4-4943-bf17-0cb2a7df27d0 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793" status: 200 len: 371 microversion: 2.1 time: 0.193485 Aug 04 04:45:28.061792 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2430/4739] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 04:45:27 2022] GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793 => generated 371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:28.087923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d511a9b-8c9e-4313-8a65-2d041e0d40c3 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] Calling method '.version_select at 0x7f19195b6940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:28.211441 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d511a9b-8c9e-4313-8a65-2d041e0d40c3 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793/defaults" status: 200 len: 371 microversion: 2.1 time: 0.137791 Aug 04 04:45:28.212327 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2431/4740] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:45:28 2022] GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793/defaults => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:28.228579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-807915b9-651a-4f1c-8010-719ada302ca6 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] Calling method '.version_select at 0x7f1919571dc0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:28.412188 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-807915b9-651a-4f1c-8010-719ada302ca6 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793" status: 200 len: 371 microversion: 2.1 time: 0.190581 Aug 04 04:45:28.413736 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2432/4741] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 04:45:28 2022] GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:28.426748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ed56f82-372c-4899-86b4-cb1bada71909 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] Calling method '.version_select at 0x7f191963f820>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:28.659697 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ed56f82-372c-4899-86b4-cb1bada71909 tempest-QuotasTestJSON-1675866962 tempest-QuotasTestJSON-1675866962-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793?user_id=9f74636be86149739134ebdc35005a7b" status: 200 len: 371 microversion: 2.1 time: 0.222887 Aug 04 04:45:28.660809 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2433/4742] 10.222.0.69 () {58 vars in 1323 bytes} [Thu Aug 4 04:45:28 2022] GET /compute/v2.1/os-quota-sets/79c78e9919204800896e642cca381793?user_id=9f74636be86149739134ebdc35005a7b => generated 371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:30.407583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:45:30.408716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:45:30.409964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:45:30.410575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:45:30.411192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:45:30.435578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:30.436107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:30.440404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:30.440897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:30.504539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:45:30.528286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for user 0e04770e8fd84cff82e73ffd27b8a50a and project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:45:30.585895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:45:30.595065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:45:30.886854 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-489d43d0-47a5-4a94-9980-97ef1640193b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.059213 Aug 04 04:45:30.891317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2310/4743] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:45:30.903867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a864eca-1766-4050-8252-181c300867c8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:30.905212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a864eca-1766-4050-8252-181c300867c8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:31.304181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6a864eca-1766-4050-8252-181c300867c8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:31.318377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a864eca-1766-4050-8252-181c300867c8 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1215 microversion: 2.1 time: 0.418760 Aug 04 04:45:31.332670 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2434/4744] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:30 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1215 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:32.346362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:32.347387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:32.360337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:32.363692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:32.364795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:32.365775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:32.556250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:32.565335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c64598e5-eda8-4773-adc7-585b90ae4b8c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1267 microversion: 2.1 time: 0.224964 Aug 04 04:45:32.572722 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2311/4745] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:32 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:33.593269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:33.594283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:33.607530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:33.607996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:33.608797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:33.609246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:33.800634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:33.813232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a45290f-6f40-455d-a51f-b180e7e4558c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1273 microversion: 2.1 time: 0.224415 Aug 04 04:45:33.816139 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2312/4746] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:33 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:33.842596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1474842125", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "31571918-f645-4eae-9aae-c7a04ff970a9"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:34.012337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] validate_networks() for [('31571918-f645-4eae-9aae-c7a04ff970a9', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:45:34.838017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:34.839449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:34.856167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:34.858389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:34.860244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:34.864468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:35.150243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:35.160450 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35deae30-29bb-45f0-8de7-2e86bb7c2da0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1273 microversion: 2.1 time: 0.326984 Aug 04 04:45:35.171547 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2313/4747] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:34 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:35.235335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:45:35.235979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:45:35.237069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:45:35.238093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:45:35.238537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:45:35.263930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:35.264855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:35.266742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:35.268567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:35.338226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Getting quotas for project cb2c594eee554e09bf15760aa561d231. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:45:35.349170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Getting quotas for user 320f9afd42cb4d82a07248ce6c661646 and project cb2c594eee554e09bf15760aa561d231. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:45:35.388276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:45:35.396000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:45:35.516646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2370af55-4581-434a-85ad-617c5fa7643a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309947 Aug 04 04:45:35.517401 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2435/4748] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:45:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:45:35.528813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4bdd8bc8-b846-4ed7-8b9b-5527f8dde5a8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:35.529550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4bdd8bc8-b846-4ed7-8b9b-5527f8dde5a8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:35.807000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4bdd8bc8-b846-4ed7-8b9b-5527f8dde5a8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:35.829057 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4bdd8bc8-b846-4ed7-8b9b-5527f8dde5a8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1218 microversion: 2.1 time: 0.304431 Aug 04 04:45:35.829661 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2314/4749] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:35 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:36.198065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:36.198987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:36.216676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:36.218197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:36.221203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:36.224134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:36.257403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:36.860509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:36.861995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:36.918401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:36.922946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:36.936317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:36.938441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:37.564967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:37.577138 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82fc9914-b7bf-4313-9b25-e465ef61f03f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1222 microversion: 2.1 time: 0.727108 Aug 04 04:45:37.582532 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2315/4750] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:36 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1222 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:37.926409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:37.946355 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd844ff0-075b-4e98-9254-da291ca4a02d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1315 microversion: 2.1 time: 1.757844 Aug 04 04:45:37.963254 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2436/4751] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:36 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1315 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:38.224210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:38.225816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:38.252380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.253974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.256310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.257268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.320628 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d HTTP/1.1 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '7794d0ad-cbee-4a0d-87fd-7c231567bc5d'} Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:38.322780 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.327960 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.330673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:38.332384 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-afcc7cc2-66ee-491a-b6d1-0acc1b8c4020 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 404 len: 111 microversion: 2.1 time: 0.113040 Aug 04 04:45:38.334365 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2316/4752] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:45:38 2022] DELETE /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:38.350806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:38.355862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: 7794d0ad-cbee-4a0d-87fd-7c231567bc5d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:38.397399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.404371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.408040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.408959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.451498 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d HTTP/1.1 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '7794d0ad-cbee-4a0d-87fd-7c231567bc5d'} Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:38.453351 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.459033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:38.459033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:38.459033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:38.459033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:38.459033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:38.459033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. Aug 04 04:45:38.459033 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:38.459917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance 7794d0ad-cbee-4a0d-87fd-7c231567bc5d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:38.460924 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8231fe94-a285-4bdc-a1f3-91d5c3e39d81 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d" status: 404 len: 111 microversion: 2.1 time: 0.119141 Aug 04 04:45:38.463184 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2437/4753] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:38 2022] GET /compute/v2.1/servers/7794d0ad-cbee-4a0d-87fd-7c231567bc5d => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:45:38.470477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:38.471616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:38.478879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.479703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.480737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.481628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.513816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:45:38.606459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:38.607332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:38.627471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.628795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.642564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.649596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.691865 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0865f2fa-69ce-4c80-921d-4696568077db tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 204 len: 0 microversion: 2.1 time: 0.224806 Aug 04 04:45:38.693003 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2317/4754] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:45:38 2022] DELETE /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:45:38.718094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:38.718864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:38.737552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.738101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.738891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.745205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:39.030287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:39.043437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb116505-f52d-4594-90cd-bd99821af21a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1276 microversion: 2.1 time: 0.441394 Aug 04 04:45:39.044370 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2438/4755] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:38 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1276 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:39.055355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:39.057780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:39.069114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:39.069497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:39.070535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:39.072598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:39.074170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:39.082394 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7dbb7d25-cb21-4810-84ac-435195e92d21 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 0.384760 Aug 04 04:45:39.086897 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2318/4756] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:38 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:39.580715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:39.593650 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1dac34cb-e33c-4e70-a891-3a50690d8047 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1315 microversion: 2.1 time: 0.547659 Aug 04 04:45:39.594072 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2439/4757] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:39 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:40.071992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:40.073419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:40.086437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.087501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.088600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.090037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.118886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:40.120589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:40.137298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.140581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.141680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.142156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.221338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:40.231443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-580798e5-1c1f-4530-bab6-04f8a75273d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1276 microversion: 2.1 time: 0.164372 Aug 04 04:45:40.235698 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2319/4758] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:40 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:40.540811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:40.563039 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2edf71f-8894-4f64-b400-3b7557944996 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 0.448975 Aug 04 04:45:40.582057 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2440/4759] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:40 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:40.616073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:40.617716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:40.620734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:40.628623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.629788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.630761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.631403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.874324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3c097f1d-6bca-457b-be15-848637c37689 req-c7b17ad6-0097-49d0-81b2-38e553bd6cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3a123d-0860-4fdd-82d1-f96440fe272d", "tag": "8bbfcffb-557d-4205-9eb5-e55119f6b915"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:40.904625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3c097f1d-6bca-457b-be15-848637c37689 req-c7b17ad6-0097-49d0-81b2-38e553bd6cdd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.905613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3c097f1d-6bca-457b-be15-848637c37689 req-c7b17ad6-0097-49d0-81b2-38e553bd6cdd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.926288 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3c097f1d-6bca-457b-be15-848637c37689 req-c7b17ad6-0097-49d0-81b2-38e553bd6cdd service nova] Creating event network-changed:8bbfcffb-557d-4205-9eb5-e55119f6b915 for instance 0f3a123d-0860-4fdd-82d1-f96440fe272d on n-h2-851337-5 Aug 04 04:45:40.936037 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3c097f1d-6bca-457b-be15-848637c37689 req-c7b17ad6-0097-49d0-81b2-38e553bd6cdd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075406 Aug 04 04:45:40.937071 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2441/4760] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:41.242574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:41.256113 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0136a998-7003-47a5-a744-c527c6771a6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1315 microversion: 2.1 time: 0.645235 Aug 04 04:45:41.257048 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2320/4761] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:40 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:41.269493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:41.271070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:41.292321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.292321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:41.293875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.295711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:41.455114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:41.469900 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7c15aeda-1502-462a-b27b-5844860a837c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1276 microversion: 2.1 time: 0.215297 Aug 04 04:45:41.478238 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2442/4762] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:41 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:41.588451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:41.589358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:41.596506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.597802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:41.598747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.599367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.036976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0082ba0fe0e448cb2871b2b14c4f39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe04c0b897454f3e876924b534321a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:42.048195 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16e02e43-631b-4947-92a9-83929062c434 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 200 len: 1511 microversion: 2.1 time: 0.463067 Aug 04 04:45:42.050619 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2321/4763] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:41 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:42.286917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:42.288119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:42.311221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.312356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.314475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.318477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.497782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:42.499087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:42.512374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.517746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.519478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.526607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.536824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:43.212612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:43.227649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1debc06f-4dfd-4233-afb6-ae21d393486f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1315 microversion: 2.1 time: 0.945267 Aug 04 04:45:43.228453 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2443/4764] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:42 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:43.235375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-31659d08-2636-4c74-a5bd-2a61905af9e3 req-91085aa2-638f-410c-8c20-26583e872328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f5eefa-1541-4941-bfbf-f885d2caff54", "name": "network-vif-deleted", "tag": "559baab8-11cc-496b-bd08-390c3d4213d2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:43.261879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-31659d08-2636-4c74-a5bd-2a61905af9e3 req-91085aa2-638f-410c-8c20-26583e872328 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:43.264555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-31659d08-2636-4c74-a5bd-2a61905af9e3 req-91085aa2-638f-410c-8c20-26583e872328 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:43.298028 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-31659d08-2636-4c74-a5bd-2a61905af9e3 req-91085aa2-638f-410c-8c20-26583e872328 service nova] Creating event network-vif-deleted:559baab8-11cc-496b-bd08-390c3d4213d2 for instance f4f5eefa-1541-4941-bfbf-f885d2caff54 on n-h2-851337-5 Aug 04 04:45:43.306237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:43.311092 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-31659d08-2636-4c74-a5bd-2a61905af9e3 req-91085aa2-638f-410c-8c20-26583e872328 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080026 Aug 04 04:45:43.311930 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2444/4765] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:43.317622 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-352f4e43-5cc6-44c3-a780-cd88c23b9b87 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 0.823385 Aug 04 04:45:43.330878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:43.330878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] [instance: f4f5eefa-1541-4941-bfbf-f885d2caff54] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:43.332261 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2322/4766] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:42 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:43.348260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:43.348722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:43.349509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:43.363795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:43.386255 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] HTTP exception thrown: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 could not be found. Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Request method failure captured: Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 HTTP/1.1 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi604YiuBXsubw7IWxc2dbYL8Om23GCzRiC5yn_BsJO-ipAUaCysM1460LpdkEjXnagK7DQMZx4FveSJMnyUUb0Nr2xF-_MSDD0EU_nrtt5v_H6Z6SH04zGT9xz1jikBN0e34cvqqg0YMlD6--ZBTVPHKi9i6d19g-WQpxxc67oo4zr3M Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fe04c0b897454f3e876924b534321a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fe04c0b897454f3e876924b534321a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fe04c0b897454f3e876924b534321a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: fe04c0b897454f3e876924b534321a97 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-109077985 Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: d0082ba0fe0e448cb2871b2b14c4f39d Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-109077985-project Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 could not be found. Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f4f5eefa-1541-4941-bfbf-f885d2caff54'} Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 could not be found. Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 could not be found. Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:43.389583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:43.394145 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:43.394145 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:43.394145 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:43.394145 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:43.394145 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:43.394145 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 could not be found. Aug 04 04:45:43.394145 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:45:43.399110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] Returning 404 to user: Instance f4f5eefa-1541-4941-bfbf-f885d2caff54 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:43.400187 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08f5ef10-2495-40a0-a122-cb2229c741f9 tempest-ServersNegativeTestJSON-109077985 tempest-ServersNegativeTestJSON-109077985-project] 10.222.0.69 "GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54" status: 404 len: 111 microversion: 2.1 time: 0.087150 Aug 04 04:45:43.411330 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2445/4767] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:43 2022] GET /compute/v2.1/servers/f4f5eefa-1541-4941-bfbf-f885d2caff54 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:44.250086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:44.250715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:44.268054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.268546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:44.269514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.270122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:44.337989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:44.338673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:44.351148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.351621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:44.352446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.352893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:45.298696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:45.373561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=16 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:45.638267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:45.655019 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c6f00d4-347f-4427-ac5f-f9f980417410 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 1.317443 Aug 04 04:45:45.658292 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2446/4768] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:44 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:45.672015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7a16ec5b-b2c7-486f-a5cc-6258719f48f3 req-8ee39979-e438-4132-abf9-ee9bee18e976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329d2b3b-9440-48a6-9f17-27992f4edab0", "tag": "71cab977-45ae-4db3-9dda-0123dac611f3"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:45.686632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:45.698899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7a16ec5b-b2c7-486f-a5cc-6258719f48f3 req-8ee39979-e438-4132-abf9-ee9bee18e976 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:45.699658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7a16ec5b-b2c7-486f-a5cc-6258719f48f3 req-8ee39979-e438-4132-abf9-ee9bee18e976 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:45.700100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:45.715163 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35264752-527e-4f96-9fbb-a1e4d0614e94 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1315 microversion: 2.1 time: 1.468806 Aug 04 04:45:45.724600 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2323/4769] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:44 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1315 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:45.726688 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7a16ec5b-b2c7-486f-a5cc-6258719f48f3 req-8ee39979-e438-4132-abf9-ee9bee18e976 service nova] Creating event network-changed:71cab977-45ae-4db3-9dda-0123dac611f3 for instance 329d2b3b-9440-48a6-9f17-27992f4edab0 on n-h1-851337-5 Aug 04 04:45:45.741926 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7a16ec5b-b2c7-486f-a5cc-6258719f48f3 req-8ee39979-e438-4132-abf9-ee9bee18e976 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080812 Aug 04 04:45:45.743696 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2447/4770] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:46.685714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:46.686312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:46.695152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:46.704188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.704881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:46.705439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.706523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:46.741232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:46.741943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:46.757253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.758057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:46.762289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.763175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:47.297932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:47.310424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e454818c-e418-4f93-a808-296005461313 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 0.628602 Aug 04 04:45:47.327683 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2324/4771] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:46 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:47.347372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8443a561-35ca-4d69-a2b3-9975bbceb2c6 req-082c8b1c-e45f-444c-8751-1231ab606294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3a123d-0860-4fdd-82d1-f96440fe272d", "name": "network-vif-plugged", "status": "completed", "tag": "8bbfcffb-557d-4205-9eb5-e55119f6b915"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:47.380513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8443a561-35ca-4d69-a2b3-9975bbceb2c6 req-082c8b1c-e45f-444c-8751-1231ab606294 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:47.381724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8443a561-35ca-4d69-a2b3-9975bbceb2c6 req-082c8b1c-e45f-444c-8751-1231ab606294 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:47.415101 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8443a561-35ca-4d69-a2b3-9975bbceb2c6 req-082c8b1c-e45f-444c-8751-1231ab606294 service nova] Creating event network-vif-plugged:8bbfcffb-557d-4205-9eb5-e55119f6b915 for instance 0f3a123d-0860-4fdd-82d1-f96440fe272d on n-h2-851337-5 Aug 04 04:45:47.428711 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8443a561-35ca-4d69-a2b3-9975bbceb2c6 req-082c8b1c-e45f-444c-8751-1231ab606294 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097261 Aug 04 04:45:47.431768 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2325/4772] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:47.612494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:47.623962 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a22d81c5-bf52-4ebd-a72b-b71d75eadfe3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1315 microversion: 2.1 time: 0.888308 Aug 04 04:45:47.630746 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2448/4773] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:46 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1315 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:48.340703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:48.342034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:48.390202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.391426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:48.394630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.395674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:48.650065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:48.651842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:48.660027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.660489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:48.661281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.661723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.360597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:49.373229 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d2989be-33de-43d7-ac5a-e3721533978c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 1.043193 Aug 04 04:45:49.375493 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2326/4774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:48 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:49.409751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:49.412539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:49.429756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.431274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.432629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.438615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.565919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:49.588678 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffc5b056-caec-4c42-93d9-e394b71665e1 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1315 microversion: 2.1 time: 0.942008 Aug 04 04:45:49.598084 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2449/4775] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:48 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:49.652443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lazy-loading 'services' on Instance uuid b8cfd2e6-5f04-4b21-b641-cc235321dc06 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:45:49.772933 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-701f313f-e332-4db2-80eb-cdacf4cbbda3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments/4cf5e8bb-5c47-4ff1-977a-f4611564017e" status: 202 len: 0 microversion: 2.1 time: 0.384011 Aug 04 04:45:49.778062 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2327/4776] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 04:45:49 2022] DELETE /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments/4cf5e8bb-5c47-4ff1-977a-f4611564017e => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:45:49.786907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffa81868-415f-4505-8c35-8a4ffa8458bb tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:49.789645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffa81868-415f-4505-8c35-8a4ffa8458bb tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:49.809948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffa81868-415f-4505-8c35-8a4ffa8458bb tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.813193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffa81868-415f-4505-8c35-8a4ffa8458bb tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.818864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffa81868-415f-4505-8c35-8a4ffa8458bb tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.822894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffa81868-415f-4505-8c35-8a4ffa8458bb tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.926071 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffa81868-415f-4505-8c35-8a4ffa8458bb tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143662 Aug 04 04:45:49.928146 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2450/4777] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:49 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:50.399032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:50.399747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:50.410785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.411516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:50.413303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.414085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:50.613066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:50.615870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:50.631119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.631617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:50.632464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.632918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.160208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:51.169537 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1a0ab4b-8e41-4971-9a02-9db4b866c79d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 0.776522 Aug 04 04:45:51.170146 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2328/4778] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:50 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:51.188249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dee9014d-6914-4220-9514-a80cfc30cc6d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:51.191386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dee9014d-6914-4220-9514-a80cfc30cc6d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:51.205813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:51.211477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dee9014d-6914-4220-9514-a80cfc30cc6d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.212219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dee9014d-6914-4220-9514-a80cfc30cc6d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.213216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dee9014d-6914-4220-9514-a80cfc30cc6d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.215083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dee9014d-6914-4220-9514-a80cfc30cc6d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.303656 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dee9014d-6914-4220-9514-a80cfc30cc6d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132267 Aug 04 04:45:51.304792 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2329/4779] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:51 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:51.320873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:51.338695 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-729b2835-5feb-4b90-92cb-dde8566d7a7c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1501 microversion: 2.1 time: 0.723487 Aug 04 04:45:51.340462 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2451/4780] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:50 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1501 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:51.363274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:51.364783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:51.385240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.387776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.389145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.392220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.481289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lazy-loading 'flavor' on Instance uuid 0f3a123d-0860-4fdd-82d1-f96440fe272d {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:45:51.998036 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b311a4dc-29ff-4c40-8f17-425cc3c12372 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d/action" status: 202 len: 0 microversion: 2.1 time: 0.637872 Aug 04 04:45:52.006445 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2330/4781] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:51 2022] POST /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:45:52.010900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:52.011781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:52.031997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.037500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.043901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.044709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.198156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:52.199247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:52.213122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.215245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.219112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.223025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.623456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:52.632230 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f7b520f-ac11-439f-92c7-977cb4f95799 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.625971 Aug 04 04:45:52.639797 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2452/4782] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:52 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:52.649824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1537ed74-15d5-4ee5-96f8-cca27622ec76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:52.652326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1537ed74-15d5-4ee5-96f8-cca27622ec76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:52.663153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:52.673311 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f5900c7-cf9f-4b93-ab64-7f60e4f60abf tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 0.481075 Aug 04 04:45:52.685499 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2331/4783] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:52 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:52.696648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1537ed74-15d5-4ee5-96f8-cca27622ec76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.697143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1537ed74-15d5-4ee5-96f8-cca27622ec76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.697948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1537ed74-15d5-4ee5-96f8-cca27622ec76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.700861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1537ed74-15d5-4ee5-96f8-cca27622ec76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.774550 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1537ed74-15d5-4ee5-96f8-cca27622ec76 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133342 Aug 04 04:45:52.778438 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2453/4784] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:52 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:53.667133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:53.667839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:53.679496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.680303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:53.681394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.682096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:53.701691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:53.702388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:53.716641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.717044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:53.718127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.718794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.767022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:54.778203 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ded6a902-ca4e-479e-beaf-c78b62c7c8d3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 1.122013 Aug 04 04:45:54.779186 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2332/4785] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:53 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:54.785821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69cdd5c3-9ab3-4a32-a50c-dca1d7188690 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:54.788589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69cdd5c3-9ab3-4a32-a50c-dca1d7188690 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:54.796322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69cdd5c3-9ab3-4a32-a50c-dca1d7188690 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:54.797106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69cdd5c3-9ab3-4a32-a50c-dca1d7188690 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.798085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69cdd5c3-9ab3-4a32-a50c-dca1d7188690 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:54.798688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69cdd5c3-9ab3-4a32-a50c-dca1d7188690 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.849796 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69cdd5c3-9ab3-4a32-a50c-dca1d7188690 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068873 Aug 04 04:45:54.852035 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2333/4786] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:54 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:54.860161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-aea74c3e-bfb0-4a59-93f1-4205f9228afd req-6bfd5b1a-1843-41c4-9766-58290ec584e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329d2b3b-9440-48a6-9f17-27992f4edab0", "name": "network-vif-plugged", "status": "completed", "tag": "71cab977-45ae-4db3-9dda-0123dac611f3"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:54.868918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:54.874807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aea74c3e-bfb0-4a59-93f1-4205f9228afd req-6bfd5b1a-1843-41c4-9766-58290ec584e5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:54.875701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aea74c3e-bfb0-4a59-93f1-4205f9228afd req-6bfd5b1a-1843-41c4-9766-58290ec584e5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.878295 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-074a626c-f75e-442e-acbe-98be8eff19b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 1.180810 Aug 04 04:45:54.878917 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2454/4787] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:53 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:54.892441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-aea74c3e-bfb0-4a59-93f1-4205f9228afd req-6bfd5b1a-1843-41c4-9766-58290ec584e5 service nova] Creating event network-vif-plugged:71cab977-45ae-4db3-9dda-0123dac611f3 for instance 329d2b3b-9440-48a6-9f17-27992f4edab0 on n-h1-851337-5 Aug 04 04:45:54.899387 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-aea74c3e-bfb0-4a59-93f1-4205f9228afd req-6bfd5b1a-1843-41c4-9766-58290ec584e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044525 Aug 04 04:45:54.900350 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2334/4788] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:55.804135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:55.805416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:55.832454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.833042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.837389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.839385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.864945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad69f020-a0a9-46c7-8a63-33830a0aac0a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:55.868199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad69f020-a0a9-46c7-8a63-33830a0aac0a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:55.887311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad69f020-a0a9-46c7-8a63-33830a0aac0a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.888227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad69f020-a0a9-46c7-8a63-33830a0aac0a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.889281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad69f020-a0a9-46c7-8a63-33830a0aac0a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.891050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad69f020-a0a9-46c7-8a63-33830a0aac0a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.960950 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad69f020-a0a9-46c7-8a63-33830a0aac0a tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100605 Aug 04 04:45:55.965695 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2335/4789] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:55 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:55.975316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:55.978292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:55.991589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.992051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.992844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.993373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:56.531440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:56.542328 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4daab27c-a4aa-4649-ba29-99ef0471c8ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1318 microversion: 2.1 time: 0.577878 Aug 04 04:45:56.542940 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2336/4790] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:55 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:56.637449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:56.649856 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1440495-f9d4-4d27-8d14-74ffde9a527b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.849292 Aug 04 04:45:56.650702 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2455/4791] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:55 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:56.974212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83c08018-1d42-4012-81bc-bb87dad0aaa7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:56.977873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83c08018-1d42-4012-81bc-bb87dad0aaa7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:57.011420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c08018-1d42-4012-81bc-bb87dad0aaa7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.011984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c08018-1d42-4012-81bc-bb87dad0aaa7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.013125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c08018-1d42-4012-81bc-bb87dad0aaa7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.013866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c08018-1d42-4012-81bc-bb87dad0aaa7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.049666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:57.109175 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83c08018-1d42-4012-81bc-bb87dad0aaa7 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139985 Aug 04 04:45:57.111451 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2337/4792] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:56 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:57.566411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:57.567184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:57.584199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.585602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.587479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.587975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.600103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:57.672522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:57.673585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:57.692518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.695799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.710407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.712255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.998210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:58.010546 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a672daf3-22cb-43e9-9792-db65021bfce1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1507 microversion: 2.1 time: 0.451703 Aug 04 04:45:58.011310 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2456/4793] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:57 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:58.031966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:58.032596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.039804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.040258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.041466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.042130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.085680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:58.101210 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73a81bc5-cb62-4f9e-8056-e0ce6ecde1c7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.432371 Aug 04 04:45:58.102563 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2338/4794] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:57 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:58.425970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:58.436375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ba2587b-bbca-41f5-b581-abc85ae1267b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1507 microversion: 2.1 time: 0.408349 Aug 04 04:45:58.437556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2457/4795] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:58 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:45:58.457548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:58.460849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.485226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.485992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.487371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.487817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.539752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4731532-6af6-42ca-8636-558933033eab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:58.542143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4731532-6af6-42ca-8636-558933033eab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.571289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4731532-6af6-42ca-8636-558933033eab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.572189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4731532-6af6-42ca-8636-558933033eab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.574483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4731532-6af6-42ca-8636-558933033eab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.576212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4731532-6af6-42ca-8636-558933033eab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.643841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:45:58.655575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:45:58.656376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:45:58.658375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:45:58.659449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:45:58.708382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4731532-6af6-42ca-8636-558933033eab tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.581878 Aug 04 04:45:58.714078 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2339/4796] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:58 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06/os-volume_attachments => generated 25 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:45:58.823369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:58.826432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.831971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.835922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.836716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.839701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.840187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.861473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.862306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.863638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.864450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.899488 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Cannot 'reboot' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action HTTP/1.1 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 28 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: {"reboot": {"type": "HARD"}} Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: exception: Cannot 'reboot' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '4c03c2e6-81e9-4d79-863b-ad9db5388753', 'body': {'reboot': {'type': 'HARD'}}} Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:45:58.913260 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:58.917257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 409 to user: Cannot 'reboot' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:58.918306 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-126d4d9b-6b7c-4e6e-b495-97fd933ba0f4 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action" status: 409 len: 145 microversion: 2.1 time: 0.099409 Aug 04 04:45:58.919096 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2340/4797] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:58 2022] POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:45:58.923506 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13380901-eb9c-407e-9dd9-9ca68eafe940 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "POST /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0/action" status: 202 len: 1109 microversion: 2.1 time: 0.467935 Aug 04 04:45:58.924774 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2458/4798] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:58 2022] POST /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0/action => generated 1109 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 04:45:58.941336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:45:58.941910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:58.942651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.944146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.950136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.951129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.952143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.952799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.965852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.966311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.976679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.977475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.076207 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Cannot 'rebuild' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action HTTP/1.1 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 65 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: exception: Cannot 'rebuild' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '4c03c2e6-81e9-4d79-863b-ad9db5388753', 'body': {'rebuild': {'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0'}}} Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:59.077983 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 409 to user: Cannot 'rebuild' instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 while it is in vm_state rescued {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:45:59.083252 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-08cff57c-3382-40d0-991f-3cfeb7e243f3 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action" status: 409 len: 146 microversion: 2.1 time: 0.154940 Aug 04 04:45:59.090914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2341/4799] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:45:58 2022] POST /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753/action => generated 146 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:45:59.100102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:59.107925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:59.120522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.122526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.123902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.129872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.187099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:45:59.362717 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14b10bd9-8690-4fc4-bc85-8fb72ce81072 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 204 len: 0 microversion: 2.1 time: 0.269131 Aug 04 04:45:59.363703 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2342/4800] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:45:59 2022] DELETE /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:45:59.385263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:59.387186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:59.409553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.410722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.412089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.413841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.640206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:59.656635 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8857fadb-620b-4a2a-a1e4-1b215a8bdb2a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.719122 Aug 04 04:45:59.657679 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2459/4801] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:58 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:45:59.666924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:59.671093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:59.689770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.694862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.697026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.698249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.807898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:45:59.819617 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-af2ebfb4-34bf-4c28-b333-a5fa48358efb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.449524 Aug 04 04:45:59.822622 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2343/4802] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:59 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:00.150530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:00.162244 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-52eeaf95-507d-457b-8ded-045fa92c1f2e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1690 microversion: 2.1 time: 0.502354 Aug 04 04:46:00.163586 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2460/4803] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:45:59 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1690 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:00.682200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:00.683195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:00.700838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.702484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:00.707324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.709576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:00.850932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:00.851629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:00.865826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.867592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:00.868441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.868887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:01.133378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:01.143574 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-808b610e-2c83-4529-b9dc-5b2d3a75e1b7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.467318 Aug 04 04:46:01.144394 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2344/4804] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:00 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:01.189709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:01.190573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:01.200003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:01.203411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:01.205861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:01.206555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:01.445921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:01.457799 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03e4350a-47a2-4e50-af3c-d6ab273aabc9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.615164 Aug 04 04:46:01.458526 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2461/4805] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:00 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:01.662723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:01.670928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ceda44a2-6c6b-4584-b752-0c12a6cb78dc tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1690 microversion: 2.1 time: 0.486524 Aug 04 04:46:01.679879 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2345/4806] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:01 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1690 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:02.166334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:02.175774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:02.213486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.218321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.220507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.222091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.483191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:02.484741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:02.493398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.494251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.495349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.496012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.816648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:02.825612 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-12ca1e02-4d0f-4db5-9b5f-744c4540b1ba tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.663523 Aug 04 04:46:02.839219 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2462/4807] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:02 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:02.847593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:02.851741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:02.870408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.872804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.874351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.876248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.997800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:03.013886 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76ba0d44-b54a-456a-a753-fa20266a8dee tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.536955 Aug 04 04:46:03.014799 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2346/4808] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:02 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:03.313404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:03.332523 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4b64100-d960-41b8-86b1-a3e79907901d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1690 microversion: 2.1 time: 0.491600 Aug 04 04:46:03.334010 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2463/4809] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:02 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1690 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:03.848304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:03.849760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:03.860659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:03.862791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:03.866180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:03.866886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.040802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:04.042602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:04.063004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.063737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.068401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.068880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.295312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:04.308410 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-070bd7ac-ea6e-4970-bd69-b42b9a8ddbef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.463847 Aug 04 04:46:04.309749 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2347/4810] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:03 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:04.360687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:04.362379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:04.372245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.377974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.384292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.385237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.428903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:04.440382 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f35e4ce3-2a63-48b1-9847-739dbaef56a6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.406802 Aug 04 04:46:04.442183 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2464/4811] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:04 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:04.556583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:04.565031 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbe1e84d-034e-4093-b3ec-4a6b8e522385 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1623 microversion: 2.1 time: 0.215157 Aug 04 04:46:04.571017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2348/4812] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:04 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1623 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:05.331738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:05.332385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:05.350123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.350587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.356755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.357133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.465972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:05.467170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:05.486405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.487505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.490127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.492923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.940873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:05.956438 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8345c87-3e32-4800-984b-8eb8f321b82b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.628106 Aug 04 04:46:05.959750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2465/4813] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:05 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:05.976635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:05.977266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:06.002027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.005108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.007503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.007823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.232980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:06.240315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:06.243944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0c4105c2-2846-4579-9bcd-7af81a55f221 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.781971 Aug 04 04:46:06.245306 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2349/4814] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:05 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:06.270837 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-930a347f-b9db-474f-bef9-fa257b0623d5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 200 len: 1623 microversion: 2.1 time: 0.309076 Aug 04 04:46:06.271472 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2466/4815] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:05 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 1623 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:06.840626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-fa8a542b-87e3-43dc-9921-2c3295297db3 req-a8a6891c-56ea-489e-8e83-2a2bca0212d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cfd2e6-5f04-4b21-b641-cc235321dc06", "name": "network-vif-deleted", "tag": "7cc6be0b-3dc7-4f8b-91d7-4a80eb827025"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:06.865287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fa8a542b-87e3-43dc-9921-2c3295297db3 req-a8a6891c-56ea-489e-8e83-2a2bca0212d3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.866001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fa8a542b-87e3-43dc-9921-2c3295297db3 req-a8a6891c-56ea-489e-8e83-2a2bca0212d3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.897039 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-fa8a542b-87e3-43dc-9921-2c3295297db3 req-a8a6891c-56ea-489e-8e83-2a2bca0212d3 service nova] Creating event network-vif-deleted:7cc6be0b-3dc7-4f8b-91d7-4a80eb827025 for instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 on n-h1-851337-5 Aug 04 04:46:06.904612 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-fa8a542b-87e3-43dc-9921-2c3295297db3 req-a8a6891c-56ea-489e-8e83-2a2bca0212d3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069627 Aug 04 04:46:06.910049 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2350/4816] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:06.979555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:06.980800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:06.993584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.994281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.997368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:07.004072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:07.266158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:07.267189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:07.278480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:07.280460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:07.286609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:07.287289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:08.257859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:08.267261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da3efb80-828e-44d0-9bb9-bbd3b7b15e48 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 1.293056 Aug 04 04:46:08.270851 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2467/4817] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:06 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:08.291435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:08.292208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: b8cfd2e6-5f04-4b21-b641-cc235321dc06] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:08.318578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:08.321176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:08.325884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:08.328204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:08.358642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:08.376056 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d687d954-4a23-4e7d-908c-18cd7d776853 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 1.114712 Aug 04 04:46:08.376675 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2351/4818] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:07 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:08.380374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 could not be found. Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 HTTP/1.1 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 could not be found. Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b8cfd2e6-5f04-4b21-b641-cc235321dc06'} Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 could not be found. Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 could not be found. Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:08.382091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 could not be found. Aug 04 04:46:08.386020 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:08.389268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 404 to user: Instance b8cfd2e6-5f04-4b21-b641-cc235321dc06 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:46:08.390902 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-269d0860-1190-47c1-ac15-dc530f8a8710 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06" status: 404 len: 111 microversion: 2.1 time: 0.118517 Aug 04 04:46:08.392794 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2468/4819] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:08 2022] GET /compute/v2.1/servers/b8cfd2e6-5f04-4b21-b641-cc235321dc06 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:46:08.402194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a48323e-3aa0-41e2-87a5-6a3c7afc39b6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '.version_select at 0x7f19191c58b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:08.460119 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4a48323e-3aa0-41e2-87a5-6a3c7afc39b6 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988990903" status: 202 len: 0 microversion: 2.1 time: 0.062674 Aug 04 04:46:08.463326 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2352/4820] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 04:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988990903 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:46:09.292247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:09.292910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:09.308243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.308933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.312942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.313756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.401866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:09.403177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:09.431826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.432571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.433709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.434339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.979470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:09.995117 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6bda35f0-808b-47cc-9f9a-c613f885e3c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.597013 Aug 04 04:46:10.004488 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2353/4821] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:09 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:10.114478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:10.133556 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d293279c-8e13-4486-9140-648ccffc5e24 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.845327 Aug 04 04:46:10.136321 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2469/4822] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:09 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:11.033164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:11.034124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:11.054059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.055477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.057502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.058635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.164838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:11.171838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:11.191437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.192279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.193542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.194639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.413592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:11.417475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:11.429338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-af4db5d3-5dc9-4335-80bd-796afc9122bd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.401670 Aug 04 04:46:11.432452 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2354/4823] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:11 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:11.487889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:11.500584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd2d3112-f665-4a2a-aa84-625d06446853 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.343394 Aug 04 04:46:11.511937 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2470/4824] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:11 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:12.470434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:12.475947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:12.524592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.524731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:12.525233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:12.525747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.526666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.529933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.534105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.534787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.535775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.536364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.586547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:12.978448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:12.992475 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-341bd2b9-205b-4189-b2f5-cc9d4277ac0d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.470348 Aug 04 04:46:13.010441 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2471/4825] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:12 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:13.044020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:13.053009 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ee8a9d7-ccde-4f6f-afe5-f93a16e72360 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.603147 Aug 04 04:46:13.060228 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2355/4826] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:12 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:14.022291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:14.024785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:14.049734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:14.050317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:14.051260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:14.054818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:14.076382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:14.077421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:14.114826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:14.115244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:14.134629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:14.137296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:14.949365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:14.957780 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-16883688-a94a-443a-9458-87d9548a39ef tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.945681 Aug 04 04:46:14.963750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2472/4827] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:14 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:14.976528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:14.985190 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15842c1c-06c1-455f-9e6f-61150875fda6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.908463 Aug 04 04:46:14.985879 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2356/4828] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:14 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:15.984781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:15.985341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:15.999613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=56 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:16.013276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:16.013996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:16.020528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.021004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:16.021790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.022237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:16.030567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.031246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:16.032099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.032541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:16.537185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:16.546665 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11b34d93-1f00-474d-ace8-fecb24b25f39 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.566290 Aug 04 04:46:16.552590 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2473/4829] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:15 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:16.649662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:16.670808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-98866119-28c8-42a2-84a2-8039db887b86 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1507 microversion: 2.1 time: 0.663279 Aug 04 04:46:16.693815 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2357/4830] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:16 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1507 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:17.577564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:17.582034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:17.605158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:17.606365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:17.607671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:17.610553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:17.704231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:17.705675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:17.721030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:17.721500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:17.722420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:17.722875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:18.429031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:18.444053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4f885ec-6b36-4359-8a11-a298c58da663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.866207 Aug 04 04:46:18.445624 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2474/4831] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:17 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:18.482560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:18.495058 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-de3cc45f-d4a4-4bcb-9d4f-e794d0886a70 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1528 microversion: 2.1 time: 0.794050 Aug 04 04:46:18.496249 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2358/4832] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:17 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1528 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:19.466899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:19.467554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:19.481714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.482519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:19.499631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.500625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:19.522137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:19.523313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:19.542826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.543425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:19.555541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.555972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:20.527961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:20.536128 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-190cacce-be66-42df-9e87-cb6a570442b2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 1.073341 Aug 04 04:46:20.536759 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2475/4833] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:19 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:20.581992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:20.607615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69c8baf9-911f-4feb-8e58-f5d443bb18b2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 1.087215 Aug 04 04:46:20.617002 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2359/4834] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:19 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:21.557983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:21.559160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:21.578995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.582691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:21.586870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.590145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:21.637156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:21.647195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:21.655781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:21.670337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.670635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:21.674986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.678610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:22.347029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:22.358939 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a3f52b5e-1e5f-468d-af67-e22afd5c4897 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.805780 Aug 04 04:46:22.372840 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2476/4835] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:21 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:22.510791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:22.520575 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27796de6-9be2-4405-9862-7dd5ad051417 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.889429 Aug 04 04:46:22.528092 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2360/4836] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:21 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:23.386265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:23.386903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:23.408239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.411844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:23.413109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.421067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:23.546405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:23.547926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:23.574597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.592304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:23.599244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.602782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:24.260694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:24.277754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d754fce3-8092-4c34-be93-ed413c52b5e8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.896285 Aug 04 04:46:24.299336 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2477/4837] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:23 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:24.307565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:24.325787 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04b40cdf-3fae-4fa8-9fd2-58f918c04584 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.787739 Aug 04 04:46:24.334280 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2361/4838] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:23 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:24.793482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:24.794247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:24.816852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:24.820525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:24.825034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:24.826604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:24.958093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:46:25.304091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:25.305256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:25.326026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.327780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:25.329335 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9cb42234-823c-4d5a-8434-e54921be0ca0 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 204 len: 0 microversion: 2.1 time: 0.540624 Aug 04 04:46:25.330634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.331710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:25.337593 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2478/4839] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:46:24 2022] DELETE /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:46:25.408853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:25.412123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:25.450400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.450881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:25.451734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.459527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:26.161678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:26.170498 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-393ea614-af37-4753-86a1-ef631c587fe8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.870653 Aug 04 04:46:26.173655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:26.181924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2362/4840] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:25 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:26.186071 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ec85fd11-3d87-49cf-97ae-8a86df7fce00 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1509 microversion: 2.1 time: 0.843841 Aug 04 04:46:26.193476 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2479/4841] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:25 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1509 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:26.209599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:26.210182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:26.246088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:26.252148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:26.253385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:26.255930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:26.568905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:26.599927 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e9d78bc-f69f-4068-875a-ce023170e141 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.416699 Aug 04 04:46:26.600888 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2363/4842] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:26 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:27.198515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:27.200034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:27.209171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.210098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.220925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.223389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.231279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:27.232309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:27.252266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.258046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.259649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.265218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.706056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:27.721092 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98338070-a6f1-4fe8-a181-23c8f602af70 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1514 microversion: 2.1 time: 0.528726 Aug 04 04:46:27.726486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2480/4843] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:27 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1514 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:27.760113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:27.760761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:27.790437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.791024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.792059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.792528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:28.089116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:28.116211 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8b84bec7-ae73-4fec-bc96-88afbd777a6b tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1509 microversion: 2.1 time: 0.891105 Aug 04 04:46:28.123052 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2364/4844] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:27 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1509 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:28.234126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:28.250776 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1193b6f4-e0c5-444e-a09a-b2c1ac1c2623 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.505340 Aug 04 04:46:28.269005 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2481/4845] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:27 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:28.747289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:28.747922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:28.762584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:28.763065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:28.763852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:28.764296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.154550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:29.156638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:29.179846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.181738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.185737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.187119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.332280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:29.344427 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-baa0d448-d67f-4eb2-83a1-54155954eedd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1532 microversion: 2.1 time: 0.601137 Aug 04 04:46:29.348791 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2365/4846] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:28 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1532 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:29.361560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:29.366243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:29.395704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.398033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.401040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.405838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.973135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:29.984614 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-075180cf-bb2f-4155-8323-4309fdbf67e5 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1509 microversion: 2.1 time: 0.839799 Aug 04 04:46:30.007008 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2482/4847] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:29 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1509 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:30.017345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f25da508-dffd-4353-98dc-8f34809b2710 req-358f9a3d-620b-478f-a060-24992b3854c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3a123d-0860-4fdd-82d1-f96440fe272d", "name": "network-vif-plugged", "status": "completed", "tag": "8bbfcffb-557d-4205-9eb5-e55119f6b915"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:30.044732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f25da508-dffd-4353-98dc-8f34809b2710 req-358f9a3d-620b-478f-a060-24992b3854c8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:30.045183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f25da508-dffd-4353-98dc-8f34809b2710 req-358f9a3d-620b-478f-a060-24992b3854c8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:30.093633 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f25da508-dffd-4353-98dc-8f34809b2710 req-358f9a3d-620b-478f-a060-24992b3854c8 service nova] Creating event network-vif-plugged:8bbfcffb-557d-4205-9eb5-e55119f6b915 for instance 0f3a123d-0860-4fdd-82d1-f96440fe272d on n-h2-851337-5 Aug 04 04:46:30.115261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f25da508-dffd-4353-98dc-8f34809b2710 req-358f9a3d-620b-478f-a060-24992b3854c8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104774 Aug 04 04:46:30.119654 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2483/4848] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:30.222781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:30.237232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91cdfc36-7aac-4592-9138-8e9d523a53dc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.885609 Aug 04 04:46:30.238988 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2366/4849] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:29 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:30.370302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:30.371250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:30.391167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:30.392225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:30.396069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:30.396619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:30.933345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:30.961138 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2206615a-3d18-4003-acf5-d697fa0b09d2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1520 microversion: 2.1 time: 0.597201 Aug 04 04:46:30.967614 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2484/4850] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:30 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1520 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:31.014968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:31.015736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:31.030039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.030501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.040570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.041250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.259313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:31.260243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:31.272734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.273576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.276568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.277447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.547368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:31.559712 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-77e4ea06-c62e-44c7-92b6-9aa704df450d tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 200 len: 1509 microversion: 2.1 time: 0.550259 Aug 04 04:46:31.592039 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2367/4851] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:31 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:31.609578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-103c24c0-b4e7-4a1d-a9be-0d15551b3d12 req-e4ea62cb-819b-48a2-b96a-3c035287bfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c03c2e6-81e9-4d79-863b-ad9db5388753", "name": "network-vif-deleted", "tag": "71ec6369-aa7d-42d2-9005-6ddfeaacc7d4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:31.682904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-103c24c0-b4e7-4a1d-a9be-0d15551b3d12 req-e4ea62cb-819b-48a2-b96a-3c035287bfc6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.684694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-103c24c0-b4e7-4a1d-a9be-0d15551b3d12 req-e4ea62cb-819b-48a2-b96a-3c035287bfc6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.732822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:31.746378 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-103c24c0-b4e7-4a1d-a9be-0d15551b3d12 req-e4ea62cb-819b-48a2-b96a-3c035287bfc6 service nova] Creating event network-vif-deleted:71ec6369-aa7d-42d2-9005-6ddfeaacc7d4 for instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 on n-h1-851337-5 Aug 04 04:46:31.748540 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a16cadc0-487a-4380-b584-f1aec0e16073 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.488975 Aug 04 04:46:31.753616 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2485/4852] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:31 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:31.763851 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-103c24c0-b4e7-4a1d-a9be-0d15551b3d12 req-e4ea62cb-819b-48a2-b96a-3c035287bfc6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166791 Aug 04 04:46:31.765054 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2368/4853] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:31.997102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:32.005324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:32.032029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.032860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.037806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.039617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.600164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:32.600877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 4c03c2e6-81e9-4d79-863b-ad9db5388753] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:32.611595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:32.652284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.653046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.654129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.654743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.677433 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6d510af4-9292-458f-a9a5-d709d26d4ef6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1520 microversion: 2.1 time: 0.663782 Aug 04 04:46:32.682477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 could not be found. Aug 04 04:46:32.683881 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2486/4854] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:31 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1520 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 HTTP/1.1 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 could not be found. Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '4c03c2e6-81e9-4d79-863b-ad9db5388753'} Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 could not be found. Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 could not be found. Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:46:32.687358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 could not be found. Aug 04 04:46:32.692350 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:46:32.694769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 404 to user: Instance 4c03c2e6-81e9-4d79-863b-ad9db5388753 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:46:32.700157 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ed84d10-53bb-4a9d-befd-ba326d097775 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753" status: 404 len: 111 microversion: 2.1 time: 0.105049 Aug 04 04:46:32.701243 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2369/4855] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:32 2022] GET /compute/v2.1/servers/4c03c2e6-81e9-4d79-863b-ad9db5388753 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:46:32.720836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:32.725685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:32.769031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.769423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.770247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.780690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.815918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:32.819512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:32.841017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.841547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.842489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.844358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.852384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:32.862855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:46:33.112097 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d1de0e6c-aa20-48bd-b3d5-b31d46776d03 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "DELETE /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 204 len: 0 microversion: 2.1 time: 0.401726 Aug 04 04:46:33.113693 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2487/4856] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:46:32 2022] DELETE /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:46:33.126794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:33.127944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:33.153592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.154608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:33.155713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.156715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:33.276017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:33.288075 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b3fe0083-c575-4d29-95fd-2a2dd25d824c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.500904 Aug 04 04:46:33.298981 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2370/4857] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:32 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:33.396381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:33.405029 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-05964f1f-330a-4eff-adda-c142e0c24b59 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.285970 Aug 04 04:46:33.411688 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2488/4858] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:33 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:33.705900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:33.707184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:33.726452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.734432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:33.736724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.745669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:34.309913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:34.318093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:34.340433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:34.341218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:34.343656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:34.344603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:35.479868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:35.491202 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d1b18d89-fa71-4ccf-b0a0-6ad2152281d7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1520 microversion: 2.1 time: 1.790359 Aug 04 04:46:35.491819 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2371/4859] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:33 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1520 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:35.513400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:35.515681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:35.534143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:35.535105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:35.542478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:35.543688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:35.544798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:35.548551 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-10bd6c4b-42e7-4416-a957-f3319aa663f3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 1.237947 Aug 04 04:46:35.559065 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2489/4860] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:34 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:36.317743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:36.321964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:36.337076 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d96b376-b7a3-4d1a-9eba-83e84d1d6123 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1521 microversion: 2.1 time: 0.839614 Aug 04 04:46:36.337932 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2372/4861] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:35 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1521 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:36.517647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:36.517647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:36.547680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.548871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:36.565906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.568769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:36.580881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:36.581509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:36.602243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.602916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:36.607130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.607774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.436937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:37.457771 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-732513c3-781b-4651-9163-3fd5228ace66 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.887078 Aug 04 04:46:37.478653 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2373/4862] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:36 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:37.487911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-29b8ccb0-a30a-4458-8dff-9c46ecbbaec6 req-11fbb6b5-4b5f-44d2-9696-57dcda37869b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329d2b3b-9440-48a6-9f17-27992f4edab0", "name": "network-vif-plugged", "status": "completed", "tag": "71cab977-45ae-4db3-9dda-0123dac611f3"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:37.512621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-29b8ccb0-a30a-4458-8dff-9c46ecbbaec6 req-11fbb6b5-4b5f-44d2-9696-57dcda37869b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:37.518496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-29b8ccb0-a30a-4458-8dff-9c46ecbbaec6 req-11fbb6b5-4b5f-44d2-9696-57dcda37869b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.557272 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-29b8ccb0-a30a-4458-8dff-9c46ecbbaec6 req-11fbb6b5-4b5f-44d2-9696-57dcda37869b service nova] Creating event network-vif-plugged:71cab977-45ae-4db3-9dda-0123dac611f3 for instance 329d2b3b-9440-48a6-9f17-27992f4edab0 on n-h1-851337-5 Aug 04 04:46:37.581276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-29b8ccb0-a30a-4458-8dff-9c46ecbbaec6 req-11fbb6b5-4b5f-44d2-9696-57dcda37869b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098349 Aug 04 04:46:37.590998 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2374/4863] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:37.613783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:37.622641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:37.647509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:37.656624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.659284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:37.660136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.769166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:37.771381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.772135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lazy-loading 'fault' on Instance uuid 697f0c15-0ac4-4599-9876-635732b63ac5 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:46:37.963322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42e55434a6d24f20b0f95a3b57d06c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089163f805e44913b469df4e8c9e85ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:37.986421 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-304828ae-4809-4b6e-8a99-790731f0fd98 tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 200 len: 1311 microversion: 2.1 time: 0.385179 Aug 04 04:46:37.997411 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2375/4864] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:37 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:38.019544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a0d90dc8-95e9-42ab-b7f2-328968fb6213 req-45fc9602-e405-4ac0-a90d-db0d2118c5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697f0c15-0ac4-4599-9876-635732b63ac5", "name": "network-vif-deleted", "tag": "42a02d7d-ebd5-4636-84b3-5397091cbe8e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:38.062825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a0d90dc8-95e9-42ab-b7f2-328968fb6213 req-45fc9602-e405-4ac0-a90d-db0d2118c5c3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:38.072234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a0d90dc8-95e9-42ab-b7f2-328968fb6213 req-45fc9602-e405-4ac0-a90d-db0d2118c5c3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:38.114904 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a0d90dc8-95e9-42ab-b7f2-328968fb6213 req-45fc9602-e405-4ac0-a90d-db0d2118c5c3 service nova] Creating event network-vif-deleted:42a02d7d-ebd5-4636-84b3-5397091cbe8e for instance 697f0c15-0ac4-4599-9876-635732b63ac5 on n-h2-851337-5 Aug 04 04:46:38.130983 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a0d90dc8-95e9-42ab-b7f2-328968fb6213 req-45fc9602-e405-4ac0-a90d-db0d2118c5c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132106 Aug 04 04:46:38.132038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2376/4865] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:38.221889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:38.236632 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb7b9b81-df6f-43bb-8ad5-bf1f87839949 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1520 microversion: 2.1 time: 1.724845 Aug 04 04:46:38.241485 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2490/4866] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:36 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1520 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:38.482402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:38.483977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:38.502970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:38.504508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:38.506120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:38.512394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:38.948658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:38.980283 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c8ad8014-33e9-4427-9310-bef71a026f81 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.493024 Aug 04 04:46:38.985456 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2377/4867] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:38 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:39.028699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:39.029336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] [instance: 697f0c15-0ac4-4599-9876-635732b63ac5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:39.053259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.054004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.056335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.057079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.098122 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] HTTP exception thrown: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 could not be found. Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Request method failure captured: Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 HTTP/1.1 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi603ZqYvzCUf_DRT4FsqKszykPqsLbByFGTXII0R_WsGZc1taQRiUw7eub4FVIDR6aLithTEuNb9Rcd3T-5cGJxZfPcWnMY3U3TE5q806mUvqWdbxU3fu3_Gp6eT9Tb0V0BNiY7SAEUHDQoUu3zT096ScEoGME7-QzTwBIuQ7wwt-Vi4 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/089163f805e44913b469df4e8c9e85ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_089163f805e44913b469df4e8c9e85ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 089163f805e44913b469df4e8c9e85ec Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-452596595 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 42e55434a6d24f20b0f95a3b57d06c42 Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-452596595-project Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 could not be found. Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '697f0c15-0ac4-4599-9876-635732b63ac5'} Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 could not be found. Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 could not be found. Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:39.100727 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 could not be found. Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] Returning 404 to user: Instance 697f0c15-0ac4-4599-9876-635732b63ac5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:46:39.105389 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f249595e-6425-4471-93b2-4850e97a945e tempest-ServerRescueNegativeTestJSON-452596595 tempest-ServerRescueNegativeTestJSON-452596595-project] 10.222.0.69 "GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5" status: 404 len: 111 microversion: 2.1 time: 0.078583 Aug 04 04:46:39.110900 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2491/4868] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:39 2022] GET /compute/v2.1/servers/697f0c15-0ac4-4599-9876-635732b63ac5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:46:39.261718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:39.262338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:39.282336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.282783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.283622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.284067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.856757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:39.878024 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f0bcd14-0d13-49f9-abb7-f11d8c5a1109 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1520 microversion: 2.1 time: 0.618451 Aug 04 04:46:39.878557 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2378/4869] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:39 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1520 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:40.006708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:40.008082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:40.015759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.023259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:40.033480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.034186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:40.915121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:40.916490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:40.932391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.934811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:40.940741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.941552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:41.006482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:41.014687 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93a56cd7-dcb6-48cb-8cbd-6fc836698db2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 1.012159 Aug 04 04:46:41.020404 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2492/4870] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:40 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:41.590636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:41.606987 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c582d13f-80f2-40ef-948e-fb78a38da4cc tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1505 microversion: 2.1 time: 0.697296 Aug 04 04:46:41.607606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2379/4871] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:40 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:41.630756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:41.631877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:41.645139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:41.654973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:41.660455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:41.662579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:42.498259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:42.507078 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38abd137-f15c-402c-9c24-f09d50080dee tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 200 len: 1505 microversion: 2.1 time: 0.881357 Aug 04 04:46:42.507688 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2493/4872] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:41 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 1505 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:42.528684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:42.534559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:42.556343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:42.557843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:42.558917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:42.560887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:42.618171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2105580173", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "775caeb1-f960-4c71-aed7-331a3bff07ae"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:42.752501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] validate_networks() for [('775caeb1-f960-4c71-aed7-331a3bff07ae', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:46:43.230476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:43.244125 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea742102-215e-4b4a-99c8-62b0252b008e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.735358 Aug 04 04:46:43.244972 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2494/4873] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:42 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:43.255197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:43.258038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:43.277423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:43.279041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:43.280170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:43.280879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:43.349250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:46:43.529288 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d7fc785-4a45-40e0-b196-0684521ff0f2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "DELETE /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 204 len: 0 microversion: 2.1 time: 0.280089 Aug 04 04:46:43.534983 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2495/4874] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:46:43 2022] DELETE /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:46:43.806399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-934469967", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "31571918-f645-4eae-9aae-c7a04ff970a9"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:43.912554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] validate_networks() for [('31571918-f645-4eae-9aae-c7a04ff970a9', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:46:44.312286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:46:44.313160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:46:44.314303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:46:44.314733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:46:44.315194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:46:44.337690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.338354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:44.339524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.340158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:44.397482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Getting quotas for project da89dc6dabf44c8f857c2af87a46b12a. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:46:44.406538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Getting quotas for user e3e6ddb957144138a38b5b0734263fd1 and project da89dc6dabf44c8f857c2af87a46b12a. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:46:44.462740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:46:44.465400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:46:44.612824 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c737ea06-aceb-4261-9234-1e989c1fd0d5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.748566 Aug 04 04:46:44.624164 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2380/4875] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:46:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:46:44.634747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:44.638203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:44.659606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.662861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:44.665133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.668856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:45.416578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:45.439309 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-afc490c2-fc64-4a6e-9776-7db080dbd173 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.806444 Aug 04 04:46:45.442691 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2381/4876] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:44 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:45.461250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0f68c1d-e9ae-4612-811f-53f38cb4b02c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:45.462410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0f68c1d-e9ae-4612-811f-53f38cb4b02c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:45.964625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c0f68c1d-e9ae-4612-811f-53f38cb4b02c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:45.977542 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0f68c1d-e9ae-4612-811f-53f38cb4b02c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1228 microversion: 2.1 time: 0.531107 Aug 04 04:46:45.988907 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2382/4877] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:45 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1228 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:46.462764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:46.463424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:46.481124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.483532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.487449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.490113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.620494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:46:46.621669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:46:46.622364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:46:46.622980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:46:46.623590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:46:46.627395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:46.664973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.664973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.664973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.664973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.745368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Getting quotas for project cb2c594eee554e09bf15760aa561d231. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:46:46.762836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Getting quotas for user 320f9afd42cb4d82a07248ce6c661646 and project cb2c594eee554e09bf15760aa561d231. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:46:46.815939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:46:46.818385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:46:46.944659 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38c7b4f7-a394-4f7d-b345-2e1d4d35810e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.142663 Aug 04 04:46:46.955009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2496/4878] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:46:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:46:46.972739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa7fd33d-491c-4193-9d00-7c33624dd875 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:46.973382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fa7fd33d-491c-4193-9d00-7c33624dd875 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:47.422826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:47.433652 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-13df4e8f-7719-484c-8cae-8ab9c3c71c93 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.975013 Aug 04 04:46:47.434596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa7fd33d-491c-4193-9d00-7c33624dd875 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:47.451508 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2383/4879] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:46 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:47.453176 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fa7fd33d-491c-4193-9d00-7c33624dd875 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1217 microversion: 2.1 time: 0.496884 Aug 04 04:46:47.456921 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2497/4880] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:46 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1217 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:47.467605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:47.469894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:47.499296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:47.500810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:47.506936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:47.508524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:47.513377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-11df6a6e-445b-4f98-a25f-11d0e0a87369 req-e1ba3d66-86a7-4d4c-abe4-f2a3d32cbae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329d2b3b-9440-48a6-9f17-27992f4edab0", "name": "network-vif-deleted", "tag": "71cab977-45ae-4db3-9dda-0123dac611f3"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:47.578095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-11df6a6e-445b-4f98-a25f-11d0e0a87369 req-e1ba3d66-86a7-4d4c-abe4-f2a3d32cbae7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:47.581753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-11df6a6e-445b-4f98-a25f-11d0e0a87369 req-e1ba3d66-86a7-4d4c-abe4-f2a3d32cbae7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:47.633724 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-11df6a6e-445b-4f98-a25f-11d0e0a87369 req-e1ba3d66-86a7-4d4c-abe4-f2a3d32cbae7 service nova] Creating event network-vif-deleted:71cab977-45ae-4db3-9dda-0123dac611f3 for instance 329d2b3b-9440-48a6-9f17-27992f4edab0 on n-h1-851337-5 Aug 04 04:46:47.661420 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-11df6a6e-445b-4f98-a25f-11d0e0a87369 req-e1ba3d66-86a7-4d4c-abe4-f2a3d32cbae7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153610 Aug 04 04:46:47.672035 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2498/4881] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:47.853310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:47.873905 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec131e4b-b152-49ea-bae5-f20303ea8822 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1286 microversion: 2.1 time: 0.412554 Aug 04 04:46:47.891650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2384/4882] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:47 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1286 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:48.462586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:48.465586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:48.486943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:48.488869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:48.503344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.507188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.511804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.512807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.516399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.517293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.520057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.524324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.720947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:48.730231 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63b84849-0d90-4fe8-b1cc-fd0ffbb21549 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1213 microversion: 2.1 time: 0.254505 Aug 04 04:46:48.740269 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2385/4883] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:48 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1213 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:48.898473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:48.899157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:48.906254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.916270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.917305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.919366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.921521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:48.932248 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-deda1cbf-61ab-4757-b055-9d09498cbdb4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.477389 Aug 04 04:46:48.937194 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2499/4884] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:48 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:49.050617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:49.065475 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa1ebf81-6085-4a9e-9de1-02934d1e80e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1286 microversion: 2.1 time: 0.170224 Aug 04 04:46:49.078696 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2386/4885] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:48 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:49.765065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:49.766753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:49.778441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.784366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:49.785435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.785922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:49.889431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:49.899934 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-217da2e6-d341-46fe-a2b6-b47f9edf8b5e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1275 microversion: 2.1 time: 0.139464 Aug 04 04:46:49.915000 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2500/4886] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:49 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:49.962212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:49.962832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:49.970783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.971584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:49.972531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.973120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.087122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:50.087736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:50.099000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.099533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.100336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.101247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.274995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:50.288153 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b727446-1ac7-4407-9645-6ce9c4016375 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1286 microversion: 2.1 time: 0.205998 Aug 04 04:46:50.304744 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2501/4887] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:50 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:50.324644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:50.339218 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dfd91838-6d63-40c8-aca1-8cd8b57cbbeb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1523 microversion: 2.1 time: 0.379230 Aug 04 04:46:50.339860 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2387/4888] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:49 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:50.925527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:50.927522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:50.937365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.939030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.940235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.940901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.058306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:51.072519 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eacf7e15-ff9b-4977-ab75-2cfd297ccbed tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1275 microversion: 2.1 time: 0.153371 Aug 04 04:46:51.082996 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2502/4889] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:50 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:51.311538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:51.312154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:51.332325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.333116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.334187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.334800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.362558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:51.363271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:51.376521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.376981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.380869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.383234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.413788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:51.435922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:51.444851 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc966ea3-d53c-438e-bd5a-fe81a2f558f7 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1286 microversion: 2.1 time: 0.138163 Aug 04 04:46:51.446081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2388/4890] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:51 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:51.621446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:51.633658 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf3eda3c-698f-4bbd-bb49-c33b5553f83c tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1505 microversion: 2.1 time: 0.276638 Aug 04 04:46:51.635264 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2503/4891] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:51 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:52.097714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:52.098224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:52.100408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:52.118119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.118585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.119427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.119876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.273819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:52.290453 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb17bbba-b95c-4433-a302-48b132d44a99 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1275 microversion: 2.1 time: 0.199041 Aug 04 04:46:52.325766 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2389/4892] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:52 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:52.465811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:52.467000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:52.476375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.477056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.478533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.479330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.660819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:52.662479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:52.677776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.678811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.679987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.681042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:53.148022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:53.189773 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bf48af69-67ba-4217-a1a2-676f9f1b7f76 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 0.727740 Aug 04 04:46:53.191000 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2504/4893] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:52 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:53.203032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:53.220377 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-130fc3bc-4e68-438d-89ac-f655cd6dc341 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1505 microversion: 2.1 time: 0.566782 Aug 04 04:46:53.221630 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2390/4894] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:52 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:53.320086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:53.320904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:53.335502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:53.336304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:53.354946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:53.356064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:53.705804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:53.714376 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-52adad92-51f9-4518-877a-35284e3d1188 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.401396 Aug 04 04:46:53.714978 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2505/4895] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:53 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:54.214016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:54.216161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:54.226853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.228020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.229206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.229886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.247453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:54.248403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:54.259978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.261707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.263005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.266163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.374753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:54.796477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:54.804196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:54.812010 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b8478ee1-75f7-4e75-a846-a40dd137222b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 0.603499 Aug 04 04:46:54.818058 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2391/4896] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:54 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:54.822059 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19e0b5df-eee5-4e27-bd33-441033db1790 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1505 microversion: 2.1 time: 0.571641 Aug 04 04:46:54.827146 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2506/4897] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:54 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:54.845270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:54.847911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:54.864278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.867569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.869085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.871334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.909490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:55.298550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:55.313691 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e2a82fb5-335a-47f2-8cbc-b52482c541d4 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.491554 Aug 04 04:46:55.314326 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2392/4898] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:54 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:55.317556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6c5c42ea-82aa-43fd-820b-f9d9f7a84622 req-ddd2005d-a8d3-45fb-9257-81a096991b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3a123d-0860-4fdd-82d1-f96440fe272d", "name": "network-vif-unplugged", "status": "completed", "tag": "8bbfcffb-557d-4205-9eb5-e55119f6b915"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:55.334703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6c5c42ea-82aa-43fd-820b-f9d9f7a84622 req-ddd2005d-a8d3-45fb-9257-81a096991b9b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:55.335577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6c5c42ea-82aa-43fd-820b-f9d9f7a84622 req-ddd2005d-a8d3-45fb-9257-81a096991b9b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:55.356780 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6c5c42ea-82aa-43fd-820b-f9d9f7a84622 req-ddd2005d-a8d3-45fb-9257-81a096991b9b service nova] Creating event network-vif-unplugged:8bbfcffb-557d-4205-9eb5-e55119f6b915 for instance 0f3a123d-0860-4fdd-82d1-f96440fe272d on n-h2-851337-5 Aug 04 04:46:55.369269 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6c5c42ea-82aa-43fd-820b-f9d9f7a84622 req-ddd2005d-a8d3-45fb-9257-81a096991b9b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061614 Aug 04 04:46:55.370998 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2507/4899] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:55.837902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:55.838692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:55.852220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:55.852928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:55.853887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:55.854499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:55.855971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:55.860576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:55.872871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:55.873852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:55.875167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:55.876043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:55.969861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:56.560662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:56.562646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:56.571552 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b00b8ca-0271-46e7-8db0-7c3936d36827 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 0.737456 Aug 04 04:46:56.587391 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d565cfee-fde1-4314-bab5-1b595821e0cf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1505 microversion: 2.1 time: 0.730784 Aug 04 04:46:56.587391 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2508/4900] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:55 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1505 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:56.588298 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2393/4901] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:55 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:56.605905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:56.606584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-18a0f3c9-b3e0-4905-a0ab-99dfb498522d req-0b5f9398-b2ba-441b-9a7d-0d80614f8515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1dad90-4a91-4a7c-a09a-4554ef5d5f58", "tag": "b14af0c1-1523-4b68-9f3b-303131b6ee00"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:56.608320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:56.616920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:56.617616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:56.618733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:56.619422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:56.679185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-18a0f3c9-b3e0-4905-a0ab-99dfb498522d req-0b5f9398-b2ba-441b-9a7d-0d80614f8515 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:56.679640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-18a0f3c9-b3e0-4905-a0ab-99dfb498522d req-0b5f9398-b2ba-441b-9a7d-0d80614f8515 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:56.703917 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-18a0f3c9-b3e0-4905-a0ab-99dfb498522d req-0b5f9398-b2ba-441b-9a7d-0d80614f8515 service nova] Creating event network-changed:b14af0c1-1523-4b68-9f3b-303131b6ee00 for instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 on n-h2-851337-5 Aug 04 04:46:56.712264 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-18a0f3c9-b3e0-4905-a0ab-99dfb498522d req-0b5f9398-b2ba-441b-9a7d-0d80614f8515 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124705 Aug 04 04:46:56.713267 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2509/4902] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:57.200063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:57.210940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ed9f6f4-8bc8-44c3-9023-f13a5323f0e0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.621131 Aug 04 04:46:57.211567 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2394/4903] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:56 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:57.613956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:57.617607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:57.618083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:57.619548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:57.625666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:57.630410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:57.634338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.635772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:57.637689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.646605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.649396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:57.650241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:57.657141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.659097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.073583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:58.085934 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b8f0f270-d04b-47f9-8b14-f897c308f31a tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 0.476186 Aug 04 04:46:58.091719 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2395/4904] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:57 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:58.127543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:58.136606 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c46fc7f1-6354-41a9-9431-792694e1a7fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 200 len: 1448 microversion: 2.1 time: 0.530221 Aug 04 04:46:58.137198 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2510/4905] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:57 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 1448 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:46:58.159825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:58.160337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:58.185522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.186621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.187696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.188455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.236518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:58.237628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:58.251117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:46:58.263862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.264614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.266334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.268550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.311342 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.compute.api [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Working on deleting snapshot 9a5e3945-2f43-414f-a0df-d33739e4cfea from shelved instance... Aug 04 04:46:58.752663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:58.769786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-50ac7c51-61fc-4632-bf96-7d8ad1aa647e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.534227 Aug 04 04:46:58.771030 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2511/4906] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:58 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:46:58.828897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0b1eb47b-644a-4215-938f-c7a10d5b9d62 req-4254db47-2690-48eb-b73b-3d4ad2246875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42435a82-deaa-43a3-930e-f1230e1885ff", "tag": "67730228-a60e-4a08-a9ea-3bc308bedeae"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:46:58.861810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0b1eb47b-644a-4215-938f-c7a10d5b9d62 req-4254db47-2690-48eb-b73b-3d4ad2246875 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.864932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0b1eb47b-644a-4215-938f-c7a10d5b9d62 req-4254db47-2690-48eb-b73b-3d4ad2246875 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.898437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0b1eb47b-644a-4215-938f-c7a10d5b9d62 req-4254db47-2690-48eb-b73b-3d4ad2246875 service nova] Creating event network-changed:67730228-a60e-4a08-a9ea-3bc308bedeae for instance 42435a82-deaa-43a3-930e-f1230e1885ff on n-h1-851337-5 Aug 04 04:46:58.918836 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0b1eb47b-644a-4215-938f-c7a10d5b9d62 req-4254db47-2690-48eb-b73b-3d4ad2246875 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095314 Aug 04 04:46:58.924182 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2512/4907] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:59.118008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:59.118773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:59.140442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:59.143457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:59.145547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:59.151094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:59.695999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Doing local delete in cell 252fd515-9666-4464-b81b-0a319b17989b(cell1) {{(pid=119342) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 04:46:59.697788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:59.698538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:59.699048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.compute.api [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 04:46:59.708162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] deallocate_for_instance() {{(pid=119342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 04:46:59.817810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:46:59.828880 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-438a6c6d-f4ff-4386-8b4a-c95327eac79e tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 0.717003 Aug 04 04:46:59.835386 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2513/4908] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:46:59 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:00.117732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1837173-2b1c-4d66-9cb6-0c441232373c tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Action: 'create', calling method: .version_select at 0x7f19195434c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1778984335", "metadata": {"Type": "work"}}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:00.829411 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1837173-2b1c-4d66-9cb6-0c441232373c tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.985913 Aug 04 04:47:00.832166 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2514/4909] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Aug 4 04:46:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 996 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 04:47:00.860125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:00.860808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:00.889787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:00.899454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:00.903893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:00.907343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:01.569410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:01.584637 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2da505a6-ca61-4a51-a291-9c20e072d667 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.742738 Aug 04 04:47:01.585272 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2515/4910] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:00 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:01.606857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2e8ba83-0844-4532-a61c-1ab19e084ac7 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Calling method '.version_select at 0x7f191a4f9670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:01.671164 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2e8ba83-0844-4532-a61c-1ab19e084ac7 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364" status: 200 len: 353 microversion: 2.1 time: 0.069476 Aug 04 04:47:01.671895 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2516/4911] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:01 2022] GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:01.689491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:01.690229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:01.701105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:01.702353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:01.704913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:01.708608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.394538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Updating instance_info_cache with network_info: [] {{(pid=119342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 04:47:02.446298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:02.455455 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b2c0f84-57b0-43e8-bfea-011f6129532c tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 0.782267 Aug 04 04:47:02.456706 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2517/4912] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:01 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:02.463733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c9bbec29-2f77-48ff-91bd-8664d8f155d6 req-012141a5-410a-4bc5-8129-7d32de33ae6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3a123d-0860-4fdd-82d1-f96440fe272d", "name": "network-vif-deleted", "tag": "8bbfcffb-557d-4205-9eb5-e55119f6b915"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:02.479517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c9bbec29-2f77-48ff-91bd-8664d8f155d6 req-012141a5-410a-4bc5-8129-7d32de33ae6b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:02.481116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c9bbec29-2f77-48ff-91bd-8664d8f155d6 req-012141a5-410a-4bc5-8129-7d32de33ae6b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.498716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.server_external_events [req-c9bbec29-2f77-48ff-91bd-8664d8f155d6 req-012141a5-410a-4bc5-8129-7d32de33ae6b service nova] Unable to find a host for instance 0f3a123d-0860-4fdd-82d1-f96440fe272d. Dropping event network-vif-deleted {{(pid=119343) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 04:47:02.500584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c9bbec29-2f77-48ff-91bd-8664d8f155d6 req-012141a5-410a-4bc5-8129-7d32de33ae6b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.042354 Aug 04 04:47:02.507903 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2518/4913] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 04:47:02.607865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:02.608818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:02.624096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:02.624565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.625399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:02.625851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.990902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:03.022777 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cbc1286-faf5-4ffd-a90c-48167e86c4b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 204 len: 0 microversion: 2.1 time: 4.861780 Aug 04 04:47:03.024983 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-856822b4-599b-47fb-b4f3-e33c69debbae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.415472 Aug 04 04:47:03.030685 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2519/4915] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:02 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:03.030858 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2396/4915] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:46:58 2022] DELETE /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 0 bytes in 4872 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:47:03.038197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:03.039098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:03.048139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-40a7defc-a6c9-4ec4-a9ed-145ffe793470 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Calling method '.version_select at 0x7f191a644700>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:03.073722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.075694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:03.078829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.082177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:03.113998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d HTTP/1.1 Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0f3a123d-0860-4fdd-82d1-f96440fe272d'} Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:03.120897 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:03.126578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:03.128049 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a5701f8-d872-4d98-b321-c3404b1dfc75 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 404 len: 111 microversion: 2.1 time: 0.094339 Aug 04 04:47:03.128645 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2520/4916] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:03 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:03.184432 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-40a7defc-a6c9-4ec4-a9ed-145ffe793470 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364" status: 200 len: 354 microversion: 2.1 time: 0.150309 Aug 04 04:47:03.192171 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2397/4917] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:03 2022] GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:03.203557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b624dc74-2b0a-415e-bef9-fde4202cded1 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Calling method '.version_select at 0x7f191a1dc3a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:03.337826 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b624dc74-2b0a-415e-bef9-fde4202cded1 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364" status: 200 len: 354 microversion: 2.1 time: 0.138448 Aug 04 04:47:03.348468 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2521/4918] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:03 2022] GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 => generated 354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:03.352897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76fe4901-edce-447f-9a49-7e4fbb0b3b54 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Calling method '.version_select at 0x7f191a3ab1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:03.442907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-166495931", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:03.511879 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76fe4901-edce-447f-9a49-7e4fbb0b3b54 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364" status: 202 len: 0 microversion: 2.1 time: 0.163201 Aug 04 04:47:03.512813 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2398/4919] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:47:03 2022] DELETE /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:47:03.521885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:03.525481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:03.560574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] validate_networks() for [('9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:47:03.573559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.576164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:03.583572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.584073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:04.566191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:04.587190 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3c66de7-5cdb-4482-a6ec-bbc4dbfb6cd0 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 1.072581 Aug 04 04:47:04.590838 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2399/4920] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:03 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:04.607816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a7df897d-bbec-4d5f-a6d6-acbf8cf76a6c tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Calling method '.version_select at 0x7f1923b03430>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:04.729091 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a7df897d-bbec-4d5f-a6d6-acbf8cf76a6c tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364" status: 200 len: 353 microversion: 2.1 time: 0.135134 Aug 04 04:47:04.729748 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2400/4921] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:04 2022] GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:04.746166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:04.748218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:04.763073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:04.765195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:04.769286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:04.769985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.376107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:05.389765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a5dc0d7-8810-4c88-bd81-742dabee1e57 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.648529 Aug 04 04:47:05.391424 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2401/4922] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:04 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:05.415181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a821d87e-9a0c-43f8-9d1c-d09b75f854f5 req-f76ac811-55fc-4201-a93a-60ffe37a78fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1dad90-4a91-4a7c-a09a-4554ef5d5f58", "name": "network-vif-plugged", "status": "completed", "tag": "b14af0c1-1523-4b68-9f3b-303131b6ee00"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:05.427367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a821d87e-9a0c-43f8-9d1c-d09b75f854f5 req-f76ac811-55fc-4201-a93a-60ffe37a78fe service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.428020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a821d87e-9a0c-43f8-9d1c-d09b75f854f5 req-f76ac811-55fc-4201-a93a-60ffe37a78fe service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.447091 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a821d87e-9a0c-43f8-9d1c-d09b75f854f5 req-f76ac811-55fc-4201-a93a-60ffe37a78fe service nova] Creating event network-vif-plugged:b14af0c1-1523-4b68-9f3b-303131b6ee00 for instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 on n-h2-851337-5 Aug 04 04:47:05.453103 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a821d87e-9a0c-43f8-9d1c-d09b75f854f5 req-f76ac811-55fc-4201-a93a-60ffe37a78fe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046167 Aug 04 04:47:05.455271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2402/4923] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:05.477407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:47:05.478500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:47:05.479188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:47:05.480400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:47:05.481100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:47:05.508265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.510890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.513594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.514064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.570615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:47:05.578390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for user 0e04770e8fd84cff82e73ffd27b8a50a and project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:47:05.596773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:47:05.601175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:47:05.613824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:05.614761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:05.651522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.652523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.654905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.665425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.667229 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-33440762-8a5e-4542-bf54-d091b8ead680 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.230590 Aug 04 04:47:05.676727 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2522/4924] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:47:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:47:05.682589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a4461b3-2ac8-4430-9646-46aa8a4aa553 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:05.683778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a4461b3-2ac8-4430-9646-46aa8a4aa553 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:05.855635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1a4461b3-2ac8-4430-9646-46aa8a4aa553 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:05.873441 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a4461b3-2ac8-4430-9646-46aa8a4aa553 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1214 microversion: 2.1 time: 0.193258 Aug 04 04:47:05.875499 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2523/4925] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:05 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:05.900734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e370348f-16e6-49aa-8239-d338046f4c26 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Calling method '.version_select at 0x7f191a63f3a0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:06.038330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e370348f-16e6-49aa-8239-d338046f4c26 tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364" status: 200 len: 353 microversion: 2.1 time: 0.157018 Aug 04 04:47:06.039273 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2524/4926] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:05 2022] GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:06.203005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:06.217718 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-348a1c18-e207-4778-bebf-b3c79ce4f5e5 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1328 microversion: 2.1 time: 0.609550 Aug 04 04:47:06.219212 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2403/4927] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:05 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1328 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:06.414214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:06.414917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:06.429257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.429754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:06.430794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.431299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:06.835349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:06.880670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62070834-680a-4bd6-b62c-8222da6ad8af tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.470325 Aug 04 04:47:06.883815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2525/4928] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:06 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:06.904786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:06.906878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:06.923897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.925056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:06.929224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.929938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.060454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c2f7e52-041e-4223-80e0-5893c8e2f86d tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Calling method '.version_select at 0x7f191a4f3d30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:07.129087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:07.148678 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42bf5e0c-5df3-4814-8425-0847d5906b14 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1210 microversion: 2.1 time: 0.249169 Aug 04 04:47:07.151236 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2404/4929] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:06 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1210 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:07.153792 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2c2f7e52-041e-4223-80e0-5893c8e2f86d tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] HTTP exception thrown: Volume 0978b522-d1c3-47b5-b0ad-2295d5b5a364 could not be found. Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c2f7e52-041e-4223-80e0-5893c8e2f86d tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Request method failure captured: Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 HTTP/1.1 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi609DwkwFYURuVzgNm89HzIBjpbwAEbCSit5v64Pa6NyTxbVJBMF898CaXbMdaDj5oSlT_ALWAIMsd5yLIofkpHPineCwbVNSIrlDm_FzU177tPrJy6QWolmZvvzUi6L-w5eH83nTjZ4Ln0EHYvTIzAqOu1o2Ni17Km82dG33LknmqME Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 87081c39dcac4490b9dde8acb4aaaae3 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesGetTestJSON-2147252025 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87081c39dcac4490b9dde8acb4aaaae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/87081c39dcac4490b9dde8acb4aaaae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/87081c39dcac4490b9dde8acb4aaaae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_87081c39dcac4490b9dde8acb4aaaae3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesGetTestJSON-2147252025 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 87081c39dcac4490b9dde8acb4aaaae3 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesGetTestJSON-2147252025 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesGetTestJSON-2147252025-project Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 60067265db2a42b795661acfac728da3 Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesGetTestJSON-2147252025-project Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: exception: Volume 0978b522-d1c3-47b5-b0ad-2295d5b5a364 could not be found. Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0978b522-d1c3-47b5-b0ad-2295d5b5a364'} Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0978b522-d1c3-47b5-b0ad-2295d5b5a364 could not be found. (HTTP 404) (Request-ID: req-f97dc76a-5fd3-421e-925a-25e10cc1c854) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:47:07.157072 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0978b522-d1c3-47b5-b0ad-2295d5b5a364 could not be found. Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0978b522-d1c3-47b5-b0ad-2295d5b5a364 could not be found. Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0978b522-d1c3-47b5-b0ad-2295d5b5a364 could not be found. Aug 04 04:47:07.161759 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:07.165726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c2f7e52-041e-4223-80e0-5893c8e2f86d tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] Returning 404 to user: Volume 0978b522-d1c3-47b5-b0ad-2295d5b5a364 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:07.166093 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c2f7e52-041e-4223-80e0-5893c8e2f86d tempest-VolumesGetTestJSON-2147252025 tempest-VolumesGetTestJSON-2147252025-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364" status: 404 len: 109 microversion: 2.1 time: 0.118021 Aug 04 04:47:07.169937 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2526/4930] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:07 2022] GET /compute/v2.1/os-volumes/0978b522-d1c3-47b5-b0ad-2295d5b5a364 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:47:07.241117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:07.242077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:07.253898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.255764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.257928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.260299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.585552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:07.598931 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-54be4d93-9ca6-46a3-9c48-b71852c0b0dc tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1528 microversion: 2.1 time: 0.359734 Aug 04 04:47:07.599867 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2405/4931] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:07 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1528 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:07.625697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:07.627141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:07.645773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.651913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.653438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.654200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.909872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:07.911287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:07.928242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.935863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.936984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.942074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:07.949622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.954836 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-740d5df8-c797-4786-ab86-663e45fcc95b tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1528 microversion: 2.1 time: 0.333590 Aug 04 04:47:07.969659 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2527/4932] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:07 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1528 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:07.972712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:08.272477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:08.289040 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f098f712-e06a-42cd-a428-84d3acfef0c7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 0.383543 Aug 04 04:47:08.289947 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2406/4933] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:07 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:08.320537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:08.323119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:08.351949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.359567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.360554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.361017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.556286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:08.568151 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7457cba3-3698-4f9d-80b8-d42526c76b05 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1272 microversion: 2.1 time: 0.272736 Aug 04 04:47:08.568895 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2407/4934] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:08 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:08.602687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-aacf134b-f6d4-47f3-aefd-06b10a23daa9 req-8df00f55-d27c-4600-b286-f29de8b27432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42435a82-deaa-43a3-930e-f1230e1885ff", "name": "network-vif-plugged", "status": "completed", "tag": "67730228-a60e-4a08-a9ea-3bc308bedeae"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:08.646778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aacf134b-f6d4-47f3-aefd-06b10a23daa9 req-8df00f55-d27c-4600-b286-f29de8b27432 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.652187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aacf134b-f6d4-47f3-aefd-06b10a23daa9 req-8df00f55-d27c-4600-b286-f29de8b27432 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.679538 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-aacf134b-f6d4-47f3-aefd-06b10a23daa9 req-8df00f55-d27c-4600-b286-f29de8b27432 service nova] Creating event network-vif-plugged:67730228-a60e-4a08-a9ea-3bc308bedeae for instance 42435a82-deaa-43a3-930e-f1230e1885ff on n-h1-851337-5 Aug 04 04:47:08.694040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:08.694569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:08.708244 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-aacf134b-f6d4-47f3-aefd-06b10a23daa9 req-8df00f55-d27c-4600-b286-f29de8b27432 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110110 Aug 04 04:47:08.711266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.711528 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2408/4935] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:08.723298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.724169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.724777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.782512 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] HTTP exception thrown: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Request method failure captured: Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 HTTP/1.1 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi608x7zrS4DnFrHf-g4LZdEQUdKsufmGwhCmL-sN43zwWAj-mF5KsrXGI5xWrwAID-SqrYMr2OOFubPa4C7DWwvZNS1ljHVvSwaY3IjmxqtxfW1h-mx4QeKDYidlF3cLlRsEopxq-GMTJG6QDThi5ZRPh3wjpWApkMshJFJwZA5ljylk Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 5d53a6581e814243bee80fed030120f1 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1924725563 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d53a6581e814243bee80fed030120f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5d53a6581e814243bee80fed030120f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d53a6581e814243bee80fed030120f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5d53a6581e814243bee80fed030120f1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1924725563 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 5d53a6581e814243bee80fed030120f1 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1924725563 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1924725563-project Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b3265e9d838e44ac8fdaa10a08652fb0 Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1924725563-project Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5c1dad90-4a91-4a7c-a09a-4554ef5d5f58'} Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:47:08.784556 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:08.788935 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:08.794046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Returning 404 to user: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:08.799654 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23a9f96a-d40b-4e3f-9e49-b13b4e98fcb8 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 404 len: 111 microversion: 2.1 time: 0.811284 Aug 04 04:47:08.800831 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2528/4936] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:47:07 2022] DELETE /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 111 bytes in 813 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:08.825134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:08.829119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:08.843909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.849266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.850997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.851471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.310314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:09.311516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:09.324253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.324913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.325879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.327229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.345369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:09.359380 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1845e47e-a7c2-4327-acc0-f82023ae738d tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1528 microversion: 2.1 time: 0.552099 Aug 04 04:47:09.360285 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2409/4937] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:08 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1528 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:09.402430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Action: 'update', calling method: >, body: {"server": {"name": "5c1dad90-4a91-4a7c-a09a-4554ef5d5f58_new"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:09.410074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:09.431466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.433646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.436529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.437884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.501839 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] HTTP exception thrown: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Request method failure captured: Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: request: PUT /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 HTTP/1.1 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 64 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi608x7zrS4DnFrHf-g4LZdEQUdKsufmGwhCmL-sN43zwWAj-mF5KsrXGI5xWrwAID-SqrYMr2OOFubPa4C7DWwvZNS1ljHVvSwaY3IjmxqtxfW1h-mx4QeKDYidlF3cLlRsEopxq-GMTJG6QDThi5ZRPh3wjpWApkMshJFJwZA5ljylk Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 5d53a6581e814243bee80fed030120f1 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1924725563 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d53a6581e814243bee80fed030120f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5d53a6581e814243bee80fed030120f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d53a6581e814243bee80fed030120f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5d53a6581e814243bee80fed030120f1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1924725563 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 5d53a6581e814243bee80fed030120f1 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1924725563 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1924725563-project Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b3265e9d838e44ac8fdaa10a08652fb0 Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1924725563-project Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "5c1dad90-4a91-4a7c-a09a-4554ef5d5f58_new"}} Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '5c1dad90-4a91-4a7c-a09a-4554ef5d5f58', 'body': {'server': {'name': '5c1dad90-4a91-4a7c-a09a-4554ef5d5f58_new'}}} Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:47:09.503692 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] Returning 404 to user: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:09.509974 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b2f90d6-2082-4b89-8684-410f3edcd8a4 tempest-ServersNegativeTestMultiTenantJSON-1924725563 tempest-ServersNegativeTestMultiTenantJSON-1924725563-project] 10.222.0.69 "PUT /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 404 len: 111 microversion: 2.1 time: 0.119901 Aug 04 04:47:09.511350 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2410/4938] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:47:09 2022] PUT /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:09.529166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:09.529764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:09.549763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.550225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.552035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.552484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.616317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:47:09.791477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e89dbc2d-02f8-4cfa-9323-5a1b2be88959 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 204 len: 0 microversion: 2.1 time: 0.272252 Aug 04 04:47:09.796615 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2411/4939] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:47:09 2022] DELETE /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:47:09.804753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:09.805890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:09.814916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.815757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.817368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.818139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.956759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:09.969229 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c05a473b-a233-442b-81d9-6bb9a6c64256 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1272 microversion: 2.1 time: 0.170868 Aug 04 04:47:09.970414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2412/4940] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:09 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:09.993714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:09.997361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:10.013602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:10.016648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:10.018554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:10.019778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:10.306661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:10.326254 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a08e03a-c7a8-4e4a-b01b-469a9b8b91d3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1317 microversion: 2.1 time: 1.019697 Aug 04 04:47:10.327604 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2529/4941] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:09 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:10.994568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:10.995233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:11.033640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.034890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.035930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.036537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.317157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:11.338260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:11.339900 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-19df9fa4-feb3-44f6-a63a-594babc8bf7f tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1534 microversion: 2.1 time: 1.368006 Aug 04 04:47:11.355476 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2413/4942] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:09 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1534 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:11.356090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:11.356090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f30e3eea-af1b-44c7-bfa7-2c3d894418ed tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1272 microversion: 2.1 time: 0.360309 Aug 04 04:47:11.356619 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2530/4943] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:10 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:11.366346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:11.367132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:11.375864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.376659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.377726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.378175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.873614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:11.885877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02b54bec-f718-4fce-9745-5d85528284dd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1506 microversion: 2.1 time: 0.539852 Aug 04 04:47:11.886479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2414/4944] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:11 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:11.907150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:11.907759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:11.920306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.920767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.922092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.923280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:12.363880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:12.364581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:12.382320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.387789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:12.388600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.389041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:12.537767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:12.548808 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8fe16611-47bf-4f4d-aed4-14048250ab50 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1506 microversion: 2.1 time: 0.645897 Aug 04 04:47:12.549414 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2531/4945] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:11 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:12.567625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:12.568549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:12.591154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.592541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:12.594419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.595102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.013512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:13.037752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95c1554a-4755-4368-b6bb-44a676553616 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1314 microversion: 2.1 time: 0.472331 Aug 04 04:47:13.042642 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2532/4946] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:12 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:13.070393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9bcbb4f-b6b3-4551-b031-610b3abb1848 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:13.080605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9bcbb4f-b6b3-4551-b031-610b3abb1848 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:13.101732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bcbb4f-b6b3-4551-b031-610b3abb1848 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.104493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bcbb4f-b6b3-4551-b031-610b3abb1848 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.105335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bcbb4f-b6b3-4551-b031-610b3abb1848 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.110183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9bcbb4f-b6b3-4551-b031-610b3abb1848 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.140827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6ddb957144138a38b5b0734263fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da89dc6dabf44c8f857c2af87a46b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:13.151871 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eacf94ae-8fc2-4e3a-bd1c-66bda53dad52 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 200 len: 1534 microversion: 2.1 time: 0.792572 Aug 04 04:47:13.152464 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2415/4947] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:12 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 1534 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:13.267922 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9bcbb4f-b6b3-4551-b031-610b3abb1848 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "PUT /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1078 microversion: 2.1 time: 0.223325 Aug 04 04:47:13.268866 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2533/4948] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:47:13 2022] PUT /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1078 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:13.285978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:13.286874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:13.293676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.294480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.295438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.296035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.786193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:13.801869 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-95718139-9e1d-4386-aa79-5e9a7f91883b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1504 microversion: 2.1 time: 0.519700 Aug 04 04:47:13.822304 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2416/4949] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:13 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:13.826912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:13.837287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:13.864185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.866474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.872959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.874206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.949037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-dddad61b-fcf9-4bc2-be73-385202d8952a req-03236f7e-5e3a-4467-aac6-87c5963edffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1dad90-4a91-4a7c-a09a-4554ef5d5f58", "name": "network-vif-deleted", "tag": "b14af0c1-1523-4b68-9f3b-303131b6ee00"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:13.981468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dddad61b-fcf9-4bc2-be73-385202d8952a req-03236f7e-5e3a-4467-aac6-87c5963edffa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.981912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dddad61b-fcf9-4bc2-be73-385202d8952a req-03236f7e-5e3a-4467-aac6-87c5963edffa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.002776 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dddad61b-fcf9-4bc2-be73-385202d8952a req-03236f7e-5e3a-4467-aac6-87c5963edffa service nova] Creating event network-vif-deleted:b14af0c1-1523-4b68-9f3b-303131b6ee00 for instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 on n-h2-851337-5 Aug 04 04:47:14.020936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-dddad61b-fcf9-4bc2-be73-385202d8952a req-03236f7e-5e3a-4467-aac6-87c5963edffa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078457 Aug 04 04:47:14.022896 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2417/4950] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:14.066986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:14.068123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:14.104730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.104951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.105572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.106022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.621423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:14.629377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98d3d2d3-4b0a-4a75-a59b-b95012bcf926 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1504 microversion: 2.1 time: 0.806742 Aug 04 04:47:14.633673 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2534/4951] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:13 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1504 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:14.650643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:14.651368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] [instance: 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:14.681621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.682180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.683032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.691506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.728528 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] HTTP exception thrown: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Request method failure captured: Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 HTTP/1.1 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi608ZNs8qQdq5xVe_tf9TSWj6dRQG7JfxyFzPuqGZFHP2OZ7XLMF3fUS4iI2EQ_dKf6Zp_00kgeBsQTVmk2e7WsLzcylelBmM-ZiTylWz4wwIwJpB6YSp2Hw0gyxRdz2cPAIR8rgDsmFaRTYDvo9ocPYH_V2CI8_nJl_pm5pAp4yWZXs Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: da89dc6dabf44c8f857c2af87a46b12a Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-798327548 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da89dc6dabf44c8f857c2af87a46b12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/da89dc6dabf44c8f857c2af87a46b12a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da89dc6dabf44c8f857c2af87a46b12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_da89dc6dabf44c8f857c2af87a46b12a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-798327548 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: da89dc6dabf44c8f857c2af87a46b12a Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-798327548 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestMultiTenantJSON-798327548-project Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: e3e6ddb957144138a38b5b0734263fd1 Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-798327548-project Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5c1dad90-4a91-4a7c-a09a-4554ef5d5f58'} Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:14.735526 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. Aug 04 04:47:14.740189 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:14.741143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:14.742881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] Returning 404 to user: Instance 5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:14.744245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd34053e-4db5-4e7a-ab35-17915e1afc65 tempest-ServersNegativeTestMultiTenantJSON-798327548 tempest-ServersNegativeTestMultiTenantJSON-798327548-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58" status: 404 len: 111 microversion: 2.1 time: 0.109225 Aug 04 04:47:14.745288 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2535/4952] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:14 2022] GET /compute/v2.1/servers/5c1dad90-4a91-4a7c-a09a-4554ef5d5f58 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:14.758261 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7b8206a-a147-4beb-84aa-7fb18ccbe3eb tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1314 microversion: 2.1 time: 0.698058 Aug 04 04:47:14.760047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:14.766132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:14.777484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:14.780452 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2418/4953] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:14 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:14.792993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.793834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.794810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.804846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.915455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:47:14.916110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:47:14.916563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:47:14.916861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:47:14.920030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:47:15.047087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:15.062827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.067308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.068379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.068976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.115176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4dcf6867-3892-4bb2-9896-3fcb89863d6b tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f191a634f70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:15.130591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5d9ff7fd-8e1e-4ad0-a903-606ac3d9a363 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "POST /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff/action" status: 202 len: 1110 microversion: 2.1 time: 0.382634 Aug 04 04:47:15.135675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2536/4954] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:47:14 2022] POST /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff/action => generated 1110 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 04:47:15.155743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:15.156566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:15.173724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.173937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.174744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.176181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.211866 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4dcf6867-3892-4bb2-9896-3fcb89863d6b tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6e7cc9c5-2387-4783-aaa3-2a330a9eb9ce" status: 200 len: 350 microversion: 2.1 time: 0.102058 Aug 04 04:47:15.212902 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2419/4955] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:15 2022] GET /compute/v2.1/os-volumes/6e7cc9c5-2387-4783-aaa3-2a330a9eb9ce => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:15.545327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:15.788567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:15.789474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:15.800666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.808777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.809880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.810484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.869324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:16.039102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:16.049780 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fefa7436-0742-4923-9543-2b5630152a45 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.897775 Aug 04 04:47:16.059737 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2537/4956] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:15 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:16.103010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7b2d233c-955e-4e10-8a6d-a370efb6f38f req-3acdab67-7779-43f8-8ebd-23d50e529f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9112c20-166e-4c8d-811c-6748f994bd4e", "tag": "92e8dfd7-39fa-4710-8cec-c915e34e6cef"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:16.132200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7b2d233c-955e-4e10-8a6d-a370efb6f38f req-3acdab67-7779-43f8-8ebd-23d50e529f21 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:16.134092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7b2d233c-955e-4e10-8a6d-a370efb6f38f req-3acdab67-7779-43f8-8ebd-23d50e529f21 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:16.159117 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7b2d233c-955e-4e10-8a6d-a370efb6f38f req-3acdab67-7779-43f8-8ebd-23d50e529f21 service nova] Creating event network-changed:92e8dfd7-39fa-4710-8cec-c915e34e6cef for instance b9112c20-166e-4c8d-811c-6748f994bd4e on n-h2-851337-5 Aug 04 04:47:16.168647 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7b2d233c-955e-4e10-8a6d-a370efb6f38f req-3acdab67-7779-43f8-8ebd-23d50e529f21 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069571 Aug 04 04:47:16.172979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2538/4957] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:17.075887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:17.077072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:17.093876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:17.095516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:17.096460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:17.098762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:17.479532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:17.491201 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-88a49cba-f359-41d4-8d2a-aa9d372e12b4 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1314 microversion: 2.1 time: 1.707345 Aug 04 04:47:17.512572 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2420/4958] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:15 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1314 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:17.966472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:17.972243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1511ff70-356a-4a6b-8727-e998773d3153 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f191a6343a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:17.975256 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ea4b18b-16ce-4b53-8f89-e01e650b9479 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.904730 Aug 04 04:47:17.983272 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2539/4959] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:17 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:18.058017 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1511ff70-356a-4a6b-8727-e998773d3153 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3b8f6f14-730d-4dd5-a5fd-042514fae7b5" status: 200 len: 350 microversion: 2.1 time: 0.090290 Aug 04 04:47:18.061924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2421/4960] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:17 2022] GET /compute/v2.1/os-volumes/3b8f6f14-730d-4dd5-a5fd-042514fae7b5 => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:18.514562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:18.515764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:18.534325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:18.534856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:18.535610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:18.536035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.012772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:19.014081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:19.062888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:19.064545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.065607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:19.072556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.193010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:19.207452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-90d33bfd-a757-42c5-a29f-f636d1df8685 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1314 microversion: 2.1 time: 0.697383 Aug 04 04:47:19.223775 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2540/4961] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:18 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:19.435487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c426347d-a02a-474f-aa33-3e869ed2f5cb req-d7537e59-a03b-45cb-9c3c-14862cedf3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9112c20-166e-4c8d-811c-6748f994bd4e", "name": "network-vif-plugged", "status": "completed", "tag": "92e8dfd7-39fa-4710-8cec-c915e34e6cef"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:19.468803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c426347d-a02a-474f-aa33-3e869ed2f5cb req-d7537e59-a03b-45cb-9c3c-14862cedf3cc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:19.470860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c426347d-a02a-474f-aa33-3e869ed2f5cb req-d7537e59-a03b-45cb-9c3c-14862cedf3cc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.505015 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c426347d-a02a-474f-aa33-3e869ed2f5cb req-d7537e59-a03b-45cb-9c3c-14862cedf3cc service nova] Creating event network-vif-plugged:92e8dfd7-39fa-4710-8cec-c915e34e6cef for instance b9112c20-166e-4c8d-811c-6748f994bd4e on n-h2-851337-5 Aug 04 04:47:19.529690 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c426347d-a02a-474f-aa33-3e869ed2f5cb req-d7537e59-a03b-45cb-9c3c-14862cedf3cc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097236 Aug 04 04:47:19.532640 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2541/4962] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:19.801109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1249923212", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "8c0cafc6-6388-4ee5-8dd9-6bc697576eaa"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:19.817094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:19.839321 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4a7973d-f4f5-47ea-add4-b1b518c29519 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.844215 Aug 04 04:47:19.853159 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2422/4963] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:18 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:19.895884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] validate_networks() for [('8c0cafc6-6388-4ee5-8dd9-6bc697576eaa', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:47:20.232421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:20.234240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:20.257244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:20.261973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:20.263659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:20.267404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.244422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:21.255111 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e2c88df-45d7-4669-93bc-3a5e0288e9e0 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1314 microversion: 2.1 time: 1.026768 Aug 04 04:47:21.256084 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2423/4964] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:20 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:21.283166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed1ae927-84df-4e2d-bd8e-3f1714692fd2 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f1923b13d30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:21.370264 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed1ae927-84df-4e2d-bd8e-3f1714692fd2 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/063ac6c7-ac88-4f33-85d3-f3cc6b8610dd" status: 200 len: 351 microversion: 2.1 time: 0.099580 Aug 04 04:47:21.375828 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2424/4965] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:21 2022] GET /compute/v2.1/os-volumes/063ac6c7-ac88-4f33-85d3-f3cc6b8610dd => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:21.381784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:21.383078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:21.391452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.391917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.392810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.393250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.844480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:21.854811 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e175aaa-dba9-4d37-b6d5-322dd25a89a5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.479571 Aug 04 04:47:21.854811 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2425/4966] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:21 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:21.858831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93a9a2ee-d426-4fdd-99ed-9c879d0e8e60 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f19239a5670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:21.877310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:47:21.877782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:47:21.878620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:47:21.878827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:47:21.879398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:47:21.890204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.891022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.892093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.892618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.918243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Getting quotas for project f20df1f53c5e41428c42841c6c3d7915. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:47:21.925267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Getting quotas for user 59b474dbfaf04163a22eeb99e30fced1 and project f20df1f53c5e41428c42841c6c3d7915. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:47:21.942279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:47:21.946086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:47:21.953327 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93a9a2ee-d426-4fdd-99ed-9c879d0e8e60 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097670 Aug 04 04:47:21.954245 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2426/4967] 10.222.0.69 () {58 vars in 1134 bytes} [Thu Aug 4 04:47:21 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:21.972405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aee90947-a494-46ff-85b4-a6ab90747a36 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f1923968040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.018595 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-545edaf2-0199-4011-8204-0aea346503df tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.484227 Aug 04 04:47:22.019967 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2542/4968] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:47:22.033485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-023d8c4a-dadb-436b-9431-4ac0e094471a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.034117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-023d8c4a-dadb-436b-9431-4ac0e094471a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:22.089212 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aee90947-a494-46ff-85b4-a6ab90747a36 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.120545 Aug 04 04:47:22.090069 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2427/4969] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Aug 4 04:47:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:22.109423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c8bd4ae-87a3-4f31-86f2-1d0f4f154d81 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f191ab221f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.254547 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c8bd4ae-87a3-4f31-86f2-1d0f4f154d81 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.149933 Aug 04 04:47:22.262608 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2428/4970] 10.222.0.69 () {58 vars in 1134 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:22.269239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60b8f6e3-e6c0-4063-8845-2fd7d65fe0e7 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f1923a71b80>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.281575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-023d8c4a-dadb-436b-9431-4ac0e094471a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:22.291245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-023d8c4a-dadb-436b-9431-4ac0e094471a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1214 microversion: 2.1 time: 0.261836 Aug 04 04:47:22.291856 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2543/4971] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:22.307998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.308880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:22.324735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:22.325596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:22.328238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:22.331762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:22.490315 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60b8f6e3-e6c0-4063-8845-2fd7d65fe0e7 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.225906 Aug 04 04:47:22.491810 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2429/4972] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:22.534169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5bcc9871-8161-48d7-86aa-b87e09c10c6f tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f191a5b6d30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.777023 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5bcc9871-8161-48d7-86aa-b87e09c10c6f tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.275692 Aug 04 04:47:22.786578 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2430/4973] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:22.792050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11d02311-bb32-420d-8de2-6a0381a046ef tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f19239a5ca0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:23.008218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:23.027885 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17978051-6c97-48a4-88d7-d5b5cef714c3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1500 microversion: 2.1 time: 0.726107 Aug 04 04:47:23.028805 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2544/4974] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1500 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:23.041795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:23.043020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:23.055272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.055965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.057016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.057913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.063335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11d02311-bb32-420d-8de2-6a0381a046ef tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.275120 Aug 04 04:47:23.064352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2431/4975] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:23.071696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b01ce2a-bbc1-496e-9551-f7bc81066a1a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:23.079378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:23.094526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b01ce2a-bbc1-496e-9551-f7bc81066a1a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.095022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b01ce2a-bbc1-496e-9551-f7bc81066a1a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.106918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:23.162388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b01ce2a-bbc1-496e-9551-f7bc81066a1a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Going to try to stop instance {{(pid=119342) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:47:23.258877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b01ce2a-bbc1-496e-9551-f7bc81066a1a tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e/action" status: 202 len: 0 microversion: 2.1 time: 0.180622 Aug 04 04:47:23.261575 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2432/4976] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:47:23 2022] POST /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:47:23.287570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7b326692-a8f0-412b-8411-f644bb77cece tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f1923ace790>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:23.416705 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7b326692-a8f0-412b-8411-f644bb77cece tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.149097 Aug 04 04:47:23.417417 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2433/4977] 10.222.0.69 () {58 vars in 1188 bytes} [Thu Aug 4 04:47:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:23.429911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:23.430784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:23.445307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.445831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.446706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.447295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.923118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:23.947496 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31f77de6-495f-4a9d-a152-99e96e76736f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.915311 Aug 04 04:47:23.950479 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2545/4978] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:23 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:23.972285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:23.974780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:23.999147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:24.001914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:24.004069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:24.004723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:24.101422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:24.110855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76e8a0c5-0b4c-47e1-842a-3ae815cf0a52 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.692204 Aug 04 04:47:24.111920 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2434/4979] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:23 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:24.129618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a931162e-5694-42d9-bf71-4e0371f20284 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] Calling method '.version_select at 0x7f19239a5c10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:24.252646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:24.258728 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a931162e-5694-42d9-bf71-4e0371f20284 tempest-VolumesTestJSON-348838260 tempest-VolumesTestJSON-348838260-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.145134 Aug 04 04:47:24.258937 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2435/4980] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 04:47:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:24.310493 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-898c3d7b-9b91-420b-b4f7-c241b4392b74 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1272 microversion: 2.1 time: 0.351537 Aug 04 04:47:24.313469 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2546/4981] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:23 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:24.973075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:24.973718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:24.989624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:24.990059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.000407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.000701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.136650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:25.137379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:25.154149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.156589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.157159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.160027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.613293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:25.623562 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5668a4da-469f-47ab-93ff-3ea7d14e1ddf tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.493881 Aug 04 04:47:25.635749 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2547/4982] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:25 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:25.653865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:25.654911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:25.705976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.706611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.713234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.714003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.766602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:25.779481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:25.795116 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2423ba3f-c9a1-4431-a64e-3248e3bdacff tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.828771 Aug 04 04:47:25.805071 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2436/4983] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:24 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:25.982247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:25.994481 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-861a242b-465d-4146-b9dd-57251c3ee0d1 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1272 microversion: 2.1 time: 0.347693 Aug 04 04:47:25.995489 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2548/4984] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:25 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:26.673623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:26.674695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:26.692250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.692692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:26.693679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.694105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:26.818216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:26.819767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:26.832833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.833293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:26.834086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.838334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:27.583206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:27.596100 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-810ff78f-c913-40ab-a966-0523403b6dbe tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.782717 Aug 04 04:47:27.597052 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2549/4985] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:26 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:27.614160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:27.615338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:27.622654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:27.625712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:27.627167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:27.628515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:27.633513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:27.650376 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e410acc-63e6-40e9-8b3e-b6e61ea75992 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.981230 Aug 04 04:47:27.672442 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2437/4986] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:26 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:28.051138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:28.067046 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b97b9f1c-e3a1-43c1-bad4-f576e5f990ec tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.466747 Aug 04 04:47:28.069046 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2550/4987] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:27 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:28.622323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:28.622700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:28.641937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.642586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:28.645362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.645845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:28.677892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:28.678695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:28.690899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.693134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:28.694911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.698376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:30.279104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:30.287497 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8303453-1679-4bb3-804a-3655d1d5b61f tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 1.672644 Aug 04 04:47:30.288093 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2438/4988] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:28 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:30.321634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:30.322269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:30.328193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:30.336385 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4f84b13f-e6d7-4b3a-8d4c-ba2d18d94c41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 1.662456 Aug 04 04:47:30.348981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:30.350251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:30.353943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:30.354651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:30.360511 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2551/4989] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:28 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:31.035382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:31.055494 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba12aaff-ed34-4fe7-88bd-840ffc6adf8c tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.754820 Aug 04 04:47:31.056119 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2439/4990] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:30 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:31.312486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:31.313422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:31.331768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.333044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.335097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.337231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.357898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:31.365251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:31.378350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.378824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.379678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.380133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.786843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:31.792495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:31.804515 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3a23ff77-f837-46d2-9b87-a8472f232b06 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.499023 Aug 04 04:47:31.806089 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2552/4991] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:31 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:31.810310 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b0205ad9-2c07-423a-bbba-f7b8f8d18fa9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.456422 Aug 04 04:47:31.811783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2440/4992] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:31 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:31.977664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-390f19a4-5da1-4a29-8292-64ebd216b27a req-039b1e08-c289-494d-96ca-cca27734d260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414d35bd-4fff-40c2-8de2-554f664295e7", "tag": "d474ae09-9203-47f5-ac16-93c2765c9e3b"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:32.000756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:32.002934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-390f19a4-5da1-4a29-8292-64ebd216b27a req-039b1e08-c289-494d-96ca-cca27734d260 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.003465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-390f19a4-5da1-4a29-8292-64ebd216b27a req-039b1e08-c289-494d-96ca-cca27734d260 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.053285 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-390f19a4-5da1-4a29-8292-64ebd216b27a req-039b1e08-c289-494d-96ca-cca27734d260 service nova] Creating event network-changed:d474ae09-9203-47f5-ac16-93c2765c9e3b for instance 414d35bd-4fff-40c2-8de2-554f664295e7 on n-h2-851337-5 Aug 04 04:47:32.063798 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-390f19a4-5da1-4a29-8292-64ebd216b27a req-039b1e08-c289-494d-96ca-cca27734d260 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090780 Aug 04 04:47:32.064698 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2553/4993] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:32.077752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:32.078391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:32.085693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.086446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.087291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.087733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.495015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:32.513861 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26323a6e-7940-4834-8b1c-70d6809ad732 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.440595 Aug 04 04:47:32.527425 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2441/4994] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:32 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:32.833649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:32.835550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:32.842566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:32.843914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:32.855878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.866449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.867995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.868617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.880096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:32.896078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.899319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.903110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.907351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:33.797702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:33.810882 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b3087d9-c1a8-4e02-b0ad-8e7b5c0b074d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.977108 Aug 04 04:47:33.812703 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2442/4995] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:32 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:33.828686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:33.829625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:33.845743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:33.846557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:33.849114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:33.851381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:34.128942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:34.145976 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9db798c8-4114-487c-b4a0-df24acd01d08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 1.320354 Aug 04 04:47:34.146574 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2554/4996] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:32 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:34.371563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:34.389495 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d52faf39-849e-40af-a1e7-6010f055b3a5 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.573888 Aug 04 04:47:34.410716 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2443/4997] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:33 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:34.834275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:34.834899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:34.847359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:34.852481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:34.855069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:34.859308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:35.168285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:35.170197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:35.189346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:35.196623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.198369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:35.200835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.202301 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c5992e8-9bd2-4efe-9966-06a7806825b3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.372458 Aug 04 04:47:35.202922 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2555/4998] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:34 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:35.204360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:35.424319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:35.425368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:35.440359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.442230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:35.445289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.445957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:36.119152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:36.131674 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-782f7720-df7e-4912-b30b-ef5df5815ca8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.967970 Aug 04 04:47:36.145020 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2444/4999] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:35 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:36.211580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:36.221407 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4003b2e8-ea16-4a44-b541-49d7bc605026 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.804796 Aug 04 04:47:36.228682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:36.229305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:36.231266 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2556/5000] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:35 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:36.255620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:36.256079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:36.256956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:36.257405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:36.840470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:36.851444 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4d7b79c-7b22-4c43-8efa-20a1aba762e6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.626503 Aug 04 04:47:36.855412 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2445/5001] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:36 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:37.152898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:37.153860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:37.174185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.174676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.175558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.176009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.259324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:37.260667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:37.313195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.313671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.323513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.324330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.830152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:37.843493 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7d4d64a-e9d1-4ff8-8e25-4fa6c536bdc1 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.693276 Aug 04 04:47:37.844181 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2557/5002] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:37 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:37.886053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:37.889665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:37.912447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.913083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.914285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.915691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:38.076525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:38.087329 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-19780380-83c6-4b5e-b055-59da3fac2409 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.838077 Aug 04 04:47:38.090657 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2446/5003] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:37 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:38.466884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:38.482364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4633491c-f4d3-4ec9-aa96-4db6739a61ab tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.607152 Aug 04 04:47:38.495892 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2558/5004] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:37 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:38.866873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:38.867531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:38.888554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:38.889052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:38.892049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:38.893900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.118219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:39.120231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:39.147954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.149188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.150361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.154666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.707467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:39.716620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:39.726705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87c52851-d4e1-4e20-8064-1381e6ce1dc9 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.614758 Aug 04 04:47:39.730803 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2559/5005] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:39 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:39.732256 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-129f5e49-8f3b-4746-84fc-c103a2b9e7b3 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.869475 Aug 04 04:47:39.735574 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2447/5006] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:38 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:39.752525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:39.757108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:39.775322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.776236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.777312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.781461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.133337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:40.148655 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c278a0d3-392a-464e-8e92-521da0831d96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.415035 Aug 04 04:47:40.149994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2560/5007] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:39 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:40.353508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-eb14c4be-c60a-4760-b1c5-73d60f6500dc req-41d2d2f8-4d27-4380-807c-ac47e6626597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414d35bd-4fff-40c2-8de2-554f664295e7", "name": "network-vif-plugged", "status": "completed", "tag": "d474ae09-9203-47f5-ac16-93c2765c9e3b"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:40.396385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-eb14c4be-c60a-4760-b1c5-73d60f6500dc req-41d2d2f8-4d27-4380-807c-ac47e6626597 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.397666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-eb14c4be-c60a-4760-b1c5-73d60f6500dc req-41d2d2f8-4d27-4380-807c-ac47e6626597 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.435511 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-eb14c4be-c60a-4760-b1c5-73d60f6500dc req-41d2d2f8-4d27-4380-807c-ac47e6626597 service nova] Creating event network-vif-plugged:d474ae09-9203-47f5-ac16-93c2765c9e3b for instance 414d35bd-4fff-40c2-8de2-554f664295e7 on n-h2-851337-5 Aug 04 04:47:40.450477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-eb14c4be-c60a-4760-b1c5-73d60f6500dc req-41d2d2f8-4d27-4380-807c-ac47e6626597 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103045 Aug 04 04:47:40.471676 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2448/5008] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:40.752878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:40.753645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:40.760766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:40.761485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:40.774496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.774970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.775785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.776233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.782716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.783211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.784017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.784465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:41.353807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:41.361890 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea0db14f-7380-4c07-b076-1c7ba05748f7 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1314 microversion: 2.1 time: 0.614624 Aug 04 04:47:41.362836 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2561/5009] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:40 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:41.369474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:41.370394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:41.390148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:41.401580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:41.402612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:41.403251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:41.616757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:41.632530 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-78fa4965-b782-4982-bb7f-dd0a9fb36e0c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1515 microversion: 2.1 time: 0.875937 Aug 04 04:47:41.633140 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2449/5010] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:40 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1515 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:41.854336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:41.875008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-babdc79f-507a-4fd7-a559-36ecff26b9bc tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.510929 Aug 04 04:47:41.877817 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2562/5011] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:41 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:42.393516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:42.394145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:42.406493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.406985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:42.412226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.412718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:42.448745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:42.671307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:42.672505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:42.679825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.680504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:42.681604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.682219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:43.238480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:43.257528 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ca584be-1eff-4470-8338-4a43c79e835d tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1498 microversion: 2.1 time: 0.869413 Aug 04 04:47:43.258919 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2450/5012] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:42 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1498 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:43.294159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:43.296763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:43.319221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:43.319673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:43.320455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:43.320892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:43.335655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:43.352738 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d19e7052-f3e5-49c4-af8f-4c98c5e8c204 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1521 microversion: 2.1 time: 0.692112 Aug 04 04:47:43.367728 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2563/5013] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:42 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1521 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:43.775480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:43.788027 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d9e28ddc-4216-47dd-8637-b27c93b066ef tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.519259 Aug 04 04:47:43.789279 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2451/5014] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:43 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:44.374591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:44.375227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:44.390138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.390946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:44.392056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.392738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:44.814366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:44.815381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:44.849275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.860463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:44.867564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.875226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:45.236675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:45.252779 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36276459-c311-4804-902c-0b7d7ca63451 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1521 microversion: 2.1 time: 0.882954 Aug 04 04:47:45.268661 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2564/5015] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:44 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1521 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:45.627431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:45.646213 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b224050c-2882-42d7-879b-fe74dd46ece3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.835084 Aug 04 04:47:45.651316 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2452/5016] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:44 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:46.276649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:46.277673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:46.292016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:46.332741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.342544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.353349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.356867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.670660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:46.671620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:46.686866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.689051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.694554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.695731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.994567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:47.002551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:47.008130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c7dce34-14a5-43c9-98ea-4796ba79c344 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1521 microversion: 2.1 time: 0.736881 Aug 04 04:47:47.016488 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2565/5017] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:46 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1521 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:47.241790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:47.257823 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eab9a75a-3756-4269-acbc-be8b9b118fb2 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.590762 Aug 04 04:47:47.259215 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2453/5018] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:46 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:47.328838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e9a6ca1-db35-4b69-896c-a9500871e4f4 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Action: 'create', calling method: .version_select at 0x7f191a60c670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-726051890", "metadata": {"Type": "work"}}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e9a6ca1-db35-4b69-896c-a9500871e4f4 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Request method failure captured: Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 121 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi609yDl7YL5aCnCdMh9WPqMw3tO_2MTzTHLVdFjBpHeu2HMBOoaYVTqsCT4UqUtQia-EPWuAjnqePwnBDnDtk4F7OGj9fRO8VMjCp6U2hi48AaIPNSAaGzx9txs-qaw-ch7ZmuXRhHS3yAg91RCpfkVaUbFm7Il3iu4jwJ_Pl2vPJorE Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecfc8138ef0d48bb881496dc32dc0b26", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 820eba916e144507a840db17b0a7d83f Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-726051890", "metadata": {"Type": "work"}}} Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-726051890', 'metadata': {'Type': 'work'}}}} Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:47:47.333347 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e9a6ca1-db35-4b69-896c-a9500871e4f4 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:47.340360 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1e9a6ca1-db35-4b69-896c-a9500871e4f4 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.318554 Aug 04 04:47:47.345293 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2566/5019] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Aug 4 04:47:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:47:47.351142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6972aa47-7d38-47ca-8de1-3af6421af41b tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Action: 'create', calling method: .version_select at 0x7f1923b13160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-899830285", "metadata": {"Type": "work"}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6972aa47-7d38-47ca-8de1-3af6421af41b tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Request method failure captured: Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 119 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi609yDl7YL5aCnCdMh9WPqMw3tO_2MTzTHLVdFjBpHeu2HMBOoaYVTqsCT4UqUtQia-EPWuAjnqePwnBDnDtk4F7OGj9fRO8VMjCp6U2hi48AaIPNSAaGzx9txs-qaw-ch7ZmuXRhHS3yAg91RCpfkVaUbFm7Il3iu4jwJ_Pl2vPJorE Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecfc8138ef0d48bb881496dc32dc0b26", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 820eba916e144507a840db17b0a7d83f Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-899830285", "metadata": {"Type": "work"}}} Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-899830285', 'metadata': {'Type': 'work'}}}} Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi '0' Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:47:47.363840 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 04:47:47.372312 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.377891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6972aa47-7d38-47ca-8de1-3af6421af41b tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:47.380955 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6972aa47-7d38-47ca-8de1-3af6421af41b tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033765 Aug 04 04:47:47.383306 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2454/5020] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Aug 4 04:47:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:47:47.391616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b86b27d3-c5f7-45f8-a3fe-ecbfedb21b2f tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Action: 'create', calling method: .version_select at 0x7f191a6ab0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1889627373", "metadata": {"Type": "work"}}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b86b27d3-c5f7-45f8-a3fe-ecbfedb21b2f tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Request method failure captured: Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 119 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi609yDl7YL5aCnCdMh9WPqMw3tO_2MTzTHLVdFjBpHeu2HMBOoaYVTqsCT4UqUtQia-EPWuAjnqePwnBDnDtk4F7OGj9fRO8VMjCp6U2hi48AaIPNSAaGzx9txs-qaw-ch7ZmuXRhHS3yAg91RCpfkVaUbFm7Il3iu4jwJ_Pl2vPJorE Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecfc8138ef0d48bb881496dc32dc0b26", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 820eba916e144507a840db17b0a7d83f Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1889627373", "metadata": {"Type": "work"}}} Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1889627373', 'metadata': {'Type': 'work'}}}} Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '' Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:47:47.396577 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 04:47:47.401558 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.402499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b86b27d3-c5f7-45f8-a3fe-ecbfedb21b2f tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:47.403504 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b86b27d3-c5f7-45f8-a3fe-ecbfedb21b2f tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016376 Aug 04 04:47:47.404199 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2567/5021] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Aug 4 04:47:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:47:47.415658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f620c27-06fe-4c68-a114-462fd21e7fea tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Calling method '.version_select at 0x7f1923a71c10>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:47.518280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4f620c27-06fe-4c68-a114-462fd21e7fea tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] HTTP exception thrown: Volume tempest-invalid-32407384 could not be found. Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f620c27-06fe-4c68-a114-462fd21e7fea tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Request method failure captured: Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-32407384 HTTP/1.1 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi609yDl7YL5aCnCdMh9WPqMw3tO_2MTzTHLVdFjBpHeu2HMBOoaYVTqsCT4UqUtQia-EPWuAjnqePwnBDnDtk4F7OGj9fRO8VMjCp6U2hi48AaIPNSAaGzx9txs-qaw-ch7ZmuXRhHS3yAg91RCpfkVaUbFm7Il3iu4jwJ_Pl2vPJorE Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecfc8138ef0d48bb881496dc32dc0b26", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 820eba916e144507a840db17b0a7d83f Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: exception: Volume tempest-invalid-32407384 could not be found. Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'tempest-invalid-32407384'} Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-32407384 could not be found. (HTTP 404) (Request-ID: req-b054b1cd-6355-47b6-b03c-c40fd9371318) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:47.520347 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-32407384 could not be found. Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-32407384 could not be found. Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-32407384 could not be found. Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f620c27-06fe-4c68-a114-462fd21e7fea tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Returning 404 to user: Volume tempest-invalid-32407384 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4f620c27-06fe-4c68-a114-462fd21e7fea tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-32407384" status: 404 len: 97 microversion: 2.1 time: 0.112101 Aug 04 04:47:47.524970 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2455/5022] 10.222.0.69 () {58 vars in 1212 bytes} [Thu Aug 4 04:47:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-32407384 => generated 97 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:47:47.532247 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ff6f6cb-cd0c-42db-9416-1fb2590e7f53 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004526 Aug 04 04:47:47.532776 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2568/5023] 10.222.0.69 () {58 vars in 1140 bytes} [Thu Aug 4 04:47:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 04:47:47.541644 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-741eef75-5278-43d2-a32b-d600d200f140 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003830 Aug 04 04:47:47.542470 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2456/5024] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Aug 4 04:47:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 04:47:47.581250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bf84f18c-fcfa-4b49-bf95-18276f8ff5e7 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Calling method '.version_select at 0x7f191a60cd30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:47.648294 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-bf84f18c-fcfa-4b49-bf95-18276f8ff5e7 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] HTTP exception thrown: Volume 701a8cc7-a64c-4bc8-95f2-079177556185 could not be found. Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bf84f18c-fcfa-4b49-bf95-18276f8ff5e7 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Request method failure captured: Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/os-volumes/701a8cc7-a64c-4bc8-95f2-079177556185 HTTP/1.1 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi609yDl7YL5aCnCdMh9WPqMw3tO_2MTzTHLVdFjBpHeu2HMBOoaYVTqsCT4UqUtQia-EPWuAjnqePwnBDnDtk4F7OGj9fRO8VMjCp6U2hi48AaIPNSAaGzx9txs-qaw-ch7ZmuXRhHS3yAg91RCpfkVaUbFm7Il3iu4jwJ_Pl2vPJorE Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecfc8138ef0d48bb881496dc32dc0b26", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 820eba916e144507a840db17b0a7d83f Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: method: Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: exception: Volume 701a8cc7-a64c-4bc8-95f2-079177556185 could not be found. Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '701a8cc7-a64c-4bc8-95f2-079177556185'} Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 701a8cc7-a64c-4bc8-95f2-079177556185 could not be found. (HTTP 404) (Request-ID: req-eb9556b1-9ecb-4fdf-bae8-ca28d94701f8) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:47:47.650586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 701a8cc7-a64c-4bc8-95f2-079177556185 could not be found. Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 701a8cc7-a64c-4bc8-95f2-079177556185 could not be found. Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 701a8cc7-a64c-4bc8-95f2-079177556185 could not be found. Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bf84f18c-fcfa-4b49-bf95-18276f8ff5e7 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Returning 404 to user: Volume 701a8cc7-a64c-4bc8-95f2-079177556185 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bf84f18c-fcfa-4b49-bf95-18276f8ff5e7 tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/701a8cc7-a64c-4bc8-95f2-079177556185" status: 404 len: 109 microversion: 2.1 time: 0.080947 Aug 04 04:47:47.655995 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2569/5025] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 04:47:47 2022] DELETE /compute/v2.1/os-volumes/701a8cc7-a64c-4bc8-95f2-079177556185 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:47.663684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1522f2d-67f8-44fb-a1c0-2571fa9c796d tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Calling method '.version_select at 0x7f1918ca9790>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:47.711449 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a1522f2d-67f8-44fb-a1c0-2571fa9c796d tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] HTTP exception thrown: Volume d240acf9-ea0e-41cb-af50-08ba744e4bd6 could not be found. Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1522f2d-67f8-44fb-a1c0-2571fa9c796d tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Request method failure captured: Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/os-volumes/d240acf9-ea0e-41cb-af50-08ba744e4bd6 HTTP/1.1 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi609yDl7YL5aCnCdMh9WPqMw3tO_2MTzTHLVdFjBpHeu2HMBOoaYVTqsCT4UqUtQia-EPWuAjnqePwnBDnDtk4F7OGj9fRO8VMjCp6U2hi48AaIPNSAaGzx9txs-qaw-ch7ZmuXRhHS3yAg91RCpfkVaUbFm7Il3iu4jwJ_Pl2vPJorE Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ecfc8138ef0d48bb881496dc32dc0b26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ecfc8138ef0d48bb881496dc32dc0b26", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ecfc8138ef0d48bb881496dc32dc0b26 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesNegativeTest-240323395 Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 820eba916e144507a840db17b0a7d83f Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesNegativeTest-240323395-project Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: method: Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: exception: Volume d240acf9-ea0e-41cb-af50-08ba744e4bd6 could not be found. Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'd240acf9-ea0e-41cb-af50-08ba744e4bd6'} Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d240acf9-ea0e-41cb-af50-08ba744e4bd6 could not be found. (HTTP 404) (Request-ID: req-3224581f-810f-406e-ba57-43743b72bfa6) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:47:47.713440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d240acf9-ea0e-41cb-af50-08ba744e4bd6 could not be found. Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d240acf9-ea0e-41cb-af50-08ba744e4bd6 could not be found. Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d240acf9-ea0e-41cb-af50-08ba744e4bd6 could not be found. Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1522f2d-67f8-44fb-a1c0-2571fa9c796d tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] Returning 404 to user: Volume d240acf9-ea0e-41cb-af50-08ba744e4bd6 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:47.722370 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1522f2d-67f8-44fb-a1c0-2571fa9c796d tempest-VolumesNegativeTest-240323395 tempest-VolumesNegativeTest-240323395-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/d240acf9-ea0e-41cb-af50-08ba744e4bd6" status: 404 len: 109 microversion: 2.1 time: 0.055855 Aug 04 04:47:47.730617 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2457/5026] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Aug 4 04:47:47 2022] GET /compute/v2.1/os-volumes/d240acf9-ea0e-41cb-af50-08ba744e4bd6 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:48.045467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:48.046464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:48.067597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.069739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.072561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.073342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.285024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:48.286374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:48.301125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.302303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.303135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.303581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.516159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:48.524589 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fa2aa2d6-c9b1-4999-8986-f1f223398d6a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1521 microversion: 2.1 time: 0.492469 Aug 04 04:47:48.542372 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2570/5027] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:48 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:48.742026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:48.774984 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7cac02a5-6227-48d4-b03a-7f36457b7fd7 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1510 microversion: 2.1 time: 0.496625 Aug 04 04:47:48.783917 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2458/5028] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:48 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:49.417866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0661d081-06b4-4f3c-ba34-3c48e0eafe6b req-48858fb9-d221-4129-8963-829910f0c990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42435a82-deaa-43a3-930e-f1230e1885ff", "name": "network-vif-plugged", "status": "completed", "tag": "67730228-a60e-4a08-a9ea-3bc308bedeae"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:49.443428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0661d081-06b4-4f3c-ba34-3c48e0eafe6b req-48858fb9-d221-4129-8963-829910f0c990 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.444052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0661d081-06b4-4f3c-ba34-3c48e0eafe6b req-48858fb9-d221-4129-8963-829910f0c990 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.472752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0661d081-06b4-4f3c-ba34-3c48e0eafe6b req-48858fb9-d221-4129-8963-829910f0c990 service nova] Creating event network-vif-plugged:67730228-a60e-4a08-a9ea-3bc308bedeae for instance 42435a82-deaa-43a3-930e-f1230e1885ff on n-h1-851337-5 Aug 04 04:47:49.484871 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0661d081-06b4-4f3c-ba34-3c48e0eafe6b req-48858fb9-d221-4129-8963-829910f0c990 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071510 Aug 04 04:47:49.485871 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2571/5029] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:49.550934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:49.551648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:49.568579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.569092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.569934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.570388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.682871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:49.683601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:49.692970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.693245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.694229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.694824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.730193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:47:49.902367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-db65960e-da38-466a-be81-04502a30e29a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "DELETE /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 204 len: 0 microversion: 2.1 time: 0.223413 Aug 04 04:47:49.903387 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2572/5030] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:47:49 2022] DELETE /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:47:49.914311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:49.915240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:49.930157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.930892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.931890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.935833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.467735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:50.478697 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a4b9db7-9251-41ba-8542-1b11b0d1c5a7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1521 microversion: 2.1 time: 0.931057 Aug 04 04:47:50.493258 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2459/5031] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:49 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1521 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:50.502456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:50.503574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:50.513301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.514868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.516038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.516716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.691923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:50.702182 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e7a5df71-dd72-47c2-afe3-c7c335994da3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1487 microversion: 2.1 time: 0.797440 Aug 04 04:47:50.705974 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2573/5032] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:49 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1487 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:50.725596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:50.726125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:50.749791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.750253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.751082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.751531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.845363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:47:51.037764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:51.051708 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d6a5ee9-593b-443a-ab4a-896568993906 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1504 microversion: 2.1 time: 0.557007 Aug 04 04:47:51.052911 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2460/5033] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:50 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1504 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:51.097681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-72869621-f63f-4b46-817c-597867527f15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 204 len: 0 microversion: 2.1 time: 0.375775 Aug 04 04:47:51.100316 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2574/5034] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:47:50 2022] DELETE /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:47:51.108900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:51.109745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:51.125045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.125807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.126812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.127481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.362587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:51.373658 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f441c64c-df0e-445b-a700-7501fc17a2dd tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1493 microversion: 2.1 time: 0.269175 Aug 04 04:47:51.376992 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2461/5035] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:51 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1493 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:51.510320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:51.511883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:51.542716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.544206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.547974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.548439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.770562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:51.784057 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d18a514-c60c-44a7-ab39-eac352ff7076 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1506 microversion: 2.1 time: 0.284094 Aug 04 04:47:51.784934 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2575/5036] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:51 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:51.808437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:51.809145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:51.817166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.817619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.821051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.821485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.077572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:52.078210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:52.100395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.100863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.101679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.102117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.359617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:52.371554 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a4a90056-9e87-49e2-9e55-a08403fa0941 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 200 len: 1506 microversion: 2.1 time: 0.566607 Aug 04 04:47:52.375465 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2462/5037] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:51 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:52.398209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:52.398921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:52.409786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.410475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.413375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.414011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.477442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:52.489028 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08a54b90-5937-4995-8271-9cd01ab0807a tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1504 microversion: 2.1 time: 0.418362 Aug 04 04:47:52.492021 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2576/5038] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:52 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:52.493911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:47:52.504150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:52.509443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:52.520463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.522270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.524473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.524927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.676726 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a58728a2-b765-4209-9937-5d29cf86bd02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "DELETE /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 204 len: 0 microversion: 2.1 time: 0.282612 Aug 04 04:47:52.678487 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2463/5039] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:47:52 2022] DELETE /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:47:53.008409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1255040141", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "31571918-f645-4eae-9aae-c7a04ff970a9"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:53.065001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:53.077246 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-149a8604-bccb-4cad-9a54-97fd7119a345 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1493 microversion: 2.1 time: 0.582210 Aug 04 04:47:53.083973 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2577/5040] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:52 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1493 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:53.137375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] validate_networks() for [('31571918-f645-4eae-9aae-c7a04ff970a9', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:47:53.512661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:53.514297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:53.526391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:53.528675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:53.530532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:53.535900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:53.803515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:53.820446 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78af99f1-34ee-490a-9f3a-60a3a3de0400 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1462 microversion: 2.1 time: 0.312118 Aug 04 04:47:53.821405 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2578/5041] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:53 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1462 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:53.929916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8a5f9bf1-69de-441b-8f17-fbedc133e4e5 req-dccaeec4-3b1e-41f0-93b0-dd6935dc8426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9112c20-166e-4c8d-811c-6748f994bd4e", "name": "network-vif-deleted", "tag": "92e8dfd7-39fa-4710-8cec-c915e34e6cef"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:53.969333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8a5f9bf1-69de-441b-8f17-fbedc133e4e5 req-dccaeec4-3b1e-41f0-93b0-dd6935dc8426 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:53.969807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8a5f9bf1-69de-441b-8f17-fbedc133e4e5 req-dccaeec4-3b1e-41f0-93b0-dd6935dc8426 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.011239 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8a5f9bf1-69de-441b-8f17-fbedc133e4e5 req-dccaeec4-3b1e-41f0-93b0-dd6935dc8426 service nova] Creating event network-vif-deleted:92e8dfd7-39fa-4710-8cec-c915e34e6cef for instance b9112c20-166e-4c8d-811c-6748f994bd4e on n-h2-851337-5 Aug 04 04:47:54.048201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8a5f9bf1-69de-441b-8f17-fbedc133e4e5 req-dccaeec4-3b1e-41f0-93b0-dd6935dc8426 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119243 Aug 04 04:47:54.050195 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2579/5042] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:54.109999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:54.110720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:54.133670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.134567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.136547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.138535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.255142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.255599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.256419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lazy-loading 'fault' on Instance uuid b9112c20-166e-4c8d-811c-6748f994bd4e {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:47:54.380932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:54.390074 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd4e8e80-99a8-4d97-bae9-d312b7426dd6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 200 len: 1304 microversion: 2.1 time: 0.286882 Aug 04 04:47:54.393443 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2580/5043] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:54 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 1304 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:54.846780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:54.847435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:54.867143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.872058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.872058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.872058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.970538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.971919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.973201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lazy-loading 'fault' on Instance uuid 414d35bd-4fff-40c2-8de2-554f664295e7 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:47:55.198686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b474dbfaf04163a22eeb99e30fced1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20df1f53c5e41428c42841c6c3d7915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:55.206992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27ca4f92-3b7c-493c-918c-a67a7c70e236 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 200 len: 1304 microversion: 2.1 time: 0.365014 Aug 04 04:47:55.207585 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2581/5044] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:54 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 1304 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:55.348433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:47:55.349074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:47:55.349570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:47:55.349987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:47:55.350516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:47:55.355491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:55.372180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.373922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:55.376690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.377493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:55.414621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:55.415588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:55.425518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Getting quotas for project cb2c594eee554e09bf15760aa561d231. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:47:55.428261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.430039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:55.431050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.431805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:55.440525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Getting quotas for user 320f9afd42cb4d82a07248ce6c661646 and project cb2c594eee554e09bf15760aa561d231. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:47:55.451506 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e HTTP/1.1 Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b9112c20-166e-4c8d-811c-6748f994bd4e'} Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:55.454066 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:55.459410 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:55.459410 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:55.459410 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:55.459410 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:55.459410 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:55.459410 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:47:55.459410 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:55.461489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:55.463717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b7001b57-be7d-4f6e-96e5-9699ac73096b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 404 len: 111 microversion: 2.1 time: 0.053437 Aug 04 04:47:55.464881 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2582/5045] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:55 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:47:55.479429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:47:55.482772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:47:55.585214 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-058c3386-c656-468f-affa-9d991a98165b tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.581290 Aug 04 04:47:55.586391 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2464/5046] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:47:55.599548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b411b636-3dc4-446c-b6a1-c94a0eebf271 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:55.600288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b411b636-3dc4-446c-b6a1-c94a0eebf271 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:55.886837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b411b636-3dc4-446c-b6a1-c94a0eebf271 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:55.916800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b411b636-3dc4-446c-b6a1-c94a0eebf271 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1218 microversion: 2.1 time: 0.322353 Aug 04 04:47:55.917389 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2583/5047] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:55 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1218 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:55.963386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-694548970", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:56.073667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] validate_networks() for [('9ba8fb9d-aff6-41b7-9ec1-7fd7cd88af3d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:47:56.143389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-817bb903-f2c7-439c-b92d-a0b6e79fcc13 req-a89c42bd-5fce-47ce-8ada-625f489acff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414d35bd-4fff-40c2-8de2-554f664295e7", "name": "network-vif-deleted", "tag": "d474ae09-9203-47f5-ac16-93c2765c9e3b"}, {"server_uuid": "42435a82-deaa-43a3-930e-f1230e1885ff", "name": "network-vif-deleted", "tag": "67730228-a60e-4a08-a9ea-3bc308bedeae"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:47:56.162547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-817bb903-f2c7-439c-b92d-a0b6e79fcc13 req-a89c42bd-5fce-47ce-8ada-625f489acff4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:56.163019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-817bb903-f2c7-439c-b92d-a0b6e79fcc13 req-a89c42bd-5fce-47ce-8ada-625f489acff4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:56.224688 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-817bb903-f2c7-439c-b92d-a0b6e79fcc13 req-a89c42bd-5fce-47ce-8ada-625f489acff4 service nova] Creating event network-vif-deleted:d474ae09-9203-47f5-ac16-93c2765c9e3b for instance 414d35bd-4fff-40c2-8de2-554f664295e7 on n-h2-851337-5 Aug 04 04:47:56.229546 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-817bb903-f2c7-439c-b92d-a0b6e79fcc13 req-a89c42bd-5fce-47ce-8ada-625f489acff4 service nova] Creating event network-vif-deleted:67730228-a60e-4a08-a9ea-3bc308bedeae for instance 42435a82-deaa-43a3-930e-f1230e1885ff on n-h1-851337-5 Aug 04 04:47:56.260237 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-817bb903-f2c7-439c-b92d-a0b6e79fcc13 req-a89c42bd-5fce-47ce-8ada-625f489acff4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120373 Aug 04 04:47:56.261168 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2584/5048] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:56.266620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:56.267367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] [instance: 414d35bd-4fff-40c2-8de2-554f664295e7] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:56.281851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:56.284284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:56.286153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:56.291502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:56.318909 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] HTTP exception thrown: Instance 414d35bd-4fff-40c2-8de2-554f664295e7 could not be found. Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Request method failure captured: Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 HTTP/1.1 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi609RBVWhNGfGBN3geIFtuNeQD70B0jmKUPdQVI0q9_X2oi4BGazogxk5nKvy2Jv1ROrX5F-uGEWf7Ia_RO96093Ohnh13V8DDBVw_KDT86h0tCfmYs8AoNq0LDvY-lMcgh-YxvwHnb8F9jNYLJYOjCPtT7LOyn0NuIDZy9hIBJ6HznY Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f20df1f53c5e41428c42841c6c3d7915 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesActionsTest-1491550640 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f20df1f53c5e41428c42841c6c3d7915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f20df1f53c5e41428c42841c6c3d7915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f20df1f53c5e41428c42841c6c3d7915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f20df1f53c5e41428c42841c6c3d7915", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesActionsTest-1491550640 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f20df1f53c5e41428c42841c6c3d7915 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesActionsTest-1491550640 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesActionsTest-1491550640-project Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 59b474dbfaf04163a22eeb99e30fced1 Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesActionsTest-1491550640-project Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 414d35bd-4fff-40c2-8de2-554f664295e7 could not be found. Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '414d35bd-4fff-40c2-8de2-554f664295e7'} Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414d35bd-4fff-40c2-8de2-554f664295e7 could not be found. Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414d35bd-4fff-40c2-8de2-554f664295e7 could not be found. Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:47:56.330352 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:56.334517 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:47:56.334517 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:47:56.334517 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:47:56.334517 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:47:56.334517 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:47:56.334517 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414d35bd-4fff-40c2-8de2-554f664295e7 could not be found. Aug 04 04:47:56.334517 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:47:56.338334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] Returning 404 to user: Instance 414d35bd-4fff-40c2-8de2-554f664295e7 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:47:56.339587 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48c80999-8be4-48ab-8315-16dc3fd83372 tempest-VolumesActionsTest-1491550640 tempest-VolumesActionsTest-1491550640-project] 10.222.0.69 "GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7" status: 404 len: 111 microversion: 2.1 time: 0.077241 Aug 04 04:47:56.354655 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2585/5049] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:56 2022] GET /compute/v2.1/servers/414d35bd-4fff-40c2-8de2-554f664295e7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:56.939798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:56.940421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:56.958079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:56.958550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:56.959384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:56.959825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:57.308568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:57.315899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:57.347103 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57198e66-474f-4cc1-a297-d57430aa051d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1222 microversion: 2.1 time: 0.410166 Aug 04 04:47:57.350028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2586/5050] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:56 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1222 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:57.446737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:47:57.447461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:47:57.448045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:47:57.448734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:47:57.449279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:47:57.468522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:57.472238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:57.474688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:57.476096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:57.542719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:47:57.568951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Getting quotas for user 0e04770e8fd84cff82e73ffd27b8a50a and project ee87a620c38c486a8c3640f2bb14675e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:47:57.602639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:47:57.605328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:47:57.682283 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d9851a2-2dcd-4ae1-95a2-6899fea247ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723351 Aug 04 04:47:57.694790 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2465/5051] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:47:57.702485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31545c66-f2ef-4686-b8e6-28637b43bc08 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:57.703537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31545c66-f2ef-4686-b8e6-28637b43bc08 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:57.938488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-31545c66-f2ef-4686-b8e6-28637b43bc08 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:57.964144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31545c66-f2ef-4686-b8e6-28637b43bc08 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1214 microversion: 2.1 time: 0.261033 Aug 04 04:47:57.965039 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2587/5052] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:57 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:47:58.380460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:58.382921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:58.402932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:58.403683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:58.406591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:58.408775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:58.710287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:58.739294 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fbe611af-e719-4558-ae7c-0e86a81224d5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1276 microversion: 2.1 time: 0.370666 Aug 04 04:47:58.741839 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2466/5053] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:58 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1276 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:58.991458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:58.992913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:59.017218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.019944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.021360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.022070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.155000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:47:59.175159 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2172c6d0-331e-423b-b5fe-345df42d1366 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1218 microversion: 2.1 time: 0.191945 Aug 04 04:47:59.194160 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2588/5054] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:58 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:47:59.762849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:59.764295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:59.775679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.776697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.783124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.784152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.962263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:00.005573 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-19293dff-8233-4fc4-ac86-05c0e52aea43 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1276 microversion: 2.1 time: 0.243641 Aug 04 04:48:00.010366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2467/5055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:47:59 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:00.202621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:00.204009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:00.215000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:00.215460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:00.220868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:00.222793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:00.860043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:00.871446 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-189ddc69-b0a8-464e-b198-0583e97f53ac tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1284 microversion: 2.1 time: 0.671434 Aug 04 04:48:00.874223 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2589/5056] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:00 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1284 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:01.030601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:01.031420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:01.047322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.051494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:01.056692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.060541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:01.384897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:01.393509 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c055620f-ef60-44a1-845f-29e5fdb3a309 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1276 microversion: 2.1 time: 0.367784 Aug 04 04:48:01.398542 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2468/5057] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:01 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1276 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:01.895532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:01.896239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:01.909212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.912853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:01.914596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.928054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:02.370575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:02.383806 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44ed65ce-8eeb-4623-8e63-caa4cc90de15 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1272 microversion: 2.1 time: 0.489357 Aug 04 04:48:02.406370 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2590/5058] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:01 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1272 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:02.423332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:02.423951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:02.440197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:02.440652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:02.441441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:02.446422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:02.622511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:02.631677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-710be425-96f5-494e-8ca3-5ed990927b67 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1276 microversion: 2.1 time: 0.213785 Aug 04 04:48:02.643097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2469/5059] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:02 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:03.408057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:03.408685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:03.437869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.438729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.439978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.441973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.668581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:03.669321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:03.686455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.687127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.689658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.690315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.944426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:03.944625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:03.963250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:03.973100 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e7523bdc-1cbe-46aa-b3cf-14c7a6cb0e41 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1272 microversion: 2.1 time: 0.569856 Aug 04 04:48:03.973561 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4b0af61-3f62-40af-a8e6-6ce83724ad44 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1276 microversion: 2.1 time: 0.316838 Aug 04 04:48:03.988327 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2470/5060] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:03 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:03.990315 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2591/5061] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:03 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1272 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:04.998754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:05.002176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:05.012933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:05.013709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:05.050488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.050979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:05.062576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.076489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.078031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:05.081579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:05.085962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.086467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:06.251053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:06.262914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e8807e7-f5fb-4de2-8bae-22a0ceaaaa38 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 1.268673 Aug 04 04:48:06.268771 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2471/5062] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:04 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:06.295637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:06.309215 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b85ada90-c991-42af-a6d9-0d470c3815ac tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 1.300740 Aug 04 04:48:06.316133 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2592/5063] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:05 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:07.289282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:07.290607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:07.303330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.307589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.308717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.309386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.336016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:07.336782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:07.345320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.360445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.368259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.373472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.498380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:07.587852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:07.945938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:07.981090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:07.991921 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-24130c3e-98fe-4221-acf6-ff2362149654 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 0.706473 Aug 04 04:48:08.002128 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2472/5064] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:07 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:08.022436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:08.032310 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e82c32d1-f05c-4e2e-9cab-d4ea03bf2722 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 0.700379 Aug 04 04:48:08.053414 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2593/5065] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:07 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:08.923287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-708288af-9ff5-4074-a4e6-91d72c17ba3b req-dac296be-3cef-44a2-8f6d-359c4e7ad1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd2ae22-ca3f-423b-bd34-634c8759d091", "tag": "821e5c80-d336-47fa-bb30-c52b3c41dc75"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:08.941207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-708288af-9ff5-4074-a4e6-91d72c17ba3b req-dac296be-3cef-44a2-8f6d-359c4e7ad1f7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:08.941661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-708288af-9ff5-4074-a4e6-91d72c17ba3b req-dac296be-3cef-44a2-8f6d-359c4e7ad1f7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:08.963408 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-708288af-9ff5-4074-a4e6-91d72c17ba3b req-dac296be-3cef-44a2-8f6d-359c4e7ad1f7 service nova] Creating event network-changed:821e5c80-d336-47fa-bb30-c52b3c41dc75 for instance fcd2ae22-ca3f-423b-bd34-634c8759d091 on n-h1-851337-5 Aug 04 04:48:08.980795 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-708288af-9ff5-4074-a4e6-91d72c17ba3b req-dac296be-3cef-44a2-8f6d-359c4e7ad1f7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061829 Aug 04 04:48:08.988454 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2473/5066] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:09.020987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:09.021796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:09.036230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.036683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.037488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.037934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.067849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:09.068341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:09.076130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.076584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.077371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.077810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.880559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:09.883499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:09.893947 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-22240099-9819-4db4-a089-7f8bbf67f24e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 0.830469 Aug 04 04:48:09.917344 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb83befb-2cca-4507-ac98-d93c29963f96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 0.881330 Aug 04 04:48:09.917344 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2594/5067] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:09 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:09.919011 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2474/5068] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:09 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:10.926882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:10.928420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:10.934083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:10.934780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:10.948111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.948585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:10.959741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.960497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:10.961363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.961808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:10.963022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.964805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:12.034779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:12.053318 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-70322d33-f4f1-4ef2-9e90-4ca1d5e47f0d tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 1.115114 Aug 04 04:48:12.055095 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2475/5069] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:10 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:12.063441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5ad2fb57-ab76-461a-8d99-1fffe1815512 req-a9cdcece-58f0-4ea4-9645-4b8432bd2c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679b682b-ef7b-48cf-82bc-73f1ff01e803", "tag": "3e598a82-9ed8-4943-8270-6903cdd62108"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:12.106080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5ad2fb57-ab76-461a-8d99-1fffe1815512 req-a9cdcece-58f0-4ea4-9645-4b8432bd2c96 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:12.107420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5ad2fb57-ab76-461a-8d99-1fffe1815512 req-a9cdcece-58f0-4ea4-9645-4b8432bd2c96 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:12.116935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:12.142147 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5ad2fb57-ab76-461a-8d99-1fffe1815512 req-a9cdcece-58f0-4ea4-9645-4b8432bd2c96 service nova] Creating event network-changed:3e598a82-9ed8-4943-8270-6903cdd62108 for instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 on n-h2-851337-5 Aug 04 04:48:12.142388 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56ee2ff4-fc98-43d6-b93f-a867f4295c25 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 1.216078 Aug 04 04:48:12.144591 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2595/5070] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:10 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:12.152397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5ad2fb57-ab76-461a-8d99-1fffe1815512 req-a9cdcece-58f0-4ea4-9645-4b8432bd2c96 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095401 Aug 04 04:48:12.152902 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2476/5071] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:13.083892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:13.085082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:13.095384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:13.103771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:13.105704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:13.106395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:13.167626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:13.169895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:13.183399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:13.184661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:13.186003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:13.187787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:13.536895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:13.551530 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d2565f70-1e82-4c54-a6ca-994b8e74e807 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 0.471980 Aug 04 04:48:13.567913 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2596/5072] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:13 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:13.669822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:13.682673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b3761c69-67a9-458b-bf54-758da5c195f5 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 0.520329 Aug 04 04:48:13.698644 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2477/5073] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:13 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:14.573493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:14.575536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:14.608415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.608881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:14.609687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.610140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:14.706582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:14.707164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:14.719595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.727781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:14.728766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.729224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:15.766657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:15.797242 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6629fb5-cb4c-4dea-ab91-e9cfa803ee6e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 1.222477 Aug 04 04:48:15.799871 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2597/5074] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:14 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:16.328100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:16.337430 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4590ad42-f3a5-419f-9032-75105e5f3663 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 1.635250 Aug 04 04:48:16.359055 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2478/5075] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:14 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:16.823363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:16.823985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:16.828145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:16.853602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:16.855573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:16.864140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:16.884542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:17.376799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:17.379380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:17.410760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:17.414309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:17.415660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:17.418118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:17.962747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:17.977180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eccf3c99-bb1b-41f1-943c-301790d747e3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 1.159114 Aug 04 04:48:17.990980 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2598/5076] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:16 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:18.102715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:18.114440 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-47a453f7-8d3c-4ee4-9665-81be633eefdd tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 0.751916 Aug 04 04:48:18.128550 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2479/5077] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:17 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:19.003410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:19.005555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:19.035314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.043268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:19.047287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.049302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:19.139736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:19.141184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:19.155457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.156198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:19.159351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.160238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:20.154525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:20.170111 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12aeed72-e698-493a-bc69-7b398e9d04f7 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 1.033814 Aug 04 04:48:20.171322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2480/5078] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:19 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:20.178693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-64a641c6-74b8-4cc4-8a78-11dc70292e46 req-4c553daf-b7b4-4a43-b998-88e7b8ad91ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd2ae22-ca3f-423b-bd34-634c8759d091", "name": "network-vif-plugged", "status": "completed", "tag": "821e5c80-d336-47fa-bb30-c52b3c41dc75"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:20.192982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-64a641c6-74b8-4cc4-8a78-11dc70292e46 req-4c553daf-b7b4-4a43-b998-88e7b8ad91ec service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:20.203008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-64a641c6-74b8-4cc4-8a78-11dc70292e46 req-4c553daf-b7b4-4a43-b998-88e7b8ad91ec service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:20.221579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:20.236646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-437aa67f-f4a0-4f5c-bd34-d7b882c7fae3 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 1.238186 Aug 04 04:48:20.242226 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2599/5079] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:18 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:20.271658 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-64a641c6-74b8-4cc4-8a78-11dc70292e46 req-4c553daf-b7b4-4a43-b998-88e7b8ad91ec service nova] Creating event network-vif-plugged:821e5c80-d336-47fa-bb30-c52b3c41dc75 for instance fcd2ae22-ca3f-423b-bd34-634c8759d091 on n-h1-851337-5 Aug 04 04:48:20.285838 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-64a641c6-74b8-4cc4-8a78-11dc70292e46 req-4c553daf-b7b4-4a43-b998-88e7b8ad91ec service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110636 Aug 04 04:48:20.287034 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2481/5080] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:21.197141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:21.197784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:21.210466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.210948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:21.211775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.217671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:21.266709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:21.267463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:21.279272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.292647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:21.294502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.296589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:22.607143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:22.623577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3bf50e27-f09b-4fda-aed2-248527b79e08 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 1.431952 Aug 04 04:48:22.624937 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2600/5081] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:21 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:22.636638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-426247e7-2e67-4581-9ae7-4970415d6814 req-5469e01a-e755-4007-a378-d3b7b9bfcb20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679b682b-ef7b-48cf-82bc-73f1ff01e803", "name": "network-vif-plugged", "status": "completed", "tag": "3e598a82-9ed8-4943-8270-6903cdd62108"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:22.682231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-426247e7-2e67-4581-9ae7-4970415d6814 req-5469e01a-e755-4007-a378-d3b7b9bfcb20 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:22.688836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-426247e7-2e67-4581-9ae7-4970415d6814 req-5469e01a-e755-4007-a378-d3b7b9bfcb20 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:22.718911 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-426247e7-2e67-4581-9ae7-4970415d6814 req-5469e01a-e755-4007-a378-d3b7b9bfcb20 service nova] Creating event network-vif-plugged:3e598a82-9ed8-4943-8270-6903cdd62108 for instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 on n-h2-851337-5 Aug 04 04:48:22.737389 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-426247e7-2e67-4581-9ae7-4970415d6814 req-5469e01a-e755-4007-a378-d3b7b9bfcb20 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108799 Aug 04 04:48:22.738826 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2601/5082] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:22.831869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:22.845083 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4403fcc-e092-4245-bae8-49cf8f572750 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1314 microversion: 2.1 time: 1.579193 Aug 04 04:48:22.845748 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2482/5083] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:21 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1314 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:23.646159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:23.647674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:23.674811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.675316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:23.677631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.680050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:23.875063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:23.877256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:23.904501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.906101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:23.908775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.910445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:24.335445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:24.353352 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dc039300-de15-45a2-ad89-9d7df8c5e4f6 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1318 microversion: 2.1 time: 0.711770 Aug 04 04:48:24.360127 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2602/5084] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:23 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:24.798219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:24.809830 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3fe4396f-2463-4793-b409-37c776de89c9 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1499 microversion: 2.1 time: 0.945697 Aug 04 04:48:24.830994 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2483/5085] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:23 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1499 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:24.846795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:24.850165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:24.885313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:24.886352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:24.891670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:24.892143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:24.927186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lazy-loading 'flavor' on Instance uuid fcd2ae22-ca3f-423b-bd34-634c8759d091 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:48:25.024534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:25.093530 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93180e97-a5fc-49ea-8e2a-176423841b84 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "POST /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091/action" status: 202 len: 0 microversion: 2.1 time: 0.255179 Aug 04 04:48:25.096776 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2603/5086] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:48:24 2022] POST /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:48:25.108127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:25.108841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:25.142079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.143865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:25.144705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.145158 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:25.383564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:25.384434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:25.396785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.397338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:25.398246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.398691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:26.220718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:26.236233 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd03ddf6-8a7c-4836-b1aa-9db5cc7dbe1d tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1507 microversion: 2.1 time: 0.852166 Aug 04 04:48:26.237806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2604/5087] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:25 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1507 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:26.282530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:26.285975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:26.306931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:26.312935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:26.316292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:26.319687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:26.384550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:26.403965 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a584d7d3-aeea-4df3-a770-9c8c0d0ad78e tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1507 microversion: 2.1 time: 1.298470 Aug 04 04:48:26.406196 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2484/5088] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:25 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1507 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:26.970633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:26.993380 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f73f1c9-b24a-47cd-b61f-a32344a95591 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1507 microversion: 2.1 time: 0.735055 Aug 04 04:48:26.995294 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2605/5089] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:26 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1507 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:27.015474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a319ad26-a01a-483a-9d4f-3c05de33cec8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:27.018436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a319ad26-a01a-483a-9d4f-3c05de33cec8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:27.035408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:27.040050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a319ad26-a01a-483a-9d4f-3c05de33cec8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.041835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a319ad26-a01a-483a-9d4f-3c05de33cec8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.045806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a319ad26-a01a-483a-9d4f-3c05de33cec8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.046908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a319ad26-a01a-483a-9d4f-3c05de33cec8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.194266 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a319ad26-a01a-483a-9d4f-3c05de33cec8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "PUT /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1079 microversion: 2.1 time: 0.181985 Aug 04 04:48:27.196721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2485/5090] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:48:27 2022] PUT /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1079 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:27.236124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:27.237710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:27.266114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.267595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.271972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.274396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.428888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:27.429496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:27.454685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.456013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.458939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.459406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.635672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:27.655351 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6cd3c2dc-a9de-497d-8506-261a004ee467 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1505 microversion: 2.1 time: 0.444638 Aug 04 04:48:27.655963 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2606/5091] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:27 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:27.681174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:27.681817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:27.722478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.723195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.724338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.725048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.850840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:27.863105 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-142e4c5f-973f-4c74-95b8-169ffc26214b tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1490 microversion: 2.1 time: 0.438490 Aug 04 04:48:27.863848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2486/5092] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:27 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1490 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:27.899087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:27.899958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:27.910844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.916086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.919863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.922786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.038229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:48:28.195248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:28.205132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:28.216239 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-18d2866d-925a-47f1-8610-271ac1232c85 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1505 microversion: 2.1 time: 0.540427 Aug 04 04:48:28.219831 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2607/5093] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:27 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:28.249079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f67cf3e-e65c-41f8-ba5f-adba92a03d02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:28.257621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f67cf3e-e65c-41f8-ba5f-adba92a03d02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:28.265918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f67cf3e-e65c-41f8-ba5f-adba92a03d02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.266821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f67cf3e-e65c-41f8-ba5f-adba92a03d02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.268737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f67cf3e-e65c-41f8-ba5f-adba92a03d02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.269353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f67cf3e-e65c-41f8-ba5f-adba92a03d02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.344026 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e526cca0-c1b0-4228-bb80-e03a30547d29 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 204 len: 0 microversion: 2.1 time: 0.450013 Aug 04 04:48:28.349248 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2487/5094] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:27 2022] DELETE /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:48:28.361534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:28.363510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:28.381835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.382299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.386012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.386482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.435784 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f67cf3e-e65c-41f8-ba5f-adba92a03d02 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "PUT /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1081 microversion: 2.1 time: 0.194810 Aug 04 04:48:28.441118 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2608/5095] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 04:48:28 2022] PUT /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1081 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:28.457259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:28.458235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:28.472714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.474147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.475372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.476038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.796700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:28.811506 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7402b594-a51b-47c4-9716-09cc1ea0bc36 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1496 microversion: 2.1 time: 0.458270 Aug 04 04:48:28.814748 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2488/5096] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:28 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1496 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:28.910893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:28.934455 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2486694-da3b-44d9-89ae-f9ecb1525364 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1507 microversion: 2.1 time: 0.483277 Aug 04 04:48:28.940817 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2609/5097] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:28 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:28.965704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:28.966595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:28.992353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.993513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.994539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.995202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.279178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:29.295603 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-18690925-818b-4618-b06e-fe4736089c4a tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1507 microversion: 2.1 time: 0.335158 Aug 04 04:48:29.296902 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2489/5098] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:28 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:29.319621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:29.320313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:29.341285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.344863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.347230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.347727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.514459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:48:29.789383 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f3fc0c72-aaaf-4cb0-bb70-66a8e34175c0 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "DELETE /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 204 len: 0 microversion: 2.1 time: 0.474068 Aug 04 04:48:29.790380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2610/5099] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:29 2022] DELETE /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:48:29.811981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:29.813323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:29.821289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.822201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.823439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.824317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.838196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:29.839015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:29.848705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.849250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.850314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.850827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.884682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:48:29.979777 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.compute.api [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Instance is already in deleting state, ignoring this request Aug 04 04:48:29.981525 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d52817a6-2152-4102-adbc-2048e464e964 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "DELETE /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 204 len: 0 microversion: 2.1 time: 0.178558 Aug 04 04:48:29.982724 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2490/5100] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:29 2022] DELETE /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:48:30.001661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:30.005750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:30.024931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:30.027750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:30.031039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:30.032779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:30.090816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:30.099512 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a5cccecb-4172-4b86-999f-d767b1405f42 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1496 microversion: 2.1 time: 0.265826 Aug 04 04:48:30.113903 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2611/5101] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:29 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1496 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:30.402251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:30.420447 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-40bd90fa-88e1-446e-bce4-4b61d70b7da2 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1513 microversion: 2.1 time: 0.433481 Aug 04 04:48:30.423895 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2491/5102] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:29 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:31.445461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:31.446925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:31.461558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.463354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.468201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.472571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.636016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:31.638846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:31.652521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.653872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.659717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.660394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.951953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:31.968239 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e60d81b-dcfc-45d0-bdc4-3c2a89881081 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1513 microversion: 2.1 time: 0.526355 Aug 04 04:48:31.984758 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2492/5103] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:31 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:32.040208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:32.055913 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ba1d35d-4973-4bee-8f96-c230235dfea5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1496 microversion: 2.1 time: 0.927940 Aug 04 04:48:32.058687 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2612/5104] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:31 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1496 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:32.991916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:32.993471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:33.003735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:33.004189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:33.004970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:33.010734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:33.084829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:33.085917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:33.110294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:33.110760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:33.117089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:33.117559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:33.363558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e04770e8fd84cff82e73ffd27b8a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee87a620c38c486a8c3640f2bb14675e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:33.373898 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6cedd8c3-2e5c-4106-b5a6-55a0693b1896 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 200 len: 1454 microversion: 2.1 time: 0.292831 Aug 04 04:48:33.374498 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2613/5105] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:33 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 1454 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:33.441998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e490ed4a-845a-411b-bc4a-eb46d02af02f req-2a385843-8c52-4533-8ec6-c24b4be04863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd2ae22-ca3f-423b-bd34-634c8759d091", "name": "network-vif-deleted", "tag": "821e5c80-d336-47fa-bb30-c52b3c41dc75"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:33.479191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e490ed4a-845a-411b-bc4a-eb46d02af02f req-2a385843-8c52-4533-8ec6-c24b4be04863 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:33.484999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e490ed4a-845a-411b-bc4a-eb46d02af02f req-2a385843-8c52-4533-8ec6-c24b4be04863 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:33.516330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e490ed4a-845a-411b-bc4a-eb46d02af02f req-2a385843-8c52-4533-8ec6-c24b4be04863 service nova] Creating event network-vif-deleted:821e5c80-d336-47fa-bb30-c52b3c41dc75 for instance fcd2ae22-ca3f-423b-bd34-634c8759d091 on n-h1-851337-5 Aug 04 04:48:33.541176 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e490ed4a-845a-411b-bc4a-eb46d02af02f req-2a385843-8c52-4533-8ec6-c24b4be04863 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104464 Aug 04 04:48:33.548795 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2614/5106] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:33.583700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:33.605476 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b7b9bc7-6849-4d2b-9286-eb60e652fe2c tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1513 microversion: 2.1 time: 0.619456 Aug 04 04:48:33.609958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2493/5107] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:32 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1513 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:34.402308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.403306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.425442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.427903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.432176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.434358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.498197 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 HTTP/1.1 Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'fcd2ae22-ca3f-423b-bd34-634c8759d091'} Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.507356 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.513186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.513186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.513186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.513186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:34.513186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:34.513186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.513186 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.516603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:34.519273 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-27f64736-ede5-49b4-8bd2-b699b7585709 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 404 len: 111 microversion: 2.1 time: 0.123898 Aug 04 04:48:34.523020 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2615/5108] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:34 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:34.539990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.541118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.558295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.559880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.562930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.564052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.609734 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 HTTP/1.1 Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'fcd2ae22-ca3f-423b-bd34-634c8759d091'} Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:34.611796 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.617094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.623621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:34.624742 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ccdbe73-c20b-4785-87b3-768d06fc65d6 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 404 len: 111 microversion: 2.1 time: 0.090209 Aug 04 04:48:34.635224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.636148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.651817 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2494/5109] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:34 2022] DELETE /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:34.713041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.717490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.718699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.723275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.723939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.726583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: fcd2ae22-ca3f-423b-bd34-634c8759d091] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.745167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.745539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.748742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.750296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.789853 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 HTTP/1.1 Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'fcd2ae22-ca3f-423b-bd34-634c8759d091'} Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.797129 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.802805 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.802805 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.802805 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.802805 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:34.802805 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:34.802805 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. Aug 04 04:48:34.802805 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.807851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance fcd2ae22-ca3f-423b-bd34-634c8759d091 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:34.811214 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1e54158a-9c60-452d-969e-abf83a538086 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091" status: 404 len: 111 microversion: 2.1 time: 0.152664 Aug 04 04:48:34.833237 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2495/5110] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:34 2022] GET /compute/v2.1/servers/fcd2ae22-ca3f-423b-bd34-634c8759d091 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:34.851828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.855427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.872706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.873459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.876033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.876658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.926614 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e HTTP/1.1 Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b9112c20-166e-4c8d-811c-6748f994bd4e'} Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:34.938215 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:34.944237 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:34.951628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:34.954980 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-751c93aa-37f2-400c-ae24-d0e6e2f50b6f tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 404 len: 111 microversion: 2.1 time: 0.119941 Aug 04 04:48:34.959202 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2496/5111] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:34 2022] DELETE /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:34.972272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.973730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: b9112c20-166e-4c8d-811c-6748f994bd4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.987187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.991024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.992843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.993683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.042548 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e HTTP/1.1 Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'b9112c20-166e-4c8d-811c-6748f994bd4e'} Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.046226 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.051697 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.051697 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.051697 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.051697 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:35.051697 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:35.051697 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. Aug 04 04:48:35.051697 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.055938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance b9112c20-166e-4c8d-811c-6748f994bd4e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:35.057370 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a36142a-4cd7-492d-8671-87fc725959ad tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e" status: 404 len: 111 microversion: 2.1 time: 0.093740 Aug 04 04:48:35.058679 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2497/5112] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:34 2022] GET /compute/v2.1/servers/b9112c20-166e-4c8d-811c-6748f994bd4e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:35.068696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.069408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.079935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.080714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.081662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.082287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.108924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d HTTP/1.1 Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0f3a123d-0860-4fdd-82d1-f96440fe272d'} Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:35.110735 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.115773 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.120132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:35.121174 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76c14e59-2c4e-4265-8976-1ee8708b6d61 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 404 len: 111 microversion: 2.1 time: 0.057019 Aug 04 04:48:35.124430 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2498/5113] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:35 2022] DELETE /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:35.133990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.135577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 0f3a123d-0860-4fdd-82d1-f96440fe272d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.171606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.172531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.175423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.176065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.219323 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d HTTP/1.1 Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0f3a123d-0860-4fdd-82d1-f96440fe272d'} Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.226043 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.231125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.231125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.231125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.231125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:35.231125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:35.231125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. Aug 04 04:48:35.231125 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.235010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 0f3a123d-0860-4fdd-82d1-f96440fe272d could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:35.237369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29ec121a-8452-4cc6-afd3-d0d43b90d989 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d" status: 404 len: 111 microversion: 2.1 time: 0.108195 Aug 04 04:48:35.256078 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2499/5114] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:35 2022] GET /compute/v2.1/servers/0f3a123d-0860-4fdd-82d1-f96440fe272d => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:48:35.272596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.274835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.300318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.300536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.304436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.307282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.349025 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 HTTP/1.1 Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'bf0033f2-2ab6-4d46-b878-eacdb321ebc7'} Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:35.354047 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.359459 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.363847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:35.365816 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4578550-d337-4d5b-a8d1-b83611f98cae tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 404 len: 111 microversion: 2.1 time: 0.107158 Aug 04 04:48:35.368202 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2500/5115] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:35 2022] DELETE /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:35.383367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.384609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: bf0033f2-2ab6-4d46-b878-eacdb321ebc7] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.400636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.402771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.406291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.406980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.451930 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 HTTP/1.1 Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'bf0033f2-2ab6-4d46-b878-eacdb321ebc7'} Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.457623 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.462512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.462512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.462512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.462512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:35.462512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:35.462512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. Aug 04 04:48:35.462512 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.468895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance bf0033f2-2ab6-4d46-b878-eacdb321ebc7 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:35.473125 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4d59c03-24ec-4ca4-94a3-a742e00ef4aa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7" status: 404 len: 111 microversion: 2.1 time: 0.100314 Aug 04 04:48:35.477887 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2501/5116] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:35 2022] GET /compute/v2.1/servers/bf0033f2-2ab6-4d46-b878-eacdb321ebc7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:35.494720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d34ed960-94d8-4477-aa0e-e6f8f8796ba5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.495867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d34ed960-94d8-4477-aa0e-e6f8f8796ba5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.512491 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-d34ed960-94d8-4477-aa0e-e6f8f8796ba5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d34ed960-94d8-4477-aa0e-e6f8f8796ba5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec HTTP/1.1 Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f981cbd7-90eb-4d64-812b-4a7c908eefec'} Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.514127 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.518186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d34ed960-94d8-4477-aa0e-e6f8f8796ba5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:35.521550 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d34ed960-94d8-4477-aa0e-e6f8f8796ba5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec" status: 404 len: 111 microversion: 2.1 time: 0.036043 Aug 04 04:48:35.524993 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2502/5117] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:35 2022] DELETE /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:35.546388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2783de6-797b-4940-adfa-487982b62931 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.549092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2783de6-797b-4940-adfa-487982b62931 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: f981cbd7-90eb-4d64-812b-4a7c908eefec] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.583169 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-d2783de6-797b-4940-adfa-487982b62931 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2783de6-797b-4940-adfa-487982b62931 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec HTTP/1.1 Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'f981cbd7-90eb-4d64-812b-4a7c908eefec'} Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:35.591062 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:35.597336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:35.597336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:35.597336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:35.597336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. Aug 04 04:48:35.597336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:35.597336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2783de6-797b-4940-adfa-487982b62931 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance f981cbd7-90eb-4d64-812b-4a7c908eefec could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:35.597336 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2783de6-797b-4940-adfa-487982b62931 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec" status: 404 len: 111 microversion: 2.1 time: 0.061713 Aug 04 04:48:35.620310 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2503/5118] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:35 2022] GET /compute/v2.1/servers/f981cbd7-90eb-4d64-812b-4a7c908eefec => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:35.672332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:35.713378 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-310626b4-03f7-47be-b501-046fac75b093 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1513 microversion: 2.1 time: 1.056719 Aug 04 04:48:35.715826 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2616/5119] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:34 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1513 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:48:36.085345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2d2c9877-95ad-4d84-82f5-4a9560a741b6 req-93749103-6be4-4039-b662-f50c3d7d55c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679b682b-ef7b-48cf-82bc-73f1ff01e803", "name": "network-vif-deleted", "tag": "3e598a82-9ed8-4943-8270-6903cdd62108"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:48:36.153391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2d2c9877-95ad-4d84-82f5-4a9560a741b6 req-93749103-6be4-4039-b662-f50c3d7d55c3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.157363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2d2c9877-95ad-4d84-82f5-4a9560a741b6 req-93749103-6be4-4039-b662-f50c3d7d55c3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.210205 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2d2c9877-95ad-4d84-82f5-4a9560a741b6 req-93749103-6be4-4039-b662-f50c3d7d55c3 service nova] Creating event network-vif-deleted:3e598a82-9ed8-4943-8270-6903cdd62108 for instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 on n-h2-851337-5 Aug 04 04:48:36.231211 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2d2c9877-95ad-4d84-82f5-4a9560a741b6 req-93749103-6be4-4039-b662-f50c3d7d55c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150466 Aug 04 04:48:36.239011 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2504/5120] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:36.736728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:36.737776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:36.759340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.762779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.764617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.766534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.857874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.859635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.860145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lazy-loading 'fault' on Instance uuid 679b682b-ef7b-48cf-82bc-73f1ff01e803 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:48:37.056508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320f9afd42cb4d82a07248ce6c661646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2c594eee554e09bf15760aa561d231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:48:37.065698 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-96d895be-bb37-4cad-bcda-16b6e4325b8e tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 200 len: 1308 microversion: 2.1 time: 0.333241 Aug 04 04:48:37.067657 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2617/5121] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:36 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:48:38.100030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:38.100925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 679b682b-ef7b-48cf-82bc-73f1ff01e803] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:38.125024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.128604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.129667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.132890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.182339 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] HTTP exception thrown: Instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 could not be found. Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Request method failure captured: Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 HTTP/1.1 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi607sgYEF016jew1w5Au1NP-qscQ81BHHfWVfOa8KOAerh8n8SWfECO1MeZsGYX8FH0yi35gOV2XXgD57odhzKO3bh1Qc_humWxt1FBQbe_yPccxsrBfJB8McZOUD1Ev7LuFeXhznao5RGcF8k3zd6Y8IBbYPKkK3XYscDoAStaScgF0 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cb2c594eee554e09bf15760aa561d231", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 320f9afd42cb4d82a07248ce6c661646 Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 could not be found. Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '679b682b-ef7b-48cf-82bc-73f1ff01e803'} Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 could not be found. Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 could not be found. Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.190445 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.196819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.196819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.196819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.196819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:38.196819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:38.196819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 could not be found. Aug 04 04:48:38.196819 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.199894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Returning 404 to user: Instance 679b682b-ef7b-48cf-82bc-73f1ff01e803 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:38.202931 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4514815f-963f-4d8f-a7ab-4fa1010a7dc8 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803" status: 404 len: 111 microversion: 2.1 time: 0.113919 Aug 04 04:48:38.205791 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2505/5122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:38 2022] GET /compute/v2.1/servers/679b682b-ef7b-48cf-82bc-73f1ff01e803 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:38.214016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:38.214484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:38.241646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.242141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.243110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.243662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.311053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] HTTP exception thrown: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Request method failure captured: Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff HTTP/1.1 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi607sgYEF016jew1w5Au1NP-qscQ81BHHfWVfOa8KOAerh8n8SWfECO1MeZsGYX8FH0yi35gOV2XXgD57odhzKO3bh1Qc_humWxt1FBQbe_yPccxsrBfJB8McZOUD1Ev7LuFeXhznao5RGcF8k3zd6Y8IBbYPKkK3XYscDoAStaScgF0 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cb2c594eee554e09bf15760aa561d231", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 320f9afd42cb4d82a07248ce6c661646 Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '42435a82-deaa-43a3-930e-f1230e1885ff'} Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:38.312887 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.317085 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.323067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Returning 404 to user: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:38.324206 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3024fbc8-39f6-4975-8e6f-5e802509f4de tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "DELETE /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 404 len: 111 microversion: 2.1 time: 0.114348 Aug 04 04:48:38.330413 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2618/5123] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:38 2022] DELETE /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:38.339120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:38.339988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 42435a82-deaa-43a3-930e-f1230e1885ff] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:38.356605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.357903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.361890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.363698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.406383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] HTTP exception thrown: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Request method failure captured: Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff HTTP/1.1 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi607sgYEF016jew1w5Au1NP-qscQ81BHHfWVfOa8KOAerh8n8SWfECO1MeZsGYX8FH0yi35gOV2XXgD57odhzKO3bh1Qc_humWxt1FBQbe_yPccxsrBfJB8McZOUD1Ev7LuFeXhznao5RGcF8k3zd6Y8IBbYPKkK3XYscDoAStaScgF0 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cb2c594eee554e09bf15760aa561d231", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 320f9afd42cb4d82a07248ce6c661646 Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '42435a82-deaa-43a3-930e-f1230e1885ff'} Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.418596 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.423358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.423358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.423358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.423358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:38.423358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:38.423358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. Aug 04 04:48:38.423358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.426777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Returning 404 to user: Instance 42435a82-deaa-43a3-930e-f1230e1885ff could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:38.428738 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa26d0d8-64eb-4f83-8083-85156272b3fa tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff" status: 404 len: 111 microversion: 2.1 time: 0.096143 Aug 04 04:48:38.435178 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2506/5124] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:38 2022] GET /compute/v2.1/servers/42435a82-deaa-43a3-930e-f1230e1885ff => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:38.443955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:38.444476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:38.454754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.455244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.457986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.458662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.503978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] HTTP exception thrown: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Request method failure captured: Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 HTTP/1.1 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi607sgYEF016jew1w5Au1NP-qscQ81BHHfWVfOa8KOAerh8n8SWfECO1MeZsGYX8FH0yi35gOV2XXgD57odhzKO3bh1Qc_humWxt1FBQbe_yPccxsrBfJB8McZOUD1Ev7LuFeXhznao5RGcF8k3zd6Y8IBbYPKkK3XYscDoAStaScgF0 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cb2c594eee554e09bf15760aa561d231", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 320f9afd42cb4d82a07248ce6c661646 Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '329d2b3b-9440-48a6-9f17-27992f4edab0'} Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:38.509231 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.513984 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.515029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Returning 404 to user: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:38.516375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-53f40d01-469a-4dea-bec4-ad69909094ae tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "DELETE /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 404 len: 111 microversion: 2.1 time: 0.077083 Aug 04 04:48:38.517594 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2619/5125] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:38 2022] DELETE /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:38.524705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:38.525822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] [instance: 329d2b3b-9440-48a6-9f17-27992f4edab0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:38.539721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.542419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.544789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.546211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.583553 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] HTTP exception thrown: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Request method failure captured: Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 HTTP/1.1 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi607sgYEF016jew1w5Au1NP-qscQ81BHHfWVfOa8KOAerh8n8SWfECO1MeZsGYX8FH0yi35gOV2XXgD57odhzKO3bh1Qc_humWxt1FBQbe_yPccxsrBfJB8McZOUD1Ev7LuFeXhznao5RGcF8k3zd6Y8IBbYPKkK3XYscDoAStaScgF0 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cb2c594eee554e09bf15760aa561d231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cb2c594eee554e09bf15760aa561d231", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: cb2c594eee554e09bf15760aa561d231 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1090676342 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 320f9afd42cb4d82a07248ce6c661646 Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerDiskConfigTestJSON-1090676342-project Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '329d2b3b-9440-48a6-9f17-27992f4edab0'} Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:38.586790 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.591467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:38.591467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:38.591467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:38.591467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:38.591467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:38.591467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. Aug 04 04:48:38.591467 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:38.597317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] Returning 404 to user: Instance 329d2b3b-9440-48a6-9f17-27992f4edab0 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:38.601624 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ea87038b-3d96-403e-9f10-c05b57766030 tempest-ServerDiskConfigTestJSON-1090676342 tempest-ServerDiskConfigTestJSON-1090676342-project] 10.222.0.69 "GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0" status: 404 len: 111 microversion: 2.1 time: 0.079681 Aug 04 04:48:38.603470 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2507/5126] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:38 2022] GET /compute/v2.1/servers/329d2b3b-9440-48a6-9f17-27992f4edab0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:48:44.104605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:44.107170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:44.134664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.143780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.149177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.152377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.234337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:44.241388 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 HTTP/1.1 Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '4450dee8-d3be-49ce-8148-e3be79884e79'} Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:44.248504 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.254178 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.262654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:44.266473 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9fb9dd8a-3559-4785-915f-1bb469b4ad96 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 404 len: 111 microversion: 2.1 time: 0.170264 Aug 04 04:48:44.278115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:44.279999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 4450dee8-d3be-49ce-8148-e3be79884e79] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:44.285259 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2620/5127] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:44 2022] DELETE /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:44.291406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.292291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.294130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.294831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.312725 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 HTTP/1.1 Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '4450dee8-d3be-49ce-8148-e3be79884e79'} Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.314643 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.318966 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.318966 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.318966 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.318966 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:44.318966 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:44.318966 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. Aug 04 04:48:44.318966 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.323355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 4450dee8-d3be-49ce-8148-e3be79884e79 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:44.324582 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e551a06-e016-414c-92a6-feb895c0e5fa tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79" status: 404 len: 111 microversion: 2.1 time: 0.051026 Aug 04 04:48:44.334459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:44.335370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:44.340166 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2508/5128] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:44 2022] GET /compute/v2.1/servers/4450dee8-d3be-49ce-8148-e3be79884e79 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:44.345766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.346584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.348719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.350232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.378719 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 HTTP/1.1 Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '886726ad-4d9d-408d-abb5-b6b22aa02893'} Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:44.380900 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.385472 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.392067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:44.393373 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0bcf89b2-8428-4348-aa55-a0d14379add5 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "DELETE /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 404 len: 111 microversion: 2.1 time: 0.063671 Aug 04 04:48:44.394230 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2621/5129] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:48:44 2022] DELETE /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:48:44.405290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:44.406645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] [instance: 886726ad-4d9d-408d-abb5-b6b22aa02893] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:44.414105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.414918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.416315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.416987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.458100 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] HTTP exception thrown: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Request method failure captured: Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 HTTP/1.1 Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi605zicqkYd0fUTHwBBsNxopekHdMwpT1nqqDApLXnEychygaGilCyUCc40rVC3uWagIx8R-iW1hLqHNmFx5bBdyX05oZlV0f4pdJEdn02sRkxMnZoxy969EyEV5iDAVBtF-zjJI99qZdhlA4ycWOqI2MmhglKoCyjYOVFjKDFVM5GSE Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee87a620c38c486a8c3640f2bb14675e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee87a620c38c486a8c3640f2bb14675e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: ee87a620c38c486a8c3640f2bb14675e Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931824355 Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 0e04770e8fd84cff82e73ffd27b8a50a Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1931824355-project Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '886726ad-4d9d-408d-abb5-b6b22aa02893'} Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:48:44.464164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.470365 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:48:44.470365 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:48:44.470365 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:48:44.470365 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:48:44.470365 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:48:44.470365 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. Aug 04 04:48:44.470365 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:48:44.474446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] Returning 404 to user: Instance 886726ad-4d9d-408d-abb5-b6b22aa02893 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:48:44.478382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-87462a15-4da0-4360-8628-385ff5a9cb16 tempest-DeleteServersTestJSON-1931824355 tempest-DeleteServersTestJSON-1931824355-project] 10.222.0.69 "GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893" status: 404 len: 111 microversion: 2.1 time: 0.079094 Aug 04 04:48:44.488359 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2509/5130] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:48:44 2022] GET /compute/v2.1/servers/886726ad-4d9d-408d-abb5-b6b22aa02893 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:49:09.456201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:10.118592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23af927f-30e9-43b6-9fc3-8ce0bdf50a6c tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1276732671", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:10.126992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-23af927f-30e9-43b6-9fc3-8ce0bdf50a6c tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] HTTP exception thrown: min_count must be <= max_count Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23af927f-30e9-43b6-9fc3-8ce0bdf50a6c tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Request method failure captured: Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 184 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_F5B_5fQI9Go68jz0Dx8XW32KAjANHHlC6aZTrhdlUAh6l7Ec9O8Dv4ksYuEokvNf1MNhF2uARvYtvXd-KFi5-3kuA0MzkHsLmgltQgiOJHPmtyf_PgqNOj4FIhG0xhZMesF1fjwHgUnzVgiWyZAir1TkuE3QwhuzdO60izuixW2s Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/de1f25d15e724a239175351d4dc51514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_de1f25d15e724a239175351d4dc51514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: ea2831b24ffa4b7f8da2fe7c832f9c5e Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1276732671", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: exception: min_count must be <= max_count Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1276732671', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 04 04:49:10.135389 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.139965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23af927f-30e9-43b6-9fc3-8ce0bdf50a6c tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Returning 400 to user: min_count must be <= max_count {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:49:10.141563 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23af927f-30e9-43b6-9fc3-8ce0bdf50a6c tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.686836 Aug 04 04:49:10.152979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2622/5131] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:49:09 2022] POST /compute/v2.1/servers => generated 74 bytes in 705 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:49:10.253923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a49556a6-667a-41c7-a76b-8cd619eefd87 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1371675572", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "max_count": 0}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a49556a6-667a-41c7-a76b-8cd619eefd87 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Request method failure captured: Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 168 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60_F5B_5fQI9Go68jz0Dx8XW32KAjANHHlC6aZTrhdlUAh6l7Ec9O8Dv4ksYuEokvNf1MNhF2uARvYtvXd-KFi5-3kuA0MzkHsLmgltQgiOJHPmtyf_PgqNOj4FIhG0xhZMesF1fjwHgUnzVgiWyZAir1TkuE3QwhuzdO60izuixW2s Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/de1f25d15e724a239175351d4dc51514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_de1f25d15e724a239175351d4dc51514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ea2831b24ffa4b7f8da2fe7c832f9c5e Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1371675572", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "max_count": 0}} Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1371675572', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'max_count': 0}}} Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 0 Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:49:10.257965 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a49556a6-667a-41c7-a76b-8cd619eefd87 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:49:10.266775 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a49556a6-667a-41c7-a76b-8cd619eefd87 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009369 Aug 04 04:49:10.270590 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2510/5132] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:49:10 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:49:10.501508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e591de4-a8ce-4012-8cc1-9e922c14a7c9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1574477868", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "max_count": 2.5}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e591de4-a8ce-4012-8cc1-9e922c14a7c9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Request method failure captured: Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 170 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_F5B_5fQI9Go68jz0Dx8XW32KAjANHHlC6aZTrhdlUAh6l7Ec9O8Dv4ksYuEokvNf1MNhF2uARvYtvXd-KFi5-3kuA0MzkHsLmgltQgiOJHPmtyf_PgqNOj4FIhG0xhZMesF1fjwHgUnzVgiWyZAir1TkuE3QwhuzdO60izuixW2s Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/de1f25d15e724a239175351d4dc51514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_de1f25d15e724a239175351d4dc51514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: ea2831b24ffa4b7f8da2fe7c832f9c5e Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1574477868", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "max_count": 2.5}} Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1574477868', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'max_count': 2.5}}} Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:49:10.507749 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e591de4-a8ce-4012-8cc1-9e922c14a7c9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1e591de4-a8ce-4012-8cc1-9e922c14a7c9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012625 Aug 04 04:49:10.526416 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2623/5133] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:49:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:49:10.645515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:10.646650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:10.650761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eaa686a4-e0b1-4e8f-8263-c0748e4c81d9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-132110963", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 0}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eaa686a4-e0b1-4e8f-8263-c0748e4c81d9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Request method failure captured: Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 167 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60_F5B_5fQI9Go68jz0Dx8XW32KAjANHHlC6aZTrhdlUAh6l7Ec9O8Dv4ksYuEokvNf1MNhF2uARvYtvXd-KFi5-3kuA0MzkHsLmgltQgiOJHPmtyf_PgqNOj4FIhG0xhZMesF1fjwHgUnzVgiWyZAir1TkuE3QwhuzdO60izuixW2s Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/de1f25d15e724a239175351d4dc51514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_de1f25d15e724a239175351d4dc51514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: ea2831b24ffa4b7f8da2fe7c832f9c5e Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-132110963", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 0}} Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-132110963', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'min_count': 0}}} Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 0 Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:49:10.656521 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eaa686a4-e0b1-4e8f-8263-c0748e4c81d9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eaa686a4-e0b1-4e8f-8263-c0748e4c81d9 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013750 Aug 04 04:49:10.661397 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2511/5134] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:49:10 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:49:10.957796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55efea4c-0d50-494d-b1b9-ec5be2a696a2 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1134093306", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 2.5}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55efea4c-0d50-494d-b1b9-ec5be2a696a2 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Request method failure captured: Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 170 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_F5B_5fQI9Go68jz0Dx8XW32KAjANHHlC6aZTrhdlUAh6l7Ec9O8Dv4ksYuEokvNf1MNhF2uARvYtvXd-KFi5-3kuA0MzkHsLmgltQgiOJHPmtyf_PgqNOj4FIhG0xhZMesF1fjwHgUnzVgiWyZAir1TkuE3QwhuzdO60izuixW2s Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/de1f25d15e724a239175351d4dc51514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1f25d15e724a239175351d4dc51514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_de1f25d15e724a239175351d4dc51514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: de1f25d15e724a239175351d4dc51514 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-899704512 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: ea2831b24ffa4b7f8da2fe7c832f9c5e Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-899704512-project Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1134093306", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 2.5}} Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1134093306', 'imageRef': '9aa8a0ec-360d-40bf-b352-1066adb51df0', 'flavorRef': '452', 'min_count': 2.5}}} Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 04:49:10.961978 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55efea4c-0d50-494d-b1b9-ec5be2a696a2 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:49:10.968773 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55efea4c-0d50-494d-b1b9-ec5be2a696a2 tempest-MultipleCreateNegativeTestJSON-899704512 tempest-MultipleCreateNegativeTestJSON-899704512-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011110 Aug 04 04:49:10.975903 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2624/5135] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:49:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:49:28.727355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1219779657", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "4c9c7bf2-2d43-4c42-b5d0-a2d6646a7c7c"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:28.870495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] validate_networks() for [('4c9c7bf2-2d43-4c42-b5d0-a2d6646a7c7c', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:49:31.185579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:49:31.187160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:49:31.187993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:49:31.188588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:49:31.189181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:49:31.212174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:31.220009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:31.221539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:31.222754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:31.292372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Getting quotas for project f4c7101675a44749a7dfce02288efb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:49:31.309450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Getting quotas for user 58b3cc9b9b8e4b82ae232fec3174f7b5 and project f4c7101675a44749a7dfce02288efb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:49:31.367590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Going to run 3 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:49:31.382207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:49:31.511337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=110ed067-25ec-450f-b593-e7e0ff3cdf9a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:49:31.632588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=2de5dd4d-d234-4fbd-bfd7-e749364c0e90,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:49:31.970774 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-edc3a086-3624-4c11-afc7-7838ed1e3b19 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.786148 Aug 04 04:49:31.971665 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2512/5136] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:49:31.982166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:31.988119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:32.048581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:32.049518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:49:32.227842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:32.234204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:32.235179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:32.235646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:32.318364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e16642d5-d672-4759-8a7d-acd565b50434 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.338233 Aug 04 04:49:32.335528 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2625/5137] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:49:31 2022] GET /compute/v2.1/servers => generated 1018 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:32.349359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53ba5960-703e-4e8e-ad52-7857c24cba2c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:32.357011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53ba5960-703e-4e8e-ad52-7857c24cba2c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:32.745326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53ba5960-703e-4e8e-ad52-7857c24cba2c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:32.768093 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53ba5960-703e-4e8e-ad52-7857c24cba2c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1223 microversion: 2.1 time: 0.436831 Aug 04 04:49:32.770172 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2513/5138] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:32 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1223 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:49:33.790268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f9cf9bc9-1927-4e58-ace2-dce64c6bd00d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:33.790925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f9cf9bc9-1927-4e58-ace2-dce64c6bd00d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:34.304415 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:49:34.304687 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 04:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b (ip 10.222.0.69) !!! Aug 04 04:49:34.458707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f9cf9bc9-1927-4e58-ace2-dce64c6bd00d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:34.466276 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f9cf9bc9-1927-4e58-ace2-dce64c6bd00d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1223 microversion: 2.1 time: 0.679801 Aug 04 04:49:34.473473 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2626/5139] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:33 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1223 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:35.501309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8eab6673-41a7-4f1c-bc55-80a90afef86a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:35.502557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8eab6673-41a7-4f1c-bc55-80a90afef86a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:35.880580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8eab6673-41a7-4f1c-bc55-80a90afef86a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:35.912157 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8eab6673-41a7-4f1c-bc55-80a90afef86a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1223 microversion: 2.1 time: 0.415629 Aug 04 04:49:35.915506 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2514/5140] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:35 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1223 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:36.936932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:36.937995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:36.959853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:36.970388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:36.975753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:36.975753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:38.104116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:38.119992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9fe46185-e446-41fa-bd3d-5018f3580152 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1275 microversion: 2.1 time: 1.187613 Aug 04 04:49:38.129782 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2627/5141] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:36 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1275 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:39.150458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:39.151401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:39.173917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:39.175023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:39.178870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:39.181048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:39.396955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:39.423287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21e9d239-78c4-47d1-9356-8093e9b793b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1281 microversion: 2.1 time: 0.261658 Aug 04 04:49:39.424292 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2515/5142] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:39 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1281 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:40.460551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:40.461302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:40.492700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:40.493449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:40.497167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:40.498207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:40.775532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:40.802209 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-18ffb76d-f3f0-44df-ba46-23cfb4956f7f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1281 microversion: 2.1 time: 0.357084 Aug 04 04:49:40.809582 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2628/5143] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:40 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1281 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:41.254235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:41.419549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1739516423", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "5c8624e1-c727-48d7-8243-1756641d059c"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:41.538144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] validate_networks() for [('5c8624e1-c727-48d7-8243-1756641d059c', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:49:41.826187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:41.829218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:41.852303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:41.857988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:41.860910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:41.869762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:42.194983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:42.210909 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8263429b-51e5-46ef-9749-b840b46c3c80 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1281 microversion: 2.1 time: 0.386453 Aug 04 04:49:42.222649 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2629/5144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:41 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1281 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:42.796802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:49:42.798016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:49:42.798894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:49:42.799512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:49:42.800211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:49:42.812972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:42.813809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:42.814890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:42.815535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:42.845363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Getting quotas for project b698d7f8ec1e48f691dc79d20e143f5c. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:49:42.853162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Getting quotas for user 53d8c592fdf749ba9eef1a2a8782c1ee and project b698d7f8ec1e48f691dc79d20e143f5c. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:49:42.868086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:49:42.871083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:49:42.969390 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83167407-a1df-4cfe-be80-0a4958799dc6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.227350 Aug 04 04:49:42.971611 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2516/5145] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:49:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 04:49:42.985925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8340d70e-1322-4c3b-9e32-1650b53c1597 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:42.987382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8340d70e-1322-4c3b-9e32-1650b53c1597 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:43.000663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:43.170224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8340d70e-1322-4c3b-9e32-1650b53c1597 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:43.185027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8340d70e-1322-4c3b-9e32-1650b53c1597 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:43.191593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8340d70e-1322-4c3b-9e32-1650b53c1597 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:43.193333 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8340d70e-1322-4c3b-9e32-1650b53c1597 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1262 microversion: 2.26 time: 0.212306 Aug 04 04:49:43.197919 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2630/5146] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:42 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1262 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:43.237763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:43.238592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:43.285294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:43.285747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:43.286540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:43.287229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:43.958828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:43.974424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a72d192-e4f5-437a-992c-5a9812706985 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.739947 Aug 04 04:49:43.977911 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2517/5147] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:43 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:44.221969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:44.225508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:44.250234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:44.254357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:44.255790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:44.256777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:44.561639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:44.613483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:44.625157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:44.629077 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-434a809d-3d4f-42bb-befb-6f4b53c26a45 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1258 microversion: 2.26 time: 0.413430 Aug 04 04:49:44.632127 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2631/5148] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:44 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1258 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:44.999188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:44.999910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:45.021342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.024177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.029986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.030795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.657271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:45.657996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:45.688727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.689192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.689997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.690441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.938461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:45.950436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:45.966627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:45.968454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:45.969649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ed6d94b5-b15f-4840-b1ba-d2188647c8e5 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1320 microversion: 2.26 time: 0.317812 Aug 04 04:49:45.970225 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2632/5149] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:45 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:45.982062 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b43e99e-b37c-488f-b4c0-f58d56fec47f tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.977122 Aug 04 04:49:45.984385 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2518/5150] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:44 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:46.999713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:47.001131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:47.016952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:47.020683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:47.041348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.041490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:47.042180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.042912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.043654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:47.044692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.045364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:47.047707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:47.365707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:47.386329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:47.388053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:47.389229 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-106cdc58-b148-4c7d-b7af-94968da55ffb tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1320 microversion: 2.26 time: 0.393999 Aug 04 04:49:47.389801 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2633/5151] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:46 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1320 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:47.705549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:47.727382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d193e281-c549-4a78-b03a-27e10067f510 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.712000 Aug 04 04:49:47.728550 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2519/5152] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:47 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:49:48.416172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:48.417476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:48.432004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:48.434021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:48.435102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:48.438146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:48.752993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:48.753626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:48.771578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:48.772053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:48.778735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:48.783397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:49.114281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:49.130926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:49.140157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:49.141485 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1dfb9406-5840-4fd0-8cea-15cdac829b6b tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1320 microversion: 2.26 time: 0.729483 Aug 04 04:49:49.142088 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2634/5153] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:48 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1320 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:49.469156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:49.478622 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed60d122-c289-463a-9b82-0015cdab2727 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.729731 Aug 04 04:49:49.479267 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2520/5154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:48 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:50.166581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:50.167323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:50.177910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.178288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:50.179127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.179575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:50.388724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:50.401143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:50.404467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:50.407758 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-224560fe-4ff2-4d37-887a-18e252c7a4fa tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1320 microversion: 2.26 time: 0.245830 Aug 04 04:49:50.410902 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2635/5155] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:50 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:50.500155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:50.501001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:50.519084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.521089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:50.525717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.528168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.441240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:51.441866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:51.467487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.468411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.471916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.478843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:52.481392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:52.498174 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d646281-a83f-40ad-8597-8d5a9933a0bf tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 2.002564 Aug 04 04:49:52.522091 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2521/5156] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:50 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:52.701024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:52.712883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:52.715811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:52.719895 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0bbbdeb9-9345-4708-a69c-3d5c9cfcbe22 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 1.282264 Aug 04 04:49:52.741800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2636/5157] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:51 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:53.529417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:53.531258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:53.533014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:53.533706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=16 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:53.563933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.564453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.569698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.570423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.750059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:53.750715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:53.752830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:53.766237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.766700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.767522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.767965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.057066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:54.067469 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd89336b-c95b-4921-b90c-1f3073278b23 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.544975 Aug 04 04:49:54.068349 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2522/5158] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:53 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:54.270207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:54.285115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:54.302017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:54.303883 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-28aa01d7-5411-420f-bca1-20966faec024 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 0.557550 Aug 04 04:49:54.305056 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2637/5159] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:53 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:49:54.692851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-72916cd5-f743-44a7-82a9-7885f31696be req-50b54ca0-408f-4433-bb88-28262f8e3e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d8088e-dd85-47d9-bdce-364f2cade02b", "tag": "f54fb06b-8452-4541-819c-9de464211657"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:54.717007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-72916cd5-f743-44a7-82a9-7885f31696be req-50b54ca0-408f-4433-bb88-28262f8e3e69 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:54.718155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-72916cd5-f743-44a7-82a9-7885f31696be req-50b54ca0-408f-4433-bb88-28262f8e3e69 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.769473 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-72916cd5-f743-44a7-82a9-7885f31696be req-50b54ca0-408f-4433-bb88-28262f8e3e69 service nova] Creating event network-changed:f54fb06b-8452-4541-819c-9de464211657 for instance c0d8088e-dd85-47d9-bdce-364f2cade02b on n-h1-851337-5 Aug 04 04:49:54.777091 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-72916cd5-f743-44a7-82a9-7885f31696be req-50b54ca0-408f-4433-bb88-28262f8e3e69 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339556 Aug 04 04:49:54.781173 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2523/5160] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:55.089806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:55.090483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:55.110287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:55.110750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:55.112227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:55.112691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:55.329491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:55.331469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:55.349340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:55.366744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:55.370913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:55.385664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:56.582968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:56.597957 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-03ee1028-000b-421f-9ca5-ffed64520504 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 1.512412 Aug 04 04:49:56.600425 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2638/5161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:55 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:56.755791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:56.765189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:56.766733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:56.773021 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ab09a84-3234-4d7d-be8a-347f4adce830 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 1.447792 Aug 04 04:49:56.775531 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2524/5162] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:55 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:57.266372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-99e5c806-8c84-4e13-91a0-4828c665c852 req-23379d84-8e6e-4c84-93d2-948c5b26eb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de5dd4d-d234-4fbd-bfd7-e749364c0e90", "tag": "779d3370-5edc-466d-b8d8-8f9bf53c633b"}, {"name": "network-changed", "server_uuid": "481d4b7e-a737-49a7-a474-84bb706a180a", "tag": "6f392c2c-a621-43d1-9c5d-442240569ecd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:57.309343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-99e5c806-8c84-4e13-91a0-4828c665c852 req-23379d84-8e6e-4c84-93d2-948c5b26eb0b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.310239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-99e5c806-8c84-4e13-91a0-4828c665c852 req-23379d84-8e6e-4c84-93d2-948c5b26eb0b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.331451 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-99e5c806-8c84-4e13-91a0-4828c665c852 req-23379d84-8e6e-4c84-93d2-948c5b26eb0b service nova] Creating event network-changed:779d3370-5edc-466d-b8d8-8f9bf53c633b for instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 on n-h2-851337-5 Aug 04 04:49:57.332416 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-99e5c806-8c84-4e13-91a0-4828c665c852 req-23379d84-8e6e-4c84-93d2-948c5b26eb0b service nova] Creating event network-changed:6f392c2c-a621-43d1-9c5d-442240569ecd for instance 481d4b7e-a737-49a7-a474-84bb706a180a on n-h2-851337-5 Aug 04 04:49:57.347075 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-99e5c806-8c84-4e13-91a0-4828c665c852 req-23379d84-8e6e-4c84-93d2-948c5b26eb0b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091621 Aug 04 04:49:57.348634 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2639/5163] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:57.622993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:57.623611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:57.635460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.636107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.637267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.639312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.805285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:57.812249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:57.832610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.833320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.834276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.835491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:58.870880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:58.876390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=59 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:58.912292 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-49449e63-264b-40ed-9853-966f74fa1f42 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 1.293272 Aug 04 04:49:58.914668 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2525/5164] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:57 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:59.069983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:59.083606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:59.094500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:59.101894 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1d1984e-ce8f-4c77-a600-8ae1abb0397d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 1.297806 Aug 04 04:49:59.111193 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2640/5165] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:49:57 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:49:59.742946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-30f7d698-e2ec-428c-bcf0-725ae558c103 req-488809db-9461-4cbd-a111-b3448b85c4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110ed067-25ec-450f-b593-e7e0ff3cdf9a", "tag": "e64c7cfb-43ed-433c-beae-0d433e3662fe"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:59.762942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:59.764913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-30f7d698-e2ec-428c-bcf0-725ae558c103 req-488809db-9461-4cbd-a111-b3448b85c4e9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:59.765365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-30f7d698-e2ec-428c-bcf0-725ae558c103 req-488809db-9461-4cbd-a111-b3448b85c4e9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:59.824453 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-30f7d698-e2ec-428c-bcf0-725ae558c103 req-488809db-9461-4cbd-a111-b3448b85c4e9 service nova] Creating event network-changed:e64c7cfb-43ed-433c-beae-0d433e3662fe for instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a on n-h1-851337-5 Aug 04 04:49:59.851876 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-30f7d698-e2ec-428c-bcf0-725ae558c103 req-488809db-9461-4cbd-a111-b3448b85c4e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112759 Aug 04 04:49:59.854878 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2526/5166] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:59.938629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:59.939371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:59.971099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:59.971561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:59.972358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:59.972800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:00.134734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:00.135477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:00.142124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:00.142579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:00.154531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:00.155046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:00.856943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:00.866045 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3fae0803-6dee-4c49-bfa6-ea4ad814459a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.931663 Aug 04 04:50:00.886433 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2641/5167] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:59 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:01.129963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:01.147587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:01.151414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:01.153942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f5331131-be38-4a9c-8cf8-73a225925b2e tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 1.022943 Aug 04 04:50:01.172509 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2527/5168] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:00 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:50:01.893963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:01.894589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:01.916631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:01.916929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:01.918118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:01.918876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:02.177704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:02.179082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:02.200784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:02.202165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:02.204953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:02.206935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:02.874641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:02.886051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=87 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:02.893044 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-09dcb533-4e19-4f3b-bb91-8473394d4bbe tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 1.003052 Aug 04 04:50:02.896401 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2642/5169] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:01 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:03.126626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:03.137096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:03.141763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:03.142997 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a81d467-0359-48e0-9b9c-2a1a592f06ee tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 0.969225 Aug 04 04:50:03.163008 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2528/5170] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:02 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:50:03.379639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c506130d-b5df-40c2-8106-eebf113310da req-1e2f164b-7a0e-460d-8867-74e3b073ecd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de5dd4d-d234-4fbd-bfd7-e749364c0e90", "name": "network-vif-plugged", "status": "completed", "tag": "779d3370-5edc-466d-b8d8-8f9bf53c633b"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:03.397816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=41 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:03.415321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c506130d-b5df-40c2-8106-eebf113310da req-1e2f164b-7a0e-460d-8867-74e3b073ecd3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.417151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c506130d-b5df-40c2-8106-eebf113310da req-1e2f164b-7a0e-460d-8867-74e3b073ecd3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.458890 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c506130d-b5df-40c2-8106-eebf113310da req-1e2f164b-7a0e-460d-8867-74e3b073ecd3 service nova] Creating event network-vif-plugged:779d3370-5edc-466d-b8d8-8f9bf53c633b for instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 on n-h2-851337-5 Aug 04 04:50:03.472180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c506130d-b5df-40c2-8106-eebf113310da req-1e2f164b-7a0e-460d-8867-74e3b073ecd3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573789 Aug 04 04:50:03.472805 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2643/5171] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:03.680423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] Calling method '.version_select at 0x7f1923968af0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:03.682109 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:50:03.682109 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 04:50:03.687375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.688348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.720506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.727804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.748720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.749409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.767418 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4101250-2dee-4d77-8573-cfa428ca8dc1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-613556378-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.603151 Aug 04 04:50:03.775267 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2529/5172] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:50:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:03.918818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:03.919782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:03.933993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.938577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.939830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.940551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:04.167459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:04.168697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:04.187491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:04.188578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:04.189679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:04.192643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:04.602551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:04.611209 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-21c8b22f-3efe-4da6-9146-6d2f0f985b88 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.697657 Aug 04 04:50:04.628192 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2644/5173] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:03 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:04.734465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:04.746181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:04.752866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:04.754352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ce29154-1670-4191-85e2-6a0d82bd22cf tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 0.592089 Aug 04 04:50:04.771416 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2530/5174] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:04 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:50:05.645776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:05.647100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:05.670910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.674034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.677130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.677992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.783867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:05.785257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:05.798085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.799495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.800497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.806481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:06.103264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:06.143259 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ac32062-0820-479c-aed5-1f59dfa000f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.504615 Aug 04 04:50:06.144671 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2645/5175] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:05 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:06.158640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-eca167ce-74d4-481c-a7bc-cef264f89eae req-672650ac-28f0-4d96-9c2a-0ca00fb355bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d8088e-dd85-47d9-bdce-364f2cade02b", "name": "network-vif-plugged", "status": "completed", "tag": "f54fb06b-8452-4541-819c-9de464211657"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:06.196090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-eca167ce-74d4-481c-a7bc-cef264f89eae req-672650ac-28f0-4d96-9c2a-0ca00fb355bf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:06.196546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-eca167ce-74d4-481c-a7bc-cef264f89eae req-672650ac-28f0-4d96-9c2a-0ca00fb355bf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:06.239528 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-eca167ce-74d4-481c-a7bc-cef264f89eae req-672650ac-28f0-4d96-9c2a-0ca00fb355bf service nova] Creating event network-vif-plugged:f54fb06b-8452-4541-819c-9de464211657 for instance c0d8088e-dd85-47d9-bdce-364f2cade02b on n-h1-851337-5 Aug 04 04:50:06.247742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-eca167ce-74d4-481c-a7bc-cef264f89eae req-672650ac-28f0-4d96-9c2a-0ca00fb355bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098651 Aug 04 04:50:06.250818 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2646/5176] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:07.046149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:07.067057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:07.084640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:07.087504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bf28096e-4eca-422f-baef-6b90a489145d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 1.307471 Aug 04 04:50:07.107514 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2531/5177] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:05 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:50:07.168697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:07.169577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:07.187777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:07.191592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:07.193825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:07.196333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:07.844328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:07.854434 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e12352e-b375-470c-8e7b-5016d1dbb439 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.692080 Aug 04 04:50:07.860576 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2647/5178] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:07 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:08.127168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:08.128402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:08.140935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:08.145747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:08.146802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:08.147573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:08.454900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8a53b455-4d05-4622-87f6-ec78d7e4605e req-1e76ef52-fb01-408d-8210-d4b3618f506f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481d4b7e-a737-49a7-a474-84bb706a180a", "name": "network-vif-plugged", "status": "completed", "tag": "6f392c2c-a621-43d1-9c5d-442240569ecd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:08.474216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8a53b455-4d05-4622-87f6-ec78d7e4605e req-1e76ef52-fb01-408d-8210-d4b3618f506f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:08.475528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8a53b455-4d05-4622-87f6-ec78d7e4605e req-1e76ef52-fb01-408d-8210-d4b3618f506f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:08.499505 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8a53b455-4d05-4622-87f6-ec78d7e4605e req-1e76ef52-fb01-408d-8210-d4b3618f506f service nova] Creating event network-vif-plugged:6f392c2c-a621-43d1-9c5d-442240569ecd for instance 481d4b7e-a737-49a7-a474-84bb706a180a on n-h2-851337-5 Aug 04 04:50:08.522451 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8a53b455-4d05-4622-87f6-ec78d7e4605e req-1e76ef52-fb01-408d-8210-d4b3618f506f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071374 Aug 04 04:50:08.523430 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2648/5179] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:08.846360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:08.867105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:08.872273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:08.881348 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8fb8cff4-c040-43ea-9dac-0b5bc044390c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 0.763161 Aug 04 04:50:08.882091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:08.882802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:08.883667 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2532/5180] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:08 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:50:08.892821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:08.903690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:08.904833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:08.905463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:09.339304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:09.353728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0fc1ae81-df52-4398-bfe9-f4c7ffbecec8 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1323 microversion: 2.1 time: 0.475741 Aug 04 04:50:09.356933 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2649/5181] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:08 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1323 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:50:09.911183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:09.912186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:09.925455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:09.925925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:09.926726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:09.927188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:10.378941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:10.379946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:10.408191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:10.408661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:10.409470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:10.420385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:10.691042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:10.703757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:10.720294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:10.724347 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d9da979d-9702-481d-89f6-a2927b3c4b32 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1362 microversion: 2.26 time: 0.818267 Aug 04 04:50:10.728009 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2533/5182] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:09 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1362 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:50:10.853779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:10.867003 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9a176ef-83e9-4113-9980-3c08adc81efd tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 200 len: 1517 microversion: 2.1 time: 0.492124 Aug 04 04:50:10.886231 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2650/5183] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:10 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 1517 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:50:10.900534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:10.904022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:10.921376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:10.922231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:10.925561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:10.926920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:11.202730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7b07b931-bcd1-46d7-b10d-f3aaeab18506 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Action: 'create', calling method: .version_select at 0x7f1918feb1f0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1948822269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMEfrnvoLSeqFGCflkcW/1/4x2G6MCmahh+u+PYHXVGQ8h+t9Vok+1cpWO+hwx/4QMuSR3DsZ/U3UTvOQ6pHYUZX6bfURgEPhB0/0/Su7PHqmYXUp7M81WWxjiLo7nezA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:11.240136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7b07b931-bcd1-46d7-b10d-f3aaeab18506 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Getting quotas for project 153fc403d7e14d50b2602a1ab14d0e06. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:50:11.269565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7b07b931-bcd1-46d7-b10d-f3aaeab18506 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Getting quotas for user 7e754f29f87f48ae882c436a510b301c and project 153fc403d7e14d50b2602a1ab14d0e06. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:50:11.344787 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7b07b931-bcd1-46d7-b10d-f3aaeab18506 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.614660 Aug 04 04:50:11.348149 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2534/5184] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:50:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:11.366800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-10458a5e-3cfb-469a-9d31-c99517b09727 req-b8cb717a-cd3c-4dd0-84a8-2454e3e6243c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110ed067-25ec-450f-b593-e7e0ff3cdf9a", "name": "network-vif-plugged", "status": "completed", "tag": "e64c7cfb-43ed-433c-beae-0d433e3662fe"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:11.390270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-10458a5e-3cfb-469a-9d31-c99517b09727 req-b8cb717a-cd3c-4dd0-84a8-2454e3e6243c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:11.391822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-10458a5e-3cfb-469a-9d31-c99517b09727 req-b8cb717a-cd3c-4dd0-84a8-2454e3e6243c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:11.414401 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-10458a5e-3cfb-469a-9d31-c99517b09727 req-b8cb717a-cd3c-4dd0-84a8-2454e3e6243c service nova] Creating event network-vif-plugged:e64c7cfb-43ed-433c-beae-0d433e3662fe for instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a on n-h1-851337-5 Aug 04 04:50:11.440767 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-10458a5e-3cfb-469a-9d31-c99517b09727 req-b8cb717a-cd3c-4dd0-84a8-2454e3e6243c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081192 Aug 04 04:50:11.448774 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2535/5185] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:11.502937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:11.527321 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc258c5b-0846-4707-9ee2-fa7a3c07df7a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90" status: 200 len: 1516 microversion: 2.1 time: 0.624120 Aug 04 04:50:11.531867 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2651/5186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:10 2022] GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90 => generated 1516 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:50:11.554792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:11.556709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:11.571706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:11.572760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:11.579903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:11.580739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:11.752129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:11.752774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:11.763084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:11.766994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:11.768087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:11.768678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.136605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:12.149069 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-403a7b09-53fd-42dc-89e2-7fc9e4ee05e3 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 200 len: 1323 microversion: 2.1 time: 0.601331 Aug 04 04:50:12.153355 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2536/5187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:11 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 1323 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:12.313387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:12.325410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:12.326942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:12.333429 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65392f8f-a607-4104-9c2b-b7d82463ab71 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1546 microversion: 2.26 time: 0.585890 Aug 04 04:50:12.343252 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2652/5188] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:11 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1546 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:50:12.365054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1918bda280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:12.391898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.392364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.392867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:12.410824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.411324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.412112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.412559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.502785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.503794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.533037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.535403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.625511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:12.664258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d264aa97-9cf7-45d5-ab22-d6d97e1a08db tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-535699227" status: 201 len: 0 microversion: 2.26 time: 0.300972 Aug 04 04:50:12.664258 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2537/5189] 10.222.0.69 () {62 vars in 1377 bytes} [Thu Aug 4 04:50:12 2022] PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-535699227 => generated 0 bytes in 303 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 04:50:12.681122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e66f18ae-d41a-4414-b08a-abe896c59467 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1919a815e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:12.701923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e66f18ae-d41a-4414-b08a-abe896c59467 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.704090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e66f18ae-d41a-4414-b08a-abe896c59467 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.759765 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e66f18ae-d41a-4414-b08a-abe896c59467 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-535699227" status: 204 len: 0 microversion: 2.26 time: 0.088897 Aug 04 04:50:12.777093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1918feb3a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:12.785667 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2653/5190] 10.222.0.69 () {60 vars in 1358 bytes} [Thu Aug 4 04:50:12 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-535699227 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:50:12.788002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.791207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.793791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:12.807907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.809339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.812741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.813388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.875170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.882766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.919174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:12.972352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-477c5375-d944-4bfa-998b-b833b0520209 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 204 len: 0 microversion: 2.26 time: 0.199953 Aug 04 04:50:12.986348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-18af091a-bf97-4bad-b717-936d83be5667 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1919a818b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:12.990990 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2538/5191] 10.222.0.69 () {60 vars in 1295 bytes} [Thu Aug 4 04:50:12 2022] DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:50:12.996979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18af091a-bf97-4bad-b717-936d83be5667 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.002878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-18af091a-bf97-4bad-b717-936d83be5667 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.035272 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-18af091a-bf97-4bad-b717-936d83be5667 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 200 len: 12 microversion: 2.26 time: 0.052218 Aug 04 04:50:13.051519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1923a71b80>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.057859 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2654/5192] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:50:12 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 12 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:13.074729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.078049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.080028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:13.100481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.102570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.109696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.111235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.176056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.177230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:13.188591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.190753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.193872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.194604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.207439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.208564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.232791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.234407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.323183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:13.387550 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b507ded-f44b-4b01-8fa7-4a73f325ed73 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-699495794" status: 201 len: 0 microversion: 2.26 time: 0.341651 Aug 04 04:50:13.390865 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2539/5193] 10.222.0.69 () {62 vars in 1377 bytes} [Thu Aug 4 04:50:13 2022] PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-699495794 => generated 0 bytes in 347 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 04:50:13.411843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-307c3a4c-e008-483e-9a3c-f8c72c286c75 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1918feb1f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.457554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-307c3a4c-e008-483e-9a3c-f8c72c286c75 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.461151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-307c3a4c-e008-483e-9a3c-f8c72c286c75 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.487667 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-307c3a4c-e008-483e-9a3c-f8c72c286c75 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 200 len: 35 microversion: 2.26 time: 0.089306 Aug 04 04:50:13.498557 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2540/5194] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:50:13 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 35 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:13.504632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1918feba60>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.514602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.515288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.518239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:13.526596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.527956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.529044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.529702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.534527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:13.560424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.561039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.611865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:13.670151 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1457b13b-929c-43ef-bdc5-861dfa503a07 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-699495794" status: 204 len: 0 microversion: 2.26 time: 0.170066 Aug 04 04:50:13.673708 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2541/5195] 10.222.0.69 () {60 vars in 1361 bytes} [Thu Aug 4 04:50:13 2022] DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-699495794 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:50:13.687212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93132ec7-2c01-470d-bce9-c5fcc6ead01c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f19191d3af0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.698904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93132ec7-2c01-470d-bce9-c5fcc6ead01c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.699787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93132ec7-2c01-470d-bce9-c5fcc6ead01c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.714474 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93132ec7-2c01-470d-bce9-c5fcc6ead01c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 200 len: 12 microversion: 2.26 time: 0.033323 Aug 04 04:50:13.716109 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2542/5196] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:50:13 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:50:13.744953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f191a23af70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.766732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.767649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.768581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:13.778710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.779526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.780733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.781248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.816882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.817677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.834879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:13.873924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ad7cfb0-cfe7-4ac7-9238-0ba9b1a58d5a tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 204 len: 0 microversion: 2.26 time: 0.151057 Aug 04 04:50:13.880333 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2543/5197] 10.222.0.69 () {60 vars in 1295 bytes} [Thu Aug 4 04:50:13 2022] DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:50:13.890247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1918bdadc0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.906374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.906835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.907356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:13.917470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.917470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.918024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.918453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.958984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.959888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.975271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.975926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.040416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:14.081670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:14.090652 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-644d8334-fdf3-45e0-8a65-839005c72601 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 200 len: 1323 microversion: 2.1 time: 0.919951 Aug 04 04:50:14.094278 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2655/5198] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:13 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 1323 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:14.112756 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a68092e1-5c30-45c9-a344-a95b2b7b45fd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-1293567697" status: 201 len: 0 microversion: 2.26 time: 0.231203 Aug 04 04:50:14.118670 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2544/5199] 10.222.0.69 () {62 vars in 1380 bytes} [Thu Aug 4 04:50:13 2022] PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-1293567697 => generated 0 bytes in 234 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 04:50:14.124243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f191a8f45e0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:14.139765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.141906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.143046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:14.154274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.157776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.161346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.162285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.235863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.237465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.261056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.262653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.319412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:14.358017 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-996c7e4e-05e0-4440-b8c7-0769b03747a3 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-1243127778" status: 201 len: 0 microversion: 2.26 time: 0.237775 Aug 04 04:50:14.359314 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2656/5200] 10.222.0.69 () {62 vars in 1380 bytes} [Thu Aug 4 04:50:14 2022] PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-1243127778 => generated 0 bytes in 240 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 04:50:14.370043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f19191dd4c0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:14.385152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.386094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.386661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:14.407450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.408076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.408716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.409297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.474268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.481618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.508439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:14.553361 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a726779e-f6e2-4a09-b740-432cbd0799b1 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 204 len: 0 microversion: 2.26 time: 0.186812 Aug 04 04:50:14.557154 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2545/5201] 10.222.0.69 () {60 vars in 1295 bytes} [Thu Aug 4 04:50:14 2022] DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:50:14.566795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f8b2e4e-1e11-43e6-aeb3-f1aa58a3d0d8 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f191a2dad30>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:14.591586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f8b2e4e-1e11-43e6-aeb3-f1aa58a3d0d8 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.592526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f8b2e4e-1e11-43e6-aeb3-f1aa58a3d0d8 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.617388 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f8b2e4e-1e11-43e6-aeb3-f1aa58a3d0d8 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 200 len: 12 microversion: 2.26 time: 0.056068 Aug 04 04:50:14.622233 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2657/5202] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:50:14 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:50:14.632176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f191a23a940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:14.642138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.642599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.643110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:14.665394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.665893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.666709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.667181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.718143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.718614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.743073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:14.780410 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e592198-deda-486e-bcff-3ee0ffc58f2c tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 204 len: 0 microversion: 2.26 time: 0.152353 Aug 04 04:50:14.786683 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2546/5203] 10.222.0.69 () {60 vars in 1295 bytes} [Thu Aug 4 04:50:14 2022] DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:50:14.796697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f191a343550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:14.830062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.830879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.831576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:14.845112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.847177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.848736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.850584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.921451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.922196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.946740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.947949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.981551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:15.019789 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01e755c4-545d-42e4-a748-5223e5108765 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-1584607519" status: 201 len: 0 microversion: 2.26 time: 0.227527 Aug 04 04:50:15.024144 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2658/5204] 10.222.0.69 () {62 vars in 1380 bytes} [Thu Aug 4 04:50:14 2022] PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-1584607519 => generated 0 bytes in 233 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 04:50:15.034852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f19239b5820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:15.060642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.063526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.066665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:15.094137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.094469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.099788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.100330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.115219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:15.120043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:15.137691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.138413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.141291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.149606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.166293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:15.200577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.208923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.274140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.295909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.372859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:15.409035 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0006410-8964-4746-a99f-f271aa00eccd tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-219526426" status: 201 len: 0 microversion: 2.26 time: 0.376438 Aug 04 04:50:15.413107 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2547/5205] 10.222.0.69 () {62 vars in 1377 bytes} [Thu Aug 4 04:50:15 2022] PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags/tempest-tag-219526426 => generated 0 bytes in 384 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 04:50:15.428127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Action: 'update_all', calling method: .version_select at 0x7f19191f6a60>, body: {"tags": ["tempest-tag-1206119783", "tempest-tag-479222994"]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:15.474553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.480032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.480799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:15.501493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.502241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.503287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.505750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.569115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.569967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.634513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:15.700007 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a2a151a-1364-4777-9e9b-de1875796383 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 200 len: 61 microversion: 2.26 time: 0.280903 Aug 04 04:50:15.702240 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2548/5206] 10.222.0.69 () {62 vars in 1312 bytes} [Thu Aug 4 04:50:15 2022] PUT /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 61 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:15.716757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aec10234-811f-4f5a-9bd9-732325aca78d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f1919ff4040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:15.756889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aec10234-811f-4f5a-9bd9-732325aca78d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.757600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aec10234-811f-4f5a-9bd9-732325aca78d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.793092 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aec10234-811f-4f5a-9bd9-732325aca78d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 200 len: 61 microversion: 2.26 time: 0.084413 Aug 04 04:50:15.795897 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2549/5207] 10.222.0.69 () {60 vars in 1292 bytes} [Thu Aug 4 04:50:15 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 61 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:15.807348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '.version_select at 0x7f191a23a940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:15.840654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.841136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.843820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:15.858130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.858691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.859562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.862251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.912065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.913335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.941395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'flavor' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:15.978767 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6505ef1-5bcb-49e5-9aa2-665fbe509507 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags" status: 204 len: 0 microversion: 2.26 time: 0.176372 Aug 04 04:50:15.985924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2550/5208] 10.222.0.69 () {60 vars in 1295 bytes} [Thu Aug 4 04:50:15 2022] DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 04:50:15.999464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:15.999949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:16.012696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.013149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.013935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.014372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.063720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=6,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:16.071241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:50:16.187717 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f03b1826-f08b-430b-bd26-afdd42c41f7d tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 204 len: 0 microversion: 2.26 time: 0.199496 Aug 04 04:50:16.192794 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2551/5209] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:50:15 2022] DELETE /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:50:16.201032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:16.201797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:16.211795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.213890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.216579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.217040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.549962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:16.569386 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-73c03aeb-0109-4ced-80a1-495ed408c32a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 200 len: 1517 microversion: 2.1 time: 1.458010 Aug 04 04:50:16.585646 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2659/5210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:15 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 1517 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:16.606104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:16.607904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:16.627024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.629302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.632715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.636053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.702472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:16.705944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:50:16.715039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:16.716681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:16.717928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4f5278e9-85bf-4999-a213-430037c36352 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1552 microversion: 2.26 time: 0.523379 Aug 04 04:50:16.720227 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2552/5211] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:16 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1552 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:50:16.949162 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44244ceb-4170-464e-be40-45eda2f734b4 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "DELETE /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 204 len: 0 microversion: 2.1 time: 0.358618 Aug 04 04:50:16.955303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2660/5212] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:50:16 2022] DELETE /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:50:16.962676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:16.964040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:16.972468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.978093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.982129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.985871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:17.390598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:17.417864 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0383723a-6edd-415a-95b2-b3841d56339c tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 200 len: 1523 microversion: 2.1 time: 0.460361 Aug 04 04:50:17.419216 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2553/5213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:16 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:17.754029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:17.755443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:17.793906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:17.794686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:17.801109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:17.801913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:18.439795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:18.441374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:18.453879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:18.469027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:18.469911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:18.474750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:20.136525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:20.151969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:20.157517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:20.167955 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-05289642-c929-47f5-8179-7aa0a2cffde0 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1552 microversion: 2.26 time: 2.429164 Aug 04 04:50:20.182630 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2661/5214] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:17 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1552 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:50:20.189397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:20.207814 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-64a89b4b-6104-4a89-b3bb-35197ff76641 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 200 len: 1523 microversion: 2.1 time: 1.771632 Aug 04 04:50:20.208392 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2554/5215] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:18 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 1523 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:50:20.744284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3628f62e-aa46-47d1-95c2-8fbfbaf5eb3b req-1c6dfaaa-ef55-4a43-8540-84f4f61b05aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481d4b7e-a737-49a7-a474-84bb706a180a", "name": "network-vif-deleted", "tag": "6f392c2c-a621-43d1-9c5d-442240569ecd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:20.782437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3628f62e-aa46-47d1-95c2-8fbfbaf5eb3b req-1c6dfaaa-ef55-4a43-8540-84f4f61b05aa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:20.783107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3628f62e-aa46-47d1-95c2-8fbfbaf5eb3b req-1c6dfaaa-ef55-4a43-8540-84f4f61b05aa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:20.815863 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3628f62e-aa46-47d1-95c2-8fbfbaf5eb3b req-1c6dfaaa-ef55-4a43-8540-84f4f61b05aa service nova] Creating event network-vif-deleted:6f392c2c-a621-43d1-9c5d-442240569ecd for instance 481d4b7e-a737-49a7-a474-84bb706a180a on n-h2-851337-5 Aug 04 04:50:20.825681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3628f62e-aa46-47d1-95c2-8fbfbaf5eb3b req-1c6dfaaa-ef55-4a43-8540-84f4f61b05aa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086000 Aug 04 04:50:20.828665 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2662/5216] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:21.197943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:21.198605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:21.217454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:21.220967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:21.231228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:21.231802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:21.232129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:21.232881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:21.248396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:21.249183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:21.250805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:21.253842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:21.332650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:21.390939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:21.402242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:21.403291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:21.403941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lazy-loading 'fault' on Instance uuid 481d4b7e-a737-49a7-a474-84bb706a180a {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:22.106127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:22.119693 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a601d588-760f-4689-95a0-bec3ca328c8d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 200 len: 1481 microversion: 2.1 time: 0.894148 Aug 04 04:50:22.120304 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2663/5217] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:21 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 1481 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:50:22.138033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:22.146715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:22.151728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d8c592fdf749ba9eef1a2a8782c1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b698d7f8ec1e48f691dc79d20e143f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:22.153754 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-174cd913-a999-43b0-952e-5b95c8011282 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 200 len: 1352 microversion: 2.26 time: 0.960407 Aug 04 04:50:22.154346 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2555/5218] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:21 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 1352 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:50:22.929341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-fdd88bd8-e944-41b5-86b9-995924eb4fea req-a43dc23c-f122-40a7-8796-79b085d5a4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110ed067-25ec-450f-b593-e7e0ff3cdf9a", "name": "network-vif-deleted", "tag": "e64c7cfb-43ed-433c-beae-0d433e3662fe"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:22.965509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fdd88bd8-e944-41b5-86b9-995924eb4fea req-a43dc23c-f122-40a7-8796-79b085d5a4b8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:22.965969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fdd88bd8-e944-41b5-86b9-995924eb4fea req-a43dc23c-f122-40a7-8796-79b085d5a4b8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.025271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-fdd88bd8-e944-41b5-86b9-995924eb4fea req-a43dc23c-f122-40a7-8796-79b085d5a4b8 service nova] Creating event network-vif-deleted:e64c7cfb-43ed-433c-beae-0d433e3662fe for instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a on n-h1-851337-5 Aug 04 04:50:23.039139 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-fdd88bd8-e944-41b5-86b9-995924eb4fea req-a43dc23c-f122-40a7-8796-79b085d5a4b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108985 Aug 04 04:50:23.041291 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2664/5219] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:23.140419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.141094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:23.155125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.155584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.156373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.156816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.187527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.188234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] [instance: 481d4b7e-a737-49a7-a474-84bb706a180a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:23.198621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.213720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.216935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.219713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.243295 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] HTTP exception thrown: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a HTTP/1.1 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '110ed067-25ec-450f-b593-e7e0ff3cdf9a'} Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.256202 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 404 to user: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9870f854-9b12-4fee-9304-77460aaeaad1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 404 len: 111 microversion: 2.1 time: 0.121602 Aug 04 04:50:23.262483 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2556/5220] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:50:23.279868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.293897 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] HTTP exception thrown: Instance 481d4b7e-a737-49a7-a474-84bb706a180a could not be found. Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Request method failure captured: Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a HTTP/1.1 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_k99_28DyHBuS5pvJIMAF2qKd6Ck6QIG_FeVnBhD3USWKGEdtIjnAcqrixY5ySMEX0OXTU_o5Zk3-h5MEjSiZthLS4eal4UfnGa1t59W4WiPHgJL4lLL4ssdAqNBW4TwXSOgXjQdU04LVP2kf21be111q8UqWNp0P6_veemdijJh8 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.26 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b698d7f8ec1e48f691dc79d20e143f5c Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerTagsTestJSON-2033357654 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b698d7f8ec1e48f691dc79d20e143f5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b698d7f8ec1e48f691dc79d20e143f5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b698d7f8ec1e48f691dc79d20e143f5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b698d7f8ec1e48f691dc79d20e143f5c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerTagsTestJSON-2033357654 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b698d7f8ec1e48f691dc79d20e143f5c Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerTagsTestJSON-2033357654 Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerTagsTestJSON-2033357654-project Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 53d8c592fdf749ba9eef1a2a8782c1ee Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerTagsTestJSON-2033357654-project Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 481d4b7e-a737-49a7-a474-84bb706a180a could not be found. Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '481d4b7e-a737-49a7-a474-84bb706a180a'} Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481d4b7e-a737-49a7-a474-84bb706a180a could not be found. Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481d4b7e-a737-49a7-a474-84bb706a180a could not be found. Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.295671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481d4b7e-a737-49a7-a474-84bb706a180a could not be found. Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.300420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] Returning 404 to user: Instance 481d4b7e-a737-49a7-a474-84bb706a180a could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:23.308183 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2cb83881-8b81-44a2-99c0-8d96274c8cf6 tempest-ServerTagsTestJSON-2033357654 tempest-ServerTagsTestJSON-2033357654-project] 10.222.0.69 "GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a" status: 404 len: 111 microversion: 2.26 time: 0.125469 Aug 04 04:50:23.315522 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2665/5221] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers/481d4b7e-a737-49a7-a474-84bb706a180a => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 04:50:23.317602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:23.318601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:23.336632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.344310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.345412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.345841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.541303 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8c415dc1-6ff0-497d-b39f-8a37e9a3d7eb tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.266112 Aug 04 04:50:23.553842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7907cbc6-840f-43dd-8732-c623a78752f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7907cbc6-840f-43dd-8732-c623a78752f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: action_args: {} Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 04:50:23.558630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7907cbc6-840f-43dd-8732-c623a78752f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7907cbc6-840f-43dd-8732-c623a78752f9 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010100 Aug 04 04:50:23.565459 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2666/5223] 10.222.0.69 () {58 vars in 1182 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:50:23.569154 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2557/5223] 10.222.0.69 () {58 vars in 1230 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:50:23.575797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.581557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:23.582767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:23.592721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.593544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.594579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.595271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.625049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.multi_cell_list [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:50:23.663180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23947c5a-5c06-48fc-a0fa-a659b1c3b112 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.092578 Aug 04 04:50:23.664741 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2667/5224] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:23.676622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.681418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:23.682939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.compute.servers [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Removing options 'limit' from query {{(pid=119342) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 04:50:23.683638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:23.705081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.705539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.706339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.706794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.778031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:50:23.884170 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-79e2d7b4-e680-496b-a5e3-3cbf14193da1 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.210845 Aug 04 04:50:23.900495 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2558/5225] 10.222.0.69 () {58 vars in 1144 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:23.903333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78f320a7-909f-4f7c-8d11-239f36945751 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78f320a7-909f-4f7c-8d11-239f36945751 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: action_args: {} Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '-1' Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 04:50:23.907939 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78f320a7-909f-4f7c-8d11-239f36945751 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:23.913124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78f320a7-909f-4f7c-8d11-239f36945751 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.014030 Aug 04 04:50:23.919175 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2668/5226] 10.222.0.69 () {58 vars in 1142 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:50:23.936033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-761e5a46-d94f-45ab-84b7-ef6b32f7d343 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-761e5a46-d94f-45ab-84b7-ef6b32f7d343 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: action_args: {} Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise error Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi 'testing' Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 04:50:23.951025 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 04:50:23.957683 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:23.962401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-761e5a46-d94f-45ab-84b7-ef6b32f7d343 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:23.964088 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-761e5a46-d94f-45ab-84b7-ef6b32f7d343 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.038837 Aug 04 04:50:23.996467 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2559/5227] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:50:23.998674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46839f1d-116f-4516-a0ec-ffe7dfba90c5 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:24.024496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46839f1d-116f-4516-a0ec-ffe7dfba90c5 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:24.026588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46839f1d-116f-4516-a0ec-ffe7dfba90c5 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:24.070890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.servers [None req-46839f1d-116f-4516-a0ec-ffe7dfba90c5 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Flavor 'non_existing_flavor' could not be found {{(pid=119343) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 04 04:50:24.072918 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46839f1d-116f-4516-a0ec-ffe7dfba90c5 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.094738 Aug 04 04:50:24.098024 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2669/5228] 10.222.0.69 () {58 vars in 1178 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:50:24.103902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:24.111872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:24.112580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:24.138887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:24.139566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:24.140396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:24.141370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:24.303721 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eee938f3-500a-4c14-8eae-c810bb769290 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.205051 Aug 04 04:50:24.306772 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2560/5229] 10.222.0.69 () {58 vars in 1174 bytes} [Thu Aug 4 04:50:24 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:50:24.347764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:24.386287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:24.408553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119343) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:24.434075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:24.434906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:24.436453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:24.437276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:24.778050 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a224bf5-e57f-4298-bcf6-1e2d8a547354 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.452189 Aug 04 04:50:24.778992 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2670/5230] 10.222.0.69 () {58 vars in 1184 bytes} [Thu Aug 4 04:50:24 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:50:24.801038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:24.811922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:24.813975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:24.828852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:24.830062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:24.831987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:24.833163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:24.897824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:50:25.022155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:25.042866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:25.043258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.213669 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-359c25da-9c88-4a8a-aaf4-8ca236ac7e4e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 1.420461 Aug 04 04:50:26.214658 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2561/5231] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 04:50:24 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:26.242778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8bd05ef7-a229-4411-8d33-9daabc6ff310 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.247593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8bd05ef7-a229-4411-8d33-9daabc6ff310 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:26.248595 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8bd05ef7-a229-4411-8d33-9daabc6ff310 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010586 Aug 04 04:50:26.253149 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2671/5232] 10.222.0.69 () {58 vars in 1178 bytes} [Thu Aug 4 04:50:26 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:50:26.267960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.277946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:26.278654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Searching by: {'deleted': False, 'project_id': 'f4c7101675a44749a7dfce02288efb2e'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:50:26.293157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.293606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.294387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.297442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.348509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:50:26.386818 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-89134132-ecef-45d9-9c5d-f4a20756551a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.123829 Aug 04 04:50:26.399152 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2562/5233] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 04:50:26 2022] GET /compute/v2.1/servers => generated 683 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:26.403673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.404178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:26.415074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.423566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.424695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.425439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.456688 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] HTTP exception thrown: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a HTTP/1.1 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '110ed067-25ec-450f-b593-e7e0ff3cdf9a'} Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:50:26.458266 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 404 to user: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c0a2ddae-226f-4388-b254-b297c9ed438a tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "DELETE /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 404 len: 111 microversion: 2.1 time: 0.061773 Aug 04 04:50:26.468764 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2672/5234] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:50:26 2022] DELETE /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:50:26.471239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.471239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:26.481650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.484132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.485287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.485942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.535476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:50:26.657756 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b03abe29-4bc5-4120-954a-a18b896a36d2 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90" status: 204 len: 0 microversion: 2.1 time: 0.191322 Aug 04 04:50:26.660341 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2563/5235] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:50:26 2022] DELETE /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:50:26.674668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.675279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:26.682473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.683309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.685035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.685806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.718444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:50:26.883401 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f0679bfc-951a-47d8-974d-adf980ec5699 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 204 len: 0 microversion: 2.1 time: 0.218540 Aug 04 04:50:26.884340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2673/5236] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:50:26 2022] DELETE /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:50:26.893772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.895871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 110ed067-25ec-450f-b593-e7e0ff3cdf9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:26.921615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.922111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.922925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.923396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.968273 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] HTTP exception thrown: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a HTTP/1.1 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '110ed067-25ec-450f-b593-e7e0ff3cdf9a'} Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.970701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. Aug 04 04:50:26.975936 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:26.982616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 404 to user: Instance 110ed067-25ec-450f-b593-e7e0ff3cdf9a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:26.983753 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7314e2ca-9bf1-48f7-ad33-caa484f66401 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a" status: 404 len: 111 microversion: 2.1 time: 0.095116 Aug 04 04:50:26.984826 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2564/5237] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:26 2022] GET /compute/v2.1/servers/110ed067-25ec-450f-b593-e7e0ff3cdf9a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:50:26.994495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.995396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:27.012179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:27.012760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:27.020858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:27.021867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:28.129489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:28.143818 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8e0cb58-b3ad-4eb3-9b8d-84380676409d tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90" status: 200 len: 1522 microversion: 2.1 time: 1.154673 Aug 04 04:50:28.146612 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2674/5238] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:26 2022] GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90 => generated 1522 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:29.171918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:29.173613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:29.190245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:29.191258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:29.192261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:29.192883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:29.389861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:29.399567 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a212eb3-8fdb-4817-8caf-bd10dc1e254e tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90" status: 200 len: 1480 microversion: 2.1 time: 0.233031 Aug 04 04:50:29.405332 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2565/5239] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:29 2022] GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90 => generated 1480 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:29.890050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-06cf0807-70ef-454e-a378-9e8b04f8a0e7 req-1f532e27-3d89-4cb1-96ca-400da9f47e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de5dd4d-d234-4fbd-bfd7-e749364c0e90", "name": "network-vif-deleted", "tag": "779d3370-5edc-466d-b8d8-8f9bf53c633b"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:29.910243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-06cf0807-70ef-454e-a378-9e8b04f8a0e7 req-1f532e27-3d89-4cb1-96ca-400da9f47e82 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:29.911273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-06cf0807-70ef-454e-a378-9e8b04f8a0e7 req-1f532e27-3d89-4cb1-96ca-400da9f47e82 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:29.933156 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-06cf0807-70ef-454e-a378-9e8b04f8a0e7 req-1f532e27-3d89-4cb1-96ca-400da9f47e82 service nova] Creating event network-vif-deleted:779d3370-5edc-466d-b8d8-8f9bf53c633b for instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 on n-h2-851337-5 Aug 04 04:50:29.959832 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-06cf0807-70ef-454e-a378-9e8b04f8a0e7 req-1f532e27-3d89-4cb1-96ca-400da9f47e82 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076356 Aug 04 04:50:29.960969 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2675/5240] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:30.432405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:30.433986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:30.456763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:30.459482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:30.462931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:30.463493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:30.514313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:30.545055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:30.545826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:30.546643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lazy-loading 'fault' on Instance uuid 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:50:30.884385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b3cc9b9b8e4b82ae232fec3174f7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c7101675a44749a7dfce02288efb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:30.914435 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ef88e482-c530-4d47-90e1-093b47f4f095 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90" status: 200 len: 1313 microversion: 2.1 time: 0.488769 Aug 04 04:50:30.919508 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2566/5241] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:30 2022] GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:31.947312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:31.949122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: 2de5dd4d-d234-4fbd-bfd7-e749364c0e90] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:31.971256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:31.972292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:31.974459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:31.975391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:32.014884 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] HTTP exception thrown: Instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 could not be found. Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90 HTTP/1.1 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 could not be found. Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '2de5dd4d-d234-4fbd-bfd7-e749364c0e90'} Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 could not be found. Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 could not be found. Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.016748 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 could not be found. Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 404 to user: Instance 2de5dd4d-d234-4fbd-bfd7-e749364c0e90 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:32.021522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-25413bef-dc2b-44e3-a13e-0f6eef5c4719 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90" status: 404 len: 111 microversion: 2.1 time: 0.080941 Aug 04 04:50:32.024253 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2676/5242] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:31 2022] GET /compute/v2.1/servers/2de5dd4d-d234-4fbd-bfd7-e749364c0e90 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:50:32.029255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:32.030210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] [instance: c0d8088e-dd85-47d9-bdce-364f2cade02b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:32.039603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:32.040190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:32.041080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:32.041731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:32.060477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-06fbc01d-89ab-4e18-b559-3932682b8823 req-1de48565-1403-42d1-b700-62f1aa631e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d8088e-dd85-47d9-bdce-364f2cade02b", "name": "network-vif-deleted", "tag": "f54fb06b-8452-4541-819c-9de464211657"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:32.061697 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] HTTP exception thrown: Instance c0d8088e-dd85-47d9-bdce-364f2cade02b could not be found. Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Request method failure captured: Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b HTTP/1.1 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60_XafYs-co-Y6pIb_nlSDB8Nvj7v4cnVWnOgZnDSKeYm9TiWKilk8_3L2iFc4L_HKdXegG4D_03z5_MLkHj9tsSBhfFrzkTytqz_BCUyh8T6xJgk0nIcNQzaSds8bv7ksTaMj8DNfhslN9nCJL4mu8e_ZcrO1O8_nEgNluMuBQVj7o Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f4c7101675a44749a7dfce02288efb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f4c7101675a44749a7dfce02288efb2e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: f4c7101675a44749a7dfce02288efb2e Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1267673517 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 58b3cc9b9b8e4b82ae232fec3174f7b5 Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ListServersNegativeTestJSON-1267673517-project Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance c0d8088e-dd85-47d9-bdce-364f2cade02b could not be found. Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'c0d8088e-dd85-47d9-bdce-364f2cade02b'} Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d8088e-dd85-47d9-bdce-364f2cade02b could not be found. Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d8088e-dd85-47d9-bdce-364f2cade02b could not be found. Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.063440 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d8088e-dd85-47d9-bdce-364f2cade02b could not be found. Aug 04 04:50:32.068555 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:50:32.069412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] Returning 404 to user: Instance c0d8088e-dd85-47d9-bdce-364f2cade02b could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:50:32.071167 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0d1fcedc-3a7c-4ea7-bf6a-73ddaf846400 tempest-ListServersNegativeTestJSON-1267673517 tempest-ListServersNegativeTestJSON-1267673517-project] 10.222.0.69 "GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b" status: 404 len: 111 microversion: 2.1 time: 0.047231 Aug 04 04:50:32.072162 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2567/5243] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:32 2022] GET /compute/v2.1/servers/c0d8088e-dd85-47d9-bdce-364f2cade02b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:50:32.078882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-06fbc01d-89ab-4e18-b559-3932682b8823 req-1de48565-1403-42d1-b700-62f1aa631e17 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:32.079369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-06fbc01d-89ab-4e18-b559-3932682b8823 req-1de48565-1403-42d1-b700-62f1aa631e17 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:32.104113 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-06fbc01d-89ab-4e18-b559-3932682b8823 req-1de48565-1403-42d1-b700-62f1aa631e17 service nova] Creating event network-vif-deleted:f54fb06b-8452-4541-819c-9de464211657 for instance c0d8088e-dd85-47d9-bdce-364f2cade02b on n-h1-851337-5 Aug 04 04:50:32.110260 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-06fbc01d-89ab-4e18-b559-3932682b8823 req-1de48565-1403-42d1-b700-62f1aa631e17 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057061 Aug 04 04:50:32.111768 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2677/5244] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:36.172961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-263458366-access_point-431005800", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "b9895301-fa83-47f2-ac55-f0f70a352aa6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1948822269", "security_groups": [{"name": "tempest-secgroup_access--1301215052"}, {"name": "tempest-secgroup_general--1548705232"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:36.228466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:36.322813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:37.458647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] validate_networks() for [('b9895301-fa83-47f2-ac55-f0f70a352aa6', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:50:40.881474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:50:40.882120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:50:40.882638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:50:40.883102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:50:40.883518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:50:40.904701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:40.905145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:40.911134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:40.919374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:41.002434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Getting quotas for project 153fc403d7e14d50b2602a1ab14d0e06. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:50:41.023477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Getting quotas for user 7e754f29f87f48ae882c436a510b301c and project 153fc403d7e14d50b2602a1ab14d0e06. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:50:41.093190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:50:41.101298 n-d-851337-5 devstack@n-api.service[119342]: WARNING nova.utils [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-263458366-access_point-431005800 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-263458366-acc Aug 04 04:50:41.108584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:50:41.327493 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f6cdc69-6870-422b-8575-ee78b600c904 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 5.163920 Aug 04 04:50:41.342118 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2568/5245] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:50:36 2022] POST /compute/v2.1/servers => generated 458 bytes in 5180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:50:41.353564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a47babf-2fdb-4969-9531-0f5fc905c990 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:41.354265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a47babf-2fdb-4969-9531-0f5fc905c990 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:41.362195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:41.368264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:41.582151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1a47babf-2fdb-4969-9531-0f5fc905c990 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:41.598876 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a47babf-2fdb-4969-9531-0f5fc905c990 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1293 microversion: 2.1 time: 0.249779 Aug 04 04:50:41.600751 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2678/5246] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:41 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1293 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:42.629499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:42.629499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:42.663738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:42.668872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:42.673723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:42.674837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:43.107348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:43.132298 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff3a2e9d-e947-4379-bbda-c00feb4b817e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1289 microversion: 2.1 time: 0.494853 Aug 04 04:50:43.133712 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2569/5247] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:42 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1289 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:44.162366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:44.164894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:44.177277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:44.181683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:44.182702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:44.184022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:44.184696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:44.652193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:44.672381 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bdd26ce9-c497-4adc-a395-7343bbbf8cda tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1351 microversion: 2.1 time: 0.519895 Aug 04 04:50:44.689437 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2679/5248] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:44 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1351 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:45.724410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:45.725733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:45.752210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:45.752989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:45.753970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:45.754597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:45.973755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:45.997942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e34341c2-7331-4d0a-aeee-a2d3b9c4690b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1351 microversion: 2.1 time: 0.303318 Aug 04 04:50:46.029066 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2570/5249] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:45 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1351 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:47.032851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:47.034626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:47.055006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:47.057022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:47.058599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:47.059811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:47.310577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:47.345102 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3dd34468-2ca7-4b05-bf6e-a1248acf1f36 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1351 microversion: 2.1 time: 0.310779 Aug 04 04:50:47.347982 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2680/5250] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:47 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1351 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:48.381205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:48.384774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:48.421358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:48.425446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:48.431811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:48.441107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:48.963726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:48.986918 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4f10d8b1-8424-41e3-9f60-683d0761ef32 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1351 microversion: 2.1 time: 0.612265 Aug 04 04:50:49.002990 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2681/5251] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:48 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1351 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:49.092100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e41bc26d-bed2-491b-a345-f7ee23b9ac35 tempest-ComputeTenantNetworksTest-842979174 tempest-ComputeTenantNetworksTest-842979174-project] Calling method '.version_select at 0x7f1918a9c3a0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:49.358928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e41bc26d-bed2-491b-a345-f7ee23b9ac35 tempest-ComputeTenantNetworksTest-842979174 tempest-ComputeTenantNetworksTest-842979174-project] 10.222.0.69 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.057207 Aug 04 04:50:49.365928 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2571/5252] 10.222.0.69 () {58 vars in 1158 bytes} [Thu Aug 4 04:50:48 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:49.376567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8311af9-a549-4fd9-93b5-7544d9060785 tempest-ComputeTenantNetworksTest-842979174 tempest-ComputeTenantNetworksTest-842979174-project] Calling method '.version_select at 0x7f1919afbee0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:49.947928 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8311af9-a549-4fd9-93b5-7544d9060785 tempest-ComputeTenantNetworksTest-842979174 tempest-ComputeTenantNetworksTest-842979174-project] 10.222.0.69 "GET /compute/v2.1/os-tenant-networks/43b0d298-c6b1-4363-bbd0-a6e58efdb4ce" status: 200 len: 140 microversion: 2.1 time: 0.580146 Aug 04 04:50:49.949158 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2682/5253] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Aug 4 04:50:49 2022] GET /compute/v2.1/os-tenant-networks/43b0d298-c6b1-4363-bbd0-a6e58efdb4ce => generated 140 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:50.034549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:50.035732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:50.054576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:50.060576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:50.061545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:50.062078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:50.286211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:50.300997 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd512c7e-7397-4f92-925c-b00efa3864bb tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1351 microversion: 2.1 time: 0.270997 Aug 04 04:50:50.305662 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2572/5254] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:50 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1351 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:51.324955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:51.326439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:51.365060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:51.365296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:51.367134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:51.367753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:51.590423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:52.791782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:52.817218 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a6c4cc0-8dfa-4b59-9b67-dee598c1c130 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1471 microversion: 2.1 time: 1.495249 Aug 04 04:50:52.821090 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2683/5255] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:51 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1471 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:53.839693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:53.846078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:53.864125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:53.870978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:53.874022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:53.879795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:53.882490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:53.886073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:53.886776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:54.556793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:54.573635 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4dce7cd-a895-4e00-9bba-aa199eba8488 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1471 microversion: 2.1 time: 0.738171 Aug 04 04:50:54.574782 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2573/5256] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:53 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1471 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:54.918572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-64c1ae17-dcbd-469a-97e7-e56c51e37747 req-2cdb0410-a5d9-414f-a9d4-1ec9ccbc0e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b4899c-c255-48d2-abe9-bb2ed090b237", "tag": "fddfb507-06cf-4dd9-85fe-49331f2c0514"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:54.963213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-64c1ae17-dcbd-469a-97e7-e56c51e37747 req-2cdb0410-a5d9-414f-a9d4-1ec9ccbc0e6d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:54.967308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-64c1ae17-dcbd-469a-97e7-e56c51e37747 req-2cdb0410-a5d9-414f-a9d4-1ec9ccbc0e6d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:55.008197 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-64c1ae17-dcbd-469a-97e7-e56c51e37747 req-2cdb0410-a5d9-414f-a9d4-1ec9ccbc0e6d service nova] Creating event network-changed:fddfb507-06cf-4dd9-85fe-49331f2c0514 for instance 08b4899c-c255-48d2-abe9-bb2ed090b237 on n-h1-851337-5 Aug 04 04:50:55.024584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-64c1ae17-dcbd-469a-97e7-e56c51e37747 req-2cdb0410-a5d9-414f-a9d4-1ec9ccbc0e6d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116868 Aug 04 04:50:55.031338 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2684/5257] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:55.616718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:55.617281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:55.636136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:55.636602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:55.637391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:55.646472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:56.780001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:56.792996 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5803cba2-c822-4974-9902-a5ff54420c6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1471 microversion: 2.1 time: 1.181321 Aug 04 04:50:56.811405 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2574/5258] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:55 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1471 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:57.829910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:57.830698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:57.848584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:57.849252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:57.851916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:57.852570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:59.014915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:59.034735 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2126f6da-6fc8-427a-a433-b42bdccfed20 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1471 microversion: 2.1 time: 1.215320 Aug 04 04:50:59.036077 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2685/5259] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:57 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1471 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:00.057798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:00.058369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:00.065272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:00.065727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:00.066524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:00.079367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:01.232253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:01.235289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=44 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:01.252406 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d48f0e7c-415d-4216-b90c-bf5e3e186ed8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1471 microversion: 2.1 time: 1.198746 Aug 04 04:51:01.271181 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2575/5260] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:00 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1471 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:02.274097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:02.274846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:02.288047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:02.290475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:02.293887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:02.294439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:02.891746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:02.902558 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee5fcf7d-649a-463c-bd9f-c840d457f60e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1471 microversion: 2.1 time: 0.632648 Aug 04 04:51:02.903196 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2686/5261] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:02 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1471 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:03.418402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c78ea23c-c7d9-4acd-94da-38456ab5f4a9 req-3c3e667b-ae59-497e-b2c5-ddb6a7f42e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b4899c-c255-48d2-abe9-bb2ed090b237", "name": "network-vif-plugged", "status": "completed", "tag": "fddfb507-06cf-4dd9-85fe-49331f2c0514"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:03.444674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c78ea23c-c7d9-4acd-94da-38456ab5f4a9 req-3c3e667b-ae59-497e-b2c5-ddb6a7f42e3d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:03.445117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c78ea23c-c7d9-4acd-94da-38456ab5f4a9 req-3c3e667b-ae59-497e-b2c5-ddb6a7f42e3d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:03.477209 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c78ea23c-c7d9-4acd-94da-38456ab5f4a9 req-3c3e667b-ae59-497e-b2c5-ddb6a7f42e3d service nova] Creating event network-vif-plugged:fddfb507-06cf-4dd9-85fe-49331f2c0514 for instance 08b4899c-c255-48d2-abe9-bb2ed090b237 on n-h1-851337-5 Aug 04 04:51:03.505330 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c78ea23c-c7d9-4acd-94da-38456ab5f4a9 req-3c3e667b-ae59-497e-b2c5-ddb6a7f42e3d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095088 Aug 04 04:51:03.506388 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2576/5262] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:03.928974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:03.929595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:03.939013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:03.939748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:03.940841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:03.941284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:05.635268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:05.680319 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1ebc412-1985-4600-97e4-42c8e3e1e07c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1471 microversion: 2.1 time: 1.751498 Aug 04 04:51:05.689277 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2687/5263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:03 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1471 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:06.712735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:06.713494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:06.735432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:06.736060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:06.743835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:06.745417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:07.810009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:07.825441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-defa9234-0e43-431c-8718-4c36a53d769e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1643 microversion: 2.1 time: 1.117832 Aug 04 04:51:07.827876 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2577/5264] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:06 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1643 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:07.853905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:07.854519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:07.874722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:07.875095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:07.875890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:07.876331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:09.370716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:09.389503 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c07b22a2-ceb4-4c61-b938-e52575f239cc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1643 microversion: 2.1 time: 1.540163 Aug 04 04:51:09.392598 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2688/5265] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:07 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1643 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:09.411521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0afe2ad-13a5-4c27-ba11-fa1664fde43e tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:09.413425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0afe2ad-13a5-4c27-ba11-fa1664fde43e tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:09.426439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0afe2ad-13a5-4c27-ba11-fa1664fde43e tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:09.429973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0afe2ad-13a5-4c27-ba11-fa1664fde43e tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:09.431681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0afe2ad-13a5-4c27-ba11-fa1664fde43e tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:09.433736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0afe2ad-13a5-4c27-ba11-fa1664fde43e tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:11.766303 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b0afe2ad-13a5-4c27-ba11-fa1664fde43e tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1794 microversion: 2.1 time: 2.354686 Aug 04 04:51:11.778995 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2578/5266] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:09 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1794 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:19.371793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=21 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:19.379269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=50 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:19.823891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1575435087", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "accb0927-b748-4d63-839e-1e9c56dcfa29"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:19.998446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] validate_networks() for [('accb0927-b748-4d63-839e-1e9c56dcfa29', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:51:21.750409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=11 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:21.762682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=15 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:22.059927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:51:22.060391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:51:22.060830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:51:22.061247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:51:22.061686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:51:22.082669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:22.085709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:22.087982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:22.090623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:22.164295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Getting quotas for project 0814a33fadb843f38478b97fd80e0754. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:51:22.187061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Getting quotas for user e620501d7c4c4c0f9805019ad4739748 and project 0814a33fadb843f38478b97fd80e0754. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:51:22.216534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:51:22.220269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:51:22.313697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a1a15eab-8db5-4712-9525-3ad983f60c07 req-ef811485-0170-4623-8b46-25d1c2432f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b4899c-c255-48d2-abe9-bb2ed090b237", "tag": "fddfb507-06cf-4dd9-85fe-49331f2c0514"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:22.314000 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd6860bf-6db2-4723-ab20-ecdbcc8fedad tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.949327 Aug 04 04:51:22.318570 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2689/5267] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:51:22.327431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7fa2116f-df62-452b-8ec7-b1f59a86fa82 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:22.328524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7fa2116f-df62-452b-8ec7-b1f59a86fa82 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:22.370429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a1a15eab-8db5-4712-9525-3ad983f60c07 req-ef811485-0170-4623-8b46-25d1c2432f8c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:22.371338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a1a15eab-8db5-4712-9525-3ad983f60c07 req-ef811485-0170-4623-8b46-25d1c2432f8c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:22.420426 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a1a15eab-8db5-4712-9525-3ad983f60c07 req-ef811485-0170-4623-8b46-25d1c2432f8c service nova] Creating event network-changed:fddfb507-06cf-4dd9-85fe-49331f2c0514 for instance 08b4899c-c255-48d2-abe9-bb2ed090b237 on n-h1-851337-5 Aug 04 04:51:22.437563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a1a15eab-8db5-4712-9525-3ad983f60c07 req-ef811485-0170-4623-8b46-25d1c2432f8c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.698823 Aug 04 04:51:22.448571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2579/5268] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:22.606791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7fa2116f-df62-452b-8ec7-b1f59a86fa82 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:22.617781 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7fa2116f-df62-452b-8ec7-b1f59a86fa82 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1216 microversion: 2.1 time: 0.294835 Aug 04 04:51:22.637543 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2690/5269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:22 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1216 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:23.656753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:23.658302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:23.671385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:23.674510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:23.678211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:23.678786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:23.958162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:23.994288 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ae27d42-64aa-4689-914c-f2dc9c4ca32f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1212 microversion: 2.1 time: 0.324017 Aug 04 04:51:23.997533 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2580/5270] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:23 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1212 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:25.017367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:25.017999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:25.058325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:25.058915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:25.065804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:25.066348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:25.352386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:25.373900 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c30d981d-3997-4ff9-8fe6-2fe925c4b7d2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1276 microversion: 2.1 time: 0.362057 Aug 04 04:51:25.376183 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2691/5271] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:25 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1276 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:26.394217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:26.394837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:26.412444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:26.417957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:26.418050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:26.418497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:26.677016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:26.696493 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f345928-90c6-488c-bb78-f8f1303c6271 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1274 microversion: 2.1 time: 0.298055 Aug 04 04:51:26.706834 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2581/5272] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:26 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1274 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:27.718305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:27.718802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:27.732054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:27.732595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:27.736854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:27.737905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:28.039818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:28.050207 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a802883c-149f-4699-9527-e92db74c0d69 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1274 microversion: 2.1 time: 0.336097 Aug 04 04:51:28.050807 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2692/5273] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:27 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1274 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:29.073310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:29.073929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:29.093107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:29.093656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:29.094592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:29.095056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:29.576442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:29.584878 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6572df12-6660-4dd1-82f0-c64a328bdea0 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 0.517548 Aug 04 04:51:29.597514 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2582/5274] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:29 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:30.619476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:30.620106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:30.638114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:30.639392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:30.641480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:30.649943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:31.260741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:31.269945 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ac4063e-7ca4-48e9-a1df-de7cc341f0a7 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 0.657630 Aug 04 04:51:31.276758 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2693/5275] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:30 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:32.253695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-57462834-835b-4057-94f5-048ba3a84919 req-47d0bab2-09a0-48ce-ba6b-39ce43cc44f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f2f579-486a-4c5e-a910-62713fffcfa1", "tag": "8d599529-25b6-4429-b6b1-d7dae607c9e1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:32.278788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-57462834-835b-4057-94f5-048ba3a84919 req-47d0bab2-09a0-48ce-ba6b-39ce43cc44f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:32.279448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-57462834-835b-4057-94f5-048ba3a84919 req-47d0bab2-09a0-48ce-ba6b-39ce43cc44f0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:32.297581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:32.306135 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-57462834-835b-4057-94f5-048ba3a84919 req-47d0bab2-09a0-48ce-ba6b-39ce43cc44f0 service nova] Creating event network-changed:8d599529-25b6-4429-b6b1-d7dae607c9e1 for instance 31f2f579-486a-4c5e-a910-62713fffcfa1 on n-h2-851337-5 Aug 04 04:51:32.306667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:32.324912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:32.326850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:32.329084 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-57462834-835b-4057-94f5-048ba3a84919 req-47d0bab2-09a0-48ce-ba6b-39ce43cc44f0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079626 Aug 04 04:51:32.329560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:32.330543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:32.331350 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2583/5276] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:32.331920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:32.612903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:32.965032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:32.980903 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7df73829-1e57-48ac-bb42-946fb434ef3e tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 0.686960 Aug 04 04:51:32.994527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2694/5277] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:32 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:34.007206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:34.007917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:34.040636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:34.041270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:34.042343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:34.045767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:35.293361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:35.335456 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9af4faa2-5185-454f-b7aa-94acf5f11d7b tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 1.330290 Aug 04 04:51:35.336885 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2584/5278] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:34 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:36.364666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:36.365223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:36.382271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:36.384079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:36.399493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:36.399958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:36.843622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:36.854052 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a4242a36-8464-4977-93cb-78493a5cb081 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 0.494636 Aug 04 04:51:36.855279 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2695/5279] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:36 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:37.879735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:37.880407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:37.890652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:37.899778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:37.903277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:37.903938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:38.659141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:38.671521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3abe7e2b-e1ac-4f0a-83b8-6cf73c8e7f0f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 0.795350 Aug 04 04:51:38.671994 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2585/5280] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:37 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:39.695134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:39.696322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:39.705384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:39.715747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:39.717245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:39.717896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:40.211153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:40.221578 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95640a0e-3c51-4161-b5d3-36a13c8be169 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 0.530698 Aug 04 04:51:40.222141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2696/5281] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:39 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:41.244407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:41.245993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:41.261707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:41.262478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:41.265386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:41.266070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:42.710619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:42.720862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-781c825a-bcd5-4b19-aa2a-0fbfba58eff8 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 1.480378 Aug 04 04:51:42.727918 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2586/5282] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:41 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:42.893388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f9edfc33-2925-4e4e-98cd-61ae510e1fc9 req-3047ad42-14a4-4331-a6d2-7c114556b2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f2f579-486a-4c5e-a910-62713fffcfa1", "name": "network-vif-plugged", "status": "completed", "tag": "8d599529-25b6-4429-b6b1-d7dae607c9e1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:42.915766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9edfc33-2925-4e4e-98cd-61ae510e1fc9 req-3047ad42-14a4-4331-a6d2-7c114556b2a9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:42.916407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f9edfc33-2925-4e4e-98cd-61ae510e1fc9 req-3047ad42-14a4-4331-a6d2-7c114556b2a9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:42.944748 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f9edfc33-2925-4e4e-98cd-61ae510e1fc9 req-3047ad42-14a4-4331-a6d2-7c114556b2a9 service nova] Creating event network-vif-plugged:8d599529-25b6-4429-b6b1-d7dae607c9e1 for instance 31f2f579-486a-4c5e-a910-62713fffcfa1 on n-h2-851337-5 Aug 04 04:51:42.959342 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f9edfc33-2925-4e4e-98cd-61ae510e1fc9 req-3047ad42-14a4-4331-a6d2-7c114556b2a9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073248 Aug 04 04:51:42.960141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2697/5283] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:43.748750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:43.749607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:43.775414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:43.775890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:43.776733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:43.777181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:44.248709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:44.271783 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd9341a3-28d9-4a02-81a9-091896acb824 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1316 microversion: 2.1 time: 0.527706 Aug 04 04:51:44.277393 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2587/5284] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:43 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:45.316448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:45.325083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:45.346823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:45.347583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:45.348190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:45.349481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:45.741658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:45.752045 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-15347270-8e18-48aa-b642-22fb5f5ec22f tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1503 microversion: 2.1 time: 0.456668 Aug 04 04:51:45.752641 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2698/5285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:45 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:45.774003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99988c5c-9fae-4030-9b15-c28b5d2fb8fa tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:45.774517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99988c5c-9fae-4030-9b15-c28b5d2fb8fa tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:45.782786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99988c5c-9fae-4030-9b15-c28b5d2fb8fa tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:45.783511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99988c5c-9fae-4030-9b15-c28b5d2fb8fa tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:45.784524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99988c5c-9fae-4030-9b15-c28b5d2fb8fa tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:45.785213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99988c5c-9fae-4030-9b15-c28b5d2fb8fa tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:45.940320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99988c5c-9fae-4030-9b15-c28b5d2fb8fa tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "DELETE /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.170244 Aug 04 04:51:45.941575 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2588/5286] 10.222.0.69 () {58 vars in 1296 bytes} [Thu Aug 4 04:51:45 2022] DELETE /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1/os-server-password => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:51:45.955541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31003243-50d6-44c0-905d-aa5a575c4ee2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:45.956941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31003243-50d6-44c0-905d-aa5a575c4ee2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:45.968381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31003243-50d6-44c0-905d-aa5a575c4ee2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:45.969281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31003243-50d6-44c0-905d-aa5a575c4ee2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:45.970695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31003243-50d6-44c0-905d-aa5a575c4ee2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:45.971460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31003243-50d6-44c0-905d-aa5a575c4ee2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:46.008265 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31003243-50d6-44c0-905d-aa5a575c4ee2 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.059227 Aug 04 04:51:46.011145 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2699/5287] 10.222.0.69 () {58 vars in 1293 bytes} [Thu Aug 4 04:51:45 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1/os-server-password => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:51:46.024067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:46.024772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:46.032363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:46.033183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:46.034281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:46.034854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:46.072733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:51:46.221380 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa60cb16-3885-4335-baeb-0ccfaa0ec3df tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "DELETE /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 204 len: 0 microversion: 2.1 time: 0.201735 Aug 04 04:51:46.225951 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2589/5288] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:51:46 2022] DELETE /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:51:46.232440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:46.233066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:46.240894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:46.241404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:46.242197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:46.242886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:47.256536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:47.273111 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c24fde3f-e001-40ad-9614-52f7e5028108 tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1509 microversion: 2.1 time: 1.042380 Aug 04 04:51:47.276235 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2700/5289] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:46 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1509 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:48.297868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:48.298565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:48.334073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:48.334532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:48.336535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:48.336979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:48.808167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2052d76d-a34d-4603-8cd6-5125a07fc782 req-ce778a8e-afb9-4216-b32e-2c83eeea3a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f2f579-486a-4c5e-a910-62713fffcfa1", "name": "network-vif-deleted", "tag": "8d599529-25b6-4429-b6b1-d7dae607c9e1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:48.824708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2052d76d-a34d-4603-8cd6-5125a07fc782 req-ce778a8e-afb9-4216-b32e-2c83eeea3a60 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:48.825328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2052d76d-a34d-4603-8cd6-5125a07fc782 req-ce778a8e-afb9-4216-b32e-2c83eeea3a60 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:48.869421 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2052d76d-a34d-4603-8cd6-5125a07fc782 req-ce778a8e-afb9-4216-b32e-2c83eeea3a60 service nova] Creating event network-vif-deleted:8d599529-25b6-4429-b6b1-d7dae607c9e1 for instance 31f2f579-486a-4c5e-a910-62713fffcfa1 on n-h2-851337-5 Aug 04 04:51:48.882215 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2052d76d-a34d-4603-8cd6-5125a07fc782 req-ce778a8e-afb9-4216-b32e-2c83eeea3a60 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078315 Aug 04 04:51:48.885253 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2701/5290] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:49.050616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e620501d7c4c4c0f9805019ad4739748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0814a33fadb843f38478b97fd80e0754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:49.063799 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e31ffbb0-8f88-4852-9f6b-e1b34a24d06c tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 200 len: 1509 microversion: 2.1 time: 0.770787 Aug 04 04:51:49.067373 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2590/5291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:48 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 1509 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:50.090135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:50.091498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] [instance: 31f2f579-486a-4c5e-a910-62713fffcfa1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:50.094737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:50.112089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:50.115670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:50.117201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:50.117656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:50.121275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=59 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:50.169004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] HTTP exception thrown: Instance 31f2f579-486a-4c5e-a910-62713fffcfa1 could not be found. Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Request method failure captured: Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 HTTP/1.1 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61BHCDWl1qLFHHxoF4nt09vuz4OoqBh0m_7Yzxw1sdXnP3_2whJ6HqfunfGwJQwy3MPAnoV9ukvCGOtzSqvMr-DTrg5qcNurfKtH_IsszdTlRt_3hPYA51JkWvKsSqRGlFUF7RKTgloYON2T1C-orG3bgeFQN12jZzGnSfhCoNtWGkQ Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 0814a33fadb843f38478b97fd80e0754 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerPasswordTestJSON-1909547336 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0814a33fadb843f38478b97fd80e0754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0814a33fadb843f38478b97fd80e0754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0814a33fadb843f38478b97fd80e0754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0814a33fadb843f38478b97fd80e0754", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerPasswordTestJSON-1909547336 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 0814a33fadb843f38478b97fd80e0754 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1909547336 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerPasswordTestJSON-1909547336-project Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: e620501d7c4c4c0f9805019ad4739748 Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerPasswordTestJSON-1909547336-project Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 31f2f579-486a-4c5e-a910-62713fffcfa1 could not be found. Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '31f2f579-486a-4c5e-a910-62713fffcfa1'} Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f2f579-486a-4c5e-a910-62713fffcfa1 could not be found. Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f2f579-486a-4c5e-a910-62713fffcfa1 could not be found. Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:51:50.174343 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f2f579-486a-4c5e-a910-62713fffcfa1 could not be found. Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:51:50.179645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] Returning 404 to user: Instance 31f2f579-486a-4c5e-a910-62713fffcfa1 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:51:50.184338 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b791d305-b142-4ec7-8a97-1621a7b47b2a tempest-ServerPasswordTestJSON-1909547336 tempest-ServerPasswordTestJSON-1909547336-project] 10.222.0.69 "GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1" status: 404 len: 111 microversion: 2.1 time: 0.095158 Aug 04 04:51:50.187530 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2702/5292] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:50 2022] GET /compute/v2.1/servers/31f2f579-486a-4c5e-a910-62713fffcfa1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:51:51.586816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-590463597", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:51.659990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:51:52.528585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:51:52.529050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:51:52.529468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:51:52.529879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:51:52.530549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:51:52.532836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:52.576005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:52.576469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:52.577260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:52.577701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:52.596240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:51:52.644398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Getting quotas for project 66f966195aae4fea9ba23bac8e6765aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:51:52.676977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Getting quotas for user 5db42a24f5034e978b6a97055f3081c3 and project 66f966195aae4fea9ba23bac8e6765aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:51:52.720255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:51:52.722634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:51:52.836575 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d937fe38-0f72-441a-bb8c-4c7cc92eda53 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253257 Aug 04 04:51:52.838237 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2591/5293] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:51:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:51:52.849490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11da7176-8cf2-4b82-bb76-2e696850d48f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:52.850719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11da7176-8cf2-4b82-bb76-2e696850d48f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:53.038666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11da7176-8cf2-4b82-bb76-2e696850d48f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:53.047673 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11da7176-8cf2-4b82-bb76-2e696850d48f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1214 microversion: 2.1 time: 0.202602 Aug 04 04:51:53.048272 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2703/5294] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:52 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:54.080408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:54.081603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:54.096708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:54.098859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:54.102188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:54.103103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:54.490734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:54.525645 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3363de8d-66ba-42b4-8991-2b2e8f581ea9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1210 microversion: 2.1 time: 0.440238 Aug 04 04:51:54.535048 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2592/5295] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:54 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1210 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:55.549466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:55.550102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:55.565108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:55.565756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:55.567852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:55.567997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:56.018387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:56.031557 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d6fa509a-fc8a-401c-ac8e-5cef882766e4 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1272 microversion: 2.1 time: 0.486072 Aug 04 04:51:56.032871 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2704/5296] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:55 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1272 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:57.056327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:57.057206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:57.075570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:57.076792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:57.081571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:57.082563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:57.281033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:57.307790 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-971a50df-ce39-4aa3-bf99-916ac6981d8f tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1272 microversion: 2.1 time: 0.256060 Aug 04 04:51:57.311484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2593/5297] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:57 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:58.333370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:58.333994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:58.342204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:58.343296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:58.344935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:58.346270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:59.274468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:59.288859 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-32ec7182-09da-43a8-87b9-7cb76e0d8c80 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.959279 Aug 04 04:51:59.305436 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2705/5298] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:58 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:00.312852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:00.314041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:00.335380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:00.336068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:00.337045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:00.337947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:00.981669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:00.993723 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbd18a2f-19d3-46da-b0e3-0c489f561885 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.684826 Aug 04 04:52:00.994751 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2594/5299] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:00 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:02.016828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:02.017531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:02.031702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:02.032154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:02.032942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:02.035315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:02.640655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:02.655858 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4426e0a8-ea3e-483e-a383-65b2dd5feae7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.643945 Aug 04 04:52:02.664023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d13e5187-2fa3-4914-937f-2485d06770b1 req-fa30f7c0-7f22-411a-83c9-4eb91ba17ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba249b0-f2de-491a-8186-6cf6079dacf4", "tag": "03bc2828-298e-4b4c-8bc4-aac4255c3923"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:02.670393 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2706/5300] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:02 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:02.690933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:02.697276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d13e5187-2fa3-4914-937f-2485d06770b1 req-fa30f7c0-7f22-411a-83c9-4eb91ba17ae3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:02.701107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d13e5187-2fa3-4914-937f-2485d06770b1 req-fa30f7c0-7f22-411a-83c9-4eb91ba17ae3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:02.734137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:02.740765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d13e5187-2fa3-4914-937f-2485d06770b1 req-fa30f7c0-7f22-411a-83c9-4eb91ba17ae3 service nova] Creating event network-changed:03bc2828-298e-4b4c-8bc4-aac4255c3923 for instance eba249b0-f2de-491a-8186-6cf6079dacf4 on n-h2-851337-5 Aug 04 04:52:02.763737 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d13e5187-2fa3-4914-937f-2485d06770b1 req-fa30f7c0-7f22-411a-83c9-4eb91ba17ae3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105690 Aug 04 04:52:02.765059 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2595/5301] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:52:03.696708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:03.697336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:03.708316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:03.714110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:03.714799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:03.718155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:03.718979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:04.188876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:04.202076 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76f0ac65-98a3-48f0-a015-e31a53d14fa1 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.505833 Aug 04 04:52:04.202909 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2707/5302] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:03 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:05.225927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:05.228296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:05.247405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:05.248289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:05.249311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:05.251305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:05.748121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:05.767881 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-895bc9a0-51a2-4da6-a651-c98ddb7bca15 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.543149 Aug 04 04:52:05.768950 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2596/5303] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:05 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:06.789014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:06.789631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:06.797602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:06.798057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:06.798827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:06.799562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:07.271419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:07.293471 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-efd4deaf-b9ad-46d9-b9e2-05bb2559d057 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.508120 Aug 04 04:52:07.304453 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2708/5304] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:06 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:08.318409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:08.319709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:08.330050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:08.330757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:08.332991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:08.333667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:08.966179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:08.979087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2d8f46ff-d2eb-43a2-97dc-7ad5beac1c71 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.665705 Aug 04 04:52:08.999943 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2597/5305] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:08 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:10.014063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:10.015052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:10.030105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:10.033786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:10.035916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:10.037802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:10.610981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:10.623989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f52dc6ec-6e32-432c-a99c-0d6ea737f28a tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.621273 Aug 04 04:52:10.625693 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2709/5306] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:10 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:10.901674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9e9a2f6f-c599-41c0-b2de-0d9a949830fa req-8a6de592-7652-4eb9-973d-ccb3e983690a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba249b0-f2de-491a-8186-6cf6079dacf4", "name": "network-vif-plugged", "status": "completed", "tag": "03bc2828-298e-4b4c-8bc4-aac4255c3923"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:10.922330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9e9a2f6f-c599-41c0-b2de-0d9a949830fa req-8a6de592-7652-4eb9-973d-ccb3e983690a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:10.923970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9e9a2f6f-c599-41c0-b2de-0d9a949830fa req-8a6de592-7652-4eb9-973d-ccb3e983690a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:10.958559 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9e9a2f6f-c599-41c0-b2de-0d9a949830fa req-8a6de592-7652-4eb9-973d-ccb3e983690a service nova] Creating event network-vif-plugged:03bc2828-298e-4b4c-8bc4-aac4255c3923 for instance eba249b0-f2de-491a-8186-6cf6079dacf4 on n-h2-851337-5 Aug 04 04:52:10.968620 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9e9a2f6f-c599-41c0-b2de-0d9a949830fa req-8a6de592-7652-4eb9-973d-ccb3e983690a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071452 Aug 04 04:52:10.971471 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2598/5307] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:52:11.647415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:11.648126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:11.663311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:11.663969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:11.664930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:11.665541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:12.273761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:12.285099 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c8ad70e3-468c-4583-b1c5-5e168937e672 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1314 microversion: 2.1 time: 0.642647 Aug 04 04:52:12.286350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2710/5308] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:11 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:13.309040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:13.309868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:13.322823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:13.323452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:13.324330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:13.328466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:14.192672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:14.204334 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-178f3e1f-700a-435a-b789-13b1573cdcf9 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1464 microversion: 2.1 time: 0.901540 Aug 04 04:52:14.204845 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2599/5309] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:13 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1464 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:14.293984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:14.298090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:14.324175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:14.326004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:14.329235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:14.334816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:14.411529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:52:14.669187 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-799f642f-a933-452d-a1bc-90788489d834 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "DELETE /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 204 len: 0 microversion: 2.1 time: 0.380562 Aug 04 04:52:14.670517 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2711/5310] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:52:14 2022] DELETE /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:52:14.679227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:14.679629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:14.703689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:14.704955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:14.706070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:14.709710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:16.119644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:16.129347 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c140dbd-04c2-4356-a994-07f516a2979d tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1470 microversion: 2.1 time: 1.454454 Aug 04 04:52:16.131900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2600/5311] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:14 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1470 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:17.162771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:17.174349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:17.188044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:17.188927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:17.195974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:17.197307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:17.643174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:17.667773 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4488f28-bf41-40d7-bdce-784495aa1cc7 tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1470 microversion: 2.1 time: 0.511659 Aug 04 04:52:17.668411 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2712/5312] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:17 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:18.622694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d0fa8ba4-2cd3-4f85-82c8-2f9b6251e551 req-308afd69-2aec-48cb-bf07-110443bafe2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba249b0-f2de-491a-8186-6cf6079dacf4", "name": "network-vif-deleted", "tag": "03bc2828-298e-4b4c-8bc4-aac4255c3923"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:18.664613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d0fa8ba4-2cd3-4f85-82c8-2f9b6251e551 req-308afd69-2aec-48cb-bf07-110443bafe2a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:18.665394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d0fa8ba4-2cd3-4f85-82c8-2f9b6251e551 req-308afd69-2aec-48cb-bf07-110443bafe2a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:18.682086 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d0fa8ba4-2cd3-4f85-82c8-2f9b6251e551 req-308afd69-2aec-48cb-bf07-110443bafe2a service nova] Creating event network-vif-deleted:03bc2828-298e-4b4c-8bc4-aac4255c3923 for instance eba249b0-f2de-491a-8186-6cf6079dacf4 on n-h2-851337-5 Aug 04 04:52:18.689060 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d0fa8ba4-2cd3-4f85-82c8-2f9b6251e551 req-308afd69-2aec-48cb-bf07-110443bafe2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077634 Aug 04 04:52:18.689873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:18.691181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:18.692026 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2601/5313] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:52:18.703617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:18.706180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:18.713801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:18.714479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:18.906693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db42a24f5034e978b6a97055f3081c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f966195aae4fea9ba23bac8e6765aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:18.920207 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8600fb67-9dba-41e7-9004-4a0f93c2a3af tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 200 len: 1299 microversion: 2.1 time: 0.232072 Aug 04 04:52:18.921572 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2713/5314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:18 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:19.943611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:19.945212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] [instance: eba249b0-f2de-491a-8186-6cf6079dacf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:19.955207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:19.955921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:19.957368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:19.957957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:19.973916 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] HTTP exception thrown: Instance eba249b0-f2de-491a-8186-6cf6079dacf4 could not be found. Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Request method failure captured: Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 HTTP/1.1 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61BjCRzIUOhpxlixSjiA1UrSYa0KcR6Sms70lrfuDKel6jktwnUvIR8f-c-I5G9UXE5Fpe1IKWkKt3MtC0Qw_aA3lMo1OussqRXZdjr72vjm7niy5TVFSA43REdcjk4eK3l-HlxP3t31rX9UoqAV3PAiGM8Wc3izhe9sI0-SO5YECNc Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 66f966195aae4fea9ba23bac8e6765aa Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesNegativeTest-877394658 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/66f966195aae4fea9ba23bac8e6765aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/66f966195aae4fea9ba23bac8e6765aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/66f966195aae4fea9ba23bac8e6765aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_66f966195aae4fea9ba23bac8e6765aa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesNegativeTest-877394658 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 66f966195aae4fea9ba23bac8e6765aa Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesNegativeTest-877394658 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesNegativeTest-877394658-project Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5db42a24f5034e978b6a97055f3081c3 Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesNegativeTest-877394658-project Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance eba249b0-f2de-491a-8186-6cf6079dacf4 could not be found. Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'eba249b0-f2de-491a-8186-6cf6079dacf4'} Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba249b0-f2de-491a-8186-6cf6079dacf4 could not be found. Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba249b0-f2de-491a-8186-6cf6079dacf4 could not be found. Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:52:19.976096 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:52:19.980094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:52:19.980094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:52:19.980094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:52:19.980094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:52:19.980094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:52:19.980094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba249b0-f2de-491a-8186-6cf6079dacf4 could not be found. Aug 04 04:52:19.980094 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:52:19.981887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] Returning 404 to user: Instance eba249b0-f2de-491a-8186-6cf6079dacf4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:52:19.982927 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ee751b1d-7626-4c92-b457-c7c78d81946c tempest-VolumesNegativeTest-877394658 tempest-VolumesNegativeTest-877394658-project] 10.222.0.69 "GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4" status: 404 len: 111 microversion: 2.1 time: 0.044403 Aug 04 04:52:19.983714 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2602/5315] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:19 2022] GET /compute/v2.1/servers/eba249b0-f2de-491a-8186-6cf6079dacf4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:52:28.909995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:28.913391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:29.849415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-483c7eaa-55d5-4650-bae9-4984f0b261fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'create', calling method: .version_select at 0x7f1919ab43a0>, body: {"keypair": {"name": "tempest-keypair-1024801041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwkHipzi0J2lgKOd3bdNXJR5FgwfD0TCSo+Gu/rjMXXgycOuka99yWHai886SkoxjvoDfAeA0DqNywyDoyvwyhg5eYkFk20tjQ4QDfjnUMGudntzBB9Ly8D/nVMprHCgA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:29.902371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-483c7eaa-55d5-4650-bae9-4984f0b261fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for project c82d8b39aae447e89fa03246411a8eff. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:52:29.930815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-483c7eaa-55d5-4650-bae9-4984f0b261fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for user 04733db33887418d9437bf7346bbc511 and project c82d8b39aae447e89fa03246411a8eff. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:52:30.015360 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-483c7eaa-55d5-4650-bae9-4984f0b261fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.111196 Aug 04 04:52:30.019237 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2714/5316] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:52:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 04:52:40.351324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-922218933", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d6b3970-731f-4cbf-9784-bf5bbdd98674"}], "security_groups": [{"name": "tempest-securitygroup--389024219"}], "key_name": "tempest-keypair-1024801041", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:40.367826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:40.369766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=51 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:40.755895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] validate_networks() for [('5d6b3970-731f-4cbf-9784-bf5bbdd98674', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:52:41.021972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:41.024014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:41.031924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1889627496", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "0a760647-8c57-4196-bdc3-553c2cbb5dcf"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1948822269", "security_groups": []}, "os:scheduler_hints": {"different_host": ["08b4899c-c255-48d2-abe9-bb2ed090b237"]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:41.181590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] validate_networks() for [('0a760647-8c57-4196-bdc3-553c2cbb5dcf', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:52:43.424003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:52:43.426112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:52:43.426802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:52:43.430667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:52:43.431404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:52:43.455673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:43.456799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:43.457886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:43.458539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:43.489915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for project c82d8b39aae447e89fa03246411a8eff. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:52:43.507121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for user 04733db33887418d9437bf7346bbc511 and project c82d8b39aae447e89fa03246411a8eff. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:52:43.541403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:52:43.548094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:52:43.624489 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-341231e2-e850-477e-8250-6f26763b792c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.280099 Aug 04 04:52:43.632153 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2603/5317] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:52:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 3288 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:52:43.637638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5d41334-6183-49c8-af05-3a5eea59e7a5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:43.638257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5d41334-6183-49c8-af05-3a5eea59e7a5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:43.924851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5d41334-6183-49c8-af05-3a5eea59e7a5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:43.943204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:52:43.944580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:52:43.945269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:52:43.946448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:52:43.947111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:52:43.959395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5d41334-6183-49c8-af05-3a5eea59e7a5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:43.971619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5d41334-6183-49c8-af05-3a5eea59e7a5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:43.980214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:43.980677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5d41334-6183-49c8-af05-3a5eea59e7a5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1281 microversion: 2.20 time: 0.343035 Aug 04 04:52:43.981426 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2604/5318] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:43 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1281 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:43.987997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:43.990440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:43.993375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:44.070768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Getting quotas for project 153fc403d7e14d50b2602a1ab14d0e06. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:52:44.088276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Getting quotas for user 7e754f29f87f48ae882c436a510b301c and project 153fc403d7e14d50b2602a1ab14d0e06. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:52:44.166679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:52:44.179791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:52:44.307411 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c4ad04ff-e292-4ad0-80ed-4a3e163a37f4 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.287384 Aug 04 04:52:44.317660 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2715/5319] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:52:41 2022] POST /compute/v2.1/servers => generated 361 bytes in 3295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:52:44.320342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0f8b14c5-a495-40d2-918f-706d96392f3e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:44.321180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0f8b14c5-a495-40d2-918f-706d96392f3e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:44.584441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f8b14c5-a495-40d2-918f-706d96392f3e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:44.592345 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0f8b14c5-a495-40d2-918f-706d96392f3e tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1242 microversion: 2.1 time: 0.276578 Aug 04 04:52:44.606982 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2605/5320] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:44 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1242 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:45.009017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:45.009779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:45.052896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:45.059896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:45.063467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:45.064185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:45.414306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:45.427965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:45.430678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:45.431887 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb86dc5f-65ac-4499-8298-d046cf6b8543 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1277 microversion: 2.20 time: 0.427737 Aug 04 04:52:45.433010 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2716/5321] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:45 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1277 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:45.621143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:45.622484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:45.654036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:45.655430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:45.657844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:45.661574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:46.110991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:46.128835 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7d8a743-d676-4b09-bbc1-254d8190e40b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1238 microversion: 2.1 time: 0.514151 Aug 04 04:52:46.132077 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2606/5322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:45 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1238 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:46.458115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:46.459415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:46.479505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:46.480468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:46.482065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:46.482524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:46.678647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:46.697052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:46.698927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:46.700238 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-046f000e-08a4-4f55-8826-66a4d544a269 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1339 microversion: 2.20 time: 0.248443 Aug 04 04:52:46.700684 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2717/5323] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:46 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:47.157288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:47.158750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:47.181736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:47.186433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:47.190006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:47.193539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:47.422288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:47.433577 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7531636c-f17f-4223-b3e3-40867762f9ec tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.284322 Aug 04 04:52:47.436264 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2607/5324] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:47 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:47.724258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:47.725068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:47.739352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:47.740425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:47.741425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:47.742069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:47.839654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:47.849962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:47.851706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:47.853776 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bbb28396-cb3b-4c89-a89e-df921665d91e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1339 microversion: 2.20 time: 0.133579 Aug 04 04:52:47.854855 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2718/5325] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:47 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:48.465993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:48.467176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:48.481204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:48.482469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:48.487470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:48.488077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:48.629345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:48.650005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-be97f004-a0cf-4d56-a9b3-f5a9db29f979 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.188487 Aug 04 04:52:48.676228 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2608/5326] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:48 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:48.883022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:48.883022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:48.901227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:48.901685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:48.902582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:48.903049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:49.121209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:49.134282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:49.141293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:49.145303 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-486cb0bb-0ec8-453a-9570-7192ea111a2e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1339 microversion: 2.20 time: 0.267419 Aug 04 04:52:49.149597 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2719/5327] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:48 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:49.678151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:49.678776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:49.702243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:49.702695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:49.703524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:49.721654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:49.885360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:49.897425 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b55ba07a-040f-471c-84a5-e534d3ad7e6b tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.223706 Aug 04 04:52:49.899396 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2609/5328] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:49 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:50.176553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:50.178027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:50.193968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:50.194710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:50.195752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:50.198492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:50.747751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:50.764807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:50.773913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:50.777777 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8d8cba47-e975-46bb-888e-46de8fe5cc5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1406 microversion: 2.20 time: 0.604990 Aug 04 04:52:50.780213 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2720/5329] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:50 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:50.925649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:50.926848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:50.942398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:50.953522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:50.957674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:50.959500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:51.336571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:51.346408 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81367bd3-dfc8-4a42-aaa3-927ffe2b157c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.425315 Aug 04 04:52:51.363787 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2610/5330] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:50 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:51.804408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:51.805025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:51.823265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:51.824017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:51.826335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:51.826991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:52.139789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:52.150469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:52.156144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:52.157354 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0fa0f398-9be0-44e9-b4b4-0413e8281a69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1406 microversion: 2.20 time: 0.357007 Aug 04 04:52:52.161240 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2721/5331] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:51 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:52.375329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:52.375860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:52.405613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:52.406843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:52.409190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:52.410947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:52.578992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:52.587438 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e973e5b4-fc60-47c1-abf0-b956a0dbe651 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.216078 Aug 04 04:52:52.600434 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2611/5332] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:52 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:52.827968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-538c8af2-6349-4d71-b16e-ff6db1dd58d4 req-651eedde-4c4f-4e2b-aa80-24cfe119bace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0", "tag": "ffe6a653-0427-4f03-be1e-2692edd9a64e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:52.853024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-538c8af2-6349-4d71-b16e-ff6db1dd58d4 req-651eedde-4c4f-4e2b-aa80-24cfe119bace service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:52.862855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-538c8af2-6349-4d71-b16e-ff6db1dd58d4 req-651eedde-4c4f-4e2b-aa80-24cfe119bace service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:52.886493 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-538c8af2-6349-4d71-b16e-ff6db1dd58d4 req-651eedde-4c4f-4e2b-aa80-24cfe119bace service nova] Creating event network-changed:ffe6a653-0427-4f03-be1e-2692edd9a64e for instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 on n-h2-851337-5 Aug 04 04:52:52.899765 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-538c8af2-6349-4d71-b16e-ff6db1dd58d4 req-651eedde-4c4f-4e2b-aa80-24cfe119bace service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078032 Aug 04 04:52:52.902165 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2722/5333] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:52:53.186922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:53.187818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:53.198879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:53.199553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:53.200564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:53.200993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:53.475856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:53.608611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:53.609341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:53.620069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:53.620530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:53.621340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:53.621787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:53.832574 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:52:53.832785 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 04:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 (ip 10.222.0.69) !!! Aug 04 04:52:54.030886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:54.105615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:54.243464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:54.252067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-042136a5-a7fc-4799-a71f-47085f7e4a7f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.647676 Aug 04 04:52:54.259211 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2723/5334] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:53 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:54.414358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:54.456256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:54.460779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:54.462234 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-88849db1-ae86-4706-b364-4368688389af tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1406 microversion: 2.20 time: 1.280446 Aug 04 04:52:54.487353 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2612/5335] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:53 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1406 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:52:55.058737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9f762f89-d61a-477e-b671-3632bf485554 req-16d72631-e5e8-4ce0-aa07-040fbc6bee38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:52:55.074894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9f762f89-d61a-477e-b671-3632bf485554 req-16d72631-e5e8-4ce0-aa07-040fbc6bee38 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:55.075725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9f762f89-d61a-477e-b671-3632bf485554 req-16d72631-e5e8-4ce0-aa07-040fbc6bee38 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:55.118429 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9f762f89-d61a-477e-b671-3632bf485554 req-16d72631-e5e8-4ce0-aa07-040fbc6bee38 service nova] Creating event network-changed:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h2-851337-5 Aug 04 04:52:55.132870 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9f762f89-d61a-477e-b671-3632bf485554 req-16d72631-e5e8-4ce0-aa07-040fbc6bee38 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080390 Aug 04 04:52:55.138267 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2724/5336] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:52:55.273716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:55.274345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:55.276287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:52:55.287502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:55.293831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:55.295097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:55.295707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:55.494492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:55.495258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:55.510755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:55.511179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:55.515095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:55.515550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:56.309447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:56.343410 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-457089a1-367b-4e67-803f-cd5fbf60e330 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 1.073159 Aug 04 04:52:56.357313 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2613/5337] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:55 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:56.772264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:56.796122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:56.798080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:56.806744 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95739e9a-a7e1-47bb-bb22-3ae8ac2e640d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1406 microversion: 2.20 time: 1.316966 Aug 04 04:52:56.814638 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2725/5338] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:55 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1406 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:52:57.365917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:57.366981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:57.374392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:57.374840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:57.375871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:57.380510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:57.842072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:57.843444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:57.862845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:57.865560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:57.866900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:57.868813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:58.748675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:58.758714 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5ac64663-0c61-487b-9424-ccfe366ed585 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 1.396810 Aug 04 04:52:58.762433 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2614/5339] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:57 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:52:59.377154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:59.389920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:59.391825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:52:59.394074 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f653bfc1-d66f-43b2-b291-d8699435dfc8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1406 microversion: 2.20 time: 1.556197 Aug 04 04:52:59.396636 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2726/5340] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:52:57 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1406 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:52:59.782069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:52:59.785550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:52:59.798551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:59.799415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:52:59.802199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:52:59.803512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:00.067981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:00.084017 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-54cc4088-b861-4e1c-97f2-53aa109150ce tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.306520 Aug 04 04:53:00.085748 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2615/5341] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:52:59 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:00.420234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:00.420858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:00.430558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:00.431054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:00.431842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:00.432838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:00.799694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3d24b4ac-4176-4f3e-9478-b5317e01050b req-3bd2a4b7-f72b-414d-9804-30028e095b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "name": "network-vif-plugged", "status": "completed", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:53:00.820969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3d24b4ac-4176-4f3e-9478-b5317e01050b req-3bd2a4b7-f72b-414d-9804-30028e095b29 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:00.821612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3d24b4ac-4176-4f3e-9478-b5317e01050b req-3bd2a4b7-f72b-414d-9804-30028e095b29 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:00.843860 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3d24b4ac-4176-4f3e-9478-b5317e01050b req-3bd2a4b7-f72b-414d-9804-30028e095b29 service nova] Creating event network-vif-plugged:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h2-851337-5 Aug 04 04:53:00.850568 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3d24b4ac-4176-4f3e-9478-b5317e01050b req-3bd2a4b7-f72b-414d-9804-30028e095b29 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056314 Aug 04 04:53:00.851650 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2616/5342] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:53:01.107797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:01.108751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:01.121182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:01.126602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:01.127702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:01.132516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:01.439791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:01.451378 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b54bab9-9a90-444a-a2b5-38ee5001cf04 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.348564 Aug 04 04:53:01.463985 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2617/5343] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:01 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:01.688623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:01.702866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:01.709117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:01.710797 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20e671da-cf7a-4925-aecf-0ae96b1230e1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1406 microversion: 2.20 time: 1.294165 Aug 04 04:53:01.712057 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2727/5344] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:00 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1406 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:02.482715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:02.483598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:02.497961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:02.503683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:02.504615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:02.509187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:02.743751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:02.745326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:02.755310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:02.756006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:02.757927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:02.758745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:02.860854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:02.879441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bcd080c-023f-472b-89de-918c95908771 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.401878 Aug 04 04:53:02.886493 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2618/5345] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:02 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:53:02.905065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2f1da8fb-bfed-40af-ae35-0bca004b56d2 req-24ed4949-f23a-4a9f-bec1-c5bbd6244140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0", "name": "network-vif-plugged", "status": "completed", "tag": "ffe6a653-0427-4f03-be1e-2692edd9a64e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:53:02.925047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2f1da8fb-bfed-40af-ae35-0bca004b56d2 req-24ed4949-f23a-4a9f-bec1-c5bbd6244140 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:02.928296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2f1da8fb-bfed-40af-ae35-0bca004b56d2 req-24ed4949-f23a-4a9f-bec1-c5bbd6244140 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:02.949382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2f1da8fb-bfed-40af-ae35-0bca004b56d2 req-24ed4949-f23a-4a9f-bec1-c5bbd6244140 service nova] Creating event network-vif-plugged:ffe6a653-0427-4f03-be1e-2692edd9a64e for instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 on n-h2-851337-5 Aug 04 04:53:02.960320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2f1da8fb-bfed-40af-ae35-0bca004b56d2 req-24ed4949-f23a-4a9f-bec1-c5bbd6244140 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059208 Aug 04 04:53:02.962921 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2619/5346] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:53:03.308893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:03.328049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:03.338453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:03.340726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f416a836-6ebe-4225-8701-cc35c78d223f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1598 microversion: 2.20 time: 0.602864 Aug 04 04:53:03.342058 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2728/5347] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:02 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1598 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:03.369405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07dde3ce-5a7c-443c-a8c9-1fc18f4fb9f1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:03.370395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07dde3ce-5a7c-443c-a8c9-1fc18f4fb9f1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:03.380291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07dde3ce-5a7c-443c-a8c9-1fc18f4fb9f1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:03.385900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07dde3ce-5a7c-443c-a8c9-1fc18f4fb9f1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:03.386936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07dde3ce-5a7c-443c-a8c9-1fc18f4fb9f1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:03.387499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07dde3ce-5a7c-443c-a8c9-1fc18f4fb9f1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:03.738022 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07dde3ce-5a7c-443c-a8c9-1fc18f4fb9f1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.373726 Aug 04 04:53:03.739311 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2620/5348] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:53:03 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-interface => generated 284 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:53:03.909849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:03.911212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:03.930213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:03.932186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:03.933527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:03.934757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:04.876711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:04.908779 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e045a40b-d6d5-4ee7-bf9b-2d0cfb10547d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1300 microversion: 2.1 time: 0.997476 Aug 04 04:53:04.914327 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2729/5349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:03 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1300 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:05.930378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:05.932753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:05.952575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:05.953282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:05.954919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:05.955522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:06.396472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:06.412740 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4914bd3-f351-40ab-aaff-3e39e65d2d4f tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1472 microversion: 2.1 time: 0.488458 Aug 04 04:53:06.413343 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2621/5350] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:05 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:06.438650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:06.439946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:06.454128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:06.455362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:06.462600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:06.463298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:06.834271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:06.848149 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6331f136-9595-479e-96e8-dd051f043f21 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1472 microversion: 2.1 time: 0.410627 Aug 04 04:53:06.858980 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2730/5351] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:06 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:06.872660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d10595f-acbd-4ef2-89a2-8b229b03616a tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:06.873567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d10595f-acbd-4ef2-89a2-8b229b03616a tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:06.882355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d10595f-acbd-4ef2-89a2-8b229b03616a tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:06.883109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d10595f-acbd-4ef2-89a2-8b229b03616a tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:06.884571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d10595f-acbd-4ef2-89a2-8b229b03616a tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:06.885255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d10595f-acbd-4ef2-89a2-8b229b03616a tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:07.465450 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d10595f-acbd-4ef2-89a2-8b229b03616a tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1623 microversion: 2.1 time: 0.596974 Aug 04 04:53:07.479142 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2622/5352] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:06 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1623 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:07.490981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-788d18da-95e8-475e-abfc-f1fd150a2a88 tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:07.491744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-788d18da-95e8-475e-abfc-f1fd150a2a88 tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:07.504317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-788d18da-95e8-475e-abfc-f1fd150a2a88 tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:07.506185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-788d18da-95e8-475e-abfc-f1fd150a2a88 tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:07.507116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-788d18da-95e8-475e-abfc-f1fd150a2a88 tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:07.508841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-788d18da-95e8-475e-abfc-f1fd150a2a88 tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:08.565010 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-788d18da-95e8-475e-abfc-f1fd150a2a88 tempest-TestSecurityGroupsBasicOps-1830844532 tempest-TestSecurityGroupsBasicOps-1830844532-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1913 microversion: 2.1 time: 1.073359 Aug 04 04:53:08.587410 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2731/5353] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:07 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1913 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:08.675316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-742a8ea6-370a-460c-bf8d-f3e00d520d6c req-236daba3-61f3-4607-911d-f4d8b3a35a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:53:08.700150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-742a8ea6-370a-460c-bf8d-f3e00d520d6c req-236daba3-61f3-4607-911d-f4d8b3a35a17 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:08.700911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-742a8ea6-370a-460c-bf8d-f3e00d520d6c req-236daba3-61f3-4607-911d-f4d8b3a35a17 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:08.733947 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-742a8ea6-370a-460c-bf8d-f3e00d520d6c req-236daba3-61f3-4607-911d-f4d8b3a35a17 service nova] Creating event network-changed:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h2-851337-5 Aug 04 04:53:08.749633 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-742a8ea6-370a-460c-bf8d-f3e00d520d6c req-236daba3-61f3-4607-911d-f4d8b3a35a17 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075797 Aug 04 04:53:08.754452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:08.755851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:08.767136 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2623/5354] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:53:08.778145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:08.778145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:08.778145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:08.778604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:08.850702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:53:08.958311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:09.082572 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b0eab85-8413-4f2d-ba21-ac528bd62226 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 204 len: 0 microversion: 2.1 time: 0.332738 Aug 04 04:53:09.083205 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2732/5355] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:53:08 2022] DELETE /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:53:09.092080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:09.093325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:09.106629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:09.107394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:09.108339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:09.111285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:09.165763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:09.501568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:09.512673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38c914af-d210-460d-bf56-599b330f34f8 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1478 microversion: 2.1 time: 0.424773 Aug 04 04:53:09.525016 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2624/5356] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:09 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1478 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:10.540716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:10.541456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:10.583952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:10.586187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:10.587474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:10.588068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:11.184714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:11.198925 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3cd51764-54f9-4c84-ab61-77dc2e0d8e63 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1478 microversion: 2.1 time: 0.662388 Aug 04 04:53:11.202876 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2733/5357] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:10 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1478 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:12.228248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:12.228855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:12.238368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:12.242394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:12.242851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:12.243679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:12.244098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:12.651556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c5c7ac0b-869f-4baa-a6d3-38f85cef59ff req-2efdd9cc-f7a5-40ce-a111-21906ad1e3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0", "name": "network-vif-deleted", "tag": "ffe6a653-0427-4f03-be1e-2692edd9a64e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:53:12.685317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:12.707419 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1216689d-bcac-4c5e-a6c6-ac82e8246dad tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 200 len: 1478 microversion: 2.1 time: 0.480102 Aug 04 04:53:12.707624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:12.712080 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2625/5358] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:12 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 1478 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:12.733627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5c7ac0b-869f-4baa-a6d3-38f85cef59ff req-2efdd9cc-f7a5-40ce-a111-21906ad1e3a7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:12.734729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5c7ac0b-869f-4baa-a6d3-38f85cef59ff req-2efdd9cc-f7a5-40ce-a111-21906ad1e3a7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:12.791491 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c5c7ac0b-869f-4baa-a6d3-38f85cef59ff req-2efdd9cc-f7a5-40ce-a111-21906ad1e3a7 service nova] Creating event network-vif-deleted:ffe6a653-0427-4f03-be1e-2692edd9a64e for instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 on n-h2-851337-5 Aug 04 04:53:12.818094 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c5c7ac0b-869f-4baa-a6d3-38f85cef59ff req-2efdd9cc-f7a5-40ce-a111-21906ad1e3a7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172532 Aug 04 04:53:12.823221 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2734/5359] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:53:13.741140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:13.741884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:13.763748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:13.764222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:13.768410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:13.770371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:13.813085 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] HTTP exception thrown: Instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 could not be found. Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Request method failure captured: Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 HTTP/1.1 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi60_-AbOst3geo8YZBq-WYi0rtrQMCyVpx8e7MBqNphlmqoar2tmluL4xvb7aoCp0j_kAHxCZVtkHx2joM8VmS2i4hvEOdQkFR1-sumVlPKEbcZHTd6sB7zMvAVrSPw8TtdtVwqdhLjWOIYaYs7BGivaDjrlib1u01WmoNXoP3Q30PTM Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 153fc403d7e14d50b2602a1ab14d0e06 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-263458366 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/153fc403d7e14d50b2602a1ab14d0e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/153fc403d7e14d50b2602a1ab14d0e06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/153fc403d7e14d50b2602a1ab14d0e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_153fc403d7e14d50b2602a1ab14d0e06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestSecurityGroupsBasicOps-263458366 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 153fc403d7e14d50b2602a1ab14d0e06 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-263458366 Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestSecurityGroupsBasicOps-263458366-project Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 7e754f29f87f48ae882c436a510b301c Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestSecurityGroupsBasicOps-263458366-project Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 could not be found. Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'd65d1fd7-2fb6-4405-aa69-bdeeace9f3e0'} Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 could not be found. Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 could not be found. Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:53:13.818497 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 could not be found. Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:53:13.822255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Returning 404 to user: Instance d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:53:13.822715 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-59f9db1b-ab36-4f0b-9846-d3f50a1ace30 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0" status: 404 len: 111 microversion: 2.1 time: 0.088753 Aug 04 04:53:13.824134 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2626/5360] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:13 2022] GET /compute/v2.1/servers/d65d1fd7-2fb6-4405-aa69-bdeeace9f3e0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:53:28.707436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:28.708328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:28.713070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:28.713914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:28.729609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:28.731527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:28.735315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:28.737314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:28.757098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-aa36ce60-6647-4f6c-9213-26e9de2f98df req-26624d13-8054-489d-9cef-6dff240f888f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b4899c-c255-48d2-abe9-bb2ed090b237", "tag": "fddfb507-06cf-4dd9-85fe-49331f2c0514"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:53:28.768424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:28.775752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:28.824288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aa36ce60-6647-4f6c-9213-26e9de2f98df req-26624d13-8054-489d-9cef-6dff240f888f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:28.824602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-aa36ce60-6647-4f6c-9213-26e9de2f98df req-26624d13-8054-489d-9cef-6dff240f888f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:28.840691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:53:28.871241 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-aa36ce60-6647-4f6c-9213-26e9de2f98df req-26624d13-8054-489d-9cef-6dff240f888f service nova] Creating event network-changed:fddfb507-06cf-4dd9-85fe-49331f2c0514 for instance 08b4899c-c255-48d2-abe9-bb2ed090b237 on n-h1-851337-5 Aug 04 04:53:28.880793 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-aa36ce60-6647-4f6c-9213-26e9de2f98df req-26624d13-8054-489d-9cef-6dff240f888f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127409 Aug 04 04:53:28.883322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2627/5361] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:53:29.024695 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff6095fe-f4e0-4a61-812d-6054daa7d108 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "DELETE /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 204 len: 0 microversion: 2.1 time: 0.319391 Aug 04 04:53:29.032258 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2735/5362] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:53:28 2022] DELETE /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:53:29.038638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:29.039558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:29.052009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:29.052477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:29.053280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:29.060242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:29.575794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:29.625765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-25e49358-e5f3-461f-821f-abf443b03c0d tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1768 microversion: 2.1 time: 0.587363 Aug 04 04:53:29.628358 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2628/5363] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:29 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1768 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:30.648747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:30.649513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:30.665743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:30.666202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:30.671181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:30.671852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:31.090736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:31.106316 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c98e9bda-2f18-41fe-bc39-2f06428e3de2 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1768 microversion: 2.1 time: 0.461864 Aug 04 04:53:31.113302 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2736/5364] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:30 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1768 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:32.135806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:32.137188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:32.145123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:32.145933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:32.146975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:32.151178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:32.708518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:32.720319 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32d61cc1-44a5-4c21-b99a-37b1350824c7 tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1768 microversion: 2.1 time: 0.588680 Aug 04 04:53:32.720908 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2629/5365] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:32 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1768 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:33.754115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:33.755331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:33.767056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:33.767673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:33.769935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:33.772090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:33.923439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e754f29f87f48ae882c436a510b301c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fc403d7e14d50b2602a1ab14d0e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:33.934217 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0006e41c-b908-4260-a05f-969af3421ddc tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 200 len: 1648 microversion: 2.1 time: 0.196179 Aug 04 04:53:33.948059 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2737/5366] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:33 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 1648 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:53:33.971339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-883802f2-6198-4425-926c-da181d59ba86 req-3de0961b-b417-4379-aaa5-3aec031b0a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b4899c-c255-48d2-abe9-bb2ed090b237", "name": "network-vif-deleted", "tag": "fddfb507-06cf-4dd9-85fe-49331f2c0514"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:53:33.997706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-883802f2-6198-4425-926c-da181d59ba86 req-3de0961b-b417-4379-aaa5-3aec031b0a8c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:33.998542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-883802f2-6198-4425-926c-da181d59ba86 req-3de0961b-b417-4379-aaa5-3aec031b0a8c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:34.038080 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-883802f2-6198-4425-926c-da181d59ba86 req-3de0961b-b417-4379-aaa5-3aec031b0a8c service nova] Creating event network-vif-deleted:fddfb507-06cf-4dd9-85fe-49331f2c0514 for instance 08b4899c-c255-48d2-abe9-bb2ed090b237 on n-h1-851337-5 Aug 04 04:53:34.045935 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-883802f2-6198-4425-926c-da181d59ba86 req-3de0961b-b417-4379-aaa5-3aec031b0a8c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077993 Aug 04 04:53:34.048903 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2630/5367] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:53:34.965902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:34.967334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] [instance: 08b4899c-c255-48d2-abe9-bb2ed090b237] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:34.976021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:34.980830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:34.981861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:34.982465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:35.010720 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] HTTP exception thrown: Instance 08b4899c-c255-48d2-abe9-bb2ed090b237 could not be found. Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Request method failure captured: Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 HTTP/1.1 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi60_-AbOst3geo8YZBq-WYi0rtrQMCyVpx8e7MBqNphlmqoar2tmluL4xvb7aoCp0j_kAHxCZVtkHx2joM8VmS2i4hvEOdQkFR1-sumVlPKEbcZHTd6sB7zMvAVrSPw8TtdtVwqdhLjWOIYaYs7BGivaDjrlib1u01WmoNXoP3Q30PTM Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 153fc403d7e14d50b2602a1ab14d0e06 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-263458366 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/153fc403d7e14d50b2602a1ab14d0e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/153fc403d7e14d50b2602a1ab14d0e06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/153fc403d7e14d50b2602a1ab14d0e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_153fc403d7e14d50b2602a1ab14d0e06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestSecurityGroupsBasicOps-263458366 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 153fc403d7e14d50b2602a1ab14d0e06 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-263458366 Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestSecurityGroupsBasicOps-263458366-project Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7e754f29f87f48ae882c436a510b301c Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestSecurityGroupsBasicOps-263458366-project Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 08b4899c-c255-48d2-abe9-bb2ed090b237 could not be found. Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '08b4899c-c255-48d2-abe9-bb2ed090b237'} Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b4899c-c255-48d2-abe9-bb2ed090b237 could not be found. Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b4899c-c255-48d2-abe9-bb2ed090b237 could not be found. Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:53:35.012555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b4899c-c255-48d2-abe9-bb2ed090b237 could not be found. Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Returning 404 to user: Instance 08b4899c-c255-48d2-abe9-bb2ed090b237 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-093f84de-323f-400e-b8b0-994a00eba79c tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237" status: 404 len: 111 microversion: 2.1 time: 0.062599 Aug 04 04:53:35.019228 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2738/5368] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:53:34 2022] GET /compute/v2.1/servers/08b4899c-c255-48d2-abe9-bb2ed090b237 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:53:39.564149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2c77299e-2ef7-4d28-ad1d-392ee16627c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:39.565531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2c77299e-2ef7-4d28-ad1d-392ee16627c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:39.630579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c77299e-2ef7-4d28-ad1d-392ee16627c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:39.631697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c77299e-2ef7-4d28-ad1d-392ee16627c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:39.635638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c77299e-2ef7-4d28-ad1d-392ee16627c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:39.636103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c77299e-2ef7-4d28-ad1d-392ee16627c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:39.734648 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2c77299e-2ef7-4d28-ad1d-392ee16627c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/ips" status: 200 len: 152 microversion: 2.20 time: 0.181058 Aug 04 04:53:39.739174 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2631/5369] 10.222.0.69 () {60 vars in 1289 bytes} [Thu Aug 4 04:53:39 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/ips => generated 152 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:53:43.304617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:53:43.305779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:43.318460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:43.322197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:43.323248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:43.323899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:43.384212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lazy-loading 'flavor' on Instance uuid 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:53:43.737791 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-facce5c3-0936-47d2-8182-d720abb92683 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/action" status: 202 len: 0 microversion: 2.20 time: 0.437368 Aug 04 04:53:43.739183 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2739/5370] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:53:43 2022] POST /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:53:43.751568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:43.758291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:43.771607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:43.772312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:43.773337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:43.773941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:44.191841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:44.213340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:44.216048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:44.220390 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a70c6312-4ed7-4933-b738-ce544b7239d0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.473482 Aug 04 04:53:44.226915 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2632/5371] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:43 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:45.255633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:45.256518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:45.274643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:45.276069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:45.277781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:45.280370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:45.723746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:45.733143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:45.735638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:45.747690 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9addc07-0806-4a9b-87e4-fef76a1a42de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.494093 Aug 04 04:53:45.750124 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2740/5372] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:45 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:46.785003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:46.786465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:46.809252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:46.812547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:46.814077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:46.815932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:47.052472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e80cce0-bb5b-4923-a1a2-73ea8ab39fff tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] Calling method '.version_select at 0x7f1919453a60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:47.106913 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e80cce0-bb5b-4923-a1a2-73ea8ab39fff tempest-TestSecurityGroupsBasicOps-263458366 tempest-TestSecurityGroupsBasicOps-263458366-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1948822269" status: 202 len: 0 microversion: 2.1 time: 0.057798 Aug 04 04:53:47.108763 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2741/5373] 10.222.0.69 () {58 vars in 1278 bytes} [Thu Aug 4 04:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1948822269 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:53:47.424898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:47.438537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:47.440294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:47.448657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a2acc5e8-d6e5-46ab-a52a-1774e40ba1de tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.671173 Aug 04 04:53:47.450544 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2633/5374] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:46 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:48.473668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:48.475141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:48.489091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:48.489761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:48.491938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:48.497169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:49.309839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:49.321093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:49.322621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:49.334472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76600711-7de2-4ff2-aca3-308fe59ec763 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.855600 Aug 04 04:53:49.335206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2742/5375] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:48 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:50.362301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:50.362927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:50.377712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:50.380424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:50.382554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:50.383033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:50.749446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:50.764547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:50.769045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:50.771940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12875e64-ac04-4420-9323-98fb0d96306c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.413720 Aug 04 04:53:50.773376 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2634/5376] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:50 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:51.798822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:51.799909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:51.830717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:51.833458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:51.838996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:51.841967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:52.557231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:52.573523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:52.579043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:52.585395 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f72dadf2-6895-4c0b-bc4b-edfb152ec0c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.790361 Aug 04 04:53:52.588585 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2743/5377] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:51 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:53.612991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:53.613596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:53.631565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:53.639706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:53.640832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:53.641431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:54.040264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:54.059315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:54.063887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:54.067762 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69f9fe47-597b-4399-9790-fb10a7d0e8f2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.456928 Aug 04 04:53:54.070083 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2635/5378] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:53 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:55.097475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:55.098117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:55.105657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:55.106530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:55.107697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:55.108358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:55.564665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:55.597262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:55.602224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:55.605869 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a48adbcc-9492-46f0-862a-5cf8bcadadb4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1744 microversion: 2.20 time: 0.511006 Aug 04 04:53:55.607964 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2744/5379] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:55 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1744 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:56.631850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:56.632532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:56.642995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:56.643800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:56.644956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:56.645670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:57.370736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:57.380921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:57.388282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:57.391797 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d841fff5-ce40-4a71-9c99-086ad727b61f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.764876 Aug 04 04:53:57.396414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2636/5380] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:56 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:58.423235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:58.425916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:58.445520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:58.446095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:58.447253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:58.449959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:58.777602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:58.799925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:58.802297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:53:58.809026 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35740a2e-dd2c-43ed-8977-8ab218baeb5e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.385951 Aug 04 04:53:58.810457 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2745/5381] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:58 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:53:59.833323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:53:59.833949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:53:59.848160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=21 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:59.850142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:59.850990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:59.856405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:53:59.856871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:53:59.918020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=51 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:54:00.211727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:00.242328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:00.245412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:00.247477 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb93200b-1ed5-4880-b5e2-410c51d2cf7d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.417935 Aug 04 04:54:00.249316 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2637/5382] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:53:59 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:01.281895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:01.283236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:01.303570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:54:01.309520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:01.316298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:01.317757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:01.318791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:01.322577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:54:02.375831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:02.386925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:02.389361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:02.390642 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ad6674c-fc60-4f98-a17e-36320f991b49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 1.115071 Aug 04 04:54:02.391265 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2746/5383] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:01 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:02.421512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-210021fe-b525-41ed-bde1-b0abe0c4b6eb req-f7a3a526-9719-4bf6-8d47-d5aff51f4ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "name": "network-vif-plugged", "status": "completed", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:54:02.464568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-210021fe-b525-41ed-bde1-b0abe0c4b6eb req-f7a3a526-9719-4bf6-8d47-d5aff51f4ac2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:02.468774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-210021fe-b525-41ed-bde1-b0abe0c4b6eb req-f7a3a526-9719-4bf6-8d47-d5aff51f4ac2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:02.527398 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-210021fe-b525-41ed-bde1-b0abe0c4b6eb req-f7a3a526-9719-4bf6-8d47-d5aff51f4ac2 service nova] Creating event network-vif-plugged:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h2-851337-5 Aug 04 04:54:02.551821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-210021fe-b525-41ed-bde1-b0abe0c4b6eb req-f7a3a526-9719-4bf6-8d47-d5aff51f4ac2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141294 Aug 04 04:54:02.552833 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2638/5384] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:54:03.417327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:03.419743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:03.443739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:03.446130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:03.447038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:03.451612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:04.758238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:04.777525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:04.781365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:04.799965 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7c31586c-fe8c-4ee9-811d-3c58b75bec3b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 1.384936 Aug 04 04:54:04.804792 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2747/5385] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:03 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:05.837095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:05.838435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:05.849032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:05.851337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:05.860418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:05.861287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:06.780327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:06.793151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:06.797891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:06.799914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81179fca-d42d-4ea9-bef4-3483751aa206 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.968221 Aug 04 04:54:06.807942 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2639/5386] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:05 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:07.836607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:07.838554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:07.887113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:07.900434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:07.907032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:07.911037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:08.287768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:08.303165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:08.310762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:08.312123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6564fc44-80a1-4740-956d-bed8763514a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.482026 Aug 04 04:54:08.322330 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2748/5387] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:07 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:54:09.344386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:09.346445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:09.358508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:09.358508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:09.359260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:09.382582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:09.997816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:10.011045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:10.020038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:10.021534 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e44770fb-75af-40aa-ab59-f5531b77d189 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.681647 Aug 04 04:54:10.022999 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2640/5388] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:09 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:11.062305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:11.062934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:11.073196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:11.073953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:11.078795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:11.080376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:11.449405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:11.459328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:11.462656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:11.464223 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b58923ef-42f4-4b92-b421-584594f50c76 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.406420 Aug 04 04:54:11.465083 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2749/5389] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:11 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:12.498163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:12.499599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:12.532304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:12.533304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:12.543796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:12.544266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:12.991088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:13.004202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:13.006051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:13.011415 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-583c5d2f-e417-4940-9600-4ff5f8f51f7e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.516238 Aug 04 04:54:13.014841 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2641/5390] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:12 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:14.044130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:14.044802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:14.069776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:14.070263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:14.084191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:14.084885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:14.966053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:15.000743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:15.002293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:15.034579 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9a2a1244-a464-44c1-bf44-5267828e94c7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.997199 Aug 04 04:54:15.035329 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2750/5391] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:14 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:16.060391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:16.061049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:16.072404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:16.072866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:16.073670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:16.074115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:16.810414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:16.822846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:16.831184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:16.832797 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b71c504-d8e0-4a1e-9f3b-dc83bcd9d52c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.776334 Aug 04 04:54:16.841656 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2642/5392] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:16 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:17.866476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:17.867148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:17.907095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:17.907562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:17.908368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:17.921341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:18.576243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:18.587034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:18.592640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:18.597858 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eaa2a646-5213-416e-a74e-075b58961a7a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.736177 Aug 04 04:54:18.631292 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2751/5393] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:17 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:19.637683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:19.642390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:19.659356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:19.659817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:19.660641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:19.661083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:20.190053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:20.204337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:20.208768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:20.210351 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cf32f07-033e-4168-95b6-0a49636bc1aa tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.576594 Aug 04 04:54:20.214045 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2643/5394] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:19 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:21.242800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:21.243480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:21.259089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:21.260474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:21.261621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:21.262800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:21.677874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:21.692854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:21.699935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:21.702063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74c5ccf2-c3be-4e13-973a-2699d5aa9c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.463907 Aug 04 04:54:21.748610 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2752/5395] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:21 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:22.754859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:22.755517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:22.776488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:22.780662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:22.783789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:22.792365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:23.221952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:23.238788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:23.241177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:23.246495 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b597e49f-a11d-4964-bcbe-b4bc753179be tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.495944 Aug 04 04:54:23.260134 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2644/5396] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:22 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:24.278663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:24.280076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:24.306768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:24.307294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:24.308111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:24.308534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:24.764947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:24.799503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:24.808946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:24.819426 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b137651d-49d4-4010-8518-19ba9e5ea760 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1739 microversion: 2.20 time: 0.545370 Aug 04 04:54:24.821811 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2753/5397] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:24 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1739 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:25.849817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:25.851358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:25.865724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:25.866872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:25.868078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:25.868889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:26.949319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:26.969236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:26.971973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:26.974627 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ee5d41a-5d1d-4a47-b7f7-2275043878f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1721 microversion: 2.20 time: 1.128640 Aug 04 04:54:26.975775 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2645/5398] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:25 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1721 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:28.009789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:28.011086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:28.029794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:28.031605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:28.035526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:28.036696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:28.550329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:28.563361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:28.568062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:28.570724 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf13f1d6-cee1-49db-bb6a-071d778eb3ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1721 microversion: 2.20 time: 0.572783 Aug 04 04:54:28.572417 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2754/5399] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:27 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1721 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:29.001880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-07f7a9fd-3301-43f6-b243-06b4830da607 req-a082abaa-aec1-4aa7-bc44-d620a1cd238d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "name": "network-vif-unplugged", "status": "completed", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:54:29.074503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-07f7a9fd-3301-43f6-b243-06b4830da607 req-a082abaa-aec1-4aa7-bc44-d620a1cd238d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:29.078549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-07f7a9fd-3301-43f6-b243-06b4830da607 req-a082abaa-aec1-4aa7-bc44-d620a1cd238d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:29.103335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-07f7a9fd-3301-43f6-b243-06b4830da607 req-a082abaa-aec1-4aa7-bc44-d620a1cd238d service nova] Creating event network-vif-unplugged:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h2-851337-5 Aug 04 04:54:29.119676 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-07f7a9fd-3301-43f6-b243-06b4830da607 req-a082abaa-aec1-4aa7-bc44-d620a1cd238d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138835 Aug 04 04:54:29.120889 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2646/5400] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:54:29.634891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:29.650339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:29.716579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:29.719480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:29.725925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:29.726404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:30.185783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:30.217863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:30.222236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:30.231624 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f526b40c-cd65-436f-a899-372b4056a541 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1664 microversion: 2.20 time: 0.613133 Aug 04 04:54:30.242985 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2755/5401] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:29 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1664 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:30.259566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6935198-3a83-41cf-97a3-1914fd9d61fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea0b2ee3-954a-464f-9cd9-a6756095ed3a"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:54:30.264576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6935198-3a83-41cf-97a3-1914fd9d61fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:30.283290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=20 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:54:30.286413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6935198-3a83-41cf-97a3-1914fd9d61fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:30.291389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6935198-3a83-41cf-97a3-1914fd9d61fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:30.292390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6935198-3a83-41cf-97a3-1914fd9d61fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:30.297109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6935198-3a83-41cf-97a3-1914fd9d61fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:30.354585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=52 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:54:30.905965 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6935198-3a83-41cf-97a3-1914fd9d61fd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.652674 Aug 04 04:54:30.906595 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2647/5402] 10.222.0.69 () {62 vars in 1364 bytes} [Thu Aug 4 04:54:30 2022] POST /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 188 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:54:31.191008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:54:31.191629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:31.211124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:31.212041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:31.213063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:31.213684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:31.282488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119343) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 04:54:31.445574 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02b025cc-c879-4b3a-bba7-0d11fcc468ae tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/action" status: 202 len: 0 microversion: 2.20 time: 0.258402 Aug 04 04:54:31.448819 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2756/5403] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:54:31 2022] POST /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:54:31.457514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:31.458539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:31.488749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:31.490381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:31.491733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:31.493538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:32.128077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:32.140216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:32.148460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:32.158773 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03f8aaf3-8f6b-4961-94e6-160a2a2470b4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1750 microversion: 2.20 time: 0.705671 Aug 04 04:54:32.160833 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2648/5404] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:31 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1750 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:33.197355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:33.197983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:33.218832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:54:33.228408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:33.228879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:33.229712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:33.230170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:33.254051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:54:34.093451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:34.107904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:34.109718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:34.113576 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a935a9af-d9a9-4029-b31e-5180af302ee1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1750 microversion: 2.20 time: 0.920337 Aug 04 04:54:34.120831 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2757/5405] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:33 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1750 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:35.150110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:35.150792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:35.168318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:35.171878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:35.175164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:35.176601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:35.904565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:35.937005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:35.939189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:35.953072 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d097e74a-bc87-41cf-8676-d2c09efd25e2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1752 microversion: 2.20 time: 0.805133 Aug 04 04:54:35.953697 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2649/5406] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:35 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1752 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:36.980133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:36.993154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:37.019579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:37.021154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:37.022242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:37.022902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:37.572880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:37.596061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:37.608415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:37.611081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92f61979-68e7-4690-a918-9097d603ad29 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1752 microversion: 2.20 time: 0.637471 Aug 04 04:54:37.621026 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2758/5407] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:36 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1752 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:38.642708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:38.644204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:38.659916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:38.660749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:38.663673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:38.664479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:39.562763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:39.571978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:39.576643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:39.588527 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-06d04dc8-07cc-468f-be74-a7578dcff9a0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1752 microversion: 2.20 time: 0.951487 Aug 04 04:54:39.589735 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2650/5408] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:38 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1752 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:40.624168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:40.625861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:40.649154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:40.651214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:40.652238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:40.653790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:41.419897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:41.442443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:41.448868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:41.451283 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-04c14f00-64fc-4f7b-a25f-bc065668b953 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1752 microversion: 2.20 time: 0.831391 Aug 04 04:54:41.455568 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2759/5409] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:40 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1752 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:42.488327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:42.490322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:42.501560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:42.504767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:42.505969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:42.506564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:43.550728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:43.560993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:43.568722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:43.576232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9849a179-9d41-4b87-90e2-ca973207e111 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1752 microversion: 2.20 time: 1.096333 Aug 04 04:54:43.578092 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2651/5410] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:42 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1752 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:44.602383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:44.603657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:44.628912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:44.629386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:44.633395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:44.633867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:45.271883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:45.289317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:45.294547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:45.296105 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22030280-b086-47ca-8e9b-962abccfc90f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1752 microversion: 2.20 time: 0.697849 Aug 04 04:54:45.298224 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2760/5411] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:44 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1752 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:46.329137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:46.330559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:46.342057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:46.342796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:46.344034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:46.344630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:46.798875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:46.822464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:46.830491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:46.836308 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8591f6b4-3e84-4830-8d96-bd574deb9042 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1752 microversion: 2.20 time: 0.518883 Aug 04 04:54:46.844661 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2652/5412] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:46 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1752 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:47.874694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:47.875642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:47.886451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:47.886914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:47.888383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:47.888833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:48.676104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:48.692249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:48.693968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:48.697982 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-59cd774f-48d3-49b3-8ab9-d686ba474c58 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.828055 Aug 04 04:54:48.705939 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2761/5413] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:47 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:49.151336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-dd93c242-47aa-4097-822c-23e468761772 req-478e71dd-189d-4fda-904f-d3a74e3120c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:54:49.172606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dd93c242-47aa-4097-822c-23e468761772 req-478e71dd-189d-4fda-904f-d3a74e3120c6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:49.173049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-dd93c242-47aa-4097-822c-23e468761772 req-478e71dd-189d-4fda-904f-d3a74e3120c6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:49.218628 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-dd93c242-47aa-4097-822c-23e468761772 req-478e71dd-189d-4fda-904f-d3a74e3120c6 service nova] Creating event network-changed:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h1-851337-5 Aug 04 04:54:49.234593 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-dd93c242-47aa-4097-822c-23e468761772 req-478e71dd-189d-4fda-904f-d3a74e3120c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086721 Aug 04 04:54:49.245441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2653/5414] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:54:49.724022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:49.724971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:49.749460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:49.750349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:49.751502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:49.752227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:50.293854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:50.315781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:50.324044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:50.327905 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-832dd4c8-225a-4f33-967e-27fcbbeade08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.607863 Aug 04 04:54:50.343772 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2762/5415] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:49 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:51.364536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:51.366082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:51.384127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:51.409822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:51.412527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:51.412977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:52.509926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:52.583634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:52.590853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:52.599510 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ccdaa32-d01b-4526-934c-ab9d21b5ebee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 1.234971 Aug 04 04:54:52.601271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2654/5416] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:51 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:54:53.626437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:53.627693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:53.643564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:53.644388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:53.646161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:53.648475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:54.524499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:54.533619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:54.544197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:54.545437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c64f03ba-311b-4149-80ef-cc2eb1a076f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.922972 Aug 04 04:54:54.546014 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2763/5417] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:53 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:55.573741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:55.575691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:55.606036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:55.629997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:55.636355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:55.638589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:56.897724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:56.915008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:56.921960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:56.926421 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6ba88fa-d771-44d4-8ede-75559f2cab40 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 1.357134 Aug 04 04:54:56.937447 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2655/5418] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:55 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:57.964178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:57.964798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:54:57.981719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:57.982210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:57.983202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:54:57.983645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:54:58.862154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:58.921095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:58.926937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:54:58.944659 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ec4a3d9a-b9e6-4fe6-9930-6ddb28d3512b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.978385 Aug 04 04:54:58.967857 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2764/5419] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:57 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:54:59.982586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:54:59.986087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:00.008791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:00.009987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:00.013138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:00.015614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:00.368740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:00.388992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:00.390507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:00.392013 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d9521f0e-8738-4f4e-8c6f-d8e31503ab1a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.416920 Aug 04 04:55:00.393317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2656/5420] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:54:59 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:01.422607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:01.423282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:01.439982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:01.447710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:01.452614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:01.454454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:01.875923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:01.889579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:01.911337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:01.912704 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83ca04b3-1e4c-4ec6-b7bc-ac963f44848e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.498360 Aug 04 04:55:01.913306 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2765/5421] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:01 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:02.938991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:02.939712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:02.952958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=20 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:02.956276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:02.956828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:02.968638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:02.969139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:02.979877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:03.302419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:03.322779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:03.331611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:03.332765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57698f2a-1a8d-43a6-86be-17aba0a294ab tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.399730 Aug 04 04:55:03.333340 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2657/5422] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:02 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:04.368908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:04.374766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:04.377292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=18 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:04.399940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:04.400612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:04.403785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:04.413461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:04.452329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=54 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:04.743570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:04.758672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:04.761515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:04.764789 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f5425e29-ebf6-4fb8-9342-35a594f1eb69 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.405381 Aug 04 04:55:04.766257 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2766/5423] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:04 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:05.795715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:05.797563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:05.809622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:05.820520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:05.827208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:05.827799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:06.388081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:06.414414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:06.425496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:06.431735 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-84c15db5-0fa1-4b48-b76c-8c744b2067a2 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.641902 Aug 04 04:55:06.448702 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2658/5424] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:05 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:07.456554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:07.457782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:07.488077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:07.488774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:07.489595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:07.490356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:07.847560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:07.865184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:07.867258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:07.868815 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b13c0b4-336a-42f0-9f65-149f17e64bcb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.416090 Aug 04 04:55:07.883181 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2767/5425] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:07 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:08.894287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:08.895948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:08.908128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:08.908888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:08.913855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:08.914729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:09.354281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:09.370869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:09.384485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:09.389550 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fe2ed92a-c883-4a69-b537-4b93d12afa1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.499193 Aug 04 04:55:09.392804 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2659/5426] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:08 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:10.423096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:10.424568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:10.447091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:10.450015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:10.453932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:10.457345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:10.792170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:10.811865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:10.827741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:10.828968 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-30df1ce1-1763-4ef8-9608-6004a442f56f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.418236 Aug 04 04:55:10.851862 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2768/5427] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:10 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:11.859275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:11.860092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:11.867644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:11.868094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:11.870643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:11.875442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:12.214633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:12.241106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:12.242719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:12.249866 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6783574-0b41-4096-9bca-e50de43a59f4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.388966 Aug 04 04:55:12.259077 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2660/5428] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:11 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:13.278425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:13.279235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:13.289408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:13.293881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:13.295074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:13.299880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:13.747775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:13.761667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:13.763936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:13.766670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b144930-3a3e-4877-99e1-35690aa9f015 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.492490 Aug 04 04:55:13.767913 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2769/5429] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:13 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:14.800380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:14.801002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:14.825960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:14.827623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:14.833344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:14.835290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:15.426893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:15.455075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:15.460526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:15.469212 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26c29576-2161-42dc-b298-638fdad17fa9 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.676723 Aug 04 04:55:15.472377 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2661/5430] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:14 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:16.501715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:16.502353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:16.531578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:16.531578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:16.531578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:16.531883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:16.985884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:17.004058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:17.006216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:17.008305 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1e8b36ee-9656-4faa-972d-2a1c53a19370 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.513828 Aug 04 04:55:17.027883 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2770/5431] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:16 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:18.040005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:18.040748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:18.061843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:18.062831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:18.065310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:18.066948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:18.358930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:18.374519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:18.376714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:18.381816 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3cb3fbb2-7a1d-49b1-a4b9-36edd16693b5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.347206 Aug 04 04:55:18.383131 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2662/5432] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:18 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:19.409365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:19.409937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:19.446933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:19.447673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:19.448673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:19.450025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:19.716014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:19.734301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:19.737934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:19.743587 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-504ae4fd-1239-4c4c-ab42-459f99c4db27 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.341132 Aug 04 04:55:19.746341 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2771/5433] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:19 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:20.772320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:20.773434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:20.805969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:20.808792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:20.814038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:20.815940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:21.230100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:21.249950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:21.256204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:21.260538 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bf8466fd-d26f-40b3-b521-31c97ca5dcc7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.492630 Aug 04 04:55:21.262704 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2663/5434] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:20 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:22.286569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:22.287289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:22.310348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:22.320535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:22.324142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:22.324974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:22.599321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-91427f70-0183-4114-b7b3-579315e39904 req-4953ec98-8f2f-4c22-b421-84b12591d27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "name": "network-vif-plugged", "status": "completed", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:55:22.620221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-91427f70-0183-4114-b7b3-579315e39904 req-4953ec98-8f2f-4c22-b421-84b12591d27e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:22.632796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-91427f70-0183-4114-b7b3-579315e39904 req-4953ec98-8f2f-4c22-b421-84b12591d27e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:22.676965 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-91427f70-0183-4114-b7b3-579315e39904 req-4953ec98-8f2f-4c22-b421-84b12591d27e service nova] Creating event network-vif-plugged:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h1-851337-5 Aug 04 04:55:22.686151 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-91427f70-0183-4114-b7b3-579315e39904 req-4953ec98-8f2f-4c22-b421-84b12591d27e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.555872 Aug 04 04:55:22.692145 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2772/5435] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:55:22.713034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:22.722543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:22.724124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:22.732947 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6fbe71a-77c7-495a-950a-16193eb802bd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.452044 Aug 04 04:55:22.734814 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2664/5436] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:22 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:55:23.760257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:23.760975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:23.792166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:23.793162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:23.794002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:23.794479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:24.015281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:24.039907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:24.041479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:24.043410 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-003dc4bf-87e9-4b45-9de2-10221e7178cc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.288758 Aug 04 04:55:24.044234 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2773/5437] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:23 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:25.068372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:25.069294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:25.087995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:25.090407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:25.098213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:25.099629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:25.407885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:25.421525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:25.423779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:25.425975 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e18c0f44-3f2d-4e56-a9c8-7494208da0c1 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1808 microversion: 2.20 time: 0.362744 Aug 04 04:55:25.426830 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2665/5438] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:25 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1808 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:26.452285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:26.452935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:26.466797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:26.470388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:26.474325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:26.474776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:26.785919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:26.798394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:26.800489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:26.802448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c483d1f7-4023-4225-82c0-b617d9542ced tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1795 microversion: 2.20 time: 0.356083 Aug 04 04:55:26.804028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2774/5439] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:55:26 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1795 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:55:55.794768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-861123074", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "58d16cb8-65dd-4089-9d25-8e5e78adee59"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:55:55.827925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=17 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:55.835430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=53 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:55.927513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] validate_networks() for [('58d16cb8-65dd-4089-9d25-8e5e78adee59', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:55:57.408790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:55:57.420222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:55:57.421246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:55:57.421939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:55:57.422829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:55:57.442295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:57.443297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:57.444509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:57.445655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:57.506337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Getting quotas for project 02f05596fde642fabe3a7fd0576708f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:55:57.512704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Getting quotas for user f9ca6bd981ef4b73a667a0d8eb8b228a and project 02f05596fde642fabe3a7fd0576708f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:55:57.538170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:55:57.540551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:55:57.680348 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ecdddae9-b817-4d6f-b23e-1bfd530d7d1c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890229 Aug 04 04:55:57.687625 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2666/5440] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:55:57.692738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d020cc80-f22a-4d47-a03f-582562339042 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:57.694308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d020cc80-f22a-4d47-a03f-582562339042 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:57.716541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=17 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:57.719847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=49 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:57.833048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d020cc80-f22a-4d47-a03f-582562339042 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:57.843893 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d020cc80-f22a-4d47-a03f-582562339042 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1213 microversion: 2.1 time: 0.155165 Aug 04 04:55:57.847437 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2775/5441] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:57 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1213 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:58.866410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:58.867713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:58.908738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:58.911465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:58.912609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:58.912935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:59.018606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:59.029371 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8279ecc4-6854-4d13-a2da-a3c29b40375a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1265 microversion: 2.1 time: 0.167055 Aug 04 04:55:59.030316 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2667/5442] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:58 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:00.052393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:00.052995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:00.072435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:00.073228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:00.076595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:00.078777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:00.387189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:00.397641 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c6fb6a03-bb70-4df6-952a-ba1c91e77933 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1271 microversion: 2.1 time: 0.348906 Aug 04 04:56:00.402076 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2776/5443] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:00 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:01.428357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:01.429000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:01.450788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:01.452526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:01.453524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:01.457983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:02.018191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:02.035168 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ea6374e-f5ee-41e3-85ef-be5128194c14 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1313 microversion: 2.1 time: 0.615596 Aug 04 04:56:02.038219 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2668/5444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:01 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:03.058198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:03.059760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:03.075759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:03.077130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:03.078932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:03.080384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:03.736365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:03.748155 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c125517-1326-4274-8567-69a3cf234aaf tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1313 microversion: 2.1 time: 0.693726 Aug 04 04:56:03.762339 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2777/5445] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:03 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:03.789719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0ed63d36-eed7-4d4f-99a2-b066bfacf663 req-19d638a5-b72f-44dd-8945-5af1a8f833af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a727a0-a045-4b95-b063-5cb4922009b0", "tag": "5c0aa17b-49d7-4f17-af00-53c7ce6791f7"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:03.808014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0ed63d36-eed7-4d4f-99a2-b066bfacf663 req-19d638a5-b72f-44dd-8945-5af1a8f833af service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:03.809530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0ed63d36-eed7-4d4f-99a2-b066bfacf663 req-19d638a5-b72f-44dd-8945-5af1a8f833af service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:03.844512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0ed63d36-eed7-4d4f-99a2-b066bfacf663 req-19d638a5-b72f-44dd-8945-5af1a8f833af service nova] Creating event network-changed:5c0aa17b-49d7-4f17-af00-53c7ce6791f7 for instance b0a727a0-a045-4b95-b063-5cb4922009b0 on n-h2-851337-5 Aug 04 04:56:03.852313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0ed63d36-eed7-4d4f-99a2-b066bfacf663 req-19d638a5-b72f-44dd-8945-5af1a8f833af service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.630981 Aug 04 04:56:03.854549 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2669/5446] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:56:04.771270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:04.771970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:04.782364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:04.782841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:04.783681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:04.784126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:05.273921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:05.287042 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-daa9c0db-a368-4041-9431-22a456622dba tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1313 microversion: 2.1 time: 0.520541 Aug 04 04:56:05.306340 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2778/5447] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:04 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:06.315153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:06.316821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:06.328042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:06.328499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:06.329295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:06.329895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:06.682829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:06.713455 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d15b6e24-a0bb-4b43-ab49-46d1b58e8546 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1313 microversion: 2.1 time: 0.389588 Aug 04 04:56:06.714838 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2670/5448] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:06 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:07.738273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:07.740351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:07.755024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:07.755807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:07.757155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:07.757812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:07.844140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:08.054516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:08.072655 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1655899b-c00a-4f13-94af-c7a9b977cd1b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1313 microversion: 2.1 time: 0.338686 Aug 04 04:56:08.093177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2779/5449] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:07 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:09.104987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:09.106745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:09.120051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:09.123664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:09.129843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:09.131014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:09.132002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:09.134162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:09.415010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:09.430408 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6555c231-5270-4d62-9c93-be660a81369a tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1313 microversion: 2.1 time: 0.333862 Aug 04 04:56:09.446863 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2671/5450] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:09 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:10.287586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8923ac27-cd52-456a-8be2-3d0f5f0feb85 req-ebc05093-0ce0-46fa-bbae-f55308935f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a727a0-a045-4b95-b063-5cb4922009b0", "name": "network-vif-plugged", "status": "completed", "tag": "5c0aa17b-49d7-4f17-af00-53c7ce6791f7"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:10.326327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8923ac27-cd52-456a-8be2-3d0f5f0feb85 req-ebc05093-0ce0-46fa-bbae-f55308935f28 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:10.329401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8923ac27-cd52-456a-8be2-3d0f5f0feb85 req-ebc05093-0ce0-46fa-bbae-f55308935f28 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:10.359650 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8923ac27-cd52-456a-8be2-3d0f5f0feb85 req-ebc05093-0ce0-46fa-bbae-f55308935f28 service nova] Creating event network-vif-plugged:5c0aa17b-49d7-4f17-af00-53c7ce6791f7 for instance b0a727a0-a045-4b95-b063-5cb4922009b0 on n-h2-851337-5 Aug 04 04:56:10.372064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8923ac27-cd52-456a-8be2-3d0f5f0feb85 req-ebc05093-0ce0-46fa-bbae-f55308935f28 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093347 Aug 04 04:56:10.390232 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2780/5451] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:56:10.457605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:10.458353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:10.511309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:10.512419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:10.514205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:10.516794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:10.905126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:10.916508 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7e29375-a778-4025-9aaa-976e21c22e4e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1313 microversion: 2.1 time: 0.462290 Aug 04 04:56:10.917659 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2672/5452] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:10 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:11.947612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:11.949488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:11.958076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:11.958938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:11.960190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:11.961098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:12.266745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:12.279849 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e362da01-e651-46c9-94b3-bc6d04b41fc5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1496 microversion: 2.1 time: 0.340464 Aug 04 04:56:12.290932 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2781/5453] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:11 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1496 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:13.062710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:13.063932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:13.073181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.074007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.075120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.076070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.151427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:56:13.356760 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-01ac0365-a1d4-4ce2-b452-102b1abc2368 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 204 len: 0 microversion: 2.1 time: 0.298341 Aug 04 04:56:13.357503 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2673/5454] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:56:13 2022] DELETE /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:56:13.366100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:13.366716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:13.376822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.378104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.380972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.382446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.705384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:13.716162 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-581424cd-b892-4583-9c03-2f42ab361399 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1502 microversion: 2.1 time: 0.354097 Aug 04 04:56:13.733144 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2782/5455] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:13 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1502 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:13.846140 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:56:13.847371 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 04:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:56:14.741996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:14.742772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:14.758115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:14.758445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:14.762321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:14.764463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:15.176797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:15.191978 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c70a8ab5-d36f-40d5-8b68-3e13d492c95c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1502 microversion: 2.1 time: 0.452889 Aug 04 04:56:15.192983 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2674/5456] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:14 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1502 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:15.812964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ba722b4e-4eab-4d0c-b325-9acf5c49e13f req-04dd0c74-d311-4159-bb6e-6b0406699572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a727a0-a045-4b95-b063-5cb4922009b0", "name": "network-vif-deleted", "tag": "5c0aa17b-49d7-4f17-af00-53c7ce6791f7"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:15.858397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ba722b4e-4eab-4d0c-b325-9acf5c49e13f req-04dd0c74-d311-4159-bb6e-6b0406699572 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:15.859216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ba722b4e-4eab-4d0c-b325-9acf5c49e13f req-04dd0c74-d311-4159-bb6e-6b0406699572 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:15.934022 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ba722b4e-4eab-4d0c-b325-9acf5c49e13f req-04dd0c74-d311-4159-bb6e-6b0406699572 service nova] Creating event network-vif-deleted:5c0aa17b-49d7-4f17-af00-53c7ce6791f7 for instance b0a727a0-a045-4b95-b063-5cb4922009b0 on n-h2-851337-5 Aug 04 04:56:15.963834 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ba722b4e-4eab-4d0c-b325-9acf5c49e13f req-04dd0c74-d311-4159-bb6e-6b0406699572 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151854 Aug 04 04:56:15.965010 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2783/5457] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:56:16.214753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:16.216100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:16.241911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:16.243377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:16.249315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:16.252993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:16.429054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:16.429863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:16.432369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lazy-loading 'fault' on Instance uuid b0a727a0-a045-4b95-b063-5cb4922009b0 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:56:16.614395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:16.635078 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f1ea4bc9-4531-43ab-ade4-a606a0622993 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 200 len: 1303 microversion: 2.1 time: 0.424096 Aug 04 04:56:16.651015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2675/5458] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:16 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 1303 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:17.659192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:17.659996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: b0a727a0-a045-4b95-b063-5cb4922009b0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:17.678607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:17.680010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:17.683319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:17.695743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:17.735333 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] HTTP exception thrown: Instance b0a727a0-a045-4b95-b063-5cb4922009b0 could not be found. Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Request method failure captured: Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 HTTP/1.1 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61FYuuwDnvIaLOmiXcS-nziL3oR0cR2-8ypq_t87iqlTv2fcA-L8FkTk5GoNTfFtyyXMHYenYv0KOOUmco2EVi_afm8sz-7oM_geLoF4Dr9PJ2orj50EXhdgShAbeNM128uGGkedHxqNcZfnDPdU8R7UuUEAmpfZ6iqiSTa4nAPTTo4 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 02f05596fde642fabe3a7fd0576708f6 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesActionsTest-1226295990 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/02f05596fde642fabe3a7fd0576708f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/02f05596fde642fabe3a7fd0576708f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/02f05596fde642fabe3a7fd0576708f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_02f05596fde642fabe3a7fd0576708f6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesActionsTest-1226295990 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 02f05596fde642fabe3a7fd0576708f6 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesActionsTest-1226295990 Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesActionsTest-1226295990-project Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f9ca6bd981ef4b73a667a0d8eb8b228a Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesActionsTest-1226295990-project Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b0a727a0-a045-4b95-b063-5cb4922009b0 could not be found. Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b0a727a0-a045-4b95-b063-5cb4922009b0'} Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a727a0-a045-4b95-b063-5cb4922009b0 could not be found. Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a727a0-a045-4b95-b063-5cb4922009b0 could not be found. Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:56:17.745409 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a727a0-a045-4b95-b063-5cb4922009b0 could not be found. Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Returning 404 to user: Instance b0a727a0-a045-4b95-b063-5cb4922009b0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:56:17.752735 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd19d04f-13ed-402a-a865-186814597f04 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0" status: 404 len: 111 microversion: 2.1 time: 0.093124 Aug 04 04:56:17.763532 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2784/5459] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:17 2022] GET /compute/v2.1/servers/b0a727a0-a045-4b95-b063-5cb4922009b0 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:56:17.976848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1415064146", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "58d16cb8-65dd-4089-9d25-8e5e78adee59"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:18.140112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] validate_networks() for [('58d16cb8-65dd-4089-9d25-8e5e78adee59', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:56:18.959133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:56:18.959566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:56:18.960580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:56:18.961041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:56:18.961482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:56:18.980997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:18.982088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:18.986648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:18.987862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:19.031309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Getting quotas for project 02f05596fde642fabe3a7fd0576708f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:56:19.039400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Getting quotas for user f9ca6bd981ef4b73a667a0d8eb8b228a and project 02f05596fde642fabe3a7fd0576708f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:56:19.058188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:56:19.062028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:56:19.099483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-664387125", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "59d28a97-84af-47e8-93a9-e1ef60e1510b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:19.156223 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-130373e5-ee4c-4c9c-af01-55250e4f1d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184722 Aug 04 04:56:19.161685 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2676/5460] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:56:19.187461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c90c7f1b-0156-4cb2-aa46-6455a2c495fb tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:19.188337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c90c7f1b-0156-4cb2-aa46-6455a2c495fb tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:19.253546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:56:19.304070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c90c7f1b-0156-4cb2-aa46-6455a2c495fb tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:19.312121 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c90c7f1b-0156-4cb2-aa46-6455a2c495fb tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1214 microversion: 2.1 time: 0.139614 Aug 04 04:56:19.312712 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2677/5461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:19 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:20.013124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:56:20.013559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:56:20.014045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:56:20.015261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:56:20.015937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:56:20.032887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.049897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.051373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.051898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.075002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:56:20.082248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:56:20.216219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:56:20.218560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59d28a97-84af-47e8-93a9-e1ef60e1510b',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:56:20.332840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:20.334671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:20.347398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.349854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.351890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.353858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.489932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:20.502769 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4e3d93c5-a426-4666-8e82-06c59a66821b tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1210 microversion: 2.1 time: 0.174225 Aug 04 04:56:20.503400 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2678/5462] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:20 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1210 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:20.565362 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-264da482-dd19-48ec-998e-c6b7fafcbc5c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470253 Aug 04 04:56:20.566011 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2785/5463] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:56:20.577537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-db61bfb4-2474-4044-ac98-3e3495d67f7a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:20.578241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-db61bfb4-2474-4044-ac98-3e3495d67f7a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:20.705413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-db61bfb4-2474-4044-ac98-3e3495d67f7a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:20.716855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-db61bfb4-2474-4044-ac98-3e3495d67f7a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1056 microversion: 2.1 time: 0.142932 Aug 04 04:56:20.719649 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2679/5464] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:20 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1056 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:21.531482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:21.532988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:21.577093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:21.577549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:21.578369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:21.578817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:21.735250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:21.744430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:21.745034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:21.767154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:21.768858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:21.772455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:21.773546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:21.774237 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-baca169b-4846-4e5c-a40c-35756774c1ed tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1272 microversion: 2.1 time: 0.249833 Aug 04 04:56:21.789286 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2786/5465] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:21 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:21.935750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:21.962689 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8b9d3c3e-756b-4ca5-a330-93f694e3aaa1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1098 microversion: 2.1 time: 0.224260 Aug 04 04:56:21.970117 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2680/5466] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:21 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1098 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:22.800896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:22.802451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:22.832711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:22.834309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:22.835882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:22.839519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:22.957038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34a64bbd-ecd1-4a01-8c3e-c56d6026523c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:22.963188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34a64bbd-ecd1-4a01-8c3e-c56d6026523c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:22.977331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a64bbd-ecd1-4a01-8c3e-c56d6026523c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:22.979499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a64bbd-ecd1-4a01-8c3e-c56d6026523c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:22.981691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a64bbd-ecd1-4a01-8c3e-c56d6026523c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:22.987131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34a64bbd-ecd1-4a01-8c3e-c56d6026523c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.093755 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34a64bbd-ecd1-4a01-8c3e-c56d6026523c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments/ea0b2ee3-954a-464f-9cd9-a6756095ed3a" status: 200 len: 194 microversion: 2.20 time: 0.142519 Aug 04 04:56:23.094775 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2681/5467] 10.222.0.69 () {60 vars in 1454 bytes} [Thu Aug 4 04:56:22 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments/ea0b2ee3-954a-464f-9cd9-a6756095ed3a => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:56:23.128448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:23.130293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:23.155521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.155982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.163174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.170794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.213885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:23.232356 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1861946d-68ca-4883-b4a9-9762b0d4cd28 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.428787 Aug 04 04:56:23.233801 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2787/5468] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:22 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:23.276066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:23.276582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:23.301357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.301817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.302612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.303114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.344028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:23.359584 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc27cdef-75e5-459c-b484-a60d40b7a44f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1172 microversion: 2.1 time: 0.263481 Aug 04 04:56:23.360430 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2682/5469] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:23 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1172 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:23.557977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lazy-loading 'services' on Instance uuid 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:56:23.703674 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7849bc13-416c-434d-b2fd-cb4fb2264ea7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments/ea0b2ee3-954a-464f-9cd9-a6756095ed3a" status: 202 len: 0 microversion: 2.20 time: 0.431921 Aug 04 04:56:23.704932 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2788/5470] 10.222.0.69 () {60 vars in 1457 bytes} [Thu Aug 4 04:56:23 2022] DELETE /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments/ea0b2ee3-954a-464f-9cd9-a6756095ed3a => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:56:23.716874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8db4ac06-1d74-4868-a321-b06b44cea449 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:23.720328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8db4ac06-1d74-4868-a321-b06b44cea449 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:23.766175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db4ac06-1d74-4868-a321-b06b44cea449 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.768456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db4ac06-1d74-4868-a321-b06b44cea449 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.771467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db4ac06-1d74-4868-a321-b06b44cea449 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.772182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8db4ac06-1d74-4868-a321-b06b44cea449 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.868224 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8db4ac06-1d74-4868-a321-b06b44cea449 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158174 Aug 04 04:56:23.869426 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2683/5471] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:23 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:24.273052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:24.273859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:24.307386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.307841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.308643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.315695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.395463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:24.401549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:24.434099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.443768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.445900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.447132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.483402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:24.776861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:24.816004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dea8bf1a-9faf-4a23-bc26-27aec657ee2c tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.534105 Aug 04 04:56:24.818322 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2789/5472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:24 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:24.884426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-138690e4-ba04-4c73-9352-cded88aaae92 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:24.888032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-138690e4-ba04-4c73-9352-cded88aaae92 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:24.929621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-138690e4-ba04-4c73-9352-cded88aaae92 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.935620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-138690e4-ba04-4c73-9352-cded88aaae92 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.939114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-138690e4-ba04-4c73-9352-cded88aaae92 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.947365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-138690e4-ba04-4c73-9352-cded88aaae92 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:25.004245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:25.016523 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b09d0ab-4842-4d02-9102-e7c256a44c5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.628068 Aug 04 04:56:25.027530 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2684/5473] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:24 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:25.059700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-138690e4-ba04-4c73-9352-cded88aaae92 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180975 Aug 04 04:56:25.065550 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2790/5474] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:24 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:25.679716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8a2e3106-5186-48f1-8db0-214d4621269e req-3a9756be-9e01-497e-bb6e-573d0fbf1d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb3f110b-6eba-47f2-835b-cd118b97ec8c", "tag": "42389ef5-40c5-43dc-862d-9f9f55679dcd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:25.717196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8a2e3106-5186-48f1-8db0-214d4621269e req-3a9756be-9e01-497e-bb6e-573d0fbf1d66 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:25.718473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8a2e3106-5186-48f1-8db0-214d4621269e req-3a9756be-9e01-497e-bb6e-573d0fbf1d66 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:25.739283 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8a2e3106-5186-48f1-8db0-214d4621269e req-3a9756be-9e01-497e-bb6e-573d0fbf1d66 service nova] Creating event network-changed:42389ef5-40c5-43dc-862d-9f9f55679dcd for instance bb3f110b-6eba-47f2-835b-cd118b97ec8c on n-h2-851337-5 Aug 04 04:56:25.760820 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8a2e3106-5186-48f1-8db0-214d4621269e req-3a9756be-9e01-497e-bb6e-573d0fbf1d66 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071504 Aug 04 04:56:25.762079 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2685/5475] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:56:25.839850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:25.840465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:25.854066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:25.855758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:25.857121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:25.857721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.040963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:26.041849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:26.045042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:26.058798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.059423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.060445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.061092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.087641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:26.097936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8a3af4b-c5b2-484c-a97f-e862dab39b79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.262461 Aug 04 04:56:26.133817 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2791/5476] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:25 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:26.145845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2b59e0a7-bff1-400e-9e95-50edf3db621b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:26.151797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2b59e0a7-bff1-400e-9e95-50edf3db621b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:26.164350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b59e0a7-bff1-400e-9e95-50edf3db621b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.169439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b59e0a7-bff1-400e-9e95-50edf3db621b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.170558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b59e0a7-bff1-400e-9e95-50edf3db621b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.171266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b59e0a7-bff1-400e-9e95-50edf3db621b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.239398 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2b59e0a7-bff1-400e-9e95-50edf3db621b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101573 Aug 04 04:56:26.245590 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2792/5477] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:26 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:26.327695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:26.340044 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-610ff2d3-ec7e-4f95-95bb-3e5ce3c03df1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.303374 Aug 04 04:56:26.346318 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2686/5478] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:26 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:27.126518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:27.127189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:27.140685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.141138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.141958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.142548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.258793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bfbac4cc-a910-417b-9792-fda14646af85 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:27.261764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfbac4cc-a910-417b-9792-fda14646af85 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:27.272366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfbac4cc-a910-417b-9792-fda14646af85 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.273241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfbac4cc-a910-417b-9792-fda14646af85 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.274254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfbac4cc-a910-417b-9792-fda14646af85 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.275026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfbac4cc-a910-417b-9792-fda14646af85 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.316653 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bfbac4cc-a910-417b-9792-fda14646af85 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062308 Aug 04 04:56:27.317610 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2687/5479] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:27 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:27.364381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:27.365174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:27.380744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.381200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.382000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.382626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.389727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:27.403030 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c4411b8-6437-4ee1-8beb-340bb50c423e tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.280992 Aug 04 04:56:27.404007 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2793/5480] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:27 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:27.585613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:27.596814 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e85d5ee5-991f-4719-9f21-7543bf479f12 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.236346 Aug 04 04:56:27.598544 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2688/5481] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:27 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:27.783554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-38891eab-6449-475e-9dda-65b25f1fd883 req-fa2e0560-29d1-4020-9ee5-d8853a601fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a1037f-e873-4349-87f4-9c07bb35c30b", "tag": "5fa0e774-771e-4c26-9e8b-1185eeb8fc7e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:27.795841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:27.810288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-38891eab-6449-475e-9dda-65b25f1fd883 req-fa2e0560-29d1-4020-9ee5-d8853a601fe6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.810796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-38891eab-6449-475e-9dda-65b25f1fd883 req-fa2e0560-29d1-4020-9ee5-d8853a601fe6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.814422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:27.859277 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-38891eab-6449-475e-9dda-65b25f1fd883 req-fa2e0560-29d1-4020-9ee5-d8853a601fe6 service nova] Creating event network-changed:5fa0e774-771e-4c26-9e8b-1185eeb8fc7e for instance 88a1037f-e873-4349-87f4-9c07bb35c30b on n-h1-851337-5 Aug 04 04:56:27.892997 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-38891eab-6449-475e-9dda-65b25f1fd883 req-fa2e0560-29d1-4020-9ee5-d8853a601fe6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110978 Aug 04 04:56:27.898523 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2794/5482] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:56:28.329375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76bf573b-ff07-4eeb-89e0-27a75df5d485 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:28.331624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76bf573b-ff07-4eeb-89e0-27a75df5d485 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:28.340310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76bf573b-ff07-4eeb-89e0-27a75df5d485 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.340676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76bf573b-ff07-4eeb-89e0-27a75df5d485 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.341522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76bf573b-ff07-4eeb-89e0-27a75df5d485 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.341975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76bf573b-ff07-4eeb-89e0-27a75df5d485 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.392108 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76bf573b-ff07-4eeb-89e0-27a75df5d485 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066757 Aug 04 04:56:28.401042 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2689/5483] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:28 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:28.444792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:28.446852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:28.455777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.456569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.457591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.458227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.621762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:28.622623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:28.639336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.640596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.643962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.644545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.722677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:28.736228 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-86ecfe55-5242-4bc6-abca-689eb7f84ab2 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.307522 Aug 04 04:56:28.737527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2795/5484] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:28 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:28.890506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:28.898299 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5ad31574-1f5f-4c07-91af-ab8133e69396 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.282479 Aug 04 04:56:28.912038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2690/5485] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:28 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:29.408931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b5f53557-ed38-424f-a065-8906a3fdcacb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:29.411744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b5f53557-ed38-424f-a065-8906a3fdcacb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:29.421977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5f53557-ed38-424f-a065-8906a3fdcacb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.422669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5f53557-ed38-424f-a065-8906a3fdcacb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.423654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5f53557-ed38-424f-a065-8906a3fdcacb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.424382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b5f53557-ed38-424f-a065-8906a3fdcacb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.461724 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b5f53557-ed38-424f-a065-8906a3fdcacb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057780 Aug 04 04:56:29.467815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2796/5486] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:29 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:29.759018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:29.759730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:29.761932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:29.768797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.769569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.770281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.770886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.918087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:29.919945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:29.920813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:29.926155 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec13ffbd-def7-4bf0-abd8-5d8811538d79 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.171933 Aug 04 04:56:29.927288 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2691/5487] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:29 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:29.936921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.937748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.938740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.939387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:30.064255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:30.090684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:30.110799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:30.119588 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b43406bf-998e-4ea8-bff7-0de75fe3d103 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.203850 Aug 04 04:56:30.120426 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2797/5488] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:29 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:30.476017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cf5db0c8-0e54-4774-b913-3befc8aabf74 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:30.479110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cf5db0c8-0e54-4774-b913-3befc8aabf74 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:30.485804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf5db0c8-0e54-4774-b913-3befc8aabf74 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:30.486267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf5db0c8-0e54-4774-b913-3befc8aabf74 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:30.487315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf5db0c8-0e54-4774-b913-3befc8aabf74 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:30.487763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf5db0c8-0e54-4774-b913-3befc8aabf74 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:30.520865 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cf5db0c8-0e54-4774-b913-3befc8aabf74 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049271 Aug 04 04:56:30.522046 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2692/5489] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:30 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:30.961744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:30.962371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:30.969984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:30.970579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:30.971402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:30.971841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.116561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:31.125591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7444d6ec-f166-475b-a2cc-4c140e14d1e5 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.167692 Aug 04 04:56:31.126717 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2798/5490] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:30 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:31.140575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:31.142019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:31.144293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:31.151226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.151936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.152807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.153320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.290375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:31.298472 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-166ac61b-b924-4f34-a97a-9915feaf798e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.162274 Aug 04 04:56:31.299072 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2693/5491] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:31 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:31.534230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a2e18ce-ba36-4202-9581-24625d74c355 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:31.536469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a2e18ce-ba36-4202-9581-24625d74c355 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:31.547215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a2e18ce-ba36-4202-9581-24625d74c355 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.547976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a2e18ce-ba36-4202-9581-24625d74c355 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.549411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a2e18ce-ba36-4202-9581-24625d74c355 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.550163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a2e18ce-ba36-4202-9581-24625d74c355 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.592851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a2e18ce-ba36-4202-9581-24625d74c355 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062797 Aug 04 04:56:31.594358 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2799/5492] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:31 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:31.623502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-48166fac-db3c-4d4e-949a-dc500c7aa44a req-e40f5f62-cd99-498b-905d-92d215e70905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3f110b-6eba-47f2-835b-cd118b97ec8c", "name": "network-vif-plugged", "status": "completed", "tag": "42389ef5-40c5-43dc-862d-9f9f55679dcd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:31.650541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-48166fac-db3c-4d4e-949a-dc500c7aa44a req-e40f5f62-cd99-498b-905d-92d215e70905 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.652736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-48166fac-db3c-4d4e-949a-dc500c7aa44a req-e40f5f62-cd99-498b-905d-92d215e70905 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.670646 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-48166fac-db3c-4d4e-949a-dc500c7aa44a req-e40f5f62-cd99-498b-905d-92d215e70905 service nova] Creating event network-vif-plugged:42389ef5-40c5-43dc-862d-9f9f55679dcd for instance bb3f110b-6eba-47f2-835b-cd118b97ec8c on n-h2-851337-5 Aug 04 04:56:31.682441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-48166fac-db3c-4d4e-949a-dc500c7aa44a req-e40f5f62-cd99-498b-905d-92d215e70905 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066475 Aug 04 04:56:31.683294 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2694/5493] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:56:32.147324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:32.147949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:32.155909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.156295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.157127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.157574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.310015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:32.317827 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8b07d66-beb0-413e-b3f0-9c21feb356c3 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1314 microversion: 2.1 time: 0.174401 Aug 04 04:56:32.324702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:32.325522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:32.328951 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2800/5494] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:32 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:32.339324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.339990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.340955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.341976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.504820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:32.513741 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2483c069-663d-4376-8470-f41cd519d608 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.193957 Aug 04 04:56:32.514423 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2695/5495] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:32 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:32.605766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f492bab4-5f71-40a6-b53b-8fc81b9a36a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:32.608443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f492bab4-5f71-40a6-b53b-8fc81b9a36a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:32.615231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f492bab4-5f71-40a6-b53b-8fc81b9a36a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.615693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f492bab4-5f71-40a6-b53b-8fc81b9a36a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.616463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f492bab4-5f71-40a6-b53b-8fc81b9a36a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.616895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f492bab4-5f71-40a6-b53b-8fc81b9a36a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.649071 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f492bab4-5f71-40a6-b53b-8fc81b9a36a8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047265 Aug 04 04:56:32.650172 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2801/5496] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:32 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:56:33.350540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:33.351436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:33.363278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.364226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.366195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.367023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.536129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:33.537576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:33.549518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.550239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.551518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.552205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.681635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:33.704826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1e655ff8-904f-4b29-b0e9-0a67e3d5f009 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1498 microversion: 2.1 time: 0.359290 Aug 04 04:56:33.706118 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2696/5497] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:33 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1498 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:33.712273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-366c5fbd-8c59-4d60-8f8d-2c5511f04963 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:33.735723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-366c5fbd-8c59-4d60-8f8d-2c5511f04963 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:33.764661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366c5fbd-8c59-4d60-8f8d-2c5511f04963 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.765122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366c5fbd-8c59-4d60-8f8d-2c5511f04963 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.765931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366c5fbd-8c59-4d60-8f8d-2c5511f04963 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.767927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-366c5fbd-8c59-4d60-8f8d-2c5511f04963 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.809646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:33.824659 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-974715f8-fa4f-45de-ac7d-323f500f45e8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.292571 Aug 04 04:56:33.825890 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2802/5498] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:33 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:33.827729 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-366c5fbd-8c59-4d60-8f8d-2c5511f04963 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.120036 Aug 04 04:56:33.828322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2697/5499] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:56:33 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:34.064682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:34.065200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:34.076890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.077352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.078152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.078603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.131790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:56:34.304012 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41e19adf-8b7b-42e4-aa86-453acd61b772 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 204 len: 0 microversion: 2.20 time: 0.242481 Aug 04 04:56:34.305146 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2803/5500] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:56:34 2022] DELETE /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:56:34.315238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:34.315238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:34.327777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.328524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.329775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.330401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.610928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:34.634094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:34.634094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:34.634094 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-97a982a1-d1b4-4176-bbca-6a2fc4b22f14 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.321339 Aug 04 04:56:34.634094 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2698/5501] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:34 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:34.641158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:34.641751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:34.655546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.655993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.656779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.657212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.734192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:56:34.849843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:34.850467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:34.860028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.860655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.865942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.866448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.932943 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a141b01d-f24d-4086-900e-6522e9a83585 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 204 len: 0 microversion: 2.1 time: 0.295697 Aug 04 04:56:34.934982 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2804/5502] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:56:34 2022] DELETE /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:56:34.952432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:34.960014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:34.979337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.980033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.981005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.981615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:35.235517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:35.248636 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38554f65-9488-444c-a337-92449a8ec590 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1504 microversion: 2.1 time: 0.309674 Aug 04 04:56:35.252678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:35.254797 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2805/5503] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:34 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:35.260547 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-94d4df00-6a96-4127-98a1-1cd02502e41d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1214 microversion: 2.1 time: 0.415932 Aug 04 04:56:35.268970 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2699/5504] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:34 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:35.662589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:35.663946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:35.675808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:35.676631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:35.678322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:35.679224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:35.846270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:35.855534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:35.857374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:35.858891 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b1c75993-9d3a-4c85-b305-7b20a098a4fc tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.201000 Aug 04 04:56:35.871733 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2806/5505] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:35 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:36.272675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:36.273243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:36.283542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:36.284328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:36.290470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.290935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.291770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.292216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.295530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.296425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.297467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.299722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.573289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:36.584570 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cff9cc57-9658-4679-ae47-3b38ef51a7d1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.307113 Aug 04 04:56:36.593206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2807/5506] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:36 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:36.602925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:36.652322 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ffa8d30-7dbf-44fb-a0cd-7d7cb066de89 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1504 microversion: 2.1 time: 0.378548 Aug 04 04:56:36.656882 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2700/5507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:36 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:36.760905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0ab44000-35a6-4171-aab3-926c6bdbca44 req-dc99e0fb-8529-4b55-a19f-670cbfd4529d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3f110b-6eba-47f2-835b-cd118b97ec8c", "name": "network-vif-deleted", "tag": "42389ef5-40c5-43dc-862d-9f9f55679dcd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:36.792222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0ab44000-35a6-4171-aab3-926c6bdbca44 req-dc99e0fb-8529-4b55-a19f-670cbfd4529d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.793097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0ab44000-35a6-4171-aab3-926c6bdbca44 req-dc99e0fb-8529-4b55-a19f-670cbfd4529d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.796499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:36.817024 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0ab44000-35a6-4171-aab3-926c6bdbca44 req-dc99e0fb-8529-4b55-a19f-670cbfd4529d service nova] Creating event network-vif-deleted:42389ef5-40c5-43dc-862d-9f9f55679dcd for instance bb3f110b-6eba-47f2-835b-cd118b97ec8c on n-h2-851337-5 Aug 04 04:56:36.829986 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0ab44000-35a6-4171-aab3-926c6bdbca44 req-dc99e0fb-8529-4b55-a19f-670cbfd4529d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073273 Aug 04 04:56:36.831297 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2808/5508] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:56:36.886996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:36.888725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:36.911615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.913334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.916349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.917658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.299231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:37.311005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:37.312641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:37.314076 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4c79c8b-8a85-4c3d-9415-3a3977bf4837 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1723 microversion: 2.20 time: 0.434393 Aug 04 04:56:37.326981 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2701/5509] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:36 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:37.607533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:37.608246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:37.624755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.625216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.626311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.627093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.683864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:37.684961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:37.697403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.698287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.699394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.701286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.770410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:37.838291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.838772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.839284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lazy-loading 'fault' on Instance uuid bb3f110b-6eba-47f2-835b-cd118b97ec8c {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:56:38.136190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca6bd981ef4b73a667a0d8eb8b228a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f05596fde642fabe3a7fd0576708f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:38.145361 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ccfcd9e-1747-4ae5-889d-feb6ce4be302 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 200 len: 1304 microversion: 2.1 time: 0.464694 Aug 04 04:56:38.150764 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2702/5510] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:37 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 1304 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:38.277239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:38.293460 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d901c988-e5c7-49b2-9472-7c93fee37990 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.688773 Aug 04 04:56:38.297015 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2809/5511] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:37 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:38.339525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:38.341715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:38.356875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:38.357719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:38.361887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:38.362641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:38.503288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:38.516012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:38.517509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:38.518667 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0762cbf0-c977-45ae-af96-5a9fa055321a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1656 microversion: 2.20 time: 0.184390 Aug 04 04:56:38.532016 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2703/5512] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:38 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1656 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:39.079924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c2f27f7f-db9d-498d-8e3c-1eb28fdaa531 req-3885c0cb-e774-4925-945c-b720ff5eebbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289", "name": "network-vif-deleted", "tag": "64039985-db62-4ab1-998c-86b56d726cb9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:39.124272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c2f27f7f-db9d-498d-8e3c-1eb28fdaa531 req-3885c0cb-e774-4925-945c-b720ff5eebbd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.128352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c2f27f7f-db9d-498d-8e3c-1eb28fdaa531 req-3885c0cb-e774-4925-945c-b720ff5eebbd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.156600 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c2f27f7f-db9d-498d-8e3c-1eb28fdaa531 req-3885c0cb-e774-4925-945c-b720ff5eebbd service nova] Creating event network-vif-deleted:64039985-db62-4ab1-998c-86b56d726cb9 for instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 on n-h1-851337-5 Aug 04 04:56:39.168338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:39.169024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] [instance: bb3f110b-6eba-47f2-835b-cd118b97ec8c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:39.176205 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c2f27f7f-db9d-498d-8e3c-1eb28fdaa531 req-3885c0cb-e774-4925-945c-b720ff5eebbd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099020 Aug 04 04:56:39.178058 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2810/5513] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:56:39.180447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.181429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.182426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.183125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.200738 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] HTTP exception thrown: Instance bb3f110b-6eba-47f2-835b-cd118b97ec8c could not be found. Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Request method failure captured: Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c HTTP/1.1 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61FYuuwDnvIaLOmiXcS-nziL3oR0cR2-8ypq_t87iqlTv2fcA-L8FkTk5GoNTfFtyyXMHYenYv0KOOUmco2EVi_afm8sz-7oM_geLoF4Dr9PJ2orj50EXhdgShAbeNM128uGGkedHxqNcZfnDPdU8R7UuUEAmpfZ6iqiSTa4nAPTTo4 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 02f05596fde642fabe3a7fd0576708f6 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesActionsTest-1226295990 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/02f05596fde642fabe3a7fd0576708f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/02f05596fde642fabe3a7fd0576708f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/02f05596fde642fabe3a7fd0576708f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_02f05596fde642fabe3a7fd0576708f6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesActionsTest-1226295990 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 02f05596fde642fabe3a7fd0576708f6 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesActionsTest-1226295990 Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesActionsTest-1226295990-project Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f9ca6bd981ef4b73a667a0d8eb8b228a Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesActionsTest-1226295990-project Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance bb3f110b-6eba-47f2-835b-cd118b97ec8c could not be found. Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'bb3f110b-6eba-47f2-835b-cd118b97ec8c'} Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb3f110b-6eba-47f2-835b-cd118b97ec8c could not be found. Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb3f110b-6eba-47f2-835b-cd118b97ec8c could not be found. Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:56:39.202772 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:39.206800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:39.206800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:56:39.206800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:56:39.206800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:56:39.206800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:56:39.206800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb3f110b-6eba-47f2-835b-cd118b97ec8c could not be found. Aug 04 04:56:39.206800 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:39.208701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] Returning 404 to user: Instance bb3f110b-6eba-47f2-835b-cd118b97ec8c could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:56:39.209883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a6ca50dd-77b1-4b6e-813a-07e8daf26fc8 tempest-VolumesActionsTest-1226295990 tempest-VolumesActionsTest-1226295990-project] 10.222.0.69 "GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c" status: 404 len: 111 microversion: 2.1 time: 0.046517 Aug 04 04:56:39.210725 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2704/5514] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:39 2022] GET /compute/v2.1/servers/bb3f110b-6eba-47f2-835b-cd118b97ec8c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:56:39.314565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:39.315344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:39.339334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.340063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.342010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.342488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.566997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:39.571223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:39.601617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.604905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.609574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:39.622042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.623331 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1acb7fc9-4937-496d-9dd7-f09733ec9c80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.313240 Aug 04 04:56:39.624245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.631659 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2811/5515] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:39 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:39.697165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.697805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.698535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lazy-loading 'fault' on Instance uuid 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:56:39.748824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:39.757253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:39.760047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:39.761711 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c8fcaec4-ed21-4e02-bedc-13ae3dad0b47 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 200 len: 1371 microversion: 2.20 time: 0.200750 Aug 04 04:56:39.775616 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2705/5516] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:39 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:40.661871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:40.663047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:40.689267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.690037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.691187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.691858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.790830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:40.795280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:40.812704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.813632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.815252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.815976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.840781 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] HTTP exception thrown: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Request method failure captured: Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 HTTP/1.1 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61CMOexmsu3Y7_so_ChBOtHx98_Svbg_zfSS9qYm5Cbc1uSu51aBFU3UpEdXszpDbp-0d6VkhSGnFR5Gi8RhHf0-UvSk-rnxFqOgrJwkioMurK9_jz8MNi6Kg_MypwyvogNVsCUldo8-S7NJMyvAuVed0izuU1Y-ngMGYaXnUwKeNPc Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c82d8b39aae447e89fa03246411a8eff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04733db33887418d9437bf7346bbc511 Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289'} Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:40.842437 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:56:40.847443 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:56:40.849364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Returning 404 to user: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:56:40.850442 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b9bad063-79a0-42a8-a8d0-9a6f4984d752 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 404 len: 111 microversion: 2.20 time: 0.066875 Aug 04 04:56:40.851218 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2706/5517] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:40 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:56:40.889479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e797c272-680f-43fa-8d19-5bbb1457abd6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '.version_select at 0x7f19189ec550>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:40.938120 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e797c272-680f-43fa-8d19-5bbb1457abd6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024801041" status: 204 len: 0 microversion: 2.20 time: 0.064172 Aug 04 04:56:40.940922 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2707/5518] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Aug 4 04:56:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024801041 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:56:41.762062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:41.778725 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7614769d-ed7a-4b4f-8e3a-a256d1b7859b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 1.120589 Aug 04 04:56:41.782052 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2812/5519] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:40 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:42.663980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cc4e246-c473-433d-a3b7-2f2ce47be3e7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'create', calling method: .version_select at 0x7f1923968d30>, body: {"keypair": {"name": "tempest-keypair-430858038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqarMrdrWL3v4eYdSVN9sINJZrG4rjJqxKyHBnUIWyq8M5vTRe4sUpY9dUCVIX/dzBRxQninyGlD64lWQhZLleV9I6OhWgG/ZY7Tw7BxjaeWThcnXtRY7Z1UlONLSwWMA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:42.696612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2cc4e246-c473-433d-a3b7-2f2ce47be3e7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for project c82d8b39aae447e89fa03246411a8eff. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:56:42.709551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-2cc4e246-c473-433d-a3b7-2f2ce47be3e7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for user 04733db33887418d9437bf7346bbc511 and project c82d8b39aae447e89fa03246411a8eff. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:56:42.740265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cc4e246-c473-433d-a3b7-2f2ce47be3e7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.080857 Aug 04 04:56:42.741846 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2708/5520] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Aug 4 04:56:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 04:56:42.806690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:42.808129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:42.816318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:42.817013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:42.817958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:42.818557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:43.222747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:43.258912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-39f1422d-a2bf-435a-8324-34041dc8ce0e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.455910 Aug 04 04:56:43.259534 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2813/5521] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:42 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:44.286680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:44.288425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:44.309352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:44.309737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:44.310551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:44.328577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:44.584665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:44.593556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc36c243-e113-4c4f-a924-0673cc6fba06 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.315083 Aug 04 04:56:44.601189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2709/5522] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:44 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:45.453995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1350635439", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d6b3970-731f-4cbf-9784-bf5bbdd98674"}], "security_groups": [{"name": "tempest-securitygroup--782427966"}], "key_name": "tempest-keypair-430858038", "user_data": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:45.624683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:45.625305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:45.685857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:45.686325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:45.687172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:45.703106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:45.724454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] validate_networks() for [('5d6b3970-731f-4cbf-9784-bf5bbdd98674', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:56:46.218696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:46.236317 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f9ad460-7a57-4980-be00-11243821dec0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.616273 Aug 04 04:56:46.240100 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2710/5523] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:45 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:47.019381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:56:47.019876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:56:47.020303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:56:47.020871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:56:47.021298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:56:47.045776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.046227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.047074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.047520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.079430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for project c82d8b39aae447e89fa03246411a8eff. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:56:47.088125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Getting quotas for user 04733db33887418d9437bf7346bbc511 and project c82d8b39aae447e89fa03246411a8eff. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:56:47.104024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:56:47.106556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:56:47.249211 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91c89bfc-607a-42d1-afe6-578d4a76bc3c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.800047 Aug 04 04:56:47.253605 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2814/5524] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Aug 4 04:56:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 04:56:47.265828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:47.266846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:47.279873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.287873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a4092fc1-d0d1-4a70-8820-37f50804d436 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:47.290470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a4092fc1-d0d1-4a70-8820-37f50804d436 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:47.292322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.293512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.294127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.510611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4092fc1-d0d1-4a70-8820-37f50804d436 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:47.523065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4092fc1-d0d1-4a70-8820-37f50804d436 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:47.535423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4092fc1-d0d1-4a70-8820-37f50804d436 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:47.539002 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a4092fc1-d0d1-4a70-8820-37f50804d436 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1281 microversion: 2.20 time: 0.269747 Aug 04 04:56:47.558116 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2815/5525] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:47 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1281 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:47.701841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:47.716120 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c88b9b01-fb4c-4d83-b8d5-b88efb74f33c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.459857 Aug 04 04:56:47.717822 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2711/5526] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:47 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:48.563549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:48.565164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:48.576887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.579680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.581662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.582721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.737079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:48.737702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:48.746301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:48.758748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.759528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.760067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.760511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.760700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:48.764697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:48.767127 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a4f1c4ab-b66f-418b-92ae-c5b07e384fe5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1277 microversion: 2.20 time: 0.207769 Aug 04 04:56:48.785197 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2816/5527] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:48 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:48.863817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-fff793a9-fdb3-40f5-935d-60bdd379cc0b req-4670ebca-f6b6-4066-82ca-74f9dd9d0948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a1037f-e873-4349-87f4-9c07bb35c30b", "name": "network-vif-plugged", "status": "completed", "tag": "5fa0e774-771e-4c26-9e8b-1185eeb8fc7e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:48.905699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fff793a9-fdb3-40f5-935d-60bdd379cc0b req-4670ebca-f6b6-4066-82ca-74f9dd9d0948 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.906559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fff793a9-fdb3-40f5-935d-60bdd379cc0b req-4670ebca-f6b6-4066-82ca-74f9dd9d0948 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.949572 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-fff793a9-fdb3-40f5-935d-60bdd379cc0b req-4670ebca-f6b6-4066-82ca-74f9dd9d0948 service nova] Creating event network-vif-plugged:5fa0e774-771e-4c26-9e8b-1185eeb8fc7e for instance 88a1037f-e873-4349-87f4-9c07bb35c30b on n-h1-851337-5 Aug 04 04:56:48.965448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-fff793a9-fdb3-40f5-935d-60bdd379cc0b req-4670ebca-f6b6-4066-82ca-74f9dd9d0948 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105659 Aug 04 04:56:48.969950 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2817/5528] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:56:49.146871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:49.159468 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-380c259a-5978-4725-a531-258655fc9d80 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.426263 Aug 04 04:56:49.160468 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2712/5529] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:48 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:49.841957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:49.846173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:49.887048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:49.891640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:49.899361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:49.901844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:50.051061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:50.063755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:50.082049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:50.087730 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-db645fc5-e929-4c63-8d16-2849ac9ed28a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1339 microversion: 2.20 time: 0.295655 Aug 04 04:56:50.090088 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2818/5530] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:49 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:50.180905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:50.181438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:50.211707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:50.212399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:50.223476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:50.223984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:50.490615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:50.513914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e15953ea-0c47-4050-9a8d-a8a052d9ddb2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1202 microversion: 2.1 time: 0.337482 Aug 04 04:56:50.515706 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2713/5531] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:50 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1202 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:51.113575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:51.114213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:51.129925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.130388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:51.131750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.132199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:51.530663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:51.539788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:51.541018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:51.542900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:51.544864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:51.552304 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7bbfef6d-752d-4f6f-87ab-5c35d5451d6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.442611 Aug 04 04:56:51.553153 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2819/5532] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:51 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:56:51.576176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.579441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:51.581032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.582289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.521076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:52.531097 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82edbf49-fe1f-41c5-b51a-730e841ac21d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1389 microversion: 2.1 time: 0.995590 Aug 04 04:56:52.532338 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2714/5533] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:51 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1389 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:52.556543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:52.558015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:52.566171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.566884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.567870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.568464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.576049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:52.577678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:52.592827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.593583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.598354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.598995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.718865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:52.911675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:52.920116 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc6414a3-2879-4585-84e3-62bfc154c8f9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1389 microversion: 2.1 time: 0.368039 Aug 04 04:56:52.920719 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2820/5534] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:52 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1389 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:52.957043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-fadf0025-80b1-4c88-908b-97eb35f19d3f req-eb719398-8b8d-4c7a-a751-2db58e46c027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8090bf-53e3-41fb-94a5-b89f2fddb011", "tag": "fb23e0a5-cdd2-4201-9424-4c42c93258cd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:52.987769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fadf0025-80b1-4c88-908b-97eb35f19d3f req-eb719398-8b8d-4c7a-a751-2db58e46c027 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.014426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-fadf0025-80b1-4c88-908b-97eb35f19d3f req-eb719398-8b8d-4c7a-a751-2db58e46c027 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.061722 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-fadf0025-80b1-4c88-908b-97eb35f19d3f req-eb719398-8b8d-4c7a-a751-2db58e46c027 service nova] Creating event network-changed:fb23e0a5-cdd2-4201-9424-4c42c93258cd for instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 on n-h2-851337-5 Aug 04 04:56:53.080932 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-fadf0025-80b1-4c88-908b-97eb35f19d3f req-eb719398-8b8d-4c7a-a751-2db58e46c027 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136510 Aug 04 04:56:53.081561 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2821/5535] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:56:53.095176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:53.095896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:53.113306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.114204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.116288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.118092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:53.118459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.127463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:53.128988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:53.130137 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-217a03a8-250f-4d12-a89c-0f281adba62b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.557991 Aug 04 04:56:53.131099 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2715/5536] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:52 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:53.365260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:53.374433 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-080682b2-7522-42a8-bac0-b11dec4f1f47 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1389 microversion: 2.1 time: 0.291639 Aug 04 04:56:53.375048 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2822/5537] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:53 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1389 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:53.396114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:53.396648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:53.403919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.407188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.408183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.408789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.482885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:56:53.703909 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b0534146-b644-469d-99fd-38dcaa9aad2e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 204 len: 0 microversion: 2.1 time: 0.312262 Aug 04 04:56:53.709702 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2716/5538] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:56:53 2022] DELETE /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:56:53.714476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:53.716281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:53.732231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.733240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.734491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.735565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:54.000856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:54.018228 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cfc0f4b8-6cf1-461c-9d23-b77d74732201 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1395 microversion: 2.1 time: 0.307878 Aug 04 04:56:54.019037 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2823/5539] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:53 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1395 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:54.157634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:54.159885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:54.185175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:54.186139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:54.194343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:54.196032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:54.489033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:54.504363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:54.506670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:54.509561 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d743fde-7576-4b29-9eed-6d3b0b4d665e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.357800 Aug 04 04:56:54.513247 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2717/5540] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:54 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:55.040402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:55.045495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:55.074533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.076370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.077429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.077908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.408098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:55.422198 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d4ce0da1-2a9d-41ab-87d3-945dcc2b102b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1395 microversion: 2.1 time: 0.385878 Aug 04 04:56:55.423046 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2824/5541] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:55 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1395 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:55.534993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:55.536572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:55.548121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.550471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.553836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.556134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.903362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:55.923085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:55.926513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:55.928014 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73f0309b-d6dd-4add-81d3-f6f1547cea52 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.397477 Aug 04 04:56:55.929314 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2718/5542] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:55 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:56:56.450486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:56.451948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:56.460284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:56.461194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:56.462243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:56.462911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:56.521324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f5d941a8-06d0-4004-958e-d87e666e9d6c req-af19d4e9-555a-4058-9f9d-dffb05b3f9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a1037f-e873-4349-87f4-9c07bb35c30b", "name": "network-vif-deleted", "tag": "5fa0e774-771e-4c26-9e8b-1185eeb8fc7e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:56:56.558384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:56.569008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f5d941a8-06d0-4004-958e-d87e666e9d6c req-af19d4e9-555a-4058-9f9d-dffb05b3f9ae service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:56.574089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f5d941a8-06d0-4004-958e-d87e666e9d6c req-af19d4e9-555a-4058-9f9d-dffb05b3f9ae service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:56.632502 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f5d941a8-06d0-4004-958e-d87e666e9d6c req-af19d4e9-555a-4058-9f9d-dffb05b3f9ae service nova] Creating event network-vif-deleted:5fa0e774-771e-4c26-9e8b-1185eeb8fc7e for instance 88a1037f-e873-4349-87f4-9c07bb35c30b on n-h1-851337-5 Aug 04 04:56:56.653511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:56.659583 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f5d941a8-06d0-4004-958e-d87e666e9d6c req-af19d4e9-555a-4058-9f9d-dffb05b3f9ae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146125 Aug 04 04:56:56.662338 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ae0d571-269c-4174-8260-795a4b759afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1353 microversion: 2.1 time: 0.216378 Aug 04 04:56:56.665267 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2825/5543] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:56 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1353 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:56.667921 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2719/5544] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 04:56:56.953117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:56.954178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:56.967490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:56.969676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:56.972532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:56.973595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:57.242156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:57.246262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:57.278987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:57.290429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:57.302248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d852d1c5-e117-4b09-8616-c5475a6c465a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.355095 Aug 04 04:56:57.321268 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2720/5545] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:56 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:57.687312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:57.688614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:57.691047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:57.693309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:57.721811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:57.722678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:57.723846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:57.724465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:57.948225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:57.962137 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-becf31d4-865f-4247-aad7-b26bccac9f7f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.279404 Aug 04 04:56:57.963451 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2826/5546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:57 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:58.336133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:58.336759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:58.354106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:58.354573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:58.355423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:58.358824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:58.718598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:58.729052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:58.732664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:58.733835 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5c433b9f-6b92-499b-8aad-d71f880d549a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.403756 Aug 04 04:56:58.741160 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2721/5547] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:58 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:56:58.983339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:58.984168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:58.996281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:58.999692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.000866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:59.004531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.005229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:59.172244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:59.183804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4fe7458-99ee-43fc-9398-6d98e9324967 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.204510 Aug 04 04:56:59.188547 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2827/5548] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:58 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:59.758276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:59.759149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:59.778907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.782678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:59.783688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.784261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.053308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:00.062067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:00.073667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:00.075093 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ddaf936f-7c85-4e4d-ac10-cf2c42f6af08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.322491 Aug 04 04:57:00.076131 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2722/5549] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:56:59 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:00.122082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7946f113-0b72-4c47-afa3-9018602a391a req-d6c3d952-e070-44b0-a5ea-f306674bcfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8090bf-53e3-41fb-94a5-b89f2fddb011", "name": "network-vif-plugged", "status": "completed", "tag": "fb23e0a5-cdd2-4201-9424-4c42c93258cd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:00.146488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7946f113-0b72-4c47-afa3-9018602a391a req-d6c3d952-e070-44b0-a5ea-f306674bcfad service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:00.147219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7946f113-0b72-4c47-afa3-9018602a391a req-d6c3d952-e070-44b0-a5ea-f306674bcfad service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.175131 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7946f113-0b72-4c47-afa3-9018602a391a req-d6c3d952-e070-44b0-a5ea-f306674bcfad service nova] Creating event network-vif-plugged:fb23e0a5-cdd2-4201-9424-4c42c93258cd for instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 on n-h2-851337-5 Aug 04 04:57:00.190199 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7946f113-0b72-4c47-afa3-9018602a391a req-d6c3d952-e070-44b0-a5ea-f306674bcfad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072895 Aug 04 04:57:00.191347 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2828/5550] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:57:00.209480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:00.211466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:00.239348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:00.240454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.250117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:00.250855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.398454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:00.409075 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3eeacfa-0f4e-46ae-8f51-15c97a6bcbe1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.203008 Aug 04 04:57:00.410227 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2723/5551] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:00 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:01.105383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:01.106685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:01.122983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.123733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.124236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.124679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.432055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:01.432946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:01.442981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.443394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.444208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.457529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.524671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:01.527565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:01.545614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:01.553606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:01.563084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31176cce-82c8-4008-a129-b27a075ae260 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1406 microversion: 2.20 time: 0.460605 Aug 04 04:57:01.566506 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2829/5552] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:01 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:01.680868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:01.696111 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f87f1d21-8c02-4c6e-be92-159512951232 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.267695 Aug 04 04:57:01.696719 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2724/5553] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:01 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:02.584680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:02.585900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:02.606877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:02.607365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:02.608196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:02.608612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:02.992633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:03.001741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:03.004145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:03.005734 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0df55d70-4944-4d1d-baf1-f51e48b4cdfe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1598 microversion: 2.20 time: 0.425026 Aug 04 04:57:03.006998 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2725/5554] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:02 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1598 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:03.012024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:03.012882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:03.032778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:03.035762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:03.037043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:03.042944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:03.109363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87299ef4-7c0a-4fc7-ac09-38f998e0208c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: .version_select at 0x7f19195025e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-582800796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQrkWrLyvaEsNSGl5rvu/74/tER4l7OCKj1uXuBz10b81RmPYnYcRUTHxACN8sXYe/dhA6NMxP3f+np73ykjOzIHhJx6ISmJ3/VFvDdY/O2QnVH15f4V29wnmq2Bh294w=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:03.146190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-87299ef4-7c0a-4fc7-ac09-38f998e0208c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:57:03.164113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-87299ef4-7c0a-4fc7-ac09-38f998e0208c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:57:03.180848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:03.192791 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-25cba0e5-f21c-416b-b576-30fd62625d5e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.181035 Aug 04 04:57:03.195573 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2726/5555] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:03 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:03.203933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be292c18-aa2a-4e0a-88c2-108bc157f82a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:03.216854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-be292c18-aa2a-4e0a-88c2-108bc157f82a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:03.238499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be292c18-aa2a-4e0a-88c2-108bc157f82a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:03.240073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be292c18-aa2a-4e0a-88c2-108bc157f82a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:03.240571 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87299ef4-7c0a-4fc7-ac09-38f998e0208c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.680691 Aug 04 04:57:03.241620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be292c18-aa2a-4e0a-88c2-108bc157f82a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:03.247649 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2830/5556] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:57:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:57:03.251084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be292c18-aa2a-4e0a-88c2-108bc157f82a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:03.434040 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-be292c18-aa2a-4e0a-88c2-108bc157f82a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.236611 Aug 04 04:57:03.436756 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2727/5557] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Aug 4 04:57:03 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-interface => generated 284 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:57:04.217428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:04.217889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:04.234934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:04.235430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:04.236451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:04.236899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:04.434770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:04.452287 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4468b64e-197e-4c78-8530-0c5e482f8bb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.232569 Aug 04 04:57:04.464806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2831/5558] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:04 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:05.481444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:05.482745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:05.501768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:05.502525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:05.503715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:05.504497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:05.680487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:05.696186 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-77fd460d-830a-4b42-9b2d-22dbc8799b44 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.220938 Aug 04 04:57:05.697381 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2728/5559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:05 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:06.717534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:06.718899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:06.740599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:06.744832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:06.746366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:06.747480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:06.944209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:06.952579 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1da4269e-b6f3-4416-b82f-8bebe68f3ba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 200 len: 1187 microversion: 2.1 time: 0.239089 Aug 04 04:57:06.953185 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2832/5560] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:06 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 1187 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:07.212329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3b0595b3-4130-495c-b0d0-6be03bb4ec35 req-ab496eb9-9fc3-48c3-baed-10d7fe15b7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8090bf-53e3-41fb-94a5-b89f2fddb011", "tag": "fb23e0a5-cdd2-4201-9424-4c42c93258cd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:07.245577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3b0595b3-4130-495c-b0d0-6be03bb4ec35 req-ab496eb9-9fc3-48c3-baed-10d7fe15b7ed service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:07.247909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3b0595b3-4130-495c-b0d0-6be03bb4ec35 req-ab496eb9-9fc3-48c3-baed-10d7fe15b7ed service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:07.265245 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3b0595b3-4130-495c-b0d0-6be03bb4ec35 req-ab496eb9-9fc3-48c3-baed-10d7fe15b7ed service nova] Creating event network-changed:fb23e0a5-cdd2-4201-9424-4c42c93258cd for instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 on n-h2-851337-5 Aug 04 04:57:07.272286 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3b0595b3-4130-495c-b0d0-6be03bb4ec35 req-ab496eb9-9fc3-48c3-baed-10d7fe15b7ed service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065490 Aug 04 04:57:07.274744 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2729/5561] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:57:07.978775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:07.979182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 88a1037f-e873-4349-87f4-9c07bb35c30b] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:07.994380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:07.994886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:07.996880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:07.997346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:08.041117 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance 88a1037f-e873-4349-87f4-9c07bb35c30b could not be found. Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b HTTP/1.1 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 88a1037f-e873-4349-87f4-9c07bb35c30b could not be found. Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '88a1037f-e873-4349-87f4-9c07bb35c30b'} Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a1037f-e873-4349-87f4-9c07bb35c30b could not be found. Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a1037f-e873-4349-87f4-9c07bb35c30b could not be found. Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:08.055417 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:57:08.060299 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:08.060299 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:08.060299 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:08.060299 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:57:08.060299 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:57:08.060299 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a1037f-e873-4349-87f4-9c07bb35c30b could not be found. Aug 04 04:57:08.060299 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:57:08.061667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance 88a1037f-e873-4349-87f4-9c07bb35c30b could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:57:08.068359 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-baf053a8-1630-4ffc-957d-8b5dd6dfba61 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b" status: 404 len: 111 microversion: 2.1 time: 0.094284 Aug 04 04:57:08.069495 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2833/5562] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:07 2022] GET /compute/v2.1/servers/88a1037f-e873-4349-87f4-9c07bb35c30b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:57:21.201952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1258770820", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "88b2449a-ee43-49cc-96e3-81bd9b7e58f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:21.236212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=21 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:21.242264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=48 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:21.382929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:57:21.670006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-565513338", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "55e73147-9892-405f-a8bc-bab750eb0fc2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-582800796", "security_groups": [{"name": "tempest-secgroup-smoke-1370567822"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:21.711799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:21.719335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:21.720059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=15 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:22.005216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] validate_networks() for [('55e73147-9892-405f-a8bc-bab750eb0fc2', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:57:22.517962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:57:22.519091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:57:22.520439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:57:22.520439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:57:22.520683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:57:22.539621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:22.540604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:22.541509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:22.541970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:22.584032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:57:22.656494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:57:22.800164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:57:22.802237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88b2449a-ee43-49cc-96e3-81bd9b7e58f1',volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:57:23.009100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:57:23.010633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:57:23.011633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:57:23.012262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:57:23.012897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:57:23.045802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:23.046475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:23.047609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:23.048244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:23.102401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:57:23.120472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:57:23.146163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:57:23.149124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:57:23.195383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53af00f6-58fb-487e-90cc-d89528ad1afe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998182 Aug 04 04:57:23.212086 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2730/5563] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:57:23.227253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d7c63ead-c9d8-4341-ab83-157169cb3219 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:23.232066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d7c63ead-c9d8-4341-ab83-157169cb3219 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:23.253299 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17a48e14-606c-489a-ba35-b883c3b1aafb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.589687 Aug 04 04:57:23.254330 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2834/5564] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:57:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:57:23.267086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7db15ea-8836-40a7-ada7-54563b981dc7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:23.270026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7db15ea-8836-40a7-ada7-54563b981dc7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:23.389932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a7db15ea-8836-40a7-ada7-54563b981dc7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:23.398898 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7db15ea-8836-40a7-ada7-54563b981dc7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1265 microversion: 2.1 time: 0.137121 Aug 04 04:57:23.399521 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2835/5565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:23 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:24.384984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d7c63ead-c9d8-4341-ab83-157169cb3219 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:24.392227 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d7c63ead-c9d8-4341-ab83-157169cb3219 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1057 microversion: 2.1 time: 1.178452 Aug 04 04:57:24.396405 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2731/5566] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:23 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1057 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:24.423459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8e688170-dec3-4bb4-bd83-14115e68946f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:24.424707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8e688170-dec3-4bb4-bd83-14115e68946f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:24.616511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8e688170-dec3-4bb4-bd83-14115e68946f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:24.633738 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8e688170-dec3-4bb4-bd83-14115e68946f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1265 microversion: 2.1 time: 0.214443 Aug 04 04:57:24.647823 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2836/5567] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:24 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:25.422906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:25.426562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:25.435330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:25.436001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:25.437048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:25.437706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:25.521343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:25.542468 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f72c5bf-26ee-47e1-b9de-79ee4356948b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1163 microversion: 2.1 time: 0.130502 Aug 04 04:57:25.544919 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2732/5568] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:25 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1163 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:25.658907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:25.660331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:25.675149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:25.686493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:25.695678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:25.700678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:25.924105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:25.955103 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d1e0b526-c2b1-48c9-878f-950f0fef44d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1325 microversion: 2.1 time: 0.288603 Aug 04 04:57:25.967064 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2837/5569] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:25 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:26.566416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:26.567802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:26.589184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:26.593151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:26.594332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:26.602810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:26.757770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:26.765817 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-47807773-41c2-4369-8997-ec5030e60561 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1173 microversion: 2.1 time: 0.203882 Aug 04 04:57:26.767057 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2733/5570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:26 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1173 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:26.987450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:26.989620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:27.015193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.015769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.020732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.024106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.227820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:27.242708 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b28d0f4-db28-40ca-ba36-aa1cfa93c6b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1323 microversion: 2.1 time: 0.259370 Aug 04 04:57:27.244790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2838/5571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:26 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1323 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:27.788392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:27.789945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:27.808583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.810352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.812039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.813732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.918509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:27.936117 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1e20db67-0ca2-41c2-948a-2b7bb248dadb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1173 microversion: 2.1 time: 0.147895 Aug 04 04:57:27.940462 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2734/5572] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:27 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1173 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:28.266985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:28.268604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:28.286692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:28.288081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:28.289621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:28.290378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:28.683985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:28.710635 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c86971f9-526a-4c2e-a48d-9a56ee5fdbb7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.446339 Aug 04 04:57:28.714446 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2839/5573] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:28 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:28.992622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:28.993252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:29.024545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:29.028699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:29.034664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:29.041530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:29.355186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:29.363268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3575051b-8d6c-47b2-bfc5-a10ee6bf9cd6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.376122 Aug 04 04:57:29.384050 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2735/5574] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:28 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:29.737144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:29.738038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:29.764189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:29.765031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:29.766006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:29.766603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.075380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:30.084892 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b6ba96ac-8269-4a94-ab35-86c9bb43ce86 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.351266 Aug 04 04:57:30.086303 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2840/5575] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:29 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:30.392495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:30.393302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:30.403788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:30.404580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.405616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:30.406285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.634358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:30.661806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12aeba27-6ddd-4de6-b076-4bcc91200039 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.274051 Aug 04 04:57:30.676834 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2736/5576] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:30 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:30.966172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6ad09474-be4f-403a-b38f-7806c1ef8c31 req-d5dba73a-eb11-485b-8945-0491143e7b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96bd5c4-0171-41c5-906b-be602d3dcfae", "tag": "fad67494-4136-4621-b661-8eb80b4c63f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:30.979564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6ad09474-be4f-403a-b38f-7806c1ef8c31 req-d5dba73a-eb11-485b-8945-0491143e7b1b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:30.980302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6ad09474-be4f-403a-b38f-7806c1ef8c31 req-d5dba73a-eb11-485b-8945-0491143e7b1b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.995955 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6ad09474-be4f-403a-b38f-7806c1ef8c31 req-d5dba73a-eb11-485b-8945-0491143e7b1b service nova] Creating event network-changed:fad67494-4136-4621-b661-8eb80b4c63f1 for instance e96bd5c4-0171-41c5-906b-be602d3dcfae on n-h1-851337-5 Aug 04 04:57:31.002873 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6ad09474-be4f-403a-b38f-7806c1ef8c31 req-d5dba73a-eb11-485b-8945-0491143e7b1b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055259 Aug 04 04:57:31.003837 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2841/5577] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:57:31.110399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:31.111074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:31.131433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.131921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.132722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.133169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.380359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:31.395667 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8585cfa3-9237-4888-b3d6-df7646a94031 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.290284 Aug 04 04:57:31.398179 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2737/5578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:31 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:31.730286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:31.732737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:31.741316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.742068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.743675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.744321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.961827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:31.976218 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9cd4dd98-0ffa-4cf6-96c5-b8ee6f1304d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.264801 Aug 04 04:57:31.993272 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2842/5579] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:31 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:32.418532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:32.419178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:32.430666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.431439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.438928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.448316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.562721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:32.715359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:32.724890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2e752427-2c1e-49bf-828d-0d57477f4e2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.310151 Aug 04 04:57:32.738782 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2738/5580] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:32 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:32.881751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67ac9482-658c-41a8-9829-3f814e98bb04 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:32.882260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67ac9482-658c-41a8-9829-3f814e98bb04 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:32.888570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67ac9482-658c-41a8-9829-3f814e98bb04 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.889024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67ac9482-658c-41a8-9829-3f814e98bb04 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.895761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67ac9482-658c-41a8-9829-3f814e98bb04 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.896219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67ac9482-658c-41a8-9829-3f814e98bb04 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.931426 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67ac9482-658c-41a8-9829-3f814e98bb04 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/ips" status: 200 len: 152 microversion: 2.20 time: 0.217631 Aug 04 04:57:32.932254 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2843/5581] 10.222.0.69 () {60 vars in 1289 bytes} [Thu Aug 4 04:57:32 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/ips => generated 152 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:57:33.004994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:33.005621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:33.014512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.015010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.015802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.016246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.085423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d8ce3fcd-a326-4faf-9125-f8be989e17da req-e6f8d3b3-b6b8-4b2a-825b-acc7e76066a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:33.093356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:33.106564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d8ce3fcd-a326-4faf-9125-f8be989e17da req-e6f8d3b3-b6b8-4b2a-825b-acc7e76066a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.107050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d8ce3fcd-a326-4faf-9125-f8be989e17da req-e6f8d3b3-b6b8-4b2a-825b-acc7e76066a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.139275 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d8ce3fcd-a326-4faf-9125-f8be989e17da req-e6f8d3b3-b6b8-4b2a-825b-acc7e76066a4 service nova] Creating event network-changed:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h1-851337-5 Aug 04 04:57:33.148718 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d8ce3fcd-a326-4faf-9125-f8be989e17da req-e6f8d3b3-b6b8-4b2a-825b-acc7e76066a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067487 Aug 04 04:57:33.153960 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2844/5582] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:57:33.426361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:33.437102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03c346ec-1dab-412a-85f8-7d2f85aa3429 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.436083 Aug 04 04:57:33.443887 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2739/5583] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:32 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:33.750177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:33.751392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:33.762351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.765127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.779011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.780069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:34.008187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:34.019075 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7059697-3441-400f-8ff3-7a3dc0cf0fad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.274944 Aug 04 04:57:34.020370 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2845/5584] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:33 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:34.457812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:34.459990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:34.462101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:34.489165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:34.491413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:34.492238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:34.492687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:34.869877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:34.882862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8912117e-5263-477b-b2fe-50c8d3f55d7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.428781 Aug 04 04:57:34.884136 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2740/5585] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:34 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:35.040893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:35.041620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:35.045071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:35.061137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.061643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:35.062552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.063074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:35.293334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:35.301587 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d0a7451-f499-4718-af10-cf48360a0ab7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.265934 Aug 04 04:57:35.303576 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2846/5586] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:35 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:35.904929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:35.905812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:35.913945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.914915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:35.916237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.916910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:36.173318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:36.181704 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7b6632bb-9d3c-49ee-bc56-905a9528b5ac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.281188 Aug 04 04:57:36.182321 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2741/5587] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:35 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:36.324679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:36.326053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:36.337832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:36.341374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:36.342364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:36.344078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:36.533741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:36.544308 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dcee5208-d308-4738-b57b-6b6f1a6c719d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.223731 Aug 04 04:57:36.545465 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2847/5588] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:36 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:36.779770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:36.780474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:36.790091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:36.801824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:36.803046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:36.803663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:36.870921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lazy-loading 'flavor' on Instance uuid 0f8090bf-53e3-41fb-94a5-b89f2fddb011 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:57:37.204182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:37.205092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:37.219013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.219768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.221300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.222867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.357078 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5dda3655-02c9-4c3f-8348-48447cda3aed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/action" status: 202 len: 0 microversion: 2.20 time: 0.579682 Aug 04 04:57:37.359566 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2742/5589] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:57:36 2022] POST /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:37.376840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:37.378405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:37.399481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.400296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.402077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.403432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.721644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:37.734201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a70e631-636e-429b-a3dd-abf38a732e31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.534983 Aug 04 04:57:37.736527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2848/5590] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:37 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:37.748720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:37.751787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:37.755301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:37.764589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.764991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:37.766678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:37.767299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.768819 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce3d5781-fec0-4339-83ae-207707598eb0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.406475 Aug 04 04:57:37.770998 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2743/5591] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:37 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:37.771166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.771467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.009145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:38.026253 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f8d56ef-8f47-47c6-8afb-57bfc650ee17 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.287353 Aug 04 04:57:38.043006 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2849/5592] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:37 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:38.761203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:38.761938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:38.780377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.780929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.784669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.785386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.794915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:38.795826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:38.810676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.820727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.823608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.825317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:39.137297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:39.153670 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1bfa06c2-e870-4cda-b173-a08ded643d36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1215 microversion: 2.1 time: 0.397459 Aug 04 04:57:39.156269 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2744/5593] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:38 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1215 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:39.174544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:39.175733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:39.200645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:39.203134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:39.206609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:39.207831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:39.330881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:39.348873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:39.352946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:39.357243 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3d013891-e98c-4e60-bf57-15b11e212740 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.567149 Aug 04 04:57:39.359916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2850/5594] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:38 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:57:39.793944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:39.802303 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7b4b38bd-6ce2-43cf-a5d7-4a8851a96b8c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.643614 Aug 04 04:57:39.802941 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2745/5595] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:39 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:40.177042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:40.177785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:40.200569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.201101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.201940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.213135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.387255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:40.388509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:40.400256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.402706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.403743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.405482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.414648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:40.549362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:40.561427 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f61a7290-a871-4053-b60f-1acdb1dfe79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.388267 Aug 04 04:57:40.562717 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2851/5596] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:40 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:40.698450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:40.714108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:40.722639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:40.725275 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb51e6fc-b9f6-4bcc-b8a6-7fa5cd69a86e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.342166 Aug 04 04:57:40.726284 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2746/5597] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:40 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:40.827966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:40.828594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:40.846744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.847241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.848052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.848645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.217176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:41.233360 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6e5c2df-17d2-4151-a4e0-c56cfff4a8f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.409202 Aug 04 04:57:41.239555 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2852/5598] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:40 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:41.583464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:41.585266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:41.598314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.598683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.601663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.602743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.757752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:41.759129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:41.782337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.789518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.790714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.791419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:42.019602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:42.030825 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bad1b1f6-af66-4fa4-8e74-a10cb9cda52b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.449685 Aug 04 04:57:42.033027 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2747/5599] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:41 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:42.045147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6efe386c-9e95-468e-82cd-b5a2ad751487 req-57e526b8-a333-4faf-84ac-c8e2d657e125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "name": "network-vif-plugged", "status": "completed", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:42.069475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6efe386c-9e95-468e-82cd-b5a2ad751487 req-57e526b8-a333-4faf-84ac-c8e2d657e125 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:42.069932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6efe386c-9e95-468e-82cd-b5a2ad751487 req-57e526b8-a333-4faf-84ac-c8e2d657e125 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:42.096033 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6efe386c-9e95-468e-82cd-b5a2ad751487 req-57e526b8-a333-4faf-84ac-c8e2d657e125 service nova] Creating event network-vif-plugged:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h1-851337-5 Aug 04 04:57:42.105011 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6efe386c-9e95-468e-82cd-b5a2ad751487 req-57e526b8-a333-4faf-84ac-c8e2d657e125 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070329 Aug 04 04:57:42.107317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2748/5600] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:57:42.154514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:42.210224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:42.214162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:42.216093 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-be0dada1-8e21-40ff-bc7b-624afaf46f6c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.463686 Aug 04 04:57:42.217410 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2853/5601] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:41 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:57:42.256309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:42.257687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:42.270659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:42.272148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:42.273446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:42.274119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:42.602105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:42.612774 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-432e35c7-3e7b-4ac9-a909-80d42d502c0f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.361871 Aug 04 04:57:42.613384 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2749/5602] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:42 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:43.053949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:43.055220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:43.066120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.070462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.085904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.088554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.246411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:43.247077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:43.261495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.262167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.263195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.263633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.708447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:43.726704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.729139 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-66cdd722-8709-449b-8103-57428f03d684 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.679943 Aug 04 04:57:43.742926 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2854/5603] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:43 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:43.749426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:43.750053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:43.776363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.776831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.777624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.778067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.807202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:43.820232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:43.822036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:43.824349 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50246895-79d7-4693-a586-144b9c8b918e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.582987 Aug 04 04:57:43.825110 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2750/5604] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:43 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:44.116428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:44.143138 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43abc2c5-f18f-4106-ac5f-7f02410edb2f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1391 microversion: 2.1 time: 0.398932 Aug 04 04:57:44.149525 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2855/5605] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:43 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1391 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:44.750072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:44.750691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:44.763023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.763975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:44.766025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.767903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:44.855980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:44.861865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:44.915865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.927780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:44.930703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.945409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.369906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:45.383530 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d050b72-88c4-4fb2-aaa3-ff86f5ec5dcb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.635767 Aug 04 04:57:45.384155 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2751/5606] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:44 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:45.403960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:45.430238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:45.439073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:45.439441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:45.440754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23f7695e-ee8c-422a-bdaf-c44890923c17 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.596750 Aug 04 04:57:45.441352 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2856/5607] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:44 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:45.442470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:45.459449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.460841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.462781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.464008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.750231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:45.763686 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b049cd80-b2d0-418d-be55-23860a0aa6da tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1564 microversion: 2.1 time: 0.354273 Aug 04 04:57:45.775509 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2752/5608] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:45 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1564 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:45.786393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:45.794014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:45.808727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.809322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.813046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.813701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:46.230490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:46.242506 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9a50897-99e7-42d5-88b1-63013bcc3c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1564 microversion: 2.1 time: 0.460802 Aug 04 04:57:46.243200 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2857/5609] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:45 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1564 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:46.406375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:46.409154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:46.419057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:46.419588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:46.420393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:46.420915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:46.467400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:46.468570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:46.481051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:46.482549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:46.483381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:46.483984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:47.019948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:47.029764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:47.034332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:47.068893 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-519f4676-8f67-47e7-bc26-66f40a5253df tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.593126 Aug 04 04:57:47.070251 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2858/5610] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:46 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:47.077377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:47.090255 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-488eae98-f5aa-4e6d-a0bc-250d2cee90dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.688718 Aug 04 04:57:47.096447 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2753/5611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:46 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:48.095495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:48.096781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:48.118329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:48.119061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:48.132202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.135479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.136580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.137257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.146946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.147868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.155662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.156367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.525842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:48.538479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:48.541234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:48.548345 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-89a06421-a2f8-4196-86fa-15f1fccfbcda tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.456644 Aug 04 04:57:48.549740 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2859/5612] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:48 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:48.716794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:48.748276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-780abdae-a3cf-4e67-833e-8f5e36f26206 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.634264 Aug 04 04:57:48.757122 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2754/5613] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:48 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:49.574784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:49.575439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:49.589718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.590436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:49.597192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.597654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:49.777138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:49.777763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:49.787417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.790184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:49.793350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.811461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:50.584419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:50.586163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:50.596399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:50.596861 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a7b59194-fd42-4571-bea5-63240a05d6c8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.823619 Aug 04 04:57:50.597465 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2755/5614] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:49 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:50.597951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:50.599720 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cfdbf75f-325b-44e6-ae2c-34be7ff238a4 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 1.028886 Aug 04 04:57:50.607863 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2860/5615] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:49 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:57:50.620446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:50.621081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:50.636114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:50.637329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:50.637460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:50.637838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:50.643263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e92b1333-5de6-4bd3-bfb2-881478068d69 req-921b7390-101e-4de2-b235-f344591fc6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:50.671079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e92b1333-5de6-4bd3-bfb2-881478068d69 req-921b7390-101e-4de2-b235-f344591fc6d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:50.671802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e92b1333-5de6-4bd3-bfb2-881478068d69 req-921b7390-101e-4de2-b235-f344591fc6d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:50.713781 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e92b1333-5de6-4bd3-bfb2-881478068d69 req-921b7390-101e-4de2-b235-f344591fc6d9 service nova] Creating event network-changed:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h1-851337-5 Aug 04 04:57:50.728962 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e92b1333-5de6-4bd3-bfb2-881478068d69 req-921b7390-101e-4de2-b235-f344591fc6d9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093499 Aug 04 04:57:50.736286 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2861/5616] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 04:57:50.956200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:50.974471 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-36f60674-2fa8-49b9-8cd2-77ca71fc4210 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1564 microversion: 2.1 time: 0.357198 Aug 04 04:57:50.978008 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2756/5617] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:50 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1564 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:51.624789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:51.625726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:51.634592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:51.635429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:51.639084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:51.655776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.668180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:51.668403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.669102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:51.670106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.671121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.671714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:51.672260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:52.250379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:52.297659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:52.306825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:52.310844 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bda22f0a-846a-4a18-8675-f7e3b03f2103 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.680825 Aug 04 04:57:52.336061 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2757/5618] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:51 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:57:52.496523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:52.511317 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38086d2d-35c0-4cce-9bef-4caee0db1c4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.886179 Aug 04 04:57:52.513443 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2862/5619] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:51 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:53.343377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:53.344994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:53.370466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.374162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:53.376717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.382533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:53.537487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:53.538563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:53.559560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:53.562730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.564405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:53.566196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.566681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:54.132698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:54.150259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:54.153037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:54.155725 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27f7f4a5-e165-40b9-8473-f177cd728695 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1744 microversion: 2.20 time: 0.817318 Aug 04 04:57:54.160068 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2758/5620] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:53 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1744 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:54.317823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:54.337898 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad98e8d5-ce93-4fe5-b050-bac273027958 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 0.804363 Aug 04 04:57:54.347684 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2863/5621] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:53 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:54.976112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-eb2067e1-f158-45af-a168-c706be59b9ae req-470c9902-7273-4614-a144-6a9978430b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96bd5c4-0171-41c5-906b-be602d3dcfae", "name": "network-vif-plugged", "status": "completed", "tag": "fad67494-4136-4621-b661-8eb80b4c63f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:55.005960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-eb2067e1-f158-45af-a168-c706be59b9ae req-470c9902-7273-4614-a144-6a9978430b24 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.011399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-eb2067e1-f158-45af-a168-c706be59b9ae req-470c9902-7273-4614-a144-6a9978430b24 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.054323 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-eb2067e1-f158-45af-a168-c706be59b9ae req-470c9902-7273-4614-a144-6a9978430b24 service nova] Creating event network-vif-plugged:fad67494-4136-4621-b661-8eb80b4c63f1 for instance e96bd5c4-0171-41c5-906b-be602d3dcfae on n-h1-851337-5 Aug 04 04:57:55.074842 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-eb2067e1-f158-45af-a168-c706be59b9ae req-470c9902-7273-4614-a144-6a9978430b24 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104883 Aug 04 04:57:55.076168 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2759/5622] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:57:55.186061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:55.187091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:55.222158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.224350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.225476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.226174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.375138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:55.375788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:55.398678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.399239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.400062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.400504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.550322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:56.559013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:56.566202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:56.568408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-784fca84-4c1b-4784-a55e-260b199d28e3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 1.386338 Aug 04 04:57:56.571580 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2864/5623] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:55 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:57.049487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.074193 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aff86a4d-f942-46f5-bfad-73011a64ed51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1203 microversion: 2.1 time: 1.701103 Aug 04 04:57:57.076486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2760/5624] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:55 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1203 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:57.170576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2fb12881-608c-47c8-94c0-d18180278b16 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Action: 'create', calling method: .version_select at 0x7f19194143a0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1946655994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtqkhkEiD0vwIKoKIJs1q1rBFTiEOkyGrGX/E0h2U0k+QSt5Zcxfucjw6HrtttYQsmWJszU20rDxekMB5UhcwkEmKDDUD8bNnhB9tv8jDZnQfM8bNQCvAEyMXSdEGgnQA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:57.216758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-2fb12881-608c-47c8-94c0-d18180278b16 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Getting quotas for project 4e689f085cbb481c92f3344a63b832c0. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:57:57.231342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-2fb12881-608c-47c8-94c0-d18180278b16 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Getting quotas for user 3daa908987ad4c55b8780721481fdd39 and project 4e689f085cbb481c92f3344a63b832c0. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:57:57.291489 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2fb12881-608c-47c8-94c0-d18180278b16 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.437282 Aug 04 04:57:57.292592 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2865/5625] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:57:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:57:57.596720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:57.597602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:57.611898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.612683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.615810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.618284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.874404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.890528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.895092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.900881 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-37baef70-7c6a-4038-81ca-afdd33b9e73a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.309905 Aug 04 04:57:57.902788 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2761/5626] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:57 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:58.105412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.110490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:58.134670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.138809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.139730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.140175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.187168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-93948233-67c3-4f6c-aae1-778363be943d req-ef3c88de-695e-4025-82c1-4b9eb2e5d3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8090bf-53e3-41fb-94a5-b89f2fddb011", "name": "network-vif-plugged", "status": "completed", "tag": "fb23e0a5-cdd2-4201-9424-4c42c93258cd"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:58.217066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-93948233-67c3-4f6c-aae1-778363be943d req-ef3c88de-695e-4025-82c1-4b9eb2e5d3e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.220700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-93948233-67c3-4f6c-aae1-778363be943d req-ef3c88de-695e-4025-82c1-4b9eb2e5d3e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.269901 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-93948233-67c3-4f6c-aae1-778363be943d req-ef3c88de-695e-4025-82c1-4b9eb2e5d3e1 service nova] Creating event network-vif-plugged:fb23e0a5-cdd2-4201-9424-4c42c93258cd for instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 on n-h2-851337-5 Aug 04 04:57:58.288834 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-93948233-67c3-4f6c-aae1-778363be943d req-ef3c88de-695e-4025-82c1-4b9eb2e5d3e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106575 Aug 04 04:57:58.292885 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2762/5627] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:57:58.494322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:58.502378 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-adbe8005-db35-4783-bdad-72d374b07bf2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1390 microversion: 2.1 time: 0.405830 Aug 04 04:57:58.503693 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2866/5628] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:58 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1390 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:58.527959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.529060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:58.537439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.538128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.539249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.539889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.930781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.931861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:58.949284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.953058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.956857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.957495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.120850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.143602 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6d314e8-bfca-44a1-93f8-bfc511b1c93f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1390 microversion: 2.1 time: 0.621210 Aug 04 04:57:59.144328 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2763/5629] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:58 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1390 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:59.166248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:59.168402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:59.185025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.191981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.193148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.195417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.559539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.577370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.580535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.585296 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-064ccbea-e767-4fb6-a971-5ef4259c16ee tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.660415 Aug 04 04:57:59.591108 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2867/5630] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:57:58 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:57:59.737944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.746881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.762945 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b616b24a-7397-4ae3-880d-60e4a67cb6dd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1390 microversion: 2.1 time: 0.601831 Aug 04 04:57:59.783914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2764/5631] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:59 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1390 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:59.789186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:59.789704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:59.809197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.809662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.810479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.810919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.914487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:58:00.152366 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-859a62dd-8fb4-4cf0-8a30-f0b56639d344 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 204 len: 0 microversion: 2.1 time: 0.366137 Aug 04 04:58:00.156355 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2868/5632] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:57:59 2022] DELETE /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:00.164515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:00.165144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:00.175865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.176326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.181291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.181762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.466234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-889354780", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1946655994", "security_groups": [{"name": "tempest-secgroup-smoke-487858948"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "064d7d3a-1558-4677-b82b-f0285177e838"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:00.568405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:00.587583 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cf917750-fa54-4bdd-a77a-250f3b04ce4b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1396 microversion: 2.1 time: 0.423110 Aug 04 04:58:00.588479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2765/5633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:00 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1396 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:00.613672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:00.614939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:00.632768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.636779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.637756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.638424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.952991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:00.988872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:01.010908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:01.013197 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-957bea6c-fa83-44a7-b472-8d6677a16bbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.403926 Aug 04 04:58:01.017721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2766/5634] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:00 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:01.091367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] validate_networks() for [('064d7d3a-1558-4677-b82b-f0285177e838', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:58:01.608935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:01.609699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:01.624456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:01.624960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:01.630880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:01.631378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.101521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:02.113998 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f38f0270-bb26-4554-9c49-abf905bf7f71 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1396 microversion: 2.1 time: 0.506377 Aug 04 04:58:02.125068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Getting quotas for project 4e689f085cbb481c92f3344a63b832c0. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:58:02.127857 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2767/5635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:01 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1396 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:02.135168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:02.135794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:02.142607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.143335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.144369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.144967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.159969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Getting quotas for user 3daa908987ad4c55b8780721481fdd39 and project 4e689f085cbb481c92f3344a63b832c0. Resources: dict_keys(['metadata_items']) {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:58:02.231854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:58:02.232417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:58:02.233005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:58:02.233567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:58:02.234077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:58:02.278991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.282702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.284400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.285843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.321819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Getting quotas for project 4e689f085cbb481c92f3344a63b832c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:58:02.372767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Getting quotas for user 3daa908987ad4c55b8780721481fdd39 and project 4e689f085cbb481c92f3344a63b832c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:58:02.391716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:58:02.395085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:58:02.514308 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c96932a7-5ba2-480e-a4a6-b18f17cd24d8 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.051549 Aug 04 04:58:02.519177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2869/5636] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:58:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:58:02.540873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:02.549447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89e3b920-9eae-47f0-9968-c4b827988127 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:02.550305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-89e3b920-9eae-47f0-9968-c4b827988127 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:02.558842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:02.560844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:02.562324 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ecf5f5a7-efae-40b7-9e73-1885f0d70131 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.433393 Aug 04 04:58:02.578778 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2768/5637] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:02 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:02.670269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-89e3b920-9eae-47f0-9968-c4b827988127 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:02.684778 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-89e3b920-9eae-47f0-9968-c4b827988127 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1302 microversion: 2.1 time: 0.153218 Aug 04 04:58:02.685859 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2870/5638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:02 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:02.856532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-fd02b0d9-3436-4e8f-b98c-e648835d5018 req-dbd64202-5c33-4100-9edb-104b61af3d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96bd5c4-0171-41c5-906b-be602d3dcfae", "name": "network-vif-deleted", "tag": "fad67494-4136-4621-b661-8eb80b4c63f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:02.894659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fd02b0d9-3436-4e8f-b98c-e648835d5018 req-dbd64202-5c33-4100-9edb-104b61af3d8e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.896705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fd02b0d9-3436-4e8f-b98c-e648835d5018 req-dbd64202-5c33-4100-9edb-104b61af3d8e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.921829 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-fd02b0d9-3436-4e8f-b98c-e648835d5018 req-dbd64202-5c33-4100-9edb-104b61af3d8e service nova] Creating event network-vif-deleted:fad67494-4136-4621-b661-8eb80b4c63f1 for instance e96bd5c4-0171-41c5-906b-be602d3dcfae on n-h1-851337-5 Aug 04 04:58:02.938826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-fd02b0d9-3436-4e8f-b98c-e648835d5018 req-dbd64202-5c33-4100-9edb-104b61af3d8e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086284 Aug 04 04:58:02.947917 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2769/5639] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:03.139902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:03.140324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:03.150476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.153790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.154812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.158554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.298154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.309645 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fb9b1511-0209-4ab1-8737-8c1d275837d4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1188 microversion: 2.1 time: 0.174546 Aug 04 04:58:03.313189 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2871/5640] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:03 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1188 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:03.592228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:03.592928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:03.602389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.602849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.603663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.604104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.712453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:03.713271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:03.729872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.730026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.730765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.748443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.861993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.892675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.896619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.899464 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7fef5425-40b5-4055-813f-52d6c64bdd08 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.311320 Aug 04 04:58:03.902479 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2770/5641] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:03 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:03.936869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.951000 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dfc89448-38c5-4b01-b595-faab421b1770 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1306 microversion: 2.1 time: 0.245184 Aug 04 04:58:03.952966 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2872/5642] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:03 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1306 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:04.336814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:04.337201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:04.361476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.361949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.362754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.363225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.595391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:04.618521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16038ac2-1881-461a-9d96-757c6b483bf8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1188 microversion: 2.1 time: 0.287046 Aug 04 04:58:04.640445 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2771/5643] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:04 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:04.924975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:04.926403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:04.964773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.968779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.969875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.970492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.979415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:04.982637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:04.996996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.997732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.998708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.001103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.014653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:05.246142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.248978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.257473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.260916 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2d087013-9703-4c0c-921f-d76cdf4ca297 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1360 microversion: 2.1 time: 0.288087 Aug 04 04:58:05.265132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.269177 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a38ce60-ad15-4080-9847-29cf4a54dc78 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.348225 Aug 04 04:58:05.271695 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2772/5644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:04 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:05.279849 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2873/5645] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:04 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:05.644694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:05.645886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:05.667311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.667850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.672834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.673468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.836778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.858926 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ca24504-9bf4-47c6-87d5-e095eae4da0b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1188 microversion: 2.1 time: 0.219095 Aug 04 04:58:05.860069 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2773/5646] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:05 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1188 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:06.290694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:06.292099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:06.307815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:06.308592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:06.340247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.342287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.347342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.351150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.359668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.364606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.376013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.376487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.022684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:07.038023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:07.040880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:07.046115 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc2b5232-537e-4acc-9513-393d786aa0d9 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1427 microversion: 2.1 time: 0.763055 Aug 04 04:58:07.053454 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2874/5647] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:06 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1427 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:07.066123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:07.066528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:07.068864 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2d71ef4-bc20-49d4-aae0-e94672f5b578 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.766252 Aug 04 04:58:07.069510 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2774/5648] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:06 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:07.076040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:07.101029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:07.101515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.102337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:07.104841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.289506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:07.307184 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-33ec7908-d3a5-4783-bc82-e56f54eee156 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1188 microversion: 2.1 time: 0.249918 Aug 04 04:58:07.312465 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2875/5649] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:07 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1188 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:07.609384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-45db99a3-ab91-4abe-aa65-72bb26f2088b req-5dbcc19a-040f-4850-ad1d-5f439cec7eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4bb523-1aa1-48a6-9cf9-688fde082a6c", "tag": "39cf7e50-b5c5-4e0e-88a6-92c11993727e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:07.634900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45db99a3-ab91-4abe-aa65-72bb26f2088b req-5dbcc19a-040f-4850-ad1d-5f439cec7eb8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:07.635934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-45db99a3-ab91-4abe-aa65-72bb26f2088b req-5dbcc19a-040f-4850-ad1d-5f439cec7eb8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.666619 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-45db99a3-ab91-4abe-aa65-72bb26f2088b req-5dbcc19a-040f-4850-ad1d-5f439cec7eb8 service nova] Creating event network-changed:39cf7e50-b5c5-4e0e-88a6-92c11993727e for instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c on n-h2-851337-5 Aug 04 04:58:07.693875 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-45db99a3-ab91-4abe-aa65-72bb26f2088b req-5dbcc19a-040f-4850-ad1d-5f439cec7eb8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092878 Aug 04 04:58:07.699055 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2775/5650] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:08.075108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:08.077578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:08.093090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:08.094313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:08.114017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.116862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.117582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.118209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.119812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.120444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.121081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.121704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.565465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.593886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.599053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.603342 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-98800361-eed0-4a40-85f9-0fd610207a66 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.513401 Aug 04 04:58:08.607109 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2776/5651] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:08 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:08.613169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:08.615016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:08.635498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.637735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.638859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.642199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.690626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.705110 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee5a9640-3be2-4239-883d-2ca502c37de2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1427 microversion: 2.1 time: 0.632528 Aug 04 04:58:08.709908 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2876/5652] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:08 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1427 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:08.760477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.768478 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca2cc9fa-1d92-4f54-b6c6-718dec8aebb1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1188 microversion: 2.1 time: 0.160067 Aug 04 04:58:08.770894 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2777/5653] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:08 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1188 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:09.632847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:09.633468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:09.650253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.652107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.654281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.655583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.731883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:09.733282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:09.766851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.767449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.768344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.770518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.127773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.144201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.146847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.150477 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-219d0fdf-d42f-4fe7-b519-a9ae9a817ccd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.524736 Aug 04 04:58:10.156117 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2877/5654] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:09 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:10.161633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:10.163658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:10.176248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.187577 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11a3d9dc-e944-40fe-bf0a-6588a40c3bbe tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1427 microversion: 2.1 time: 0.459911 Aug 04 04:58:10.200757 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2778/5655] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:09 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1427 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:10.201678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:10.204963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.205827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:10.206282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.354513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.369330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6791db16-8e27-46d0-95a7-06a38ffb0a81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1188 microversion: 2.1 time: 0.211687 Aug 04 04:58:10.370251 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2878/5656] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:10 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1188 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:11.182918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:11.183583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:11.193435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.194103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.195880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.196641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.224473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:11.225761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:11.237045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.239512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.242555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.243279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.646611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.652654 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37332703-e504-4d87-835e-9d8124898232 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1427 microversion: 2.1 time: 0.434701 Aug 04 04:58:11.667276 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2879/5657] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:11 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1427 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:11.674212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:11.676219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:11.687145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.688288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.690176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.691133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.696091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.721422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.723071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.724345 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-109334ab-97db-4389-8e4d-442370333600 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.546417 Aug 04 04:58:11.740178 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2779/5658] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:11 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:11.744065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.744523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.745654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lazy-loading 'fault' on Instance uuid e96bd5c4-0171-41c5-906b-be602d3dcfae {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:58:11.810130 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.822465 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1323696-511c-411a-a611-bd7e260fcc1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 200 len: 1193 microversion: 2.1 time: 0.152877 Aug 04 04:58:11.829436 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2880/5659] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:11 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 1193 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:12.673660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:12.674936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:12.685745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.686646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.687647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.688278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.762759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:12.764091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:12.779543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.780944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=16 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.788087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.791233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.792280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.795508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.908401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:12.917666 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4307314c-26d3-42d5-8872-87fd6576fd6d tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1427 microversion: 2.1 time: 0.247993 Aug 04 04:58:12.934071 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2780/5660] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:12 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1427 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:12.945151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:12.949203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: e96bd5c4-0171-41c5-906b-be602d3dcfae] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:12.962232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.965284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.969627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.970275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.001954 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance e96bd5c4-0171-41c5-906b-be602d3dcfae could not be found. Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae HTTP/1.1 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance e96bd5c4-0171-41c5-906b-be602d3dcfae could not be found. Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'e96bd5c4-0171-41c5-906b-be602d3dcfae'} Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96bd5c4-0171-41c5-906b-be602d3dcfae could not be found. Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96bd5c4-0171-41c5-906b-be602d3dcfae could not be found. Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:58:13.014866 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:58:13.020926 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:58:13.020926 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:58:13.020926 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:58:13.020926 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:58:13.020926 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:58:13.020926 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96bd5c4-0171-41c5-906b-be602d3dcfae could not be found. Aug 04 04:58:13.020926 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:58:13.026384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance e96bd5c4-0171-41c5-906b-be602d3dcfae could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:58:13.027958 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a8eef09a-c2cc-412f-bf1e-ee860afeef79 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae" status: 404 len: 111 microversion: 2.1 time: 0.089034 Aug 04 04:58:13.032887 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2781/5661] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:12 2022] GET /compute/v2.1/servers/e96bd5c4-0171-41c5-906b-be602d3dcfae => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:58:13.175735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:13.191367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:13.193638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:13.198161 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a9088e07-9bae-487d-ad97-97a1ad421e8a tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.448312 Aug 04 04:58:13.213123 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2881/5662] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:12 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:58:13.939510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:13.940811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:13.959359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.960192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.961224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.961896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.201349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:14.211412 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-df700dd2-8555-4a02-9ffb-3a5cc21e9ad2 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1427 microversion: 2.1 time: 0.275734 Aug 04 04:58:14.212324 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2782/5663] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:13 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1427 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:14.226867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:14.228258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:14.244935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.245943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.247202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.247888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.412617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-64e497ca-d6e2-4134-9832-0ac5225658b4 req-33951ca7-fa51-466a-8550-8e44b5f85d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4bb523-1aa1-48a6-9cf9-688fde082a6c", "name": "network-vif-plugged", "status": "completed", "tag": "39cf7e50-b5c5-4e0e-88a6-92c11993727e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:14.430459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-64e497ca-d6e2-4134-9832-0ac5225658b4 req-33951ca7-fa51-466a-8550-8e44b5f85d27 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.431034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-64e497ca-d6e2-4134-9832-0ac5225658b4 req-33951ca7-fa51-466a-8550-8e44b5f85d27 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.459408 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-64e497ca-d6e2-4134-9832-0ac5225658b4 req-33951ca7-fa51-466a-8550-8e44b5f85d27 service nova] Creating event network-vif-plugged:39cf7e50-b5c5-4e0e-88a6-92c11993727e for instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c on n-h2-851337-5 Aug 04 04:58:14.472341 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-64e497ca-d6e2-4134-9832-0ac5225658b4 req-33951ca7-fa51-466a-8550-8e44b5f85d27 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065185 Aug 04 04:58:14.476976 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2783/5664] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:14.586748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:14.612635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:14.615575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:14.620614 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-32959867-a293-42f7-b5bb-dec61d67cf49 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.398875 Aug 04 04:58:14.630504 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2882/5665] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:14 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:15.234657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:15.236036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:15.256905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.257628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.258613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.259248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.264066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:15.487601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:15.503906 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-465ec9ae-69b4-44fe-9d1e-97406c1e8f96 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1427 microversion: 2.1 time: 0.274547 Aug 04 04:58:15.505441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2784/5666] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:15 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1427 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:15.654457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:15.655679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:15.669991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.673710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.674911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.675544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.706098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-828859894", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:15.840294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] validate_networks() for None {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:58:16.045621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:16.060409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:16.068369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:16.078923 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ea26014-fd5c-41e1-80ba-97d45bb4dbbe tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.429056 Aug 04 04:58:16.079559 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2883/5667] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:15 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:16.383673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:58:16.384366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:58:16.384874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:58:16.385027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:58:16.385442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:58:16.398821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.399595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:16.400593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.401213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:16.437744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Getting quotas for project e51a9775e2f04a58a42aa18a9a7a117e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:58:16.449340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Getting quotas for user 09437d08e6b04b7fbe2dbaee8731f195 and project e51a9775e2f04a58a42aa18a9a7a117e. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:58:16.467146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:58:16.470635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:58:16.530124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:16.534235 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c8bd2313-2d40-49df-9aeb-e87171e0cc54 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844036 Aug 04 04:58:16.537179 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2785/5668] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:58:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:58:16.547064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:16.552211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e38d15e0-3148-4c97-b43d-a257ed806e05 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:16.553081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e38d15e0-3148-4c97-b43d-a257ed806e05 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:16.567256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.573073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:16.591010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.600076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:16.669950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e38d15e0-3148-4c97-b43d-a257ed806e05 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:16.683934 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e38d15e0-3148-4c97-b43d-a257ed806e05 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1213 microversion: 2.1 time: 0.136531 Aug 04 04:58:16.694417 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2786/5669] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:16 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:17.022666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.037065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d470330a-b6a6-4540-8ad3-851862e0a692 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1606 microversion: 2.1 time: 0.512386 Aug 04 04:58:17.053414 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2884/5670] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:16 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1606 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:17.064074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:17.064717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:17.071608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.072077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.072875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.073334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.131474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:17.132530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:17.146995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.147863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.149491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.150158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.747022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.773289 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5ab0831-3bc5-40f1-864e-560ee3c12c7f tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1606 microversion: 2.1 time: 0.709806 Aug 04 04:58:17.778067 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2787/5671] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:17 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1606 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:17.798945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c81f8822-4421-48dd-81bb-55c2158356fd tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:17.801666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c81f8822-4421-48dd-81bb-55c2158356fd tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:17.817413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.839308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.843614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.847464 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a66d516-7289-4dfe-b5c6-bf7e3fcf7ff7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 0.730880 Aug 04 04:58:17.855066 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2885/5672] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:17 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:17.872143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:17.875453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:17.884263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.885213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.886176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.886776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.946680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c81f8822-4421-48dd-81bb-55c2158356fd tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.966764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c81f8822-4421-48dd-81bb-55c2158356fd tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1213 microversion: 2.1 time: 0.186261 Aug 04 04:58:17.986042 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2788/5673] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:17 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1213 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:18.170917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:18.182751 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1db0dca-9537-4c61-9502-8481541324c4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1606 microversion: 2.1 time: 0.321086 Aug 04 04:58:18.184047 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2886/5674] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:17 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1606 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:18.885783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:18.886581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:18.904141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.904272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.905248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.905761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.991309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:18.991937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:19.014360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.014814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.021820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.027313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.342136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:19.355499 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f54a2d0-5712-4b59-bfa1-f7f60152eef3 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1283 microversion: 2.1 time: 0.369437 Aug 04 04:58:19.356104 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2887/5675] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:18 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1283 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:20.047941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f82e4fce-67f0-4eb1-b9de-0039a32ac820 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:20.055587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f82e4fce-67f0-4eb1-b9de-0039a32ac820 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:20.073617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f82e4fce-67f0-4eb1-b9de-0039a32ac820 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.076074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f82e4fce-67f0-4eb1-b9de-0039a32ac820 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.078947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f82e4fce-67f0-4eb1-b9de-0039a32ac820 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.079730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f82e4fce-67f0-4eb1-b9de-0039a32ac820 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.115082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:20.151342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:20.153997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:20.156645 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2ae3a23a-469b-4640-a282-8a216510a544 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1739 microversion: 2.20 time: 1.279167 Aug 04 04:58:20.161112 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2789/5676] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:18 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1739 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:20.186457 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f82e4fce-67f0-4eb1-b9de-0039a32ac820 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action" status: 200 len: 24575 microversion: 2.1 time: 0.159503 Aug 04 04:58:20.187796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2888/5677] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:58:20 2022] POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action => generated 24575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:58:20.384436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:20.386392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:20.401816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.402715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.403691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.404209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.499090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:20.508497 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a6793fba-c629-4b6a-8271-2b47a674796d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1271 microversion: 2.1 time: 0.130455 Aug 04 04:58:20.509384 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2790/5678] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:20 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:21.193186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:21.195901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:21.236725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.255977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.258270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.258270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.539855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:21.540508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:21.556575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.557333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.560072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.560739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.766519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:21.774849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.795371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:21.796964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:21.806761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5c48d165-b32e-408d-8f05-b1a9475298eb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1721 microversion: 2.20 time: 0.623342 Aug 04 04:58:21.807602 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2889/5679] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:21 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1721 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:21.982317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:21.992951 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8dc0edf1-2fca-4656-8e19-cb5fe7a6b5be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1313 microversion: 2.1 time: 0.460545 Aug 04 04:58:21.994114 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2791/5680] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:21 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:22.114684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6a1eae86-bbd5-4b04-a15f-bc32cf0e3a66 req-30046218-fd00-4068-a93d-322ecef58524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d51c82-d2ac-4d02-9d3d-9f9d5050243a", "tag": "1f7aa792-58d2-414f-a976-c44a63d0d7c5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:22.131658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a1eae86-bbd5-4b04-a15f-bc32cf0e3a66 req-30046218-fd00-4068-a93d-322ecef58524 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:22.132259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a1eae86-bbd5-4b04-a15f-bc32cf0e3a66 req-30046218-fd00-4068-a93d-322ecef58524 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:22.156255 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6a1eae86-bbd5-4b04-a15f-bc32cf0e3a66 req-30046218-fd00-4068-a93d-322ecef58524 service nova] Creating event network-changed:1f7aa792-58d2-414f-a976-c44a63d0d7c5 for instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a on n-h1-851337-5 Aug 04 04:58:22.162169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6a1eae86-bbd5-4b04-a15f-bc32cf0e3a66 req-30046218-fd00-4068-a93d-322ecef58524 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052029 Aug 04 04:58:22.163927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2890/5681] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:22.542585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-57b45c17-8a0e-4501-ae13-b00bf88ba7a0 req-04ae9128-5fb0-494d-b47f-d194a8d364c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4bb523-1aa1-48a6-9cf9-688fde082a6c", "tag": "39cf7e50-b5c5-4e0e-88a6-92c11993727e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:22.557290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:22.564034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-57b45c17-8a0e-4501-ae13-b00bf88ba7a0 req-04ae9128-5fb0-494d-b47f-d194a8d364c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:22.565486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-57b45c17-8a0e-4501-ae13-b00bf88ba7a0 req-04ae9128-5fb0-494d-b47f-d194a8d364c4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:22.593240 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-57b45c17-8a0e-4501-ae13-b00bf88ba7a0 req-04ae9128-5fb0-494d-b47f-d194a8d364c4 service nova] Creating event network-changed:39cf7e50-b5c5-4e0e-88a6-92c11993727e for instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c on n-h2-851337-5 Aug 04 04:58:22.608392 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-57b45c17-8a0e-4501-ae13-b00bf88ba7a0 req-04ae9128-5fb0-494d-b47f-d194a8d364c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263373 Aug 04 04:58:22.618590 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2792/5682] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:22.853094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:22.859601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:22.884422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:22.889814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:22.897379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:22.901077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:22.901854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.025845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:23.026570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:23.040139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.040890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.041918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.044261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.281500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:23.299574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:23.306424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:23.308126 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff60efc0-82a7-4a28-bf57-5963db9d979c tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1724 microversion: 2.20 time: 0.476513 Aug 04 04:58:23.311804 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2891/5683] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:22 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:23.338011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-09705cd3-d6ff-445a-805f-396702b3f949 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "744aebbf-b234-4520-9c25-879baf10a502"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:23.342169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-09705cd3-d6ff-445a-805f-396702b3f949 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:23.364058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09705cd3-d6ff-445a-805f-396702b3f949 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.364780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09705cd3-d6ff-445a-805f-396702b3f949 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.369021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09705cd3-d6ff-445a-805f-396702b3f949 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.371023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09705cd3-d6ff-445a-805f-396702b3f949 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.468136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:23.487641 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1bae3c94-d86e-4b60-b874-92b5a05503e7 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1313 microversion: 2.1 time: 0.456709 Aug 04 04:58:23.487641 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2793/5684] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:23 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:23.921512 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-09705cd3-d6ff-445a-805f-396702b3f949 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.588015 Aug 04 04:58:23.922603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2892/5685] 10.222.0.69 () {62 vars in 1364 bytes} [Thu Aug 4 04:58:23 2022] POST /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-volume_attachments => generated 188 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:58:24.086864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a57e3fda-5dda-40fb-b04f-edda8017151b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:24.087779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a57e3fda-5dda-40fb-b04f-edda8017151b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:24.102159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a57e3fda-5dda-40fb-b04f-edda8017151b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.102976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a57e3fda-5dda-40fb-b04f-edda8017151b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.104306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a57e3fda-5dda-40fb-b04f-edda8017151b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.105086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a57e3fda-5dda-40fb-b04f-edda8017151b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.237570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d29598d6-1572-4ea0-adb5-a77acd20c939 req-7488e005-5719-4adc-999c-a9a4ebf2c535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8090bf-53e3-41fb-94a5-b89f2fddb011", "name": "network-vif-unplugged", "status": "completed", "tag": "fb23e0a5-cdd2-4201-9424-4c42c93258cd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:24.256769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d29598d6-1572-4ea0-adb5-a77acd20c939 req-7488e005-5719-4adc-999c-a9a4ebf2c535 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.257550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d29598d6-1572-4ea0-adb5-a77acd20c939 req-7488e005-5719-4adc-999c-a9a4ebf2c535 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.274259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.server_external_events [req-d29598d6-1572-4ea0-adb5-a77acd20c939 req-7488e005-5719-4adc-999c-a9a4ebf2c535 service nova] Unable to find a host for instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011. Dropping event network-vif-unplugged {{(pid=119343) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 04:58:24.275691 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d29598d6-1572-4ea0-adb5-a77acd20c939 req-7488e005-5719-4adc-999c-a9a4ebf2c535 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043956 Aug 04 04:58:24.276846 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2893/5686] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 04:58:24.440338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a57e3fda-5dda-40fb-b04f-edda8017151b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-volume_attachments/744aebbf-b234-4520-9c25-879baf10a502" status: 202 len: 0 microversion: 2.20 time: 0.361732 Aug 04 04:58:24.443465 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2794/5687] 10.222.0.69 () {60 vars in 1457 bytes} [Thu Aug 4 04:58:24 2022] DELETE /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-volume_attachments/744aebbf-b234-4520-9c25-879baf10a502 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:24.500679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:24.501527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:24.509745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.510504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.511379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.512235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.518102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:24.518718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:24.526715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.537521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.537521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.537521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.612456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119342) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 04:58:24.727102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:24.728656 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc27b250-f7c0-49af-9393-c322a1b3a4e6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "POST /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/action" status: 202 len: 0 microversion: 2.20 time: 0.215368 Aug 04 04:58:24.732514 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2795/5688] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Aug 4 04:58:24 2022] POST /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:24.739797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:24.740566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:24.746596 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7bbc92a-8a75-4b04-a2cb-4a355055e60e tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1313 microversion: 2.1 time: 0.250915 Aug 04 04:58:24.748028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.748494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.749288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.749729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.767498 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2894/5689] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:24 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:24.964727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:24.974265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:24.975901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:24.977132 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b16638e2-f9dc-4360-a477-319a0d090bed tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1672 microversion: 2.20 time: 0.242947 Aug 04 04:58:24.978026 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2796/5690] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:24 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1672 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:25.772034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:25.772657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:25.781322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.782264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.783087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.784152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.977119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:25.985907 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3d159abc-6753-438a-941f-3ff3702c962b tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1313 microversion: 2.1 time: 0.217933 Aug 04 04:58:25.986532 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2895/5691] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:25 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:26.006680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:26.008189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:26.020659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:26.021385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:26.022419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:26.022925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:26.213790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:26.223437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:26.225474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:26.226986 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-143b3c7a-6c75-4a4a-b323-fd100328e845 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1672 microversion: 2.20 time: 0.225030 Aug 04 04:58:26.227502 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2797/5692] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:26 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:27.010405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:27.011787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:27.021744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:27.022772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:27.023775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:27.024795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:27.220678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:27.232016 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2adffab1-417d-4483-a8c9-132ae0f70abc tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1313 microversion: 2.1 time: 0.225758 Aug 04 04:58:27.233068 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2896/5693] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:27 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:27.248414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:27.257044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:27.257707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:27.266748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:27.267178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:27.268215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:27.268656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:27.485722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:27.497414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:27.499527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:27.501214 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a3499a69-a756-4c44-b498-6ab2ab1e0f1f tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.254166 Aug 04 04:58:27.502610 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2798/5694] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:27 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:28.257266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:28.258635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:28.266774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.267672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.268737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.269971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.489463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:28.505828 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57a88cd7-1b47-4aac-885b-a884af7aae1d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1313 microversion: 2.1 time: 0.253355 Aug 04 04:58:28.506815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2897/5695] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:28 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:28.527901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:28.529404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:28.531750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:28.541131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.541862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.547946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.548669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.766992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:28.793002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:28.797866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:28.799254 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6809eb8b-aecb-4fb5-a49f-adf8bed955c8 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.275286 Aug 04 04:58:28.802647 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2799/5696] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:28 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:29.095944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d73e54fe-10b7-4e65-bbf9-f41eb0a0c6e9 req-c006b6c4-d8f7-4260-8ab1-2954f0f4f1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d51c82-d2ac-4d02-9d3d-9f9d5050243a", "name": "network-vif-plugged", "status": "completed", "tag": "1f7aa792-58d2-414f-a976-c44a63d0d7c5"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:29.136739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d73e54fe-10b7-4e65-bbf9-f41eb0a0c6e9 req-c006b6c4-d8f7-4260-8ab1-2954f0f4f1ef service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.137564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d73e54fe-10b7-4e65-bbf9-f41eb0a0c6e9 req-c006b6c4-d8f7-4260-8ab1-2954f0f4f1ef service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.160646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d73e54fe-10b7-4e65-bbf9-f41eb0a0c6e9 req-c006b6c4-d8f7-4260-8ab1-2954f0f4f1ef service nova] Creating event network-vif-plugged:1f7aa792-58d2-414f-a976-c44a63d0d7c5 for instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a on n-h1-851337-5 Aug 04 04:58:29.176167 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d73e54fe-10b7-4e65-bbf9-f41eb0a0c6e9 req-c006b6c4-d8f7-4260-8ab1-2954f0f4f1ef service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085185 Aug 04 04:58:29.177441 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2898/5697] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:29.556207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:29.556847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:29.564593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.565352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.566947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.567625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.803906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:29.806823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:29.817658 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed60af5b-a856-4bee-9e25-6d167459995f tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1313 microversion: 2.1 time: 0.285049 Aug 04 04:58:29.822743 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2800/5698] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:29 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:29.831174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:29.834037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:29.846025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.851909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.852780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.853263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.180718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:30.190495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:30.194346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:30.195801 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3b579ee4-13d6-4cce-a2c0-3bbbf999ac8b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.374388 Aug 04 04:58:30.196860 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2899/5699] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:29 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:58:30.846824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:30.848767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:30.871952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.872730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.873984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.874597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.220318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:31.221797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:31.243545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.244285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.245397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.245998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.309687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:31.320534 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e2f79a35-5bf6-4102-8eb2-652457617b32 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1461 microversion: 2.1 time: 0.482630 Aug 04 04:58:31.348385 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2801/5700] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:30 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1461 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:31.373855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7859c347-3971-46e9-855a-ddc60a83fd96 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a20ea6f6-26cd-4569-be88-d9277375816b", "device": "/dev/sdb"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:31.379876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7859c347-3971-46e9-855a-ddc60a83fd96 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:31.387056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7859c347-3971-46e9-855a-ddc60a83fd96 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.387763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7859c347-3971-46e9-855a-ddc60a83fd96 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.389088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7859c347-3971-46e9-855a-ddc60a83fd96 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.389922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7859c347-3971-46e9-855a-ddc60a83fd96 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.591573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:31.614523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:31.632536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:31.634649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-688b7d1c-de8c-4978-9f77-065d1d3fa71b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.418415 Aug 04 04:58:31.635815 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2900/5701] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:31 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:58:31.882304 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7859c347-3971-46e9-855a-ddc60a83fd96 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "POST /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531382 Aug 04 04:58:31.883046 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2802/5702] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 04:58:31 2022] POST /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:32.671644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:32.671644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:32.682442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:32.682887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:32.684178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:32.685042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:32.963946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:32.987349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:32.991272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:32.994180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-35e19c26-0041-4bc6-b002-aa91fd927064 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.339585 Aug 04 04:58:33.002573 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2901/5703] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:32 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:34.019048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:34.020551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:34.041056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.041763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.043907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.044569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.389304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:34.401244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:34.418797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:34.420404 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e143f6b-f918-4aea-9d03-3276a36cd5f7 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.406116 Aug 04 04:58:34.436730 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2803/5704] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:34 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:35.482659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:35.483466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:35.501588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.502189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.503104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.504166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.711844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:35.729529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:35.731124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:35.732360 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-610f9883-60e7-4695-988b-8ecb4d7b61f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.266040 Aug 04 04:58:35.733337 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2902/5705] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:35 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:36.761503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:36.762873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:36.793100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:36.793970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:36.795097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:36.796795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:37.000719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:37.009559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:37.011121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:37.012615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c58d0e63-c6ba-4524-a3e4-2e85c09ef8dd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.257048 Aug 04 04:58:37.013585 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2804/5706] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:36 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:38.036491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:38.037727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:38.044968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.045626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.046581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.047204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.244108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:38.252337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:38.253900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:38.255493 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad36c304-6417-4555-8429-386012675942 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.223448 Aug 04 04:58:38.256390 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2903/5707] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:38 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:39.280304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:39.281003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:39.288958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.289415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.290194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.290633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.431525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:39.440207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:39.441821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:39.443302 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0d2d3f1d-5a75-41de-9a87-d64cf3def73e tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.167006 Aug 04 04:58:39.443881 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2805/5708] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:39 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:40.466678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:40.467362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:40.475345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.475819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.477621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.478083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.666439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:40.682857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:40.685734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:40.688014 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c763ae2f-35d1-4f0b-b84b-aa6fbb41fd6d tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.224563 Aug 04 04:58:40.688612 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2904/5709] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:40 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:41.711819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:41.712874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:41.720764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.721227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:41.727160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.727788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:41.880987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:41.892299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:41.894673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:41.895760 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f100fc7-bc0a-440a-adf7-c4a860b0e4d3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.188407 Aug 04 04:58:41.896959 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2806/5710] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:41 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:42.255180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1e258fbf-6883-40cd-adde-e0df45233713 req-32332a33-7e60-4366-96a3-08dfebe0d5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8090bf-53e3-41fb-94a5-b89f2fddb011", "name": "network-vif-plugged", "status": "completed", "tag": "fb23e0a5-cdd2-4201-9424-4c42c93258cd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:42.286084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1e258fbf-6883-40cd-adde-e0df45233713 req-32332a33-7e60-4366-96a3-08dfebe0d5b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:42.286854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1e258fbf-6883-40cd-adde-e0df45233713 req-32332a33-7e60-4366-96a3-08dfebe0d5b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:42.314124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1e258fbf-6883-40cd-adde-e0df45233713 req-32332a33-7e60-4366-96a3-08dfebe0d5b5 service nova] Creating event network-vif-plugged:fb23e0a5-cdd2-4201-9424-4c42c93258cd for instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 on n-h2-851337-5 Aug 04 04:58:42.324251 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1e258fbf-6883-40cd-adde-e0df45233713 req-32332a33-7e60-4366-96a3-08dfebe0d5b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072812 Aug 04 04:58:42.325769 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2905/5711] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:42.919428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:42.920047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:42.928745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:42.929209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:42.932726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:42.933269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:43.152269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:43.177048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:43.179113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:43.180509 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e367806f-11d3-4b01-b34b-8352978305cd tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.265187 Aug 04 04:58:43.181202 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2807/5712] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:42 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:44.205000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:44.207183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:44.226685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.227219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.228035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.228481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.265034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:44.396377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:44.406083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:44.407649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:44.408851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70df1b61-9eef-47d5-806c-3f9c7b943995 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1730 microversion: 2.20 time: 0.208392 Aug 04 04:58:44.410225 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2906/5713] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:44 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:45.434668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:45.436689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:45.454216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.454917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.455706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.458128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.662906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:45.674192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:45.676409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:45.677790 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1b14be3-65a9-4b62-8523-b7df276566c5 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1717 microversion: 2.20 time: 0.248789 Aug 04 04:58:45.678691 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2808/5714] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:58:45 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1717 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:58:47.832975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1461908575", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "69f787f4-f1f0-4335-adfd-061f3d044e13", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:47.929674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:58:48.355960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:58:48.356663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:58:48.357344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:58:48.357962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:58:48.358568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:58:48.371161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:48.371626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:48.372451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:48.372901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:48.392247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:58:48.398531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:58:48.414690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:58:48.416990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='69f787f4-f1f0-4335-adfd-061f3d044e13',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:58:48.498860 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-12d08e25-e77c-4fff-894a-8d0f0918d091 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669649 Aug 04 04:58:48.500172 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2907/5715] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:58:48.510546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6fa22809-4e88-4a2a-b969-d57d1b7d6b31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:48.511760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6fa22809-4e88-4a2a-b969-d57d1b7d6b31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:48.585503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6fa22809-4e88-4a2a-b969-d57d1b7d6b31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:48.594087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6fa22809-4e88-4a2a-b969-d57d1b7d6b31 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1057 microversion: 2.1 time: 0.087311 Aug 04 04:58:48.608958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2809/5716] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:48 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1057 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:49.619404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:49.620761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:49.671151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.671983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.673042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.673744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.775821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:49.785867 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-752212c8-6bdc-4bd3-bd0c-be48a87a333c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1127 microversion: 2.1 time: 0.171733 Aug 04 04:58:49.787009 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2908/5717] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:49 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1127 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:50.438053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a1d615e-5556-45b6-8430-8cb9b808b7dc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:50.439446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a1d615e-5556-45b6-8430-8cb9b808b7dc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:50.466550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1d615e-5556-45b6-8430-8cb9b808b7dc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.467789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1d615e-5556-45b6-8430-8cb9b808b7dc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.469857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1d615e-5556-45b6-8430-8cb9b808b7dc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.470688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a1d615e-5556-45b6-8430-8cb9b808b7dc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.813516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:50.816057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:50.835980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.838108 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a1d615e-5556-45b6-8430-8cb9b808b7dc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1833 microversion: 2.1 time: 0.404518 Aug 04 04:58:50.839556 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2810/5718] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:50 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1833 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:50.839940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.849246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.850885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.869709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:50.870816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:50.886843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.887350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.888219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.888758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.081524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:51.112224 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0bd38b1c-1ec2-4594-815b-fcecb0c2faf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.305816 Aug 04 04:58:51.118704 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2909/5719] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:50 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:51.182724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:51.210160 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad7d3d18-3b96-41a0-9cc9-2257fb0978ec tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1682 microversion: 2.1 time: 0.349324 Aug 04 04:58:51.215903 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2811/5720] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:50 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1682 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:51.402344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8dac1133-7094-4a0c-8bf8-26a8087f9ad7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:51.405366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8dac1133-7094-4a0c-8bf8-26a8087f9ad7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:51.428201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dac1133-7094-4a0c-8bf8-26a8087f9ad7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.433749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dac1133-7094-4a0c-8bf8-26a8087f9ad7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.435509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dac1133-7094-4a0c-8bf8-26a8087f9ad7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.436667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dac1133-7094-4a0c-8bf8-26a8087f9ad7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.564877 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8dac1133-7094-4a0c-8bf8-26a8087f9ad7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action" status: 200 len: 32640 microversion: 2.1 time: 0.166800 Aug 04 04:58:51.567820 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2910/5721] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:58:51 2022] POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action => generated 32640 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:58:51.725048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:51.726270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:51.739713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.744348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.745874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.746141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.863317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6e8888d5323d46a3b5f2be8cb8ad4424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23712bf4540d438ca89380c68a92dca1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:51.864451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] flavor_id is None. Assuming migration. {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 04:58:51.865129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 04:58:52.137449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:52.138738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:52.150732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.153959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.154982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.160857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.387246 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-79a69ff5-3d8e-411e-9fbd-227fc6f4d620 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action" status: 202 len: 0 microversion: 2.1 time: 0.666442 Aug 04 04:58:52.388396 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2812/5722] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:58:51 2022] POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:58:52.397188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:52.398103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:52.409686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.410286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.411692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.412325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.606843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:52.633292 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83a8129c-4d51-4356-a2bb-30eadef37922 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.499795 Aug 04 04:58:52.634373 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2911/5723] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:52 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:52.680531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e98770c4-36ee-4ad3-a2c7-14c8d7d5d2b7 req-afecba4f-ea4b-4d6b-9d94-ccbb91f5ff61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283366f9-4639-4ea0-8758-51008d68af4e", "tag": "06c25993-fdb4-447d-88a6-f80a790332ca"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:58:52.700991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e98770c4-36ee-4ad3-a2c7-14c8d7d5d2b7 req-afecba4f-ea4b-4d6b-9d94-ccbb91f5ff61 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.701455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e98770c4-36ee-4ad3-a2c7-14c8d7d5d2b7 req-afecba4f-ea4b-4d6b-9d94-ccbb91f5ff61 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.731353 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e98770c4-36ee-4ad3-a2c7-14c8d7d5d2b7 req-afecba4f-ea4b-4d6b-9d94-ccbb91f5ff61 service nova] Creating event network-changed:06c25993-fdb4-447d-88a6-f80a790332ca for instance 283366f9-4639-4ea0-8758-51008d68af4e on n-h2-851337-5 Aug 04 04:58:52.741497 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e98770c4-36ee-4ad3-a2c7-14c8d7d5d2b7 req-afecba4f-ea4b-4d6b-9d94-ccbb91f5ff61 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074181 Aug 04 04:58:52.742150 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2912/5724] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:53.280160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:53.292560 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7849cfbc-9a60-43fb-937d-87f8d6de4c52 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1691 microversion: 2.1 time: 0.899967 Aug 04 04:58:53.293559 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2813/5725] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:52 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1691 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:53.661977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:53.663260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:53.674730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:53.676784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:53.679283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:53.680432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:53.681122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.082291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:54.115151 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9c293757-1f93-4c80-9eec-86a716ddba9d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.458876 Aug 04 04:58:54.131029 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2913/5726] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:53 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:54.316679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:54.318184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:54.320539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.333321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.338569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.344046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.346124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.376131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c97cab5-3b9d-4d10-a16a-0431094a84be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:54.376711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c97cab5-3b9d-4d10-a16a-0431094a84be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:54.408031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c97cab5-3b9d-4d10-a16a-0431094a84be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.413321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c97cab5-3b9d-4d10-a16a-0431094a84be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.414419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c97cab5-3b9d-4d10-a16a-0431094a84be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.415234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c97cab5-3b9d-4d10-a16a-0431094a84be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.482742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c97cab5-3b9d-4d10-a16a-0431094a84be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.111032 Aug 04 04:58:54.492718 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2914/5727] 10.222.0.69 () {58 vars in 1293 bytes} [Thu Aug 4 04:58:54 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c/os-server-password => generated 116 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:58:54.781575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:54.792867 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-da36dc85-d2b4-4ac1-9099-4b7939603f85 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1691 microversion: 2.1 time: 0.481078 Aug 04 04:58:54.809310 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2814/5728] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:54 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1691 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:55.138336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:55.138994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:55.146935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.148048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.149014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.149466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.377459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:55.400590 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e88c5a9e-a506-419e-8004-20a5ff9392d5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.262606 Aug 04 04:58:55.402527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2915/5729] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:55 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:55.825154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:55.826794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:55.851154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.853376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.855928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.860344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.891767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.193065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:56.209783 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-221d518f-0282-4e7e-8c1f-8694b985bd4f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1691 microversion: 2.1 time: 0.388501 Aug 04 04:58:56.210623 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2815/5730] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:55 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1691 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:56.422499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:56.423149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:56.432778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:56.438488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:56.440411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:56.441157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:56.659664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:56.671519 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24355969-65d6-4be5-817e-dbd6d92908d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.252282 Aug 04 04:58:56.672216 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2916/5731] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:56 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:57.247913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:57.252956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:57.283515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:57.285588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:57.286816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:57.287503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:57.557443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:57.570350 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3f23415-daf7-4ed2-a671-cdd3d3c5ce5b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.333121 Aug 04 04:58:57.580931 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2816/5732] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:57 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:57.702603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:57.703646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:57.711265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:57.711891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:57.712995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:57.713435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:57.948940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:57.959055 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0e6fcadb-924d-4b12-8cd6-024d29ea0479 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.260429 Aug 04 04:58:57.960067 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2917/5733] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:57 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:58.610430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:58.612214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:58.619825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.622510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.623304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.624570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.625539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.785482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:58.794348 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8f7ce23a-abcc-4cf2-8ffd-ad4db75dd526 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.189509 Aug 04 04:58:58.794942 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2817/5734] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:58 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:58.990663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:58.992543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:58.998079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.999135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:59.004105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.004483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.005517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.006116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.183529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:59.193159 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f09e690c-ca90-41ac-a67d-a3ed2721b23b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.215681 Aug 04 04:58:59.201028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2918/5735] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:58 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:59.815317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:59.816631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:59.824480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.824933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.827661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.828381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.981397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:59.992132 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fbc9100e-520b-4278-8543-98b73b94cb94 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.180909 Aug 04 04:59:00.003020 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2818/5736] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:59 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:00.216050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:00.216593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:00.224802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.225264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.226064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.226512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.405294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:00.417204 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-faeecbf2-79d5-494f-88f6-d535e7fa8f48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.205886 Aug 04 04:59:00.432381 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2919/5737] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:00 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:01.036429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:01.037188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:01.047858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.048549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.050416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.051100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.296086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:01.306114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-54cec82b-581b-4354-ae44-680c5202d026 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.292222 Aug 04 04:59:01.307414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2819/5738] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:01 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:01.445718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:01.446531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:01.457311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.458048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.459205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.459823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.696570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:01.705311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1731d59d-4897-49ad-96cc-594e9a3c1036 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.268701 Aug 04 04:59:01.706800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2920/5739] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:01 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:02.328355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:02.329774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:02.338250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.338718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.339684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.340152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.494476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:02.503493 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81b45399-1afe-46b7-9fac-80330099abef tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.179200 Aug 04 04:59:02.504089 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2820/5740] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:02 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:02.727941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:02.728570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:02.747692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.748158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.748955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.749401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.948629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:02.962793 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-998520a9-e3a0-45b4-8898-1fb8da53be5b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.239342 Aug 04 04:59:02.964174 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2921/5741] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:02 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:03.526147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:03.527376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:03.535813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:03.536505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:03.537298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:03.537739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:03.720411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:03.728335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8324520-9afe-440c-b2a3-48b708dc22c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.206962 Aug 04 04:59:03.728910 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2821/5742] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:03 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:03.986246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:03.987748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:03.995492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:03.996109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:03.997011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:03.997563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.134890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:04.143476 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22c1fa14-9458-4968-a8bf-3ff56b660600 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.161439 Aug 04 04:59:04.144213 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2922/5743] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:03 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:04.749967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:04.750532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:04.758642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.759132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.760319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.761138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.926686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:04.936001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-23fc23c7-b22a-4458-9859-bbb590316ba0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.189994 Aug 04 04:59:04.936813 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2822/5744] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:04 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:05.164856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:05.165657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:05.173089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.173766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.174755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.175246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.328330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:05.336773 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-86f5477f-a115-43fc-bf01-7917adda6449 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.176028 Aug 04 04:59:05.337507 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2923/5745] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:05 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:05.962693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:05.965485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:05.977607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.978450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.980515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.981268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.157418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:06.165989 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1276525f-e884-4e10-ba45-acc7d4664c67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.211968 Aug 04 04:59:06.167540 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2823/5746] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:05 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:06.358817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:06.359615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:06.370032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.370740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.372030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.373516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.544794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:06.553761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c4624bd-b15c-4293-8f1b-92798fb229bd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.199435 Aug 04 04:59:06.554679 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2924/5747] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:06 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:07.188137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:07.189894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:07.197246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.197975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:07.198925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.199574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:07.490380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:07.501197 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7396cc6d-05b8-4d7c-af7c-9d1d268a0923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.316836 Aug 04 04:59:07.502780 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2824/5748] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:07 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:07.575716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:07.576342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:07.591759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.593767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:07.595250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.595899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:07.650581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.802128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:07.810777 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3ac274b4-78bf-4f6c-92d8-0f79872812d9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.240657 Aug 04 04:59:07.811772 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2925/5749] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:07 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:08.523628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:08.524254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:08.532339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:08.533645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:08.534093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:08.534748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:08.703338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:08.713204 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fdee53b5-5aaa-4ee0-8050-d23d3c67783a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.193623 Aug 04 04:59:08.714013 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2825/5750] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:08 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:08.833964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:08.834680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:08.841962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:08.842722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:08.843766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:08.844377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.025573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:09.035242 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-98f8f215-65cf-4375-a481-34581bd56b51 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.205118 Aug 04 04:59:09.037284 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2926/5751] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:08 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:09.754111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:09.754799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:09.770484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.770997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.771792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.772232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.965004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:09.974005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-671ecf7a-ca88-464c-a952-dd4f4f4b3ad0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.240812 Aug 04 04:59:09.987493 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2826/5752] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:09 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:10.057257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:10.058491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:10.067542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.068510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.069397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.069878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.229835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:10.239690 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a261f014-94f6-436d-af8c-ff83c967586c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1169 microversion: 2.1 time: 0.186620 Aug 04 04:59:10.240713 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2927/5753] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:10 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1169 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:10.996921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:10.997523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:11.005116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.005575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.006347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.006789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.152790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:11.162132 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce3112c8-3dcb-4185-aca9-77298bbee531 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.169171 Aug 04 04:59:11.162730 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2827/5754] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:10 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:11.260298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:11.261021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:11.268748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.269317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.270199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.270738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.405300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:11.428961 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d4ca736-d386-4726-b6a6-a49d9c1e870b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.172583 Aug 04 04:59:11.430047 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2928/5755] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:11 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:12.183390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:12.183944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:12.190912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.191409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:12.192161 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.192593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:12.347254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:12.355091 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce323e16-896d-4910-b13b-c27f69cc3253 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.175725 Aug 04 04:59:12.355671 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2828/5756] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:12 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:12.452616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:12.453298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:12.467220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.467686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:12.468480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.468929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:12.630359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:12.644383 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9463e611-ce41-4aa4-ad28-22e89bd0e8a5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.190172 Aug 04 04:59:12.645356 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2929/5757] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:12 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:13.379720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:13.381994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:13.392832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:13.393533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:13.395005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:13.395632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:13.574466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:13.595860 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d2a81d7-998a-494e-b238-ab3b21f12a40 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1696 microversion: 2.1 time: 0.221686 Aug 04 04:59:13.597177 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2829/5758] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:13 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1696 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:13.666062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:13.666680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:13.677203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:13.677656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:13.678533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:13.678990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:13.826606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:13.837962 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe078597-18e8-483d-a9f4-90080ce8c8e4 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.176269 Aug 04 04:59:13.843003 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2930/5759] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:13 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:14.621779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:14.622596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:14.638804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.639656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.640877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.642232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.696137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-851923b0-1ed4-404e-a2f6-2a0aed01952c req-08147709-634a-49b6-a05a-6e4a7c9e4b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "name": "network-vif-unplugged", "status": "completed", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:14.721987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-851923b0-1ed4-404e-a2f6-2a0aed01952c req-08147709-634a-49b6-a05a-6e4a7c9e4b88 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.723094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-851923b0-1ed4-404e-a2f6-2a0aed01952c req-08147709-634a-49b6-a05a-6e4a7c9e4b88 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.747522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-851923b0-1ed4-404e-a2f6-2a0aed01952c req-08147709-634a-49b6-a05a-6e4a7c9e4b88 service nova] Creating event network-vif-unplugged:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h2-851337-5 Aug 04 04:59:14.769198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-851923b0-1ed4-404e-a2f6-2a0aed01952c req-08147709-634a-49b6-a05a-6e4a7c9e4b88 service nova] Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:59:14.796816 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-851923b0-1ed4-404e-a2f6-2a0aed01952c req-08147709-634a-49b6-a05a-6e4a7c9e4b88 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109658 Aug 04 04:59:14.807377 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2931/5760] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:59:14.860693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:14.861779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:14.871125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.871657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.872526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.873037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.890299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:14.901002 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a8c7552-207e-4937-8d75-1dce7fd4fc1d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1695 microversion: 2.1 time: 0.287259 Aug 04 04:59:14.902272 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2830/5761] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:14 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1695 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:15.066483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:15.075330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ca70d27-77e0-436b-8a19-b5b53d8edcb5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.219039 Aug 04 04:59:15.076481 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2932/5762] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:14 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:15.924985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:15.926351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:15.935981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.936781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:15.937767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.938384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.097297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:16.097873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:16.107465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:16.107879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.108941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.109190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.109836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.121621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3129b761-b674-44f1-af56-29d497ffe97c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1695 microversion: 2.1 time: 0.201699 Aug 04 04:59:16.122633 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2831/5763] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:15 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:16.283968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:16.292679 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-89e5a2d6-8f2e-412d-88db-f0e410efc3dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.199518 Aug 04 04:59:16.293390 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2933/5764] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:16 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:16.789217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ecb5a63-b4e4-43e8-944d-8a0d37923409 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:16.791646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ecb5a63-b4e4-43e8-944d-8a0d37923409 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:16.798123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ecb5a63-b4e4-43e8-944d-8a0d37923409 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.799392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ecb5a63-b4e4-43e8-944d-8a0d37923409 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.800313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ecb5a63-b4e4-43e8-944d-8a0d37923409 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.800864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ecb5a63-b4e4-43e8-944d-8a0d37923409 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.805052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:16.831086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6c2f4daf-1453-4a1f-a9cd-e3dfcb352eb8 req-77b52078-f74d-4bc7-9735-a72948a39852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:16.832328 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ecb5a63-b4e4-43e8-944d-8a0d37923409 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047203 Aug 04 04:59:16.833241 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2832/5765] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Aug 4 04:59:16 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:16.842734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6c2f4daf-1453-4a1f-a9cd-e3dfcb352eb8 req-77b52078-f74d-4bc7-9735-a72948a39852 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.844506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6c2f4daf-1453-4a1f-a9cd-e3dfcb352eb8 req-77b52078-f74d-4bc7-9735-a72948a39852 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.858996 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6c2f4daf-1453-4a1f-a9cd-e3dfcb352eb8 req-77b52078-f74d-4bc7-9735-a72948a39852 service nova] Creating event network-changed:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h2-851337-5 Aug 04 04:59:16.867380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-6c2f4daf-1453-4a1f-a9cd-e3dfcb352eb8 req-77b52078-f74d-4bc7-9735-a72948a39852 service nova] Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 04:59:16.882239 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6c2f4daf-1453-4a1f-a9cd-e3dfcb352eb8 req-77b52078-f74d-4bc7-9735-a72948a39852 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055598 Aug 04 04:59:16.887507 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2934/5766] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:59:16.901315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:16.901832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:16.915758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.916132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.920820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.921298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.952932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:59:17.084596 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14921cd4-0b72-4af6-bde6-f176637ccc33 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 204 len: 0 microversion: 2.20 time: 0.185209 Aug 04 04:59:17.086043 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2833/5767] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:59:16 2022] DELETE /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:59:17.101134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:17.113340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:17.122903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.125215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.134137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.135238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.144917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:17.145977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:17.152852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.153574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.154544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.155207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.427820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:17.432592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:17.441149 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-58dbbff2-5799-4285-be0c-2236b5d10292 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1693 microversion: 2.1 time: 0.300977 Aug 04 04:59:17.443195 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2834/5768] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:17 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1693 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:17.444876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:17.446703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:17.448204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:17.448761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1699fe5-b1cd-4a5e-b458-182a79e5cfd0 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.357664 Aug 04 04:59:17.448886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:17.450773 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2935/5769] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:59:17 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:59:17.456443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.457174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.458178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.458914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.629751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:17.639441 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-988cf7ec-3080-4fd4-9870-4da1cb8b3214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.194629 Aug 04 04:59:17.651790 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2835/5770] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:17 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:18.504897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:18.505761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:18.509949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:18.510394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:18.513363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.514277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.515029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.515580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.522473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.524132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.532051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.533293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.810990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:18.820890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:18.821067 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9124c561-9eb0-409e-9d52-4b434081d5e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1693 microversion: 2.1 time: 0.315251 Aug 04 04:59:18.821580 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2836/5771] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:18 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1693 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:18.829088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:18.830639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:18.838218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:18.838845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:18.844465 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5fbe8dd3-2fcc-47d0-8321-ddb90e1a0b54 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.344000 Aug 04 04:59:18.845069 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2936/5772] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:59:18 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:59:18.845661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.846360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.847363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.848098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.997849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:19.008155 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd467e77-3f20-4a6a-a0bc-87902b9366fd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.185510 Aug 04 04:59:19.008752 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2837/5773] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:18 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:19.844225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:19.844891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:19.858289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.858746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.863774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.864672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.871496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:19.873220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:19.894462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.895254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.896218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.897058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.289308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.312047 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d39ca7a-ea77-478a-adeb-bac475f30f26 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1690 microversion: 2.1 time: 0.468748 Aug 04 04:59:20.341334 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2937/5774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:19 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1690 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:20.359519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:20.363336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:20.374621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.379984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.381000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.381604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.466310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.480772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.486879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.488863 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d358d75-1bcc-41a0-bf78-b3ae90d842f6 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1723 microversion: 2.20 time: 0.621644 Aug 04 04:59:20.492272 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2838/5775] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:59:19 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1723 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:59:20.508680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a570ff55-76a5-4b2a-a905-e19b497f8426 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:20.511918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a570ff55-76a5-4b2a-a905-e19b497f8426 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:20.520617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a570ff55-76a5-4b2a-a905-e19b497f8426 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.521301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a570ff55-76a5-4b2a-a905-e19b497f8426 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.523138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a570ff55-76a5-4b2a-a905-e19b497f8426 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.527704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a570ff55-76a5-4b2a-a905-e19b497f8426 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.624742 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a570ff55-76a5-4b2a-a905-e19b497f8426 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action" status: 204 len: 0 microversion: 2.1 time: 0.130910 Aug 04 04:59:20.628669 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2839/5776] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:59:20 2022] POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:20.648056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:20.656114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:20.674539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.675104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.676095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.689536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.697680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.708274 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-de8f1665-dd75-4e6c-b2ba-ba53272b96f1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.365343 Aug 04 04:59:20.712051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2938/5777] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:20 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:20.976831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.987163 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c34b2f7c-5249-4b8e-a0e0-900e1b3d7985 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1690 microversion: 2.1 time: 0.353015 Aug 04 04:59:21.001816 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2840/5778] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:20 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1690 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:21.503101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3e52fbee-4dfd-421d-8ae0-356b354fca8d req-50a87780-2ebc-46d8-8f54-51469a2afa04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8090bf-53e3-41fb-94a5-b89f2fddb011", "name": "network-vif-deleted", "tag": "fb23e0a5-cdd2-4201-9424-4c42c93258cd"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:21.516641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:21.518898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:21.533073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.535519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.537952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.538425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.542860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3e52fbee-4dfd-421d-8ae0-356b354fca8d req-50a87780-2ebc-46d8-8f54-51469a2afa04 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.544717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3e52fbee-4dfd-421d-8ae0-356b354fca8d req-50a87780-2ebc-46d8-8f54-51469a2afa04 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.580065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3e52fbee-4dfd-421d-8ae0-356b354fca8d req-50a87780-2ebc-46d8-8f54-51469a2afa04 service nova] Creating event network-vif-deleted:fb23e0a5-cdd2-4201-9424-4c42c93258cd for instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 on n-h2-851337-5 Aug 04 04:59:21.600901 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3e52fbee-4dfd-421d-8ae0-356b354fca8d req-50a87780-2ebc-46d8-8f54-51469a2afa04 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105172 Aug 04 04:59:21.603156 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2939/5779] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:59:21.736657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:21.744335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:21.746849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:21.762021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:21.765176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.766264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04733db33887418d9437bf7346bbc511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82d8b39aae447e89fa03246411a8eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:21.768356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.769821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b2906e5-a3bc-464f-b91c-e133f184e42b tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 200 len: 1366 microversion: 2.20 time: 0.258068 Aug 04 04:59:21.770334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.771486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.773020 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2841/5780] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:59:21 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:59:22.012887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:22.014548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:22.037273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.037772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:22.039348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.043324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:22.124546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:22.143854 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5790382e-8f39-4914-9573-90d03ce7b6c3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.412277 Aug 04 04:59:22.144860 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2940/5781] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:21 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:22.291425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:22.302448 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-af5de6ee-db64-41cd-9eee-553b8daa33a0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1690 microversion: 2.1 time: 0.297558 Aug 04 04:59:22.318115 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2842/5782] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:22 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1690 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:22.803074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:22.803705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:22.817899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.818382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:22.819190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.825030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:22.844823 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] HTTP exception thrown: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Request method failure captured: Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 HTTP/1.1 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61CMOexmsu3Y7_so_ChBOtHx98_Svbg_zfSS9qYm5Cbc1uSu51aBFU3UpEdXszpDbp-0d6VkhSGnFR5Gi8RhHf0-UvSk-rnxFqOgrJwkioMurK9_jz8MNi6Kg_MypwyvogNVsCUldo8-S7NJMyvAuVed0izuU1Y-ngMGYaXnUwKeNPc Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c82d8b39aae447e89fa03246411a8eff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04733db33887418d9437bf7346bbc511 Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0f8090bf-53e3-41fb-94a5-b89f2fddb011'} Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:22.847135 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:22.852543 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:22.854676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Returning 404 to user: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:22.856135 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3daccb97-ae9f-4b95-ab9e-2ed5e3ea34c3 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 404 len: 111 microversion: 2.20 time: 0.065521 Aug 04 04:59:22.857253 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2941/5783] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:59:22 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:59:22.867370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d9588b1c-492b-43a3-a99d-2455f0bc3273 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '.version_select at 0x7f1923a4b5e0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:22.875078 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9588b1c-492b-43a3-a99d-2455f0bc3273 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [1b3553b0-2080-4552-b69c-cd78772dd193] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 04:59:23.172094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:23.173016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:23.180963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:23.181691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:23.182981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:23.184076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:23.409383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:23.423568 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6d44945-b904-4cd1-80f9-eebef92c36a1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.255719 Aug 04 04:59:23.424478 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2942/5784] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:23 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:23.439312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:23.440375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:23.449379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:23.449837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:23.450623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:23.451515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:23.609289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:23.613370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:23.625898 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3aa70968-fe8a-48f8-ae6a-2f02f2de2d2d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1682 microversion: 2.1 time: 0.199796 Aug 04 04:59:23.627240 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2943/5785] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:23 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:23.883299 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9588b1c-492b-43a3-a99d-2455f0bc3273 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [1b3553b0-2080-4552-b69c-cd78772dd193] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44656. Aug 04 04:59:23.907271 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d9588b1c-492b-43a3-a99d-2455f0bc3273 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-430858038" status: 204 len: 0 microversion: 2.20 time: 1.045113 Aug 04 04:59:23.909891 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2843/5786] 10.222.0.69 () {60 vars in 1259 bytes} [Thu Aug 4 04:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-430858038 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 04:59:24.446918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:24.447624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:24.454494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=62 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:24.466987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8e7e7eee-0cdd-43a1-b380-6f122b7de6c5 req-06d9b1f2-694f-4e20-86c6-38d5cfc02e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283366f9-4639-4ea0-8758-51008d68af4e", "name": "network-vif-plugged", "status": "completed", "tag": "06c25993-fdb4-447d-88a6-f80a790332ca"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:24.471104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.471839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.475073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.475801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.483154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:24.490264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8e7e7eee-0cdd-43a1-b380-6f122b7de6c5 req-06d9b1f2-694f-4e20-86c6-38d5cfc02e9c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.492523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8e7e7eee-0cdd-43a1-b380-6f122b7de6c5 req-06d9b1f2-694f-4e20-86c6-38d5cfc02e9c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.514142 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8e7e7eee-0cdd-43a1-b380-6f122b7de6c5 req-06d9b1f2-694f-4e20-86c6-38d5cfc02e9c service nova] Creating event network-vif-plugged:06c25993-fdb4-447d-88a6-f80a790332ca for instance 283366f9-4639-4ea0-8758-51008d68af4e on n-h2-851337-5 Aug 04 04:59:24.530380 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8e7e7eee-0cdd-43a1-b380-6f122b7de6c5 req-06d9b1f2-694f-4e20-86c6-38d5cfc02e9c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069893 Aug 04 04:59:24.532804 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2844/5787] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:59:24.764826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:24.777670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5f4a3d36-14f2-46c1-9d36-ba525272e27f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1203 microversion: 2.1 time: 0.334624 Aug 04 04:59:24.792085 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2944/5788] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:24 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1203 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:25.804955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:25.806421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:25.831325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.843861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:25.844789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.845850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.039399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:26.049707 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-423c1ae6-2101-429f-b6de-7832e27c3def tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1390 microversion: 2.1 time: 0.251295 Aug 04 04:59:26.050634 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2845/5789] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:25 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:26.082353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:26.084014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:26.100648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.101117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.102710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.103181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.313556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:26.328784 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2807ecff-0ebf-4800-819c-831a9657ac6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1390 microversion: 2.1 time: 0.250930 Aug 04 04:59:26.344612 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2945/5790] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:26 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1390 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:26.351442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:26.352487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:26.359904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.361032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.362462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.363131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.538545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:26.546626 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b686191-39da-4140-a6cb-6cb3179b8590 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1390 microversion: 2.1 time: 0.200390 Aug 04 04:59:26.547273 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2846/5791] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:26 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1390 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:26.566937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-535e480c-13a4-4126-93e7-82bad4b2763a req-dc100124-defd-4f1f-ad91-05bf4dce1eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "name": "network-vif-plugged", "status": "completed", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:26.578947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-535e480c-13a4-4126-93e7-82bad4b2763a req-dc100124-defd-4f1f-ad91-05bf4dce1eb8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.582542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-535e480c-13a4-4126-93e7-82bad4b2763a req-dc100124-defd-4f1f-ad91-05bf4dce1eb8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.597798 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-535e480c-13a4-4126-93e7-82bad4b2763a req-dc100124-defd-4f1f-ad91-05bf4dce1eb8 service nova] Creating event network-vif-plugged:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h2-851337-5 Aug 04 04:59:26.604617 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-535e480c-13a4-4126-93e7-82bad4b2763a req-dc100124-defd-4f1f-ad91-05bf4dce1eb8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044094 Aug 04 04:59:26.605586 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2946/5792] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:59:26.648046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:26.648725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:26.660562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.662107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.663140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.663755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.686626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:26.698108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:59:26.811003 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d808d51-b6f6-4d6a-8085-23c992aaca0f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 204 len: 0 microversion: 2.1 time: 0.166667 Aug 04 04:59:26.815036 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2847/5793] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:59:26 2022] DELETE /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:26.822577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:26.823699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:26.832392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.833193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.834555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.835528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:27.009981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:27.019969 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7fd1b382-5f91-4ba1-90b8-7f5e0957521a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1396 microversion: 2.1 time: 0.201814 Aug 04 04:59:27.021138 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2947/5794] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:26 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1396 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:28.045530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:28.046832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:28.054356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.055126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.056090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.056715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.246563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:28.255867 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4b6ca514-9941-4abc-b2f2-b7f6370372de tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1396 microversion: 2.1 time: 0.214575 Aug 04 04:59:28.257041 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2848/5795] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:28 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1396 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:28.403134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:28.403631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:28.418743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.423015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.423864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.424318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.461097 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] HTTP exception thrown: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Request method failure captured: Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 HTTP/1.1 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61CMOexmsu3Y7_so_ChBOtHx98_Svbg_zfSS9qYm5Cbc1uSu51aBFU3UpEdXszpDbp-0d6VkhSGnFR5Gi8RhHf0-UvSk-rnxFqOgrJwkioMurK9_jz8MNi6Kg_MypwyvogNVsCUldo8-S7NJMyvAuVed0izuU1Y-ngMGYaXnUwKeNPc Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c82d8b39aae447e89fa03246411a8eff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04733db33887418d9437bf7346bbc511 Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0f8090bf-53e3-41fb-94a5-b89f2fddb011'} Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:28.464561 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Returning 404 to user: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:28.470725 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f601b8b-f626-4a43-8c46-5faa7c652484 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 404 len: 111 microversion: 2.20 time: 0.067507 Aug 04 04:59:28.475742 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2948/5796] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:59:28 2022] DELETE /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:59:28.479941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:28.480565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 0f8090bf-53e3-41fb-94a5-b89f2fddb011] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:28.491039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.491496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.495610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.496093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.527181 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] HTTP exception thrown: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Request method failure captured: Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 HTTP/1.1 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61CMOexmsu3Y7_so_ChBOtHx98_Svbg_zfSS9qYm5Cbc1uSu51aBFU3UpEdXszpDbp-0d6VkhSGnFR5Gi8RhHf0-UvSk-rnxFqOgrJwkioMurK9_jz8MNi6Kg_MypwyvogNVsCUldo8-S7NJMyvAuVed0izuU1Y-ngMGYaXnUwKeNPc Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c82d8b39aae447e89fa03246411a8eff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04733db33887418d9437bf7346bbc511 Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0f8090bf-53e3-41fb-94a5-b89f2fddb011'} Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.531329 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Returning 404 to user: Instance 0f8090bf-53e3-41fb-94a5-b89f2fddb011 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:28.536938 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60564651-cc8d-4585-9a8b-cbbce6377432 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011" status: 404 len: 111 microversion: 2.20 time: 0.059414 Aug 04 04:59:28.538740 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2849/5797] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:59:28 2022] GET /compute/v2.1/servers/0f8090bf-53e3-41fb-94a5-b89f2fddb011 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:59:28.987732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7fa4a06f-730b-478e-b58a-1d7aae0fdfda req-b3bc689a-673d-446b-b1a2-54aa3f99771a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283366f9-4639-4ea0-8758-51008d68af4e", "name": "network-vif-deleted", "tag": "06c25993-fdb4-447d-88a6-f80a790332ca"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:29.015764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7fa4a06f-730b-478e-b58a-1d7aae0fdfda req-b3bc689a-673d-446b-b1a2-54aa3f99771a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.017096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7fa4a06f-730b-478e-b58a-1d7aae0fdfda req-b3bc689a-673d-446b-b1a2-54aa3f99771a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.061348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7fa4a06f-730b-478e-b58a-1d7aae0fdfda req-b3bc689a-673d-446b-b1a2-54aa3f99771a service nova] Creating event network-vif-deleted:06c25993-fdb4-447d-88a6-f80a790332ca for instance 283366f9-4639-4ea0-8758-51008d68af4e on n-h2-851337-5 Aug 04 04:59:29.078241 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7fa4a06f-730b-478e-b58a-1d7aae0fdfda req-b3bc689a-673d-446b-b1a2-54aa3f99771a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095692 Aug 04 04:59:29.080829 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2949/5798] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:59:29.280580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:29.281217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:29.300871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.301336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.302140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.303078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.439383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:29.448082 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-59a02e81-dce9-4121-99e4-6298513da407 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1188 microversion: 2.1 time: 0.171659 Aug 04 04:59:29.449408 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2850/5799] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:29 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1188 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:30.494495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:30.504795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:30.527132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.527601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.528397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.528843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.614916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:30.625149 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5361cc4e-f134-47f0-879e-d7728b97b22f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1188 microversion: 2.1 time: 0.158491 Aug 04 04:59:30.643582 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2950/5800] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:30 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1188 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:31.647381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:31.648249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:31.662123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.663942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.669274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.670284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.804088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:31.814924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-106f32d7-d26c-4d3d-948b-8f56774af03f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1188 microversion: 2.1 time: 0.171794 Aug 04 04:59:31.815725 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2851/5801] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:31 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1188 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:32.836099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:32.836719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:32.851903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:32.852659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:32.853795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:32.855232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:32.973097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:32.987610 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ebf454a9-e1b7-4469-9764-5c6be617a87a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1188 microversion: 2.1 time: 0.155297 Aug 04 04:59:32.989689 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2951/5802] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:32 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1188 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:33.324929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:33.325485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:33.342611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:33.343101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:33.343891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:33.344340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:33.367695 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] HTTP exception thrown: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Request method failure captured: Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 HTTP/1.1 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61CMOexmsu3Y7_so_ChBOtHx98_Svbg_zfSS9qYm5Cbc1uSu51aBFU3UpEdXszpDbp-0d6VkhSGnFR5Gi8RhHf0-UvSk-rnxFqOgrJwkioMurK9_jz8MNi6Kg_MypwyvogNVsCUldo8-S7NJMyvAuVed0izuU1Y-ngMGYaXnUwKeNPc Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c82d8b39aae447e89fa03246411a8eff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 04733db33887418d9437bf7346bbc511 Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289'} Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:33.372203 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.377087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Returning 404 to user: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:33.379531 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0243275b-c0a7-431b-b641-e427fb2ff777 tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 404 len: 111 microversion: 2.20 time: 0.054215 Aug 04 04:59:33.380644 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2852/5803] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Aug 4 04:59:33 2022] DELETE /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:59:33.389252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:33.390106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] [instance: 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:33.398855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:33.399562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:33.400521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:33.401147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:33.416498 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] HTTP exception thrown: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Request method failure captured: Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 HTTP/1.1 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61CMOexmsu3Y7_so_ChBOtHx98_Svbg_zfSS9qYm5Cbc1uSu51aBFU3UpEdXszpDbp-0d6VkhSGnFR5Gi8RhHf0-UvSk-rnxFqOgrJwkioMurK9_jz8MNi6Kg_MypwyvogNVsCUldo8-S7NJMyvAuVed0izuU1Y-ngMGYaXnUwKeNPc Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c82d8b39aae447e89fa03246411a8eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c82d8b39aae447e89fa03246411a8eff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: c82d8b39aae447e89fa03246411a8eff Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1098534995 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 04733db33887418d9437bf7346bbc511 Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1098534995-project Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289'} Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.418386 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. Aug 04 04:59:33.423815 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:33.425598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] Returning 404 to user: Instance 4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:33.426664 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2a188692-c9f5-4dbc-ab9a-c95a7e7d8acb tempest-AttachVolumeShelveTestJSON-1098534995 tempest-AttachVolumeShelveTestJSON-1098534995-project] 10.222.0.69 "GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289" status: 404 len: 111 microversion: 2.20 time: 0.042024 Aug 04 04:59:33.427810 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2952/5804] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Aug 4 04:59:33 2022] GET /compute/v2.1/servers/4d2cafe7-b2d6-4ec4-94df-4e7c39bc0289 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:59:34.011053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:34.011883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:34.024037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.025062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.028481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.029087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.127257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:34.136718 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-464e8dda-f6c0-4165-84ff-70acb3e7ce52 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1188 microversion: 2.1 time: 0.130151 Aug 04 04:59:34.139430 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2853/5805] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:34 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:35.162421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:35.163882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:35.173300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.174189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.175297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.176008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.303990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:35.313334 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-097ba76f-3575-4e64-bf45-24aa3a84ef73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 200 len: 1188 microversion: 2.1 time: 0.154931 Aug 04 04:59:35.318864 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2953/5806] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:35 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 1188 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:36.341445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:36.342083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:36.350393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.351056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.352100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.352726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.410836 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e HTTP/1.1 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '283366f9-4639-4ea0-8758-51008d68af4e'} Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:36.420898 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:36.426345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:36.426345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:36.426345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:36.426345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:36.426345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:36.426345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:36.426345 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:36.428117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:36.431521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57cd1fbc-5c9a-4caa-94e7-62f32599ca90 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 404 len: 111 microversion: 2.1 time: 0.094920 Aug 04 04:59:36.432290 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2854/5807] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:36 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:59:40.935052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:40.935686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:40.946061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.951452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:40.952618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.953292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.000721 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e HTTP/1.1 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '283366f9-4639-4ea0-8758-51008d68af4e'} Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:41.003555 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.008074 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.012481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:41.013747 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2938c04d-e66a-473a-9e59-abc216e89b4e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 404 len: 111 microversion: 2.1 time: 0.083165 Aug 04 04:59:41.016609 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2954/5808] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:59:40 2022] DELETE /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:59:41.023613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:41.024985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 283366f9-4639-4ea0-8758-51008d68af4e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:41.034093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.034651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.035827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.036526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.053278 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e HTTP/1.1 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '283366f9-4639-4ea0-8758-51008d68af4e'} Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:41.055233 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.060542 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:41.060542 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:41.060542 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:41.060542 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:41.060542 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:41.060542 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. Aug 04 04:59:41.060542 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:41.062835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance 283366f9-4639-4ea0-8758-51008d68af4e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:41.064019 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-92a7cf30-ac34-49e3-97c3-735dd6c2d056 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e" status: 404 len: 111 microversion: 2.1 time: 0.044772 Aug 04 04:59:41.064973 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2855/5809] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:41 2022] GET /compute/v2.1/servers/283366f9-4639-4ea0-8758-51008d68af4e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:59:43.850549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5c873cf8-cdf3-4029-891e-9e550353255f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:43.853060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5c873cf8-cdf3-4029-891e-9e550353255f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:43.870122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c873cf8-cdf3-4029-891e-9e550353255f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:43.870586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c873cf8-cdf3-4029-891e-9e550353255f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:43.873490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c873cf8-cdf3-4029-891e-9e550353255f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:43.873948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c873cf8-cdf3-4029-891e-9e550353255f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:43.968120 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5c873cf8-cdf3-4029-891e-9e550353255f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action" status: 200 len: 24572 microversion: 2.1 time: 0.121444 Aug 04 04:59:43.970462 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2955/5810] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 04:59:43 2022] POST /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1/action => generated 24572 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:48.247867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c9dc31e-8a20-458c-8ef4-8dcdaa99eded tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'create', calling method: .version_select at 0x7f1923a448b0>, body: {"keypair": {"name": "tempest-keypair-1830437874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELOkMzDsZuU6Y0igv6zlAs3MVzE63BA8ViUNeJN+y3jwt6wFAQ8fzY+Fmp3YxERmBe5EO6A6CmbNs8BielTH1KVtIoe/jQ4oJ+ncRpCFOCNYvf91t313gr2ABZWBdB3yA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:48.278632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7c9dc31e-8a20-458c-8ef4-8dcdaa99eded tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for project 92a8935bd6624e6a832843d52384cf89. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:59:48.290629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-7c9dc31e-8a20-458c-8ef4-8dcdaa99eded tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for user 5adbe69f2bf94f02a0bbf0ea913481a4 and project 92a8935bd6624e6a832843d52384cf89. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:59:48.346404 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c9dc31e-8a20-458c-8ef4-8dcdaa99eded tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.309094 Aug 04 04:59:48.348571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2856/5811] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 04:59:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:59:50.148260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d79179bf-3c04-4c73-9a1d-f043716434fd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:50.150658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d79179bf-3c04-4c73-9a1d-f043716434fd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:50.169213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d79179bf-3c04-4c73-9a1d-f043716434fd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:50.178582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d79179bf-3c04-4c73-9a1d-f043716434fd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:50.180248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d79179bf-3c04-4c73-9a1d-f043716434fd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:50.181789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d79179bf-3c04-4c73-9a1d-f043716434fd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:50.474447 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d79179bf-3c04-4c73-9a1d-f043716434fd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1833 microversion: 2.1 time: 0.330173 Aug 04 04:59:50.480824 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2956/5812] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:50 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1833 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:51.085368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:51.092886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-600050674", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd46842b-be85-491f-a3b3-166799a5ee38"}], "security_groups": [{"name": "tempest-securitygroup--657828313"}], "key_name": "tempest-keypair-1830437874", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:51.313334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] validate_networks() for [('bd46842b-be85-491f-a3b3-166799a5ee38', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:59:52.720947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:59:52.722206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:59:52.722991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:59:52.723900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:59:52.724497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:59:52.745234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.751244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.752735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.754296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.823871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for project 92a8935bd6624e6a832843d52384cf89. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:59:52.841042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for user 5adbe69f2bf94f02a0bbf0ea913481a4 and project 92a8935bd6624e6a832843d52384cf89. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:59:52.882989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:59:52.887679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:59:52.970670 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b21e3528-1d37-44e2-b0b5-f26d54679724 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.883964 Aug 04 04:59:52.973666 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2857/5813] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 04:59:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:59:52.991262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dbf8d3fe-6ae3-42c8-be3c-3eabd92a61b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:52.992742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dbf8d3fe-6ae3-42c8-be3c-3eabd92a61b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:53.281065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dbf8d3fe-6ae3-42c8-be3c-3eabd92a61b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:53.293160 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dbf8d3fe-6ae3-42c8-be3c-3eabd92a61b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1237 microversion: 2.1 time: 0.313201 Aug 04 04:59:53.296066 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2957/5814] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:52 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1237 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:53.319139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:53.319658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:53.327821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a7e97de1-3168-49e8-9581-afeb0ae40ef5 req-4822616d-6083-4853-ae80-50a995982ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:53.340963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.346343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.348062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.349010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a7e97de1-3168-49e8-9581-afeb0ae40ef5 req-4822616d-6083-4853-ae80-50a995982ce7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.349738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a7e97de1-3168-49e8-9581-afeb0ae40ef5 req-4822616d-6083-4853-ae80-50a995982ce7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.350466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.377821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a7e97de1-3168-49e8-9581-afeb0ae40ef5 req-4822616d-6083-4853-ae80-50a995982ce7 service nova] Creating event network-changed:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h2-851337-5 Aug 04 04:59:53.398150 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a7e97de1-3168-49e8-9581-afeb0ae40ef5 req-4822616d-6083-4853-ae80-50a995982ce7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074623 Aug 04 04:59:53.407722 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2958/5815] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:59:53.438347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:59:53.800807 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3eaa7ee3-a88b-4bdd-a16c-0766a14c1ba8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 204 len: 0 microversion: 2.1 time: 0.485964 Aug 04 04:59:53.807189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2858/5816] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 04:59:53 2022] DELETE /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:53.824892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:53.825901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:53.858870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.863722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.868557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.872518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.320055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:54.320770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:54.352642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.356447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.357868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.359257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.421577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:54.454749 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9a2add9-c284-439b-b849-ba16f4344e5c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1688 microversion: 2.1 time: 0.638879 Aug 04 04:59:54.455931 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2959/5817] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:53 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1688 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:54.536171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:54.546871 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dfb830c2-2b4f-47d6-86db-bd779ab98f20 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1241 microversion: 2.1 time: 0.235223 Aug 04 04:59:54.551693 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2859/5818] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:54 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:55.478695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:55.479466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:55.498881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=34 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:55.507667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.511096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.514443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.517221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.536582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=65 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:55.576446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:55.577147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:55.591123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.611584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.614205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.619599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:56.039125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:56.086229 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c5163df2-d294-41cf-829f-9635107f7f15 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1297 microversion: 2.1 time: 0.514885 Aug 04 04:59:56.087877 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2860/5819] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:55 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1297 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:56.331376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:56.346015 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b277ca8c-6f17-40e1-8559-426cdcd3ec3d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1688 microversion: 2.1 time: 0.872380 Aug 04 04:59:56.351123 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2960/5820] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:55 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1688 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:56.710239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-50aaa95b-4a6f-42b5-bdbd-75ef0ad99dd7 req-8aeec2cc-0786-4c29-bd06-734e19c821d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3616f7c2-1f29-470a-b8f8-01fc8d9637c1", "name": "network-vif-deleted", "tag": "b8154787-ebe6-41a1-a659-f74c4d615c71"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:56.727586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:56.764613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-50aaa95b-4a6f-42b5-bdbd-75ef0ad99dd7 req-8aeec2cc-0786-4c29-bd06-734e19c821d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:56.770346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-50aaa95b-4a6f-42b5-bdbd-75ef0ad99dd7 req-8aeec2cc-0786-4c29-bd06-734e19c821d6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:56.841772 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-50aaa95b-4a6f-42b5-bdbd-75ef0ad99dd7 req-8aeec2cc-0786-4c29-bd06-734e19c821d6 service nova] Creating event network-vif-deleted:b8154787-ebe6-41a1-a659-f74c4d615c71 for instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 on n-h2-851337-5 Aug 04 04:59:56.862592 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-50aaa95b-4a6f-42b5-bdbd-75ef0ad99dd7 req-8aeec2cc-0786-4c29-bd06-734e19c821d6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151640 Aug 04 04:59:56.864322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2861/5821] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:59:57.109291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:57.110604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:57.132682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.133573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.142475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.143946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.305027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:57.341183 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aef0a0de-46bb-4bb0-ba1e-ab54ab5f59b1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1295 microversion: 2.1 time: 0.236598 Aug 04 04:59:57.355059 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2961/5822] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:57 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1295 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:57.373470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:57.374217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:57.394528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.395210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.396061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.396508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.510766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.511253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.513634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lazy-loading 'fault' on Instance uuid 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:59:57.577257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:57.619818 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-70069974-9037-4b11-b467-009d6907e9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 200 len: 1355 microversion: 2.1 time: 0.252531 Aug 04 04:59:57.621549 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2862/5823] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:57 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 1355 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:58.367326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:58.367956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:58.382849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.383358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.386161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.388249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.640768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:58.645977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:58.649735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 3616f7c2-1f29-470a-b8f8-01fc8d9637c1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:58.658236 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffcd5105-b7c1-40f5-a9f2-fd72a3f367ae tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1362 microversion: 2.1 time: 0.292022 Aug 04 04:59:58.659732 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2962/5824] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:58 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:58.680784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.683295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.689733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.692745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.729895 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] HTTP exception thrown: Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 could not be found. Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Request method failure captured: Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 HTTP/1.1 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61GdXrmWyyfE0J7enPpcIyS3LbibZR7PXqlPp3pVVyYXeHezoFuAT9ZF9b7K8886gn6e2_GN0Rt88Tw2FVFNfZo60Q6Vfblx2XonnMcQkg2IArZTVP8WZoQSTyoQkYC3HCAudPfq8W-oRSVCIp2pGPcTSXLlrp9_fe9GWe5eWg1Vi9I Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_af3d0230675c48d8ba4d39a956313de9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 09e52c6cb3694904a605112a9901e18c Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 could not be found. Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '3616f7c2-1f29-470a-b8f8-01fc8d9637c1'} Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 could not be found. Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 could not be found. Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:58.735336 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 could not be found. Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Returning 404 to user: Instance 3616f7c2-1f29-470a-b8f8-01fc8d9637c1 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:59:58.741106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3021cae3-d472-4f57-8326-23696fb80aa7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1" status: 404 len: 111 microversion: 2.1 time: 0.095425 Aug 04 04:59:58.745413 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2863/5825] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:58 2022] GET /compute/v2.1/servers/3616f7c2-1f29-470a-b8f8-01fc8d9637c1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:59:58.992948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7f2a77ad-c081-40b1-8f67-6e762fcbfdc7 req-08699674-43f0-4b01-a7a7-2facf66b0382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0693875a-57c5-4180-a006-46160ba75de5", "tag": "8ff06d33-06eb-4e19-8005-e1f5e6279307"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:59:59.017969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f2a77ad-c081-40b1-8f67-6e762fcbfdc7 req-08699674-43f0-4b01-a7a7-2facf66b0382 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.018474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f2a77ad-c081-40b1-8f67-6e762fcbfdc7 req-08699674-43f0-4b01-a7a7-2facf66b0382 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.059984 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7f2a77ad-c081-40b1-8f67-6e762fcbfdc7 req-08699674-43f0-4b01-a7a7-2facf66b0382 service nova] Creating event network-changed:8ff06d33-06eb-4e19-8005-e1f5e6279307 for instance 0693875a-57c5-4180-a006-46160ba75de5 on n-h1-851337-5 Aug 04 04:59:59.076223 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7f2a77ad-c081-40b1-8f67-6e762fcbfdc7 req-08699674-43f0-4b01-a7a7-2facf66b0382 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091534 Aug 04 04:59:59.076859 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2963/5826] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 04:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:59:59.682301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:59.683806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:59.695883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.696692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.697915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.698473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.960847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:59.969534 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b10b12e1-de90-437c-8e5c-305c34c19c6e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1362 microversion: 2.1 time: 0.290880 Aug 04 04:59:59.970430 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2864/5827] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:59 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:00.293771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:00.294505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:00.305408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.306221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.307556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.308234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.432604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lazy-loading 'services' on Instance uuid 67d51c82-d2ac-4d02-9d3d-9f9d5050243a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:00:00.527397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad26a53a-9f08-42e2-9044-051f632558be tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "DELETE /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a/os-volume_attachments/a20ea6f6-26cd-4569-be88-d9277375816b" status: 202 len: 0 microversion: 2.1 time: 0.237978 Aug 04 05:00:00.532446 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2964/5828] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:00:00 2022] DELETE /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a/os-volume_attachments/a20ea6f6-26cd-4569-be88-d9277375816b => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:00:00.991134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:00.992751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:01.001030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.001845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.003178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.004250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.304947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:01.315541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2ceffb68-7255-49ba-b28e-b881e60df7bf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1362 microversion: 2.1 time: 0.328851 Aug 04 05:00:01.332929 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2865/5829] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:00 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:02.345344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:02.346831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:02.363407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.364459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.366221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.366905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.718037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:02.746873 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06184ec1-3a72-4ffb-8016-b1373edbe926 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1362 microversion: 2.1 time: 0.411816 Aug 04 05:00:02.748122 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2965/5830] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:02 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:03.769686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:03.771378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:03.782075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:03.782829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:03.801137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:03.801830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:03.804596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:03.805241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:03.963306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-02a9e696-8485-48aa-bf7a-9a1e3db1715d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '.version_select at 0x7f191a2579d0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:03.969250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:04.012177 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-02a9e696-8485-48aa-bf7a-9a1e3db1715d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-582800796" status: 202 len: 0 microversion: 2.1 time: 0.057475 Aug 04 05:00:04.016385 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2966/5831] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 05:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-582800796 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:00:04.053698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a3d24d2-4bcf-427f-8fe1-a9cf39f18f28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: .version_select at 0x7f191aa64af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-742081769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6Rp+RdLNLx+IVdsuQhxfTqYR8md7Mg3oe+uWOPHHQrCOQAH0pgtM85rLJzzloUfb0JA7ctGQd4xHcyFg6DlUTCasbFII0VkjEjDyqQbEr0DmE8HkE6ukTv22Ajn7ctNQ=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:04.091896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5a3d24d2-4bcf-427f-8fe1-a9cf39f18f28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:00:04.100159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5a3d24d2-4bcf-427f-8fe1-a9cf39f18f28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:00:04.101934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:04.109722 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-681fc811-565f-456d-bfbf-5b8a5c98a2d5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1362 microversion: 2.1 time: 0.344666 Aug 04 05:00:04.110875 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2866/5832] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:03 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:04.141409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a3d24d2-4bcf-427f-8fe1-a9cf39f18f28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.092635 Aug 04 05:00:04.152019 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2967/5833] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:00:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:05.132894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:05.133450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:05.151252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.152413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.154103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.154900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.590456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:05.603108 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-faabcfbb-4d71-4e00-9bed-4a6c9f2c26d3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1362 microversion: 2.1 time: 0.470584 Aug 04 05:00:05.608602 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2867/5834] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:05 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:05.693046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e20761ea-c943-4d26-b8ce-13401102fad8 req-bda28dd8-6e64-474f-999f-038f9e9eb42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0693875a-57c5-4180-a006-46160ba75de5", "name": "network-vif-plugged", "status": "completed", "tag": "8ff06d33-06eb-4e19-8005-e1f5e6279307"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:05.717851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e20761ea-c943-4d26-b8ce-13401102fad8 req-bda28dd8-6e64-474f-999f-038f9e9eb42b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.718746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e20761ea-c943-4d26-b8ce-13401102fad8 req-bda28dd8-6e64-474f-999f-038f9e9eb42b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.747467 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e20761ea-c943-4d26-b8ce-13401102fad8 req-bda28dd8-6e64-474f-999f-038f9e9eb42b service nova] Creating event network-vif-plugged:8ff06d33-06eb-4e19-8005-e1f5e6279307 for instance 0693875a-57c5-4180-a006-46160ba75de5 on n-h1-851337-5 Aug 04 05:00:05.762496 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e20761ea-c943-4d26-b8ce-13401102fad8 req-bda28dd8-6e64-474f-999f-038f9e9eb42b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071929 Aug 04 05:00:05.764944 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2968/5835] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:06.632990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:06.639591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:06.672156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.672879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:06.674001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.675340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:07.013933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:07.030367 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e2ce50d3-b4c4-4195-8489-0138bbd70691 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1362 microversion: 2.1 time: 0.404462 Aug 04 05:00:07.057759 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2868/5836] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:06 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:08.071084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:08.074486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:08.088244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.089991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.092842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.095402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.339554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:08.349938 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-72cb23b6-397f-4781-8f2e-0e97801f1e5f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1548 microversion: 2.1 time: 0.284184 Aug 04 05:00:08.351032 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2969/5837] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:08 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1548 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:08.374077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-285d8fa3-65fa-4063-9ba9-07ddfc20668f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:08.374077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-285d8fa3-65fa-4063-9ba9-07ddfc20668f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:08.381379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-285d8fa3-65fa-4063-9ba9-07ddfc20668f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.382109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-285d8fa3-65fa-4063-9ba9-07ddfc20668f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.383378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-285d8fa3-65fa-4063-9ba9-07ddfc20668f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.384049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-285d8fa3-65fa-4063-9ba9-07ddfc20668f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.484210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:08.484865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:08.492633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.493089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.493890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.494339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.528333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:00:08.635392 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bfba8b66-fbe6-4c35-980a-bd39d39eebde tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "DELETE /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 204 len: 0 microversion: 2.1 time: 0.155673 Aug 04 05:00:08.636522 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2970/5838] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:00:08 2022] DELETE /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:00:08.652994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:08.653863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:08.674404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.674945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.675870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.676404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.940455 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-285d8fa3-65fa-4063-9ba9-07ddfc20668f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.572899 Aug 04 05:00:08.944067 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2869/5839] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 05:00:08 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-interface => generated 284 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:09.043092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:09.053225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea0f1d72-a197-4b7b-aa35-f3cf30af971c tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1467 microversion: 2.1 time: 0.404426 Aug 04 05:00:09.054447 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2971/5840] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:08 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1467 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:10.077033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:10.079973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:10.100144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:10.104729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:10.107407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:10.108859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:10.408458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:10.426587 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1da2bb84-9282-4166-89f9-56475b328297 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1467 microversion: 2.1 time: 0.354607 Aug 04 05:00:10.484505 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2870/5841] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:10 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1467 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:11.159115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e43f36c2-7f36-46b8-84c2-a42a9a4810d5 req-07d67202-a904-4a58-a062-9462051e5f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0693875a-57c5-4180-a006-46160ba75de5", "tag": "8ff06d33-06eb-4e19-8005-e1f5e6279307"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:11.213220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e43f36c2-7f36-46b8-84c2-a42a9a4810d5 req-07d67202-a904-4a58-a062-9462051e5f31 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:11.214393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e43f36c2-7f36-46b8-84c2-a42a9a4810d5 req-07d67202-a904-4a58-a062-9462051e5f31 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:11.262204 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e43f36c2-7f36-46b8-84c2-a42a9a4810d5 req-07d67202-a904-4a58-a062-9462051e5f31 service nova] Creating event network-changed:8ff06d33-06eb-4e19-8005-e1f5e6279307 for instance 0693875a-57c5-4180-a006-46160ba75de5 on n-h1-851337-5 Aug 04 05:00:11.278067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e43f36c2-7f36-46b8-84c2-a42a9a4810d5 req-07d67202-a904-4a58-a062-9462051e5f31 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129993 Aug 04 05:00:11.279004 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2972/5842] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:11.495324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:11.496306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:11.536183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:11.538872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:11.542102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:11.542841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:12.233881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:12.253413 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d3116ce-608e-43b2-bdcd-89310cab931d tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1467 microversion: 2.1 time: 0.786839 Aug 04 05:00:12.265951 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2871/5843] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:11 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1467 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:13.282318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:13.283908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:13.314224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.315073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.316129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.323006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.454353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4b0b631e-18d4-4816-8692-e12b09bc4742 req-96ca1172-43fc-47e8-83bd-abb25c8073b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d51c82-d2ac-4d02-9d3d-9f9d5050243a", "name": "network-vif-deleted", "tag": "1f7aa792-58d2-414f-a976-c44a63d0d7c5"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:13.461081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.461798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.462520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lazy-loading 'fault' on Instance uuid 67d51c82-d2ac-4d02-9d3d-9f9d5050243a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:00:13.488474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4b0b631e-18d4-4816-8692-e12b09bc4742 req-96ca1172-43fc-47e8-83bd-abb25c8073b2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.492029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4b0b631e-18d4-4816-8692-e12b09bc4742 req-96ca1172-43fc-47e8-83bd-abb25c8073b2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.530675 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4b0b631e-18d4-4816-8692-e12b09bc4742 req-96ca1172-43fc-47e8-83bd-abb25c8073b2 service nova] Creating event network-vif-deleted:1f7aa792-58d2-414f-a976-c44a63d0d7c5 for instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a on n-h1-851337-5 Aug 04 05:00:13.545026 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4b0b631e-18d4-4816-8692-e12b09bc4742 req-96ca1172-43fc-47e8-83bd-abb25c8073b2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098325 Aug 04 05:00:13.566830 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2872/5844] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 05:00:13.651474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09437d08e6b04b7fbe2dbaee8731f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51a9775e2f04a58a42aa18a9a7a117e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:13.681433 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c2d3df6-294c-4aeb-81c4-d98eecc5b385 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 200 len: 1303 microversion: 2.1 time: 0.405798 Aug 04 05:00:13.690850 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2973/5845] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:13 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 1303 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:14.720298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:14.721695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] [instance: 67d51c82-d2ac-4d02-9d3d-9f9d5050243a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:14.759954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.761439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:14.762551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.764681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:14.810377 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] HTTP exception thrown: Instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a could not be found. Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Request method failure captured: Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a HTTP/1.1 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61HkEv1aVozZ0FBZKAoSfZkEr4Qt4CagK3v2E7UhKsj9gl1xk8_lIMzPiI9mWnjG6TbyoOfnK3Kl2_glDk6ovo5yUpEcDF-hx--oqU1F17UohnBEZqq5V64E-Xk-vYCOBDPkJ24MoLAhuswomzE-_N9ZBrAXrY6JxxGxJObZJgeHte8 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: e51a9775e2f04a58a42aa18a9a7a117e Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesBackupsTest-1591856959 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e51a9775e2f04a58a42aa18a9a7a117e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e51a9775e2f04a58a42aa18a9a7a117e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e51a9775e2f04a58a42aa18a9a7a117e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e51a9775e2f04a58a42aa18a9a7a117e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesBackupsTest-1591856959 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: e51a9775e2f04a58a42aa18a9a7a117e Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesBackupsTest-1591856959 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesBackupsTest-1591856959-project Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 09437d08e6b04b7fbe2dbaee8731f195 Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesBackupsTest-1591856959-project Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a could not be found. Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '67d51c82-d2ac-4d02-9d3d-9f9d5050243a'} Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a could not be found. Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a could not be found. Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:00:14.815353 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a could not be found. Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] Returning 404 to user: Instance 67d51c82-d2ac-4d02-9d3d-9f9d5050243a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-248a601e-2c55-42d8-9fa4-d4458db90ac2 tempest-VolumesBackupsTest-1591856959 tempest-VolumesBackupsTest-1591856959-project] 10.222.0.69 "GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a" status: 404 len: 111 microversion: 2.1 time: 0.108455 Aug 04 05:00:14.824438 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2873/5846] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:14 2022] GET /compute/v2.1/servers/67d51c82-d2ac-4d02-9d3d-9f9d5050243a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:00:14.911277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1248964244", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "4bc5cd2f-8c1a-4241-b938-d5444657af72"}], "key_name": "tempest-TestNetworkAdvancedServerOps-742081769", "security_groups": [{"name": "tempest-secgroup-smoke-454150111"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:14.939978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:15.660879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] validate_networks() for [('4bc5cd2f-8c1a-4241-b938-d5444657af72', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:00:16.587789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:00:16.589028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:00:16.589683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:00:16.590272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:00:16.590879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:00:16.611030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.611933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.616691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.619487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.661594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:00:16.670099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:00:16.692500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:00:16.696023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:00:16.792106 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dfe7d13b-560e-40bb-80f3-2e17e624f13e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.892396 Aug 04 05:00:16.795159 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2974/5847] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:00:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:00:16.806560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20afa8b5-db82-4bce-871c-5b76a276ed08 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:16.807347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-20afa8b5-db82-4bce-871c-5b76a276ed08 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:16.918339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-20afa8b5-db82-4bce-871c-5b76a276ed08 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:16.931093 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20afa8b5-db82-4bce-871c-5b76a276ed08 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1266 microversion: 2.1 time: 0.128398 Aug 04 05:00:16.955691 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2874/5848] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:16 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:17.958922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:17.959567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:17.972984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.977921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:17.978803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.979283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:18.141509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:18.153780 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5d0419bd-2181-4394-a14a-233cd5cbd9ba tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1318 microversion: 2.1 time: 0.199172 Aug 04 05:00:18.154379 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2975/5849] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:17 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:19.180237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:19.181056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:19.215269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.221518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.225755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.226260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.382224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:19.394135 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-02ef552b-7872-4a07-9bb6-fa07e3b8708b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1324 microversion: 2.1 time: 0.217567 Aug 04 05:00:19.395072 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2875/5850] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:19 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1324 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:20.418004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:20.418554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:20.437518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.438355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.439406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.442390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.906646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:20.916257 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74db4704-a81b-4369-ae00-382c25d9e885 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1391 microversion: 2.1 time: 0.502385 Aug 04 05:00:20.922770 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2976/5851] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:20 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1391 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:21.415379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c686ba79-052c-45dc-b73b-d3de7a5fa714 req-135de08f-41d8-407f-afe8-a14f7cfe388b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:21.433176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c686ba79-052c-45dc-b73b-d3de7a5fa714 req-135de08f-41d8-407f-afe8-a14f7cfe388b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:21.433978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c686ba79-052c-45dc-b73b-d3de7a5fa714 req-135de08f-41d8-407f-afe8-a14f7cfe388b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:21.480276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:21.482854 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c686ba79-052c-45dc-b73b-d3de7a5fa714 req-135de08f-41d8-407f-afe8-a14f7cfe388b service nova] Creating event network-changed:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:00:21.504894 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c686ba79-052c-45dc-b73b-d3de7a5fa714 req-135de08f-41d8-407f-afe8-a14f7cfe388b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093053 Aug 04 05:00:21.524215 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2876/5852] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:21.944759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:21.946429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:21.961670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:21.962508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:21.964317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:21.965066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:22.267567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:22.282579 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8bb98eae-1666-43d9-aad3-05bb5061d204 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1391 microversion: 2.1 time: 0.341689 Aug 04 05:00:22.284271 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2977/5853] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:21 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:23.311545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:23.312296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:23.324692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.338832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.339743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.340536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.632796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:23.655002 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f8b02067-3c83-4807-be35-48767f198de2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1391 microversion: 2.1 time: 0.351436 Aug 04 05:00:23.656126 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2877/5854] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:23 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:24.677472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:24.678154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:24.688284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.689039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:24.689920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.690404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:24.886089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:24.888352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:24.896630 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ad90d48-a2e0-489a-9fab-769d2d963d44 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1391 microversion: 2.1 time: 0.223245 Aug 04 05:00:24.897229 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2978/5855] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:24 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:25.116276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2016063822", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ded9e55d-ae44-407c-887d-4a349254044e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:25.205879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:00:25.652596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:00:25.653105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:00:25.653687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:00:25.654759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:00:25.655879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:00:25.672283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:25.672283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:25.673025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:25.673487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:25.700602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:00:25.707097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:00:25.782109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:00:25.785894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ded9e55d-ae44-407c-887d-4a349254044e',volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:00:25.942302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:25.947044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:25.969698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:25.974862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c31a84c-7d40-497d-a554-475eb4ffe6f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862696 Aug 04 05:00:25.976623 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2878/5856] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:00:25.997674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8608aa23-9e38-410c-9b13-7915ae082e92 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:26.005251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8608aa23-9e38-410c-9b13-7915ae082e92 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:26.010347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.013414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.018011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.019126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.126163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8608aa23-9e38-410c-9b13-7915ae082e92 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:26.140625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8608aa23-9e38-410c-9b13-7915ae082e92 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1071 microversion: 2.1 time: 0.148240 Aug 04 05:00:26.141464 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2879/5857] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:25 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1071 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:26.272847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:26.283956 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b9457ee-6684-4981-b190-1c2251680b91 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1391 microversion: 2.1 time: 0.365474 Aug 04 05:00:26.285403 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2979/5858] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:25 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1391 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:26.856934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6efdb0c6-f77a-4e2b-a3f0-5e168a5dc2bd req-f805981c-3fa2-4586-8b7d-2c6e152cf2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "name": "network-vif-plugged", "status": "completed", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:26.882817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6efdb0c6-f77a-4e2b-a3f0-5e168a5dc2bd req-f805981c-3fa2-4586-8b7d-2c6e152cf2c6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.884362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6efdb0c6-f77a-4e2b-a3f0-5e168a5dc2bd req-f805981c-3fa2-4586-8b7d-2c6e152cf2c6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.914371 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6efdb0c6-f77a-4e2b-a3f0-5e168a5dc2bd req-f805981c-3fa2-4586-8b7d-2c6e152cf2c6 service nova] Creating event network-vif-plugged:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:00:26.925116 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6efdb0c6-f77a-4e2b-a3f0-5e168a5dc2bd req-f805981c-3fa2-4586-8b7d-2c6e152cf2c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188362 Aug 04 05:00:26.926677 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2880/5859] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:27.163081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:27.176922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:27.179274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:27.180234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:27.188852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:27.189313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:27.190342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:27.190795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:27.261396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:27.271968 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23ea3fea-3644-4983-b8c3-24f9a50006fc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1169 microversion: 2.1 time: 0.113078 Aug 04 05:00:27.272577 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2980/5860] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:27 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1169 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:27.308193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:27.308901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:27.323459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:27.323922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:27.325373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:27.326201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:27.487791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:27.504337 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9875cba7-6719-425a-8c2f-06bc0d14f902 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1391 microversion: 2.1 time: 0.201101 Aug 04 05:00:27.523977 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2881/5861] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:27 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:28.293708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:28.294327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:28.314899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.318947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.320109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.321950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.525993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:28.526617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:28.535771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:28.547629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:28.557050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.557826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.558431 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c2ac4e3-6927-4fd1-8415-4a40bd899aec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1229 microversion: 2.1 time: 0.267653 Aug 04 05:00:28.560324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.562137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.574140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2981/5862] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:28 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1229 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:28.909275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:28.925138 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f38752a5-f072-481b-9395-aeefdcfcdf71 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1563 microversion: 2.1 time: 0.400392 Aug 04 05:00:28.929326 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2882/5863] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:28 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1563 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:28.954292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:28.955404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:28.962387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.963239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.964269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.964939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.178577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:29.188609 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e2a4fd3f-ef57-48d9-a662-7ed67792d7ac tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1563 microversion: 2.1 time: 0.238913 Aug 04 05:00:29.189944 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2982/5864] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:28 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:29.247106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c3f8f9a5-e7e1-4a62-88b6-4d6a2d7e6271 req-1f897bf8-cc90-4c45-9059-962cf911a31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fe46d7-d991-4d16-94c2-10106d69dfe5", "tag": "a9ad4453-bde3-46b1-ad99-aeb59d45b6a4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:29.261994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c3f8f9a5-e7e1-4a62-88b6-4d6a2d7e6271 req-1f897bf8-cc90-4c45-9059-962cf911a31c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.268888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c3f8f9a5-e7e1-4a62-88b6-4d6a2d7e6271 req-1f897bf8-cc90-4c45-9059-962cf911a31c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.323877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c3f8f9a5-e7e1-4a62-88b6-4d6a2d7e6271 req-1f897bf8-cc90-4c45-9059-962cf911a31c service nova] Creating event network-changed:a9ad4453-bde3-46b1-ad99-aeb59d45b6a4 for instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 on n-h1-851337-5 Aug 04 05:00:29.335222 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c3f8f9a5-e7e1-4a62-88b6-4d6a2d7e6271 req-1f897bf8-cc90-4c45-9059-962cf911a31c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091579 Aug 04 05:00:29.340087 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2883/5865] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:00:29.582016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:29.583449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:29.594466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.595248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.597303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.597939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.935145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:29.950891 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bc74a823-89ec-49dc-b146-68b608aee948 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1229 microversion: 2.1 time: 0.374553 Aug 04 05:00:29.965960 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2983/5866] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:29 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1229 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:30.974241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:30.974945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:30.991450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.993251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:30.994059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.997374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:31.617360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:31.626064 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00f6c0eb-de56-461d-a87b-d22a37761f23 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1229 microversion: 2.1 time: 0.656873 Aug 04 05:00:31.640351 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2884/5867] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:30 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1229 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:32.090264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:32.090900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:32.095442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f5c613c2-7cc4-4aba-b4dc-1de459f30198 req-c8358b31-3440-4946-8879-8a208ddf1771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:32.110994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:32.111754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.112743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:32.113384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.116631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f5c613c2-7cc4-4aba-b4dc-1de459f30198 req-c8358b31-3440-4946-8879-8a208ddf1771 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:32.117365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f5c613c2-7cc4-4aba-b4dc-1de459f30198 req-c8358b31-3440-4946-8879-8a208ddf1771 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.146657 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f5c613c2-7cc4-4aba-b4dc-1de459f30198 req-c8358b31-3440-4946-8879-8a208ddf1771 service nova] Creating event network-changed:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:00:32.165940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f5c613c2-7cc4-4aba-b4dc-1de459f30198 req-c8358b31-3440-4946-8879-8a208ddf1771 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071493 Aug 04 05:00:32.166941 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2885/5868] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:32.378036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:32.391210 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1152fce7-8136-4335-b570-875ac59a66d6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1563 microversion: 2.1 time: 0.304747 Aug 04 05:00:32.394735 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2984/5869] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:32 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1563 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:32.654219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:32.655762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:32.673762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:32.675584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.676920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:32.677432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.944258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:32.956686 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbc92764-a984-437d-a602-e6cd8aacc645 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1229 microversion: 2.1 time: 0.311577 Aug 04 05:00:32.957620 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2886/5870] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:32 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1229 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:33.978587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:33.980515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:33.991035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.991886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:33.993269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.993947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:34.162407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:34.173466 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd24bd4f-ea3f-4db0-99b0-060a5e4bd9df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1229 microversion: 2.1 time: 0.199115 Aug 04 05:00:34.174076 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2985/5871] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:33 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1229 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:35.193801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:35.194408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:35.202417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.202870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.203699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.204134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.350987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:35.358320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ee497d1-5f21-4181-80cf-3039e1e5592d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.168409 Aug 04 05:00:35.358915 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2887/5872] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:35 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:36.380669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:36.381803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:36.388993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:36.390137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:36.391162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:36.391838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:36.549339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:36.558228 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-72f95828-9dfd-468f-b409-06f71c132ffa tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.181669 Aug 04 05:00:36.570982 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2986/5873] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:36 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:37.582402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:37.583149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:37.587534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:37.588687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=10 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:37.594811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:37.595297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:37.596085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:37.596532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:37.745811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:37.754260 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16d63385-b0f7-4c55-9dc3-55013c82a1b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.176034 Aug 04 05:00:37.755303 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2888/5874] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:37 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:38.780159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:38.780713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:38.788263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.788719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.789724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.790175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.947904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:38.957874 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e7bb0850-03e1-4398-bd91-9ae98df2dba5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.182338 Aug 04 05:00:38.958873 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2987/5875] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:38 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:39.980526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:39.981835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:39.990883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.992094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:39.994085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.994993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:40.157570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:40.166146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b84ada7-dddb-4977-addf-5eea02ad4129 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.190206 Aug 04 05:00:40.166736 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2889/5876] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:39 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:41.187234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:41.187859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:41.195386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.195847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:41.196645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.197094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:41.344017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:41.352682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d8bdb0c-0c2d-46cb-9db5-eb490b717715 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.170156 Aug 04 05:00:41.354413 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2988/5877] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:41 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:42.375458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:42.376758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:42.384574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:42.385346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:42.386351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:42.386788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:42.546005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:42.554618 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-759c5536-b472-4349-b93b-bcc9294e6f4f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.183643 Aug 04 05:00:42.555238 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2890/5878] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:42 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:43.576804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:43.577430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:43.586141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.587117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.589728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.590448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.770463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:43.780318 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dcaef542-eafa-4e10-a3f9-759c6bcaa0dc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.207929 Aug 04 05:00:43.780902 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2989/5879] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:43 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:44.802530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:44.805496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:44.813044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.815057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.815969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.816530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.991266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:45.001430 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21ce6a66-959d-43f4-b1ac-dafdbd12796a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.203725 Aug 04 05:00:45.015573 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2891/5880] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:44 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:45.588723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b3eb28c1-a86a-4521-9ef1-4bc0e0bf9df7 req-43966852-9f19-4b30-a766-675eb1a45296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fe46d7-d991-4d16-94c2-10106d69dfe5", "name": "network-vif-plugged", "status": "completed", "tag": "a9ad4453-bde3-46b1-ad99-aeb59d45b6a4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:45.608111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b3eb28c1-a86a-4521-9ef1-4bc0e0bf9df7 req-43966852-9f19-4b30-a766-675eb1a45296 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:45.609083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b3eb28c1-a86a-4521-9ef1-4bc0e0bf9df7 req-43966852-9f19-4b30-a766-675eb1a45296 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:45.624337 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b3eb28c1-a86a-4521-9ef1-4bc0e0bf9df7 req-43966852-9f19-4b30-a766-675eb1a45296 service nova] Creating event network-vif-plugged:a9ad4453-bde3-46b1-ad99-aeb59d45b6a4 for instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 on n-h1-851337-5 Aug 04 05:00:45.630278 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b3eb28c1-a86a-4521-9ef1-4bc0e0bf9df7 req-43966852-9f19-4b30-a766-675eb1a45296 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050758 Aug 04 05:00:45.631466 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2990/5881] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:46.023441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:46.024318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:46.033522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.034268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.035070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.035527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.176451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:46.184758 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb4e0bff-ecac-4f61-8828-a8886e595205 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1217 microversion: 2.1 time: 0.165673 Aug 04 05:00:46.185749 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2892/5882] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:46 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:47.209704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:47.211108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:47.222221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.223026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.224010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.224623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.393637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:47.411897 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-463ab2cd-12e4-4087-886d-17c173f5e3ab tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1405 microversion: 2.1 time: 0.202547 Aug 04 05:00:47.411897 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2991/5883] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:47 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:47.433067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:47.433699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:47.441526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.441988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.442782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.444214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.613250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:47.623976 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ecf2003b-4ffb-4e26-8702-10552eecbcec tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1405 microversion: 2.1 time: 0.195406 Aug 04 05:00:47.625612 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2893/5884] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:47 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:47.649126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1795210945"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:47.659306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:47.671580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.672358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.673768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.675762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.810355 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Attempting to quiesce instance before volume snapshot. Aug 04 05:00:47.861995 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 04 05:00:47.973567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Creating snapshot from volume ded9e55d-ae44-407c-887d-4a349254044e. {{(pid=119343) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 04 05:00:49.071211 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f45be1a4-17b7-4cdf-bc73-40b617ccb79a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5/action" status: 202 len: 0 microversion: 2.1 time: 1.429129 Aug 04 05:00:49.072796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2992/5885] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:00:47 2022] POST /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5/action => generated 0 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 05:00:50.265433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-775372651", "imageRef": "52baa9a3-125f-401d-8ab3-c3b23560571c", "flavorRef": "452", "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:50.323987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:00:50.720653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:00:50.721086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:00:50.721574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:00:50.721995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:00:50.723175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:00:50.734234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.734697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.735670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.736126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.755692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:00:50.762362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:00:50.775739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:00:50.778317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='82c1ce29-88f9-41f0-8874-a0433a902f96',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:00:50.867956 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3f773bf5-1159-4c5f-86de-61dbd7619a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608129 Aug 04 05:00:50.868803 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2894/5886] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:00:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:00:50.884925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb3c8264-38d6-461b-a38c-fbf7c2e71ceb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:50.886374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb3c8264-38d6-461b-a38c-fbf7c2e71ceb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:50.969673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cb3c8264-38d6-461b-a38c-fbf7c2e71ceb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:50.978317 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb3c8264-38d6-461b-a38c-fbf7c2e71ceb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1229 microversion: 2.1 time: 0.101428 Aug 04 05:00:50.978921 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2993/5887] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:50 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:51.809622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0784007-2acb-44e5-94a7-b5c4b827c40f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:51.812046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0784007-2acb-44e5-94a7-b5c4b827c40f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:51.822352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0784007-2acb-44e5-94a7-b5c4b827c40f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:51.822822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0784007-2acb-44e5-94a7-b5c4b827c40f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:51.823665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0784007-2acb-44e5-94a7-b5c4b827c40f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:51.824116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0784007-2acb-44e5-94a7-b5c4b827c40f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:51.885931 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0784007-2acb-44e5-94a7-b5c4b827c40f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action" status: 200 len: 24568 microversion: 2.1 time: 0.079936 Aug 04 05:00:51.893574 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2895/5888] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:00:51 2022] POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action => generated 24568 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:00:52.000527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:52.001179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:52.009770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:52.010228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:52.011053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:52.011498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:52.094186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:52.098163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:52.103830 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-49008050-e16b-4c0e-bf36-305d0bd45b1f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1281 microversion: 2.1 time: 0.107826 Aug 04 05:00:52.104916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2994/5889] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:51 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:53.128916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:53.129799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:53.168515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.169047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.170425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.170986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.513171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:53.516422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=92 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:53.525930 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7144ac79-fe5d-49e2-a6ec-6301974f93ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.403783 Aug 04 05:00:53.526979 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2896/5890] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:53 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:54.222366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8c14d556-bf93-42ac-b274-0088bb8e5d2f req-f5182d1e-ff6f-4065-8e21-ee6770293113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6564893-b761-4261-94c3-992ae77ee01e", "tag": "b8dfc1b0-e4ff-42a7-a176-f5942d9b4f3e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:00:54.252520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8c14d556-bf93-42ac-b274-0088bb8e5d2f req-f5182d1e-ff6f-4065-8e21-ee6770293113 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.252984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8c14d556-bf93-42ac-b274-0088bb8e5d2f req-f5182d1e-ff6f-4065-8e21-ee6770293113 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.276807 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8c14d556-bf93-42ac-b274-0088bb8e5d2f req-f5182d1e-ff6f-4065-8e21-ee6770293113 service nova] Creating event network-changed:b8dfc1b0-e4ff-42a7-a176-f5942d9b4f3e for instance a6564893-b761-4261-94c3-992ae77ee01e on n-h1-851337-5 Aug 04 05:00:54.285475 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8c14d556-bf93-42ac-b274-0088bb8e5d2f req-f5182d1e-ff6f-4065-8e21-ee6770293113 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067074 Aug 04 05:00:54.286087 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2995/5891] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:00:54.552846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:54.553586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:54.568759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.569572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.570572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.572308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.834143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:54.843540 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29fc9aeb-64a1-4358-8a12-93b0068751e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.295862 Aug 04 05:00:54.845046 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2897/5892] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:54 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:55.868074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:55.868917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:55.881021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.884809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:55.885947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.893418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:56.210374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:56.220068 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6e2c42d1-811a-4854-aba1-fdcf51d79d26 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.357789 Aug 04 05:00:56.220666 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2996/5893] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:55 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:57.252858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:57.253496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:57.269802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:57.271219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:57.272316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:57.275686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:57.525594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:57.536586 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-326520aa-3efc-437e-af00-c6249d426c6b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.294942 Aug 04 05:00:57.537900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2898/5894] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:57 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:58.562725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:58.563423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:58.581168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=38 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:58.583096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.583732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.584674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.585259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.866515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:58.875724 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11da7f25-57a2-4da1-b8af-3363f4228bb6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.319488 Aug 04 05:00:58.890529 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2997/5895] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:58 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:59.908032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:59.908844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:59.918057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:59.922361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.923308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:59.924481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.925580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:00.164203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:00.175507 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1dce351-36b8-4b5c-ade1-d1b99b9c7214 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.281372 Aug 04 05:01:00.176593 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2899/5896] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:59 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:01.223530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:01.224234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:01.227124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:01.233839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.234997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.236001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.236669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.501738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:01.515409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b729c6e7-952e-4c94-8281-5d182daae84a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.298880 Aug 04 05:01:01.527542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2998/5897] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:01 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:02.538649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:02.541559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:02.550630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:02.552043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:02.557670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.558286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:02.559365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.559740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:02.819519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:02.845766 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-84972ced-8d75-493b-8bb1-6f3f144ad046 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.311019 Aug 04 05:01:02.851473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2900/5898] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:02 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:02.875490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5cc73546-c39f-4ceb-97ca-5945c8e61bcc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:02.879160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5cc73546-c39f-4ceb-97ca-5945c8e61bcc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:02.883312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5cc73546-c39f-4ceb-97ca-5945c8e61bcc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.884401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5cc73546-c39f-4ceb-97ca-5945c8e61bcc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:02.884898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5cc73546-c39f-4ceb-97ca-5945c8e61bcc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.885552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5cc73546-c39f-4ceb-97ca-5945c8e61bcc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.103521 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5cc73546-c39f-4ceb-97ca-5945c8e61bcc tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1832 microversion: 2.1 time: 0.233797 Aug 04 05:01:03.116291 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 2999/5899] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:02 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1832 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:03.130650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:03.131529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:03.139866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.140663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.141749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.142492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.345647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:03.359362 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-047b7746-2625-46d0-b869-578f9a1b0411 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1681 microversion: 2.1 time: 0.232598 Aug 04 05:01:03.360485 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2901/5900] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:03 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:03.485866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-97069b83-f3df-4098-b170-7afe602b0a56 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:03.486938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-97069b83-f3df-4098-b170-7afe602b0a56 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:03.496270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97069b83-f3df-4098-b170-7afe602b0a56 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.496990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97069b83-f3df-4098-b170-7afe602b0a56 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.498171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97069b83-f3df-4098-b170-7afe602b0a56 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.498638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-97069b83-f3df-4098-b170-7afe602b0a56 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.561902 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-97069b83-f3df-4098-b170-7afe602b0a56 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action" status: 200 len: 32640 microversion: 2.1 time: 0.083148 Aug 04 05:01:03.569609 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3000/5901] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:01:03 2022] POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action => generated 32640 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:01:03.752529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:03.764061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:03.764061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.764061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.764061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.764061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.798678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6e8888d5323d46a3b5f2be8cb8ad4424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23712bf4540d438ca89380c68a92dca1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:03.799292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] flavor_id is None. Assuming migration. {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 05:01:03.799745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:01:03.880408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:03.880408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:03.898638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.899247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.900071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.900526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.956883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1460d953-e590-4908-ad27-06d22dd75117 tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action" status: 202 len: 0 microversion: 2.1 time: 0.208353 Aug 04 05:01:03.961913 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2902/5902] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:01:03 2022] POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:01:03.968450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:03.969084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:03.976488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.977250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.978296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.979008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:04.159418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:04.168451 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8e69cc5f-527a-4536-8984-e4615d7729f7 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.295588 Aug 04 05:01:04.169493 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3001/5903] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:03 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:04.213647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:04.227433 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b74ca3cb-0f02-4031-b32c-bc2a47fae79c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1690 microversion: 2.1 time: 0.263122 Aug 04 05:01:04.228696 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2903/5904] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:03 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:05.190221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:05.190864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:05.208097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.208659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.209796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.213491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.258057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:05.258684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:05.294704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.300083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.300977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.302696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.557344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:05.570529 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7bfdca6a-8b4a-476f-9a7a-2e9e7e65379f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.384344 Aug 04 05:01:05.571865 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3002/5905] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:05 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:05.667744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:05.679821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f916ff0f-df93-445c-ae88-43f3f3e3f56f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1690 microversion: 2.1 time: 0.428721 Aug 04 05:01:05.680352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2904/5906] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:05 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1690 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:06.592581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:06.593217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:06.611762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.612227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.613045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.613503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.707636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:06.708258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:06.730377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.730864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.732272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.732665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.823491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:06.832110 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f7c4067-e724-43a2-8418-373413b0bbb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.243419 Aug 04 05:01:06.837168 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3003/5907] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:06 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:06.969644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:06.980584 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-30b01927-427e-408b-bee3-9bed43eb64e0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1690 microversion: 2.1 time: 0.276903 Aug 04 05:01:06.994688 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2905/5908] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:06 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:07.857923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:07.858559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:07.867100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:07.867947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:07.868965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:07.869507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:08.009490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:08.010715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:08.024262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:08.025964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:08.026420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:08.030747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:08.031277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:08.040136 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4b3cbc88-f18e-46d3-9c69-1dcd6bdab498 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.186747 Aug 04 05:01:08.040725 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3004/5909] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:07 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:08.190831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:08.199445 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc2e16f2-51fa-4434-8136-f5b1985f0c3e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.196748 Aug 04 05:01:08.210300 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2906/5910] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:08 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:09.062656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:09.063338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:09.071388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.072058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.073189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.074100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.223934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:09.225270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:09.244502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.248188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.253374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.254179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.282105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:09.299486 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9885484e-d27c-43e4-9bc9-d43cdc3b3ebc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.240801 Aug 04 05:01:09.301110 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3005/5911] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:09 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:09.483830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:09.501134 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-462e89f9-e823-4e7f-902d-3b2379d33220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.280954 Aug 04 05:01:09.504473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2907/5912] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:09 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:10.323032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:10.324281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:10.334916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.336143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.337712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.338576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.536704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:10.541605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:10.546772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:10.565881 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-051a8f3e-d12b-42d1-8e16-92a44efb7d11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1341 microversion: 2.1 time: 0.247930 Aug 04 05:01:10.566492 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3006/5913] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:10 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:10.567502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.568178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.569219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.569862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.776881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:10.785986 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e25ea11-cb04-42b4-a6dd-68d45c203f2a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.253795 Aug 04 05:01:10.786710 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2908/5914] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:10 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:11.592431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:11.593165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:11.601660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.602271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.603218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.603778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.786359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:11.795381 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ec2ee5e-f1ae-4eb7-9789-412f28ecba03 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.208918 Aug 04 05:01:11.795993 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3007/5915] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:11 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:11.819334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:11.820896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:11.831206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.831903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.833282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.833993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:12.018057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:12.030203 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bcdccf9a-f610-4d28-be17-7b50c1b480fb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.217820 Aug 04 05:01:12.030842 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2909/5916] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:11 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:12.827490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:12.828516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:12.844364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:12.846877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:12.849674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:12.850368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:13.039273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:13.050139 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3bfdfaca-b198-4eea-bbaf-40bd11d58f05 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.228332 Aug 04 05:01:13.055072 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3008/5917] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:12 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:13.055207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:13.055207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:13.066808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:13.067406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:13.068456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:13.069042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:13.242012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:13.251376 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-05febcfc-7649-46ef-9b90-0464e2824460 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.202493 Aug 04 05:01:13.263978 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2910/5918] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:13 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:14.073465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:14.074188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:14.081946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.082483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.083376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.083899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.231736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:14.242819 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-71f10376-00bd-463b-b161-fe5ef2d66d5d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.173262 Aug 04 05:01:14.244027 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3009/5919] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:14 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:14.285953 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:14.287537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:14.297221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.298204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.299809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.300401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.458235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:14.461555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:14.469240 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85d76074-e315-49e9-a051-14e091d52419 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.187533 Aug 04 05:01:14.470157 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2911/5920] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:14 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:14.575634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aeb1f86e-dc30-443c-bd3e-0f7ba0ce64fd tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:14.576389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aeb1f86e-dc30-443c-bd3e-0f7ba0ce64fd tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:14.583365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aeb1f86e-dc30-443c-bd3e-0f7ba0ce64fd tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.584096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aeb1f86e-dc30-443c-bd3e-0f7ba0ce64fd tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.585068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aeb1f86e-dc30-443c-bd3e-0f7ba0ce64fd tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.585677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aeb1f86e-dc30-443c-bd3e-0f7ba0ce64fd tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.613037 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aeb1f86e-dc30-443c-bd3e-0f7ba0ce64fd tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/ips" status: 200 len: 145 microversion: 2.1 time: 0.041942 Aug 04 05:01:14.619453 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3010/5921] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 05:01:14 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:15.412159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:15.413285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:15.420010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.420459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.421242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.421681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.491077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:15.491709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:15.504722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.505392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.508655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.511236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.704932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:15.716697 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f68bb100-897f-4ed2-a2b1-2f9fb7e30b2f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.455599 Aug 04 05:01:15.721296 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2912/5922] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:15 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:15.846310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:15.855831 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3d54979e-fb90-4097-a17e-531ce8123997 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.368838 Aug 04 05:01:15.861635 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3011/5923] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:15 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:16.745892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:16.748839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:16.759967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.761993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.764005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.764783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.890943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:16.892381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:16.939322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.947712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.952255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.957934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:17.069957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:17.085224 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41421b4f-f3c7-44b7-b90f-4246d925a274 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.344550 Aug 04 05:01:17.086283 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2913/5924] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:16 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:17.244042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:17.253172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=100 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:17.257060 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8748de98-ade9-4413-a3fd-65b76f7c7940 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.376969 Aug 04 05:01:17.268712 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3012/5925] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:16 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:18.108893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:18.111942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:18.142732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc6df42e-e9ea-4f3e-bc49-540eef3e931e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbd34743-4501-4e41-915c-8bd1af8cec52"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:18.144187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.145162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.146210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.147184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc6df42e-e9ea-4f3e-bc49-540eef3e931e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:18.148210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.158764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc6df42e-e9ea-4f3e-bc49-540eef3e931e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.160006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc6df42e-e9ea-4f3e-bc49-540eef3e931e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.161263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc6df42e-e9ea-4f3e-bc49-540eef3e931e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.161889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc6df42e-e9ea-4f3e-bc49-540eef3e931e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.355093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:18.366628 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d4ff69b-a1d5-45b6-b6d3-e4f443ecef21 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.263937 Aug 04 05:01:18.367275 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2914/5926] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:18 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:18.373244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:18.374420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:18.382081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.383184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.384289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.384937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.571343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:18.581383 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-19bd7dff-6693-4fbf-84ea-1c8ceff70569 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.212555 Aug 04 05:01:18.582529 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2915/5927] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:18 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:18.951511 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc6df42e-e9ea-4f3e-bc49-540eef3e931e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813085 Aug 04 05:01:18.952404 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3013/5928] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:01:18 2022] POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:19.392802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:19.393631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:19.414032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.415513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.416959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.419555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.609652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:19.610188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:19.624429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.635760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.636908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.637591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.689111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:19.705874 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7019806c-3083-4ec3-8c15-49ccd8dcc915 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.319884 Aug 04 05:01:19.706495 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2916/5929] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:19 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:19.868069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:19.887568 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-533fe7e1-0f0c-4a49-8f1d-ff47c3cc80c0 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.283564 Aug 04 05:01:19.900220 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3014/5930] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:19 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:20.730510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:20.732059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:20.744171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.760149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.763424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.772802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.926152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:20.926794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:20.951260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.951949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.953228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.953893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:21.152678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:21.164965 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc7a5d9e-341b-4fd2-a220-c8260fa2009a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.438875 Aug 04 05:01:21.181892 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2917/5931] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:20 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:21.269883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:21.287006 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2157f412-4076-4c20-99e6-c88574cfb04b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.364866 Aug 04 05:01:21.297285 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3015/5932] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:20 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:22.192552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:22.194285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:22.205145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:22.206520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:22.207852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:22.208454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:22.320458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:22.321161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:22.339571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:22.340247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:22.341191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:22.341812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:22.411791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:22.426686 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8011ad04-5124-42bb-8f1d-f1e906b43e75 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.237787 Aug 04 05:01:22.440312 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2918/5933] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:22 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:22.594897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:22.605250 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d35c4eb4-c794-46cc-a2ff-143fc0af2a93 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.291242 Aug 04 05:01:22.606354 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3016/5934] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:22 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:23.453053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:23.453705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:23.469442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.470621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.473019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.474103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.630032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:23.630774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:23.649040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.649660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.650570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.651169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.842013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:23.854943 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a00f1ff6-ed3d-43ec-bef4-3b1f1e3a0c1e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.405350 Aug 04 05:01:23.858211 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2919/5935] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:23 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:23.989094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:24.003589 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ac35a34-0c02-4377-aae0-a53c6f32f0fe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1695 microversion: 2.1 time: 0.373307 Aug 04 05:01:24.004227 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3017/5936] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:23 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1695 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:24.147049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-12d272fe-9072-4ee3-a011-217f135d3525 req-09f1bfdd-d964-40bd-9941-49819abddbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6564893-b761-4261-94c3-992ae77ee01e", "name": "network-vif-plugged", "status": "completed", "tag": "b8dfc1b0-e4ff-42a7-a176-f5942d9b4f3e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:24.172617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-12d272fe-9072-4ee3-a011-217f135d3525 req-09f1bfdd-d964-40bd-9941-49819abddbd3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:24.173288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-12d272fe-9072-4ee3-a011-217f135d3525 req-09f1bfdd-d964-40bd-9941-49819abddbd3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:24.193772 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-12d272fe-9072-4ee3-a011-217f135d3525 req-09f1bfdd-d964-40bd-9941-49819abddbd3 service nova] Creating event network-vif-plugged:b8dfc1b0-e4ff-42a7-a176-f5942d9b4f3e for instance a6564893-b761-4261-94c3-992ae77ee01e on n-h1-851337-5 Aug 04 05:01:24.212690 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-12d272fe-9072-4ee3-a011-217f135d3525 req-09f1bfdd-d964-40bd-9941-49819abddbd3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069114 Aug 04 05:01:24.213484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2920/5937] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:24.889031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:24.893695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:24.911229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:24.912032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:24.917789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:24.918568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.112131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c63977e0-e9ac-455f-8ca2-42c417696fac req-ee04e1f2-a820-439c-b592-9de192f39b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "name": "network-vif-unplugged", "status": "completed", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:25.139604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c63977e0-e9ac-455f-8ca2-42c417696fac req-ee04e1f2-a820-439c-b592-9de192f39b5c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:25.140409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c63977e0-e9ac-455f-8ca2-42c417696fac req-ee04e1f2-a820-439c-b592-9de192f39b5c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.165925 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c63977e0-e9ac-455f-8ca2-42c417696fac req-ee04e1f2-a820-439c-b592-9de192f39b5c service nova] Creating event network-vif-unplugged:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h1-851337-5 Aug 04 05:01:25.177681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-c63977e0-e9ac-455f-8ca2-42c417696fac req-ee04e1f2-a820-439c-b592-9de192f39b5c service nova] Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:01:25.182315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:25.198487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c63977e0-e9ac-455f-8ca2-42c417696fac req-ee04e1f2-a820-439c-b592-9de192f39b5c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.391377 Aug 04 05:01:25.199572 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3018/5938] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:25.205092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:25.206016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:25.214294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:25.215661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.216616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:25.217211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.225836 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7599780b-98ca-4152-b476-44ab7a585289 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1375 microversion: 2.1 time: 0.344635 Aug 04 05:01:25.252603 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2921/5939] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:24 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1375 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:25.478409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:25.491788 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-74339426-a834-402f-88cd-de3eb9934c62 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1694 microversion: 2.1 time: 0.290752 Aug 04 05:01:25.492591 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3019/5940] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:25 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1694 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:26.281034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:26.283333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:26.298328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.300264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.302558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.304257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.546211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:26.547763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:26.559759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.560538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.561673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.562373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.616491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:26.633895 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99d3b3ad-25af-4c57-a9a8-9bea87bec594 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1563 microversion: 2.1 time: 0.363889 Aug 04 05:01:26.635305 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2922/5941] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:26 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1563 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:26.676967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:26.679996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:26.700370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.700825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.701619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.702227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.249843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:27.260736 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-474c7f75-8e88-4a27-9c39-f8b173f3c188 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1694 microversion: 2.1 time: 0.721598 Aug 04 05:01:27.262921 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3020/5942] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:26 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1694 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:27.269089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0f6f6ce2-fbac-4453-a19a-0d6a90740ce6 req-e8cf955e-5125-4770-8fde-215b85f0a221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:27.284405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0f6f6ce2-fbac-4453-a19a-0d6a90740ce6 req-e8cf955e-5125-4770-8fde-215b85f0a221 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.285071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0f6f6ce2-fbac-4453-a19a-0d6a90740ce6 req-e8cf955e-5125-4770-8fde-215b85f0a221 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.302994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0f6f6ce2-fbac-4453-a19a-0d6a90740ce6 req-e8cf955e-5125-4770-8fde-215b85f0a221 service nova] Creating event network-changed:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h1-851337-5 Aug 04 05:01:27.308954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:27.318281 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b873e39-1704-4c2f-8bea-b3b72bf939d2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1563 microversion: 2.1 time: 0.657847 Aug 04 05:01:27.318937 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2923/5943] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:26 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1563 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:27.319385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-0f6f6ce2-fbac-4453-a19a-0d6a90740ce6 req-e8cf955e-5125-4770-8fde-215b85f0a221 service nova] Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:01:27.339187 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0f6f6ce2-fbac-4453-a19a-0d6a90740ce6 req-e8cf955e-5125-4770-8fde-215b85f0a221 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074512 Aug 04 05:01:27.341063 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3021/5944] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:27.412550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:27.413060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:27.419839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.420301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.421083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.421522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.452495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:01:27.541656 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7429bf24-8ad5-44bd-8a7e-801d29214a89 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 204 len: 0 microversion: 2.1 time: 0.132570 Aug 04 05:01:27.551054 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2924/5945] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:01:27 2022] DELETE /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:01:27.551715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:27.552463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:27.559937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.560412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.561217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.561674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.710633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:27.719740 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-228bb0b9-81f1-47af-87f5-b9aebe959426 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1569 microversion: 2.1 time: 0.172199 Aug 04 05:01:27.720336 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3022/5946] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:27 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:28.288105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:28.288816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:28.304873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.308494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:28.309568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.312900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:28.483777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:28.492508 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a1df7ccd-cea6-41ab-9ce5-8e4968532c37 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1692 microversion: 2.1 time: 0.208579 Aug 04 05:01:28.493342 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2925/5947] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:28 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1692 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:28.741753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:28.743027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:28.746051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=52 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:28.752339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.752810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:28.753620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.754150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:28.912963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:28.924262 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-053f349f-c8be-4144-9c95-7a4e4f5398f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1569 microversion: 2.1 time: 0.186415 Aug 04 05:01:28.924779 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3023/5948] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:28 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:29.516553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:29.517331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:29.524407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:29.524867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:29.525644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:29.526117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:29.685731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:29.695273 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6dfb60f-2ba5-4d5e-9509-25a87eec6b28 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1692 microversion: 2.1 time: 0.182904 Aug 04 05:01:29.704033 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2926/5949] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:29 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:29.946158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:29.946800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:29.955308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:29.955776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:29.956580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:29.957038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:30.105651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:30.114283 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08847224-d181-41bd-8dd9-6a8259b5958e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1569 microversion: 2.1 time: 0.172111 Aug 04 05:01:30.114871 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3024/5950] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:29 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:30.718404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:30.719673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:30.726607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:30.729841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:30.730892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:30.731923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:30.733075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:30.753528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:30.908164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:30.916102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-05f8e1de-42c7-4909-857e-f38d23a493f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1692 microversion: 2.1 time: 0.202373 Aug 04 05:01:30.916794 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2927/5951] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:30 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:31.135358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:31.136173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:31.143357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.143935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:31.144829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.145423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:31.345815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:31.357052 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51d4424b-db9a-44ad-97b5-513883cb5a48 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1569 microversion: 2.1 time: 0.225361 Aug 04 05:01:31.357943 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3025/5952] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:31 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:31.953985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:31.955492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:31.973986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.974756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:31.975946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.976623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.177798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:32.186545 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bfb52f19-4f47-4269-94d9-9146c9c844d8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1689 microversion: 2.1 time: 0.249649 Aug 04 05:01:32.191026 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2928/5953] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:31 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1689 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:32.212952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9a075a31-d51d-4329-b30e-3a0b552aaee7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:32.213516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a075a31-d51d-4329-b30e-3a0b552aaee7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:32.221633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a075a31-d51d-4329-b30e-3a0b552aaee7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.222088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a075a31-d51d-4329-b30e-3a0b552aaee7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.225649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a075a31-d51d-4329-b30e-3a0b552aaee7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.227314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a075a31-d51d-4329-b30e-3a0b552aaee7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.379860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:32.380638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:32.390333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.391359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.392235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.392636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.426652 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9a075a31-d51d-4329-b30e-3a0b552aaee7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action" status: 202 len: 0 microversion: 2.1 time: 0.219142 Aug 04 05:01:32.427891 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3026/5954] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:01:32 2022] POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:01:32.439219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:32.440190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:32.450205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.450866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.452108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.452795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.484795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:32.824492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:32.835472 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91feea3f-0395-4e73-82e6-1ffb1468ceb8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1569 microversion: 2.1 time: 0.460059 Aug 04 05:01:32.837432 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2929/5955] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:32 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1569 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:32.919106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:32.928337 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-52f26369-d836-436d-a3e1-33f29cb3d4e4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1688 microversion: 2.1 time: 0.496025 Aug 04 05:01:32.928946 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3027/5956] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:32 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1688 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:33.282214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-09d69178-b5ec-4265-a88f-aca6504c002f req-df277520-bf19-4826-8646-146a98c11b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6564893-b761-4261-94c3-992ae77ee01e", "name": "network-vif-deleted", "tag": "b8dfc1b0-e4ff-42a7-a176-f5942d9b4f3e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:33.298315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-09d69178-b5ec-4265-a88f-aca6504c002f req-df277520-bf19-4826-8646-146a98c11b4d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.299042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-09d69178-b5ec-4265-a88f-aca6504c002f req-df277520-bf19-4826-8646-146a98c11b4d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.353245 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-09d69178-b5ec-4265-a88f-aca6504c002f req-df277520-bf19-4826-8646-146a98c11b4d service nova] Creating event network-vif-deleted:b8dfc1b0-e4ff-42a7-a176-f5942d9b4f3e for instance a6564893-b761-4261-94c3-992ae77ee01e on n-h1-851337-5 Aug 04 05:01:33.359597 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-09d69178-b5ec-4265-a88f-aca6504c002f req-df277520-bf19-4826-8646-146a98c11b4d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085074 Aug 04 05:01:33.360344 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2930/5957] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:01:33.685159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3075febe-f244-4898-a69d-ea6b282853b0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:33.696820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3075febe-f244-4898-a69d-ea6b282853b0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.697328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3075febe-f244-4898-a69d-ea6b282853b0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.753247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3075febe-f244-4898-a69d-ea6b282853b0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 05:01:33.826323 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3075febe-f244-4898-a69d-ea6b282853b0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action" status: 202 len: 0 microversion: 2.1 time: 0.144941 Aug 04 05:01:33.827356 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3028/5958] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:01:33 2022] POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:01:33.837593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:33.838531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:33.852653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.855347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.857645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.859652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.860208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:33.860954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:33.879135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.879605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.880414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.880875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.163541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:34.195737 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e5b676c-e7be-46fd-9424-09561c8ef2fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1360 microversion: 2.1 time: 0.340210 Aug 04 05:01:34.203256 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3029/5959] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:33 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1360 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:34.220472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:34.221129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:34.247037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:34.248509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.252816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:34.254019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.338174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:34.348343 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3334ee34-6261-46af-8c68-3fd7e32d442d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.516430 Aug 04 05:01:34.351519 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2931/5960] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:33 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:34.373472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e3e2d4fd-f8f3-44ac-a6da-c54c1f6b36c8 req-b10d7c7b-518b-477e-a7ed-6d69f089db8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "name": "network-vif-plugged", "status": "completed", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:34.383307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e3e2d4fd-f8f3-44ac-a6da-c54c1f6b36c8 req-b10d7c7b-518b-477e-a7ed-6d69f089db8b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:34.383919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e3e2d4fd-f8f3-44ac-a6da-c54c1f6b36c8 req-b10d7c7b-518b-477e-a7ed-6d69f089db8b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.405673 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e3e2d4fd-f8f3-44ac-a6da-c54c1f6b36c8 req-b10d7c7b-518b-477e-a7ed-6d69f089db8b service nova] Creating event network-vif-plugged:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h1-851337-5 Aug 04 05:01:34.415740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-e3e2d4fd-f8f3-44ac-a6da-c54c1f6b36c8 req-b10d7c7b-518b-477e-a7ed-6d69f089db8b service nova] Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:01:34.441885 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e3e2d4fd-f8f3-44ac-a6da-c54c1f6b36c8 req-b10d7c7b-518b-477e-a7ed-6d69f089db8b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087670 Aug 04 05:01:34.442744 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2932/5961] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:34.485443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:34.495073 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e855adc5-a308-4351-9397-7ddcceeddbfd tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1688 microversion: 2.1 time: 0.290644 Aug 04 05:01:34.497398 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3030/5962] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:34 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1688 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:35.218278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:35.218898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:35.232830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.233700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.234902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.235653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.373873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:35.379481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:35.382321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:35.400396 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-79731205-9312-42dd-baa5-7e2f34e0e317 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1360 microversion: 2.1 time: 0.185874 Aug 04 05:01:35.403832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.404970 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2933/5963] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:35 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1360 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:35.405663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.406643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.407257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.522199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:35.523344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:35.535325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.536197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.537444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.538416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.599698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:35.613319 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1592ded1-2a55-46f0-9858-4367960d0b7d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.246823 Aug 04 05:01:35.615631 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3031/5964] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:35 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:35.802075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:35.813664 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81b86f9f-ae47-4079-818f-04772d2e9b47 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1688 microversion: 2.1 time: 0.296514 Aug 04 05:01:35.814777 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2934/5965] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:35 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1688 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:36.426264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:36.426904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:36.443316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.445525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.446482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.446969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.571237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:36.582800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a1a4341-47a1-4538-8aa2-7018ee765510 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1360 microversion: 2.1 time: 0.161045 Aug 04 05:01:36.585273 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3032/5966] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:36 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:36.653050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:36.654256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:36.679045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.680031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.682749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.685370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.840336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:36.840981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:36.848935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.849423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.850238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.850697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:37.114504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:37.134551 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4843f45-0ab9-4cc2-bb7c-ab964bab3ee6 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.493674 Aug 04 05:01:37.142613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2935/5967] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:36 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:37.222866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:37.234890 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36fe55c9-f650-4f8f-a840-8feec2909de8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1688 microversion: 2.1 time: 0.398613 Aug 04 05:01:37.235796 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3033/5968] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:36 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1688 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:37.605969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:37.606989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:37.617991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:37.619805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:37.623281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:37.623843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:37.810291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:37.829766 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52cc9517-b4b9-4dee-b2e6-5862c5a2b6fb tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1360 microversion: 2.1 time: 0.227160 Aug 04 05:01:37.833363 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2936/5969] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:37 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:38.165274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:38.166228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:38.179471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.180521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.184499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.186714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.259055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:38.260096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:38.267748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.268456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.269398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.270346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.585895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:38.594989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ddfb3ac-12ab-4a3d-b804-b87c6846d2ec tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.434564 Aug 04 05:01:38.609431 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3034/5970] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:38 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:38.635353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:38.651586 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f1e8603-28c8-4936-855e-e36f40da147e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1688 microversion: 2.1 time: 0.396441 Aug 04 05:01:38.652695 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2937/5971] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:38 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1688 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:38.655317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ecd8cde4-f932-4031-ba1b-31c10b171f14 req-fbc15fcb-894a-4a14-a9ac-02c3e6936229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "name": "network-vif-unplugged", "status": "completed", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:38.673915 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ecd8cde4-f932-4031-ba1b-31c10b171f14 req-fbc15fcb-894a-4a14-a9ac-02c3e6936229 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.674638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ecd8cde4-f932-4031-ba1b-31c10b171f14 req-fbc15fcb-894a-4a14-a9ac-02c3e6936229 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.692290 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ecd8cde4-f932-4031-ba1b-31c10b171f14 req-fbc15fcb-894a-4a14-a9ac-02c3e6936229 service nova] Creating event network-vif-unplugged:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:01:38.702400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-ecd8cde4-f932-4031-ba1b-31c10b171f14 req-fbc15fcb-894a-4a14-a9ac-02c3e6936229 service nova] Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:01:38.715199 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ecd8cde4-f932-4031-ba1b-31c10b171f14 req-fbc15fcb-894a-4a14-a9ac-02c3e6936229 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063522 Aug 04 05:01:38.716078 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3035/5972] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:01:38.857053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:38.858651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:38.874289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.875238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.894345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.895615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.026287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:39.037150 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27c137d7-a690-4ef3-b9b4-b3b8728630fe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1360 microversion: 2.1 time: 0.184996 Aug 04 05:01:39.038594 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2938/5973] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:38 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1360 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:39.618271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:39.619543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:39.627002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.627726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.628684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.639745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.674863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:39.675755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:39.685792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.686252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.687085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.687546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.942292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:39.954231 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c96f1a84-03d3-40e1-81b6-5efa41bdd532 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.341540 Aug 04 05:01:39.954841 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3036/5974] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:39 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:40.057621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:40.059168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:40.067853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:40.075719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.076360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.077418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.078167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.084277 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-406af839-fecf-445b-9fbe-3bec2c442e14 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1688 microversion: 2.1 time: 0.412848 Aug 04 05:01:40.086286 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2939/5975] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:39 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1688 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:40.135729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.136882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.137358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lazy-loading 'fault' on Instance uuid a6564893-b761-4261-94c3-992ae77ee01e {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:01:40.196072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:40.210001 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-633557ec-3375-4e28-a35e-2122dc92d542 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 200 len: 1365 microversion: 2.1 time: 0.156133 Aug 04 05:01:40.211017 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3037/5976] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:40 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:40.748602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-414983d6-07eb-4972-bf60-70b6dacad361 req-b7a5d224-e8cb-47aa-a8eb-041b85df2d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:40.761273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-414983d6-07eb-4972-bf60-70b6dacad361 req-b7a5d224-e8cb-47aa-a8eb-041b85df2d69 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.762334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-414983d6-07eb-4972-bf60-70b6dacad361 req-b7a5d224-e8cb-47aa-a8eb-041b85df2d69 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.790313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-414983d6-07eb-4972-bf60-70b6dacad361 req-b7a5d224-e8cb-47aa-a8eb-041b85df2d69 service nova] Creating event network-changed:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:01:40.805989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-414983d6-07eb-4972-bf60-70b6dacad361 req-b7a5d224-e8cb-47aa-a8eb-041b85df2d69 service nova] Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:01:40.820671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-414983d6-07eb-4972-bf60-70b6dacad361 req-b7a5d224-e8cb-47aa-a8eb-041b85df2d69 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079238 Aug 04 05:01:40.821366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2940/5977] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:40.985278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:40.985930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:40.995888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.996352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.023430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.023939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.110105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:41.110815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:41.130859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.131349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.132157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.132604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.373335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:41.385290 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4b9deb99-0e4a-48a1-b8bc-61bcf6d620d7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.412913 Aug 04 05:01:41.393583 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3038/5978] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:40 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:41.398638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:41.399288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:41.426632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.427336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.428278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.428870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.456024 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e HTTP/1.1 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'a6564893-b761-4261-94c3-992ae77ee01e'} Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:01:41.463519 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:41.466774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:01:41.467558 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93a04a1b-e4ff-4254-b78c-89c42f760953 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 404 len: 111 microversion: 2.1 time: 0.072574 Aug 04 05:01:41.468142 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3039/5979] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:41 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:01:41.685271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:41.696222 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-afb63e27-f006-4252-b195-405b4116b557 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1688 microversion: 2.1 time: 0.593997 Aug 04 05:01:41.696844 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2941/5980] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:41 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1688 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:42.429939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:42.430650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:42.438712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.439751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:42.440806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.441438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:42.616383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:42.625140 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a235bb3-e470-474f-8076-acbb678c1377 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.199725 Aug 04 05:01:42.625952 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3040/5981] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:42 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:42.733114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:42.733733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:42.742261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.742760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:42.743555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.744160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:42.947591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:42.957280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c79eb4a9-b266-41ab-8585-052de11fe923 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1681 microversion: 2.1 time: 0.228418 Aug 04 05:01:42.958751 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2942/5982] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:42 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:43.661628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:43.663584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:43.684544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:43.686017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:43.686924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:43.688167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:44.002663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:44.012404 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7804464-cea8-4a17-a67d-0349b883970e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1722 microversion: 2.1 time: 0.365476 Aug 04 05:01:44.012994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3041/5983] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:43 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:45.034448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:45.035207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:45.064655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.065595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.066593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.067211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.203886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-cf29e822-2318-4850-9fd0-ea552284d6e0 req-2497a3e9-cf72-4a52-9d4d-fb01993f4ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "name": "network-vif-plugged", "status": "completed", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:45.229285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cf29e822-2318-4850-9fd0-ea552284d6e0 req-2497a3e9-cf72-4a52-9d4d-fb01993f4ec9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.232897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cf29e822-2318-4850-9fd0-ea552284d6e0 req-2497a3e9-cf72-4a52-9d4d-fb01993f4ec9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.260977 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-cf29e822-2318-4850-9fd0-ea552284d6e0 req-2497a3e9-cf72-4a52-9d4d-fb01993f4ec9 service nova] Creating event network-vif-plugged:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:01:45.276028 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-cf29e822-2318-4850-9fd0-ea552284d6e0 req-2497a3e9-cf72-4a52-9d4d-fb01993f4ec9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077898 Aug 04 05:01:45.279607 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3042/5984] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:01:45.641641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:45.652210 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b06278a5-f5e2-487c-a933-a57334b744a5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1699 microversion: 2.1 time: 0.622075 Aug 04 05:01:45.652827 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2943/5985] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:45 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1699 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:45.676821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31d39d29-2586-4f92-95b9-8c9082f30272 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:45.684755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31d39d29-2586-4f92-95b9-8c9082f30272 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.685224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31d39d29-2586-4f92-95b9-8c9082f30272 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.761757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31d39d29-2586-4f92-95b9-8c9082f30272 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Going to try to start instance {{(pid=119343) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 05:01:45.797185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:45.853621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31d39d29-2586-4f92-95b9-8c9082f30272 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action" status: 202 len: 0 microversion: 2.1 time: 0.181996 Aug 04 05:01:45.855867 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3043/5986] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:01:45 2022] POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:01:45.867542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:45.872428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:45.891195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.892430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.896473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.900403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.943036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:45.943729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:45.957849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.958312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.959146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.959617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:46.012839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:01:46.138708 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-71451cba-5e46-46d2-8fa0-e574d196680d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 204 len: 0 microversion: 2.1 time: 0.209831 Aug 04 05:01:46.141897 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3044/5987] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:01:45 2022] DELETE /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:01:46.159554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:46.161314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:46.164337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:46.173796 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a86e0a3-15a2-4113-badc-eee95b86a0e2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1708 microversion: 2.1 time: 0.313986 Aug 04 05:01:46.175245 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2944/5988] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:45 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1708 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:46.177334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:46.177801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:46.178601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:46.179072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:46.374877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:46.383709 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-93da0d2c-d137-4150-8686-5fb8ff82cc16 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1411 microversion: 2.1 time: 0.236219 Aug 04 05:01:46.384976 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3045/5989] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:46 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1411 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:47.197850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:47.199351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:47.213100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.219434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.221539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.222316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.249006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:47.406285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:47.406907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:47.415379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.416025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.417719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.418361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.592102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:47.601518 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c882ef4-4535-45d8-b80a-c241988af012 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1708 microversion: 2.1 time: 0.408415 Aug 04 05:01:47.607462 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2945/5990] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:47 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1708 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:47.654038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:47.662515 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7f89a48a-0d14-4f16-b5fb-94d8306a18bc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1411 microversion: 2.1 time: 0.260810 Aug 04 05:01:47.663715 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3046/5991] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:47 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1411 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:48.633274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:48.634086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:48.642939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.644277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.648301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.649206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.686113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:48.690340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:48.708387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.709691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.711794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.712347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.908071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:48.916793 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ad403ca-b1be-4a11-9e01-a9b65a1d6785 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1369 microversion: 2.1 time: 0.236848 Aug 04 05:01:48.917555 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3047/5992] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:48 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1369 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:48.931388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2532abb2-fd10-416c-9822-5b9ce301a83b req-25001c79-0292-42e0-ab62-d1ec34012182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fe46d7-d991-4d16-94c2-10106d69dfe5", "name": "network-vif-deleted", "tag": "a9ad4453-bde3-46b1-ad99-aeb59d45b6a4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:01:48.949255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2532abb2-fd10-416c-9822-5b9ce301a83b req-25001c79-0292-42e0-ab62-d1ec34012182 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.949728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2532abb2-fd10-416c-9822-5b9ce301a83b req-25001c79-0292-42e0-ab62-d1ec34012182 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.973565 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2532abb2-fd10-416c-9822-5b9ce301a83b req-25001c79-0292-42e0-ab62-d1ec34012182 service nova] Creating event network-vif-deleted:a9ad4453-bde3-46b1-ad99-aeb59d45b6a4 for instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 on n-h1-851337-5 Aug 04 05:01:48.989473 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2532abb2-fd10-416c-9822-5b9ce301a83b req-25001c79-0292-42e0-ab62-d1ec34012182 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070313 Aug 04 05:01:48.990036 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3048/5993] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:01:49.317252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:49.333914 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c549a15b-9c4b-4d1a-abe2-9cd1f67b45cc tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1708 microversion: 2.1 time: 0.705503 Aug 04 05:01:49.348126 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2946/5994] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:48 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1708 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:49.939922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:49.940627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:49.951405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:49.951880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:49.952687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:49.953144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:50.196926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:50.208980 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46098d03-6fac-4146-902e-f5ab5c91206a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1202 microversion: 2.1 time: 0.274153 Aug 04 05:01:50.209586 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3049/5995] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:49 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1202 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:50.355692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:50.356312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:50.367487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:50.368197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:50.371028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:50.378395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:50.632189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:50.655691 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3cf0a65-88dc-4e57-b169-f5a082fc6a54 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1712 microversion: 2.1 time: 0.303560 Aug 04 05:01:50.674432 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2947/5996] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:50 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1712 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:51.231214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:51.231867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:51.258873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:51.259417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:51.263292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:51.266807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:51.428569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:51.460269 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-89b63590-ac6d-4b30-a60b-3ff7c140f46c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1202 microversion: 2.1 time: 0.234223 Aug 04 05:01:51.466762 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3050/5997] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:51 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1202 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:52.481362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:52.481980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:52.494603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:52.496926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:52.503596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:52.504242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:52.624571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:52.633941 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cccd8bbb-067f-4d68-91f8-f79432ebb9b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1202 microversion: 2.1 time: 0.157099 Aug 04 05:01:52.651868 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2948/5998] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:52 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:53.660606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:53.662093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:53.677628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:53.678494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:53.686712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:53.687911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:54.030527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:54.045971 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a46f86a6-f059-4dd4-98d2-ebea4aeefce5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1202 microversion: 2.1 time: 0.393699 Aug 04 05:01:54.062674 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3051/5999] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:53 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:55.073271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:55.073994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:55.097170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:55.098565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:55.099431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:55.099874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:55.260316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:55.274943 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c12d433a-79d3-4c47-bccc-ba2a8e9b2f36 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 200 len: 1202 microversion: 2.1 time: 0.205629 Aug 04 05:01:55.276772 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2949/6000] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:55 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 1202 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:56.309019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:56.309858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:56.321936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:56.325723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:56.327113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:56.328190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:56.398130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 HTTP/1.1 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'd7fe46d7-d991-4d16-94c2-10106d69dfe5'} Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:01:56.402220 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:01:56.406048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:01:56.407284 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3254cab1-6bab-42c9-b40d-769af24323e5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 404 len: 111 microversion: 2.1 time: 0.103057 Aug 04 05:01:56.411046 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3052/6001] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:56 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:02:00.786485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:00.787202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:00.789796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=46 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:00.797958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:00.798777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:00.799612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:00.800211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:00.820637 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e HTTP/1.1 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a6564893-b761-4261-94c3-992ae77ee01e'} Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:02:00.822274 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4654ab1-75c4-4691-9285-bb9452a0ea68 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 404 len: 111 microversion: 2.1 time: 0.042287 Aug 04 05:02:00.826490 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2950/6002] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:02:00 2022] DELETE /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:02:00.837353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:00.837997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a6564893-b761-4261-94c3-992ae77ee01e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:00.846893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:00.848494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:00.849328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:00.850316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:00.850968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:00.871417 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e HTTP/1.1 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'a6564893-b761-4261-94c3-992ae77ee01e'} Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:00.873361 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.877336 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:00.877336 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:00.877336 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:00.877336 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:02:00.877336 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:02:00.877336 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. Aug 04 05:02:00.877336 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:00.878519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance a6564893-b761-4261-94c3-992ae77ee01e could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:02:00.881434 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6878b17f-de3e-4555-83c8-749c3effefd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e" status: 404 len: 111 microversion: 2.1 time: 0.052188 Aug 04 05:02:00.882512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3053/6003] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:00 2022] GET /compute/v2.1/servers/a6564893-b761-4261-94c3-992ae77ee01e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:02:01.581415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:01.582271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:01.590137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:01.590947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:01.591985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:01.592534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:01.611598 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 HTTP/1.1 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'd7fe46d7-d991-4d16-94c2-10106d69dfe5'} Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:02:01.613784 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.618269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:02:01.620443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-be9179ef-c48f-4710-8d9d-95e2c06c9400 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 404 len: 111 microversion: 2.1 time: 0.042586 Aug 04 05:02:01.621386 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2951/6004] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:02:01 2022] DELETE /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:02:01.629492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:01.630465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d7fe46d7-d991-4d16-94c2-10106d69dfe5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:01.637328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:01.637984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:01.638795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:01.639281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:01.657792 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 HTTP/1.1 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'd7fe46d7-d991-4d16-94c2-10106d69dfe5'} Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:01.659408 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance d7fe46d7-d991-4d16-94c2-10106d69dfe5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-05a29891-576c-467a-96a7-b21d3042a484 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5" status: 404 len: 111 microversion: 2.1 time: 0.035306 Aug 04 05:02:01.662735 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3054/6005] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:01 2022] GET /compute/v2.1/servers/d7fe46d7-d991-4d16-94c2-10106d69dfe5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:02:01.752884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a206852-5358-426d-a868-78c59764481f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: .version_select at 0x7f1919f7b5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-328461503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLjzA0UyrOL5lyD+zWczD6fgKWeGDwGRwylvsYbISzOZB8ed3kY3yZKlAN0pmhDpm6KHw7XMKlUZwV4DDecL1xBgQR7kZD7u1IDywaqKglOa81DUI275w2eYwkjkACEAA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:01.776300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9a206852-5358-426d-a868-78c59764481f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:02:01.782404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9a206852-5358-426d-a868-78c59764481f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:02:01.819589 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a206852-5358-426d-a868-78c59764481f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.070788 Aug 04 05:02:01.823438 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2952/6006] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:02:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:05.456863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08dace73-9fbb-4863-b8dc-0894579d0c1b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:05.462028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08dace73-9fbb-4863-b8dc-0894579d0c1b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:05.478249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08dace73-9fbb-4863-b8dc-0894579d0c1b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:05.478726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08dace73-9fbb-4863-b8dc-0894579d0c1b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:05.482683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08dace73-9fbb-4863-b8dc-0894579d0c1b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:05.483244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08dace73-9fbb-4863-b8dc-0894579d0c1b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:05.567032 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08dace73-9fbb-4863-b8dc-0894579d0c1b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action" status: 200 len: 63189 microversion: 2.1 time: 0.398597 Aug 04 05:02:05.568915 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3055/6007] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:02:05 2022] POST /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a/action => generated 63189 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:02:11.777041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=31 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:11.793136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:11.811568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:11.957358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e89bb7a-e24d-43ae-95fb-334dedc3e21b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:11.958440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e89bb7a-e24d-43ae-95fb-334dedc3e21b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:11.969005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e89bb7a-e24d-43ae-95fb-334dedc3e21b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:11.969757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e89bb7a-e24d-43ae-95fb-334dedc3e21b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:11.970593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e89bb7a-e24d-43ae-95fb-334dedc3e21b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:11.971747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e89bb7a-e24d-43ae-95fb-334dedc3e21b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:12.120087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e89bb7a-e24d-43ae-95fb-334dedc3e21b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1832 microversion: 2.1 time: 0.345268 Aug 04 05:02:12.120987 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2953/6008] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:11 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1832 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:13.551276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:13.551805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:13.559957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c00dca8b-abac-4e04-81d9-eecc4c1ae500 req-213bad4b-cb9e-4c02-9979-a22d543ed9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:13.577542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:13.578287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:13.580032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c00dca8b-abac-4e04-81d9-eecc4c1ae500 req-213bad4b-cb9e-4c02-9979-a22d543ed9a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:13.581025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:13.581641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:13.583368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c00dca8b-abac-4e04-81d9-eecc4c1ae500 req-213bad4b-cb9e-4c02-9979-a22d543ed9a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:13.610828 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c00dca8b-abac-4e04-81d9-eecc4c1ae500 req-213bad4b-cb9e-4c02-9979-a22d543ed9a4 service nova] Creating event network-changed:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:02:13.627805 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c00dca8b-abac-4e04-81d9-eecc4c1ae500 req-213bad4b-cb9e-4c02-9979-a22d543ed9a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070235 Aug 04 05:02:13.631927 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2954/6009] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:13.650116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:02:13.807919 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63f03a1d-2c74-45e4-85ba-6ef3d8daa9b4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 204 len: 0 microversion: 2.1 time: 0.260184 Aug 04 05:02:13.820235 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3056/6010] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:02:13 2022] DELETE /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:02:13.820837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:13.823235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:13.832513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:13.833864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:13.834870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:13.841425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:14.007752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:14.017335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-95e1b4b7-22c5-449e-8404-80e96b57fc19 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1687 microversion: 2.1 time: 0.201745 Aug 04 05:02:14.018486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2955/6011] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:13 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:15.050432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:15.052163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:15.069307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:15.069790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:15.070624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:15.071121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:15.388668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:15.398790 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48dc857c-fbf1-4d88-9583-de6dcfec3629 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1687 microversion: 2.1 time: 0.359139 Aug 04 05:02:15.409356 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3057/6012] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:15 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1687 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:16.093885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3120b70b-cb5f-4477-a595-168362624981 req-b3cafd8c-9ce1-42b4-98f3-fb36bc83e770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a341dc85-0dfd-4b44-953a-ad4bd2670a1a", "name": "network-vif-deleted", "tag": "01318447-e4d1-4a64-86b5-3b81d3df8c82"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:16.106992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3120b70b-cb5f-4477-a595-168362624981 req-b3cafd8c-9ce1-42b4-98f3-fb36bc83e770 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:16.107464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3120b70b-cb5f-4477-a595-168362624981 req-b3cafd8c-9ce1-42b4-98f3-fb36bc83e770 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:16.124297 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3120b70b-cb5f-4477-a595-168362624981 req-b3cafd8c-9ce1-42b4-98f3-fb36bc83e770 service nova] Creating event network-vif-deleted:01318447-e4d1-4a64-86b5-3b81d3df8c82 for instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a on n-h2-851337-5 Aug 04 05:02:16.131205 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3120b70b-cb5f-4477-a595-168362624981 req-b3cafd8c-9ce1-42b4-98f3-fb36bc83e770 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042751 Aug 04 05:02:16.143361 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2956/6013] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:16.436264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:16.437541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:16.462001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:16.463668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:16.464534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:16.464999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:16.468826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:16.512244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:16.512979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:16.513798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lazy-loading 'fault' on Instance uuid a341dc85-0dfd-4b44-953a-ad4bd2670a1a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:02:16.585301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:16.594043 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-04a087b4-f2e4-4e17-8658-4bcc4c8b7fd3 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 200 len: 1356 microversion: 2.1 time: 0.161949 Aug 04 05:02:16.608448 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3058/6014] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:16 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:17.624996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:17.626423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: a341dc85-0dfd-4b44-953a-ad4bd2670a1a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:17.644768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:17.645255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:17.646071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:17.646511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:17.662139 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] HTTP exception thrown: Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a could not be found. Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Request method failure captured: Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a HTTP/1.1 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61GdXrmWyyfE0J7enPpcIyS3LbibZR7PXqlPp3pVVyYXeHezoFuAT9ZF9b7K8886gn6e2_GN0Rt88Tw2FVFNfZo60Q6Vfblx2XonnMcQkg2IArZTVP8WZoQSTyoQkYC3HCAudPfq8W-oRSVCIp2pGPcTSXLlrp9_fe9GWe5eWg1Vi9I Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_af3d0230675c48d8ba4d39a956313de9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 09e52c6cb3694904a605112a9901e18c Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a could not be found. Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a341dc85-0dfd-4b44-953a-ad4bd2670a1a'} Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a could not be found. Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a could not be found. Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:17.663861 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a could not be found. Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Returning 404 to user: Instance a341dc85-0dfd-4b44-953a-ad4bd2670a1a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3952987-1a2b-46f9-97b5-66fe02274dae tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a" status: 404 len: 111 microversion: 2.1 time: 0.053659 Aug 04 05:02:17.667726 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2957/6015] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:17 2022] GET /compute/v2.1/servers/a341dc85-0dfd-4b44-953a-ad4bd2670a1a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:02:22.527728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4f32eb47-da53-4f9f-9d1d-7364f47ebac8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '.version_select at 0x7f191a759550>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:22.568272 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4f32eb47-da53-4f9f-9d1d-7364f47ebac8 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-742081769" status: 202 len: 0 microversion: 2.1 time: 0.044223 Aug 04 05:02:22.569750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3059/6016] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 05:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-742081769 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:02:22.613193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a55add2e-c086-498c-b9a4-ac7c5dbfff64 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: .version_select at 0x7f191a1c7550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-790351635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnFtXb6JviYzCofaHPPdAg7Jiy/U4XYa9YsgdVbliq4AVKC5Y1ap56S5FXjyH7I0Sp++amVluvzZZw5UkqHVWw7S1XQPqhKm+xylaN+6+vB/AAiSCXnFf0QZIKfIjS3xA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:22.648514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a55add2e-c086-498c-b9a4-ac7c5dbfff64 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:02:22.664492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a55add2e-c086-498c-b9a4-ac7c5dbfff64 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:02:22.769917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a55add2e-c086-498c-b9a4-ac7c5dbfff64 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.160692 Aug 04 05:02:22.777707 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2958/6017] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:02:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:31.371688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2043705391", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-328461503", "security_groups": [{"name": "tempest-secgroup-smoke-880733176"}], "block_device_mapping_v2": [{"uuid": "8dcae657-4a8e-4497-b250-329a38c0b603", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:31.400686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=7 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:31.402524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:31.586610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:02:32.444906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=18 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:32.457833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-673422460", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "a7f9748f-1fad-4df0-ba37-add6e34f78a3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-790351635", "security_groups": [{"name": "tempest-secgroup-smoke-550667320"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:32.732898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:33.101733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] validate_networks() for [('a7f9748f-1fad-4df0-ba37-add6e34f78a3', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:02:33.308659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:02:33.309227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:02:33.309574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:02:33.309999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:02:33.310420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:02:33.324136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:33.324601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:33.325417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:33.326041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:33.347285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:02:33.357374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:02:33.491139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:02:33.493561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dcae657-4a8e-4497-b250-329a38c0b603',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:02:33.792646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b94adbc6-c1ea-48db-90af-db2b04e96f60 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.426947 Aug 04 05:02:33.804319 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3060/6018] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:02:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:02:33.825469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60f11400-f6b7-4af7-9ca4-ca565e683fac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:33.827693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-60f11400-f6b7-4af7-9ca4-ca565e683fac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:34.037472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-60f11400-f6b7-4af7-9ca4-ca565e683fac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:34.050674 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60f11400-f6b7-4af7-9ca4-ca565e683fac tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1094 microversion: 2.1 time: 0.238427 Aug 04 05:02:34.051431 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3061/6019] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:33 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1094 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:34.098782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:02:34.099604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:02:34.100139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:02:34.100720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:02:34.101150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:02:34.151934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:34.153813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:34.156385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:34.156857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:34.180358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:02:34.187360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:02:34.206464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:02:34.209364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:02:34.317818 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e2194007-54f6-4a75-9e0d-702204691fa2 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.874671 Aug 04 05:02:34.324375 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2959/6020] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:02:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:02:34.332837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65cb988a-9e64-4fe2-97e5-fdfcf314eff7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:34.334135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-65cb988a-9e64-4fe2-97e5-fdfcf314eff7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:34.456286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-65cb988a-9e64-4fe2-97e5-fdfcf314eff7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:34.468985 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65cb988a-9e64-4fe2-97e5-fdfcf314eff7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1265 microversion: 2.1 time: 0.139813 Aug 04 05:02:34.471779 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3062/6021] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:34 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:35.076666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:35.077380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:35.111683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:35.115742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:35.117963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:35.119372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:35.228267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:35.241719 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dbbb2fc2-87d2-4ab0-9717-a921d37c552c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1192 microversion: 2.1 time: 0.173630 Aug 04 05:02:35.254834 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2960/6022] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:35 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1192 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:35.495105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:35.495936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:35.530715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:35.531385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:35.534795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:35.535400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:35.790944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:35.798987 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ce291a38-7a3b-49c2-b42e-d35d2e13ab75 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1261 microversion: 2.1 time: 0.309139 Aug 04 05:02:35.799597 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3063/6023] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:35 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1261 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:36.265514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:36.269702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:36.297110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:36.307889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:36.310576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:36.314567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:36.595774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:36.614139 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5fcf532-765a-4bbe-940a-eae442acd8ce tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1210 microversion: 2.1 time: 0.353615 Aug 04 05:02:36.614753 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2961/6024] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:36 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1210 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:02:36.831494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:36.832126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:36.849522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:36.849973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:36.853365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:36.853829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:37.009980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:37.017881 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5142cd3d-191f-468d-995a-44294b409236 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1323 microversion: 2.1 time: 0.200595 Aug 04 05:02:37.031616 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3064/6025] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:36 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:37.639987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:37.640614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:37.665980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:37.666662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:37.668686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:37.669781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:38.042528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:38.043482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:38.053540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:38.054355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:38.066427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:38.067326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:38.241933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:38.267855 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7af7fbfc-071c-46d8-bfec-1abd2d83edd0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1277 microversion: 2.1 time: 0.632465 Aug 04 05:02:38.270738 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2962/6026] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:37 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1277 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:38.412922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:38.421137 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5c43b2b0-4e4e-494d-ae06-f2522de5c142 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1390 microversion: 2.1 time: 0.383648 Aug 04 05:02:38.426519 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3065/6027] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:38 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1390 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:38.996689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b198c461-0f82-46f6-863c-59b850502930 req-6a5f144f-dce6-402c-866c-9fdcd33f8395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1", "tag": "03b7583b-80b3-42bb-b803-016872ae27ce"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:39.021453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b198c461-0f82-46f6-863c-59b850502930 req-6a5f144f-dce6-402c-866c-9fdcd33f8395 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.021908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b198c461-0f82-46f6-863c-59b850502930 req-6a5f144f-dce6-402c-866c-9fdcd33f8395 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.057958 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b198c461-0f82-46f6-863c-59b850502930 req-6a5f144f-dce6-402c-866c-9fdcd33f8395 service nova] Creating event network-changed:03b7583b-80b3-42bb-b803-016872ae27ce for instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 on n-h2-851337-5 Aug 04 05:02:39.069740 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b198c461-0f82-46f6-863c-59b850502930 req-6a5f144f-dce6-402c-866c-9fdcd33f8395 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076184 Aug 04 05:02:39.070440 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2963/6028] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:39.139869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6591f5fd-db24-48fd-8d58-974ff4b552e4 req-cd5c9483-c4f6-454c-a66a-0c82c0a25c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf0fb1-4729-4021-8ac4-26ac95f2fb07", "tag": "4244eb38-f59a-4fce-b45a-1498a4e95ab0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:39.162402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6591f5fd-db24-48fd-8d58-974ff4b552e4 req-cd5c9483-c4f6-454c-a66a-0c82c0a25c9f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.162858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6591f5fd-db24-48fd-8d58-974ff4b552e4 req-cd5c9483-c4f6-454c-a66a-0c82c0a25c9f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.188067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6591f5fd-db24-48fd-8d58-974ff4b552e4 req-cd5c9483-c4f6-454c-a66a-0c82c0a25c9f service nova] Creating event network-changed:4244eb38-f59a-4fce-b45a-1498a4e95ab0 for instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 on n-h2-851337-5 Aug 04 05:02:39.213942 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6591f5fd-db24-48fd-8d58-974ff4b552e4 req-cd5c9483-c4f6-454c-a66a-0c82c0a25c9f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077705 Aug 04 05:02:39.214859 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3066/6029] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:39.293880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:39.298396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:39.323828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.324356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.325209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.328635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.453049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:39.453991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:39.470464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.488911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.493807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.494617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.836313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:39.849530 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-74eacfa2-a0cf-48f4-a47b-a1b24dd25266 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1277 microversion: 2.1 time: 0.560398 Aug 04 05:02:39.851414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2964/6030] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:39 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1277 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:39.894346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:39.906046 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b2119a8-c308-43b0-8b0a-62fd9f670619 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1390 microversion: 2.1 time: 0.458405 Aug 04 05:02:39.911105 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3067/6031] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:39 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1390 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:40.876152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:40.876773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:40.884787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:40.894593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:40.895465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:40.896056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:40.934185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:40.934832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:40.947495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:40.947968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:40.949511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:40.949975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:41.309518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:41.324901 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a773aeff-72e1-47ad-a741-46cc673e9279 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1277 microversion: 2.1 time: 0.452413 Aug 04 05:02:41.328843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:41.338811 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2965/6032] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:40 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1277 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:41.341196 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36c3c901-5e72-4831-aaa0-c43cee731cce tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1390 microversion: 2.1 time: 0.411923 Aug 04 05:02:41.341804 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3068/6033] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:40 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1390 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:02:42.346332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:42.346973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:42.350023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:42.363038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:42.364153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:42.368828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:42.373733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:42.374581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:42.376012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:42.376556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:42.382799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:42.384440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:42.385128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:42.610449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:42.613789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:42.629425 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-347b7536-15ad-41b4-b03a-8c14da4219ae tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1277 microversion: 2.1 time: 0.287322 Aug 04 05:02:42.630274 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0db77ed-8189-431b-b201-f0b3fa2a257b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1390 microversion: 2.1 time: 0.267312 Aug 04 05:02:42.631395 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3069/6034] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:42 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:42.647080 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2966/6035] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:42 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:43.654388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:43.655062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:43.658365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:43.660535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:43.669412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:43.669671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:43.670105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:43.671003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:43.675465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:43.682394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:43.683849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:43.684897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:43.685517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:43.904486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:43.915295 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1dc2cea5-41f0-40e5-bfcd-fbcd54693050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1277 microversion: 2.1 time: 0.265974 Aug 04 05:02:43.915894 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3070/6036] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:43 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:43.951071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:43.960371 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad9fe887-c217-43a0-90a7-b2df02bd392f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1390 microversion: 2.1 time: 0.306931 Aug 04 05:02:43.975518 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2967/6037] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:43 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1390 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:44.937733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:44.940193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:44.944297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:44.952302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:44.952821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:44.953614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:44.954111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:44.984894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:44.986133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:44.994136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:44.995431 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:44.999122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:44.999868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:45.001355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:45.002029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:45.229256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:45.241269 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7f04c957-3b4f-416c-895c-d9330c98e5b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1277 microversion: 2.1 time: 0.308527 Aug 04 05:02:45.242274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3071/6038] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:44 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:45.259326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:45.267424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bfaf6b49-7a6d-4591-b731-34f022d13efc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1390 microversion: 2.1 time: 0.286978 Aug 04 05:02:45.281917 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2968/6039] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:44 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1390 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:45.373459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4fb5282e-9165-43fb-a6a0-56c75095eb2c req-af91adaa-dba6-4436-82cc-4788dc2a3e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf0fb1-4729-4021-8ac4-26ac95f2fb07", "name": "network-vif-plugged", "status": "completed", "tag": "4244eb38-f59a-4fce-b45a-1498a4e95ab0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:45.399924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4fb5282e-9165-43fb-a6a0-56c75095eb2c req-af91adaa-dba6-4436-82cc-4788dc2a3e1c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:45.399924 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4fb5282e-9165-43fb-a6a0-56c75095eb2c req-af91adaa-dba6-4436-82cc-4788dc2a3e1c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:45.433124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4fb5282e-9165-43fb-a6a0-56c75095eb2c req-af91adaa-dba6-4436-82cc-4788dc2a3e1c service nova] Creating event network-vif-plugged:4244eb38-f59a-4fce-b45a-1498a4e95ab0 for instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 on n-h2-851337-5 Aug 04 05:02:45.440365 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4fb5282e-9165-43fb-a6a0-56c75095eb2c req-af91adaa-dba6-4436-82cc-4788dc2a3e1c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071573 Aug 04 05:02:45.441507 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3072/6040] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:46.265842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:46.266545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:46.267259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:46.267783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:46.276662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.277124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.277911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.278526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.284601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.284601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.289234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.290413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.379373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lazy-loading 'services' on Instance uuid 0693875a-57c5-4180-a006-46160ba75de5 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:02:46.471473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:46.478071 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-545c0354-8252-4ac2-9e2a-0c90e35a1154 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-volume_attachments/fbd34743-4501-4e41-915c-8bd1af8cec52" status: 202 len: 0 microversion: 2.1 time: 0.220116 Aug 04 05:02:46.481513 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77c28dd0-b013-4265-8769-437661420fa5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.221401 Aug 04 05:02:46.482741 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3073/6041] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:46 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:02:46.484083 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2969/6042] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:02:46 2022] DELETE /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-volume_attachments/fbd34743-4501-4e41-915c-8bd1af8cec52 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:02:46.492452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:46.495342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:46.505032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.505536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.506429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.506932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.719186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:46.727513 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ddf2415b-f6a4-4a4c-8fa4-28c8c5dc535e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1390 microversion: 2.1 time: 0.241678 Aug 04 05:02:46.728791 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2970/6043] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:46 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:47.504300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:47.505697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:47.514280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:47.515076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:47.516114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:47.517473 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:47.727432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:47.737162 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20499200-eba6-4580-b602-ddf60c42a975 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.236533 Aug 04 05:02:47.737759 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3074/6044] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:47 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:47.754102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:47.755654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:47.765163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:47.765883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:47.767203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:47.767895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:48.030876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:48.038882 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48c1396c-e316-4d62-a048-77ec12ef4947 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1561 microversion: 2.1 time: 0.293487 Aug 04 05:02:48.041829 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2971/6045] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:47 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1561 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:48.073043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:48.073690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:48.089726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:48.092954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:48.096849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:48.099125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:48.655305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:48.669348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-442ba2bc-2cd8-4f60-b0c6-746c20f05ef4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1561 microversion: 2.1 time: 0.609996 Aug 04 05:02:48.669939 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3075/6046] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:48 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1561 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:48.763475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:48.765735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:48.775755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:48.776589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:48.777653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:48.778317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:49.044216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:49.054551 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83006ed8-df82-4712-850f-e91b242afeff tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.298613 Aug 04 05:02:49.068390 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2972/6047] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:48 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:50.080571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:50.081908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:50.090820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:50.091340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:50.092276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:50.092599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:50.333920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:50.344273 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a453168b-7022-4148-954f-1625331b4b99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.267277 Aug 04 05:02:50.346034 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3076/6048] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:50 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:50.636390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:50.637028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:50.640165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c62949ae-dd1e-4022-83e0-a790c99052db req-dec266c2-3ff9-4ab4-8c85-cbb02bd78f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf0fb1-4729-4021-8ac4-26ac95f2fb07", "tag": "4244eb38-f59a-4fce-b45a-1498a4e95ab0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:50.651446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:50.652154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:50.653680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:50.654271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:50.655914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c62949ae-dd1e-4022-83e0-a790c99052db req-dec266c2-3ff9-4ab4-8c85-cbb02bd78f1d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:50.664366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c62949ae-dd1e-4022-83e0-a790c99052db req-dec266c2-3ff9-4ab4-8c85-cbb02bd78f1d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:50.685029 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c62949ae-dd1e-4022-83e0-a790c99052db req-dec266c2-3ff9-4ab4-8c85-cbb02bd78f1d service nova] Creating event network-changed:4244eb38-f59a-4fce-b45a-1498a4e95ab0 for instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 on n-h2-851337-5 Aug 04 05:02:50.702905 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c62949ae-dd1e-4022-83e0-a790c99052db req-dec266c2-3ff9-4ab4-8c85-cbb02bd78f1d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066103 Aug 04 05:02:50.704082 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3077/6049] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:02:50.841036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:50.850330 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ea8531a-5935-4f03-b8a0-ffe610a7c685 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1561 microversion: 2.1 time: 0.218290 Aug 04 05:02:50.851576 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2973/6050] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:50 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1561 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:51.368049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:51.368761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:51.382642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:51.383068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:51.384589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:51.385046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:51.639578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:51.650443 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcc92caf-3226-4692-ab64-66824c6253ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.288391 Aug 04 05:02:51.663256 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3078/6051] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:51 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:52.671913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:52.672887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:52.682542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:52.683279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:52.684155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:52.684603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:52.853654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:52.861752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e275e27-4649-49f5-aaca-d7dc01b6a2b3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.194511 Aug 04 05:02:52.862696 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2974/6052] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:52 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:53.034639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-88607000-2b1e-401c-8419-dce2a2c6f1c3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:53.042561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88607000-2b1e-401c-8419-dce2a2c6f1c3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:53.043128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-88607000-2b1e-401c-8419-dce2a2c6f1c3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:53.079921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-88607000-2b1e-401c-8419-dce2a2c6f1c3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 05:02:53.135862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-88607000-2b1e-401c-8419-dce2a2c6f1c3 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action" status: 202 len: 0 microversion: 2.1 time: 0.105472 Aug 04 05:02:53.136751 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3079/6053] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:02:53 2022] POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:02:53.145179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:53.146515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:53.153359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:53.153816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:53.154750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:53.155254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:53.314091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:53.323563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-efc2bcee-0160-40bc-88cc-96941793b006 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.182618 Aug 04 05:02:53.338770 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2975/6054] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:53 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:53.886147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:53.887377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:53.898432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:53.899369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:53.900445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:53.901928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:53.907368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:54.057921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:54.066423 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01d68a4b-14c4-4577-bd8f-2925a8b8338d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.186202 Aug 04 05:02:54.067047 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3080/6055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:53 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:54.345411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:54.346059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:54.354234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:54.354684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:54.355494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:54.355964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:54.361742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:54.511842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:54.521072 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4a6e37f-8665-4832-8782-daff9ba94bb5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.179519 Aug 04 05:02:54.531859 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2976/6056] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:54 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:55.086798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:55.087380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:55.094900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:55.095574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:55.096371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:55.096827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:55.256120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:55.264840 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ab22aa57-634f-4a80-a1fa-1800bd280e93 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.182161 Aug 04 05:02:55.265426 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3081/6057] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:55 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:55.416608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-889ad0ce-a1e3-4da9-9673-22cf15cd2b05 req-866093ef-7076-4c4f-96c7-712f6b454366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1", "name": "network-vif-plugged", "status": "completed", "tag": "03b7583b-80b3-42bb-b803-016872ae27ce"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:02:55.432849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-889ad0ce-a1e3-4da9-9673-22cf15cd2b05 req-866093ef-7076-4c4f-96c7-712f6b454366 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:55.433571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-889ad0ce-a1e3-4da9-9673-22cf15cd2b05 req-866093ef-7076-4c4f-96c7-712f6b454366 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:55.446834 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-889ad0ce-a1e3-4da9-9673-22cf15cd2b05 req-866093ef-7076-4c4f-96c7-712f6b454366 service nova] Creating event network-vif-plugged:03b7583b-80b3-42bb-b803-016872ae27ce for instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 on n-h2-851337-5 Aug 04 05:02:55.463446 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-889ad0ce-a1e3-4da9-9673-22cf15cd2b05 req-866093ef-7076-4c4f-96c7-712f6b454366 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050989 Aug 04 05:02:55.464088 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2977/6058] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:02:55.547522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:55.552613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:55.574411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:55.575161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:55.576122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:55.576723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:55.807194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:55.816577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8fa40aef-c5ba-4fdc-852e-af505351d8cf tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.273755 Aug 04 05:02:55.817556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3082/6059] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:55 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:56.288270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:56.292067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:56.301934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:56.302450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:56.303446 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:56.304066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:56.581658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:56.590884 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3eb88fa2-f8fc-4e07-968f-9fc16d71dac2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1265 microversion: 2.1 time: 0.307291 Aug 04 05:02:56.595065 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2978/6060] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:56 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:56.838995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:56.839756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:56.851263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:56.852498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:56.853267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:56.853563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:57.063245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:57.072835 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fadc2b1c-292c-467e-a8f5-e3dfa7a951b9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.238181 Aug 04 05:02:57.073444 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3083/6061] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:56 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:02:57.612684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:57.614916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:57.623369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:57.623943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:57.624830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:57.625479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:57.796748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:57.804789 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5d85653b-91d0-46ed-9eed-85564fb7b3a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1453 microversion: 2.1 time: 0.196197 Aug 04 05:02:57.806059 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2979/6062] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:57 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:57.826234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:57.826882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:57.833561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:57.834039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:57.834845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:57.835332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:57.999702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:58.008791 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-864d8b75-2aa3-4763-8157-fd162a15753d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1453 microversion: 2.1 time: 0.186459 Aug 04 05:02:58.009860 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3084/6063] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:57 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:58.010636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:58.011199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:58.018816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.019874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.020660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.021109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.063033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:02:58.097941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:58.098590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:58.136409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.136951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.139283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.141181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.176293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-01edb6eb-e870-4432-bb5c-2556d1791b8e tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 204 len: 0 microversion: 2.1 time: 0.322397 Aug 04 05:02:58.177980 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2980/6064] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:02:57 2022] DELETE /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:02:58.188655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:58.189654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:58.199107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.199820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.200874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.202111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.477693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:58.490160 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8dd8ed84-3cb5-4420-a63d-3d2ab52d4ae4 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1730 microversion: 2.1 time: 0.306507 Aug 04 05:02:58.498898 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2981/6065] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:58 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1730 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:58.520710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:58.529839 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-45503d09-3c87-4fac-83fe-2afc1f4242fe tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.438589 Aug 04 05:02:58.532664 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3085/6066] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:58 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:02:59.511930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:59.512645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:59.520208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:59.520875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:59.521671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:59.522105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:59.558157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:59.558797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:59.569917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:59.570874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:59.571752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:59.574868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:00.221297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:00.240683 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48d91741-b96a-470b-942d-55f37d87293c tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1730 microversion: 2.1 time: 0.732852 Aug 04 05:03:00.243025 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2982/6067] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:59 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1730 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:00.344300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:00.361263 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e925c43d-d274-40e4-8d9c-6af62622771c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.808401 Aug 04 05:03:00.362091 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3086/6068] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:59 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:01.084410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-589230ce-2164-4014-9f29-49ba0877111c req-499ad790-8e5d-4234-b255-66db0aaff1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1", "tag": "03b7583b-80b3-42bb-b803-016872ae27ce"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:01.129673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-589230ce-2164-4014-9f29-49ba0877111c req-499ad790-8e5d-4234-b255-66db0aaff1de service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:01.133795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-589230ce-2164-4014-9f29-49ba0877111c req-499ad790-8e5d-4234-b255-66db0aaff1de service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:01.155624 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-589230ce-2164-4014-9f29-49ba0877111c req-499ad790-8e5d-4234-b255-66db0aaff1de service nova] Creating event network-changed:03b7583b-80b3-42bb-b803-016872ae27ce for instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 on n-h2-851337-5 Aug 04 05:03:01.168970 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-589230ce-2164-4014-9f29-49ba0877111c req-499ad790-8e5d-4234-b255-66db0aaff1de service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089411 Aug 04 05:03:01.169601 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2983/6069] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:01.264276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:01.265358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:01.295094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:01.295570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:01.296386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:01.296845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:01.384463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:01.385155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:01.402886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:01.403371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:01.404155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:01.404593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:01.498401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3daa908987ad4c55b8780721481fdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e689f085cbb481c92f3344a63b832c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:01.512603 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ce93513f-5a44-4c1d-8feb-6e497f077503 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 200 len: 1663 microversion: 2.1 time: 0.252056 Aug 04 05:03:01.516146 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3087/6070] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:01 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 1663 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:01.662719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:01.678326 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-19522b59-a1d0-467e-a913-b2c2df8138a0 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.298475 Aug 04 05:03:01.679534 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2984/6071] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:01 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:02.537342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:02.537992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:02.549013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:02.551786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:02.552645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:02.553908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:02.555369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:02.608174 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] HTTP exception thrown: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Request method failure captured: Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c HTTP/1.1 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61HIAl_kuPFAxUAyOIEF-2kehWGbBUjaLDE-fSmJPGH1haBIb0XVWR1EvBPVmQJ9c74tgwPfbNZnvDufqRkbulHmab3O4brTkv49ILAKbgb9ZHBPXNIentgdkM9zTqI8LyDk5Tr2W9L8_ABnaooniP9-z8OfsUh07ktUqTKRVGanlnk Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4e689f085cbb481c92f3344a63b832c0 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4e689f085cbb481c92f3344a63b832c0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4e689f085cbb481c92f3344a63b832c0 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestServerBasicOps-1929402029-project Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 3daa908987ad4c55b8780721481fdd39 Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestServerBasicOps-1929402029-project Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0f4bb523-1aa1-48a6-9cf9-688fde082a6c'} Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:02.610190 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:02.614869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:02.614869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:02.614869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:02.614869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:03:02.614869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:03:02.614869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:02.614869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:02.615556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Returning 404 to user: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:03:02.616693 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ddcdf51b-a8e3-4da9-9029-dd1327dbf9ee tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 404 len: 111 microversion: 2.1 time: 0.084059 Aug 04 05:03:02.623165 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3088/6072] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:02 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:03:02.700675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:02.701421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:02.728620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:02.729106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:02.729926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:02.730375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:02.978236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:02.993106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-86323946-0e1a-4db4-bc2c-6f74de8d4f45 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1676 microversion: 2.1 time: 0.297864 Aug 04 05:03:03.009440 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2985/6073] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:02 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1676 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:03.241135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a7a234cc-d8a1-412c-8eba-a7ea36630ea0 req-663f664b-d5c3-42a6-b324-4e87a0209a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4bb523-1aa1-48a6-9cf9-688fde082a6c", "name": "network-vif-deleted", "tag": "39cf7e50-b5c5-4e0e-88a6-92c11993727e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:03.265751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a7a234cc-d8a1-412c-8eba-a7ea36630ea0 req-663f664b-d5c3-42a6-b324-4e87a0209a55 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:03.266225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a7a234cc-d8a1-412c-8eba-a7ea36630ea0 req-663f664b-d5c3-42a6-b324-4e87a0209a55 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:03.284987 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a7a234cc-d8a1-412c-8eba-a7ea36630ea0 req-663f664b-d5c3-42a6-b324-4e87a0209a55 service nova] Creating event network-vif-deleted:39cf7e50-b5c5-4e0e-88a6-92c11993727e for instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c on n-h2-851337-5 Aug 04 05:03:03.291465 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a7a234cc-d8a1-412c-8eba-a7ea36630ea0 req-663f664b-d5c3-42a6-b324-4e87a0209a55 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054069 Aug 04 05:03:03.292771 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3089/6074] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:03.812043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:03.813200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:03.824728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:03.825309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:03.826198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:03.826742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:03.841171 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] HTTP exception thrown: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Request method failure captured: Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c HTTP/1.1 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61HIAl_kuPFAxUAyOIEF-2kehWGbBUjaLDE-fSmJPGH1haBIb0XVWR1EvBPVmQJ9c74tgwPfbNZnvDufqRkbulHmab3O4brTkv49ILAKbgb9ZHBPXNIentgdkM9zTqI8LyDk5Tr2W9L8_ABnaooniP9-z8OfsUh07ktUqTKRVGanlnk Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 4e689f085cbb481c92f3344a63b832c0 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4e689f085cbb481c92f3344a63b832c0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 4e689f085cbb481c92f3344a63b832c0 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestServerBasicOps-1929402029-project Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 3daa908987ad4c55b8780721481fdd39 Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestServerBasicOps-1929402029-project Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0f4bb523-1aa1-48a6-9cf9-688fde082a6c'} Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:03:03.843079 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.847358 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.848076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Returning 404 to user: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:03:03.848974 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7522dc2f-cdac-417c-9ad0-e4afad4cd3be tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 404 len: 111 microversion: 2.1 time: 0.044309 Aug 04 05:03:03.849631 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2986/6075] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:03:03 2022] DELETE /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:03:03.859821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:03.860724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] [instance: 0f4bb523-1aa1-48a6-9cf9-688fde082a6c] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:03.868704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:03.869287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:03.870296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:03.870897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:03.885025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] HTTP exception thrown: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Request method failure captured: Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c HTTP/1.1 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61HIAl_kuPFAxUAyOIEF-2kehWGbBUjaLDE-fSmJPGH1haBIb0XVWR1EvBPVmQJ9c74tgwPfbNZnvDufqRkbulHmab3O4brTkv49ILAKbgb9ZHBPXNIentgdkM9zTqI8LyDk5Tr2W9L8_ABnaooniP9-z8OfsUh07ktUqTKRVGanlnk Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4e689f085cbb481c92f3344a63b832c0 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e689f085cbb481c92f3344a63b832c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4e689f085cbb481c92f3344a63b832c0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4e689f085cbb481c92f3344a63b832c0 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestServerBasicOps-1929402029 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestServerBasicOps-1929402029-project Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 3daa908987ad4c55b8780721481fdd39 Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestServerBasicOps-1929402029-project Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0f4bb523-1aa1-48a6-9cf9-688fde082a6c'} Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:03.886879 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:03.891821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Returning 404 to user: Instance 0f4bb523-1aa1-48a6-9cf9-688fde082a6c could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:03:03.892832 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e70d7992-9456-4856-b5ec-a5243661a87b tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c" status: 404 len: 111 microversion: 2.1 time: 0.038175 Aug 04 05:03:03.894991 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3090/6076] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:03 2022] GET /compute/v2.1/servers/0f4bb523-1aa1-48a6-9cf9-688fde082a6c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:03:04.015531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:04.017789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:04.041427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:04.042133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:04.046389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:04.047062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:04.087655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41d1a015-c301-4abb-818d-70ac1f2b4119 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] Calling method '.version_select at 0x7f1919571a60>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:04.135712 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41d1a015-c301-4abb-818d-70ac1f2b4119 tempest-TestServerBasicOps-1929402029 tempest-TestServerBasicOps-1929402029-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1946655994" status: 202 len: 0 microversion: 2.1 time: 0.052356 Aug 04 05:03:04.138140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3091/6077] 10.222.0.69 () {58 vars in 1254 bytes} [Thu Aug 4 05:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1946655994 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:03:04.231608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:04.240840 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a56a2263-9ee4-4d64-a08f-9ce274fb331c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1653 microversion: 2.1 time: 0.230427 Aug 04 05:03:04.241751 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2987/6078] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:04 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1653 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:04.262135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c30dd967-25f5-4e3f-bc85-0d4762f82e2f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:04.269653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c30dd967-25f5-4e3f-bc85-0d4762f82e2f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:04.270208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c30dd967-25f5-4e3f-bc85-0d4762f82e2f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:04.311445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c30dd967-25f5-4e3f-bc85-0d4762f82e2f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Going to try to start instance {{(pid=119343) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 05:03:04.366455 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c30dd967-25f5-4e3f-bc85-0d4762f82e2f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action" status: 202 len: 0 microversion: 2.1 time: 0.107986 Aug 04 05:03:04.367790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3092/6079] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:03:04 2022] POST /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:03:04.376949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:04.377829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:04.392907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:04.404186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:04.406579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:04.407275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:04.724383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:04.754094 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5b0094a3-e72a-41f4-a606-031124ae8361 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1662 microversion: 2.1 time: 0.381715 Aug 04 05:03:04.765749 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2988/6080] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:04 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1662 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:05.779178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:05.784478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:05.791788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:05.792253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:05.793044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:05.793492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:06.017819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:06.027788 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2fbb234c-e45c-411d-90fa-7a2239ee7081 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1662 microversion: 2.1 time: 0.254005 Aug 04 05:03:06.028918 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3093/6081] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:05 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1662 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:07.049339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:07.050678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:07.058595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:07.059395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:07.060416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:07.061672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:07.589123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:07.599221 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52419735-9a19-4cef-a6be-a49d2f3b7345 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1666 microversion: 2.1 time: 0.553645 Aug 04 05:03:07.602484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2989/6082] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:07 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1666 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:13.218919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0dcbdf04-a333-4dc0-b2a1-399b512cd683 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:13.222037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0dcbdf04-a333-4dc0-b2a1-399b512cd683 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:13.229346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dcbdf04-a333-4dc0-b2a1-399b512cd683 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:13.230002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dcbdf04-a333-4dc0-b2a1-399b512cd683 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:13.230998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dcbdf04-a333-4dc0-b2a1-399b512cd683 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:13.231606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dcbdf04-a333-4dc0-b2a1-399b512cd683 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:13.292064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0dcbdf04-a333-4dc0-b2a1-399b512cd683 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action" status: 200 len: 24567 microversion: 2.1 time: 0.076093 Aug 04 05:03:13.293512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3094/6083] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:03:13 2022] POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:03:19.647283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:19.649981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:19.654154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:19.663124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:19.678448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:19.678994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:19.681752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:19.682392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:20.110939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:20.130145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ee46ceb-8fae-40de-8cc2-da216c04bb80 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1680 microversion: 2.1 time: 0.486924 Aug 04 05:03:20.139929 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2990/6084] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:19 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1680 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:20.388553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78ec76be-dc5a-4f5a-be42-ed34dfbcc87e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:20.392352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-78ec76be-dc5a-4f5a-be42-ed34dfbcc87e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:20.418079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78ec76be-dc5a-4f5a-be42-ed34dfbcc87e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:20.418561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78ec76be-dc5a-4f5a-be42-ed34dfbcc87e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:20.428315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78ec76be-dc5a-4f5a-be42-ed34dfbcc87e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:20.428841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78ec76be-dc5a-4f5a-be42-ed34dfbcc87e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:20.516282 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78ec76be-dc5a-4f5a-be42-ed34dfbcc87e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action" status: 200 len: 32645 microversion: 2.1 time: 0.132257 Aug 04 05:03:20.519166 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3095/6085] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:03:20 2022] POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action => generated 32645 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:03:20.713346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41f76458-d37e-426c-b7f4-0a1e71093ddb tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:20.715062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41f76458-d37e-426c-b7f4-0a1e71093ddb tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:20.734894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41f76458-d37e-426c-b7f4-0a1e71093ddb tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:20.735382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41f76458-d37e-426c-b7f4-0a1e71093ddb tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:20.736163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41f76458-d37e-426c-b7f4-0a1e71093ddb tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:20.736607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41f76458-d37e-426c-b7f4-0a1e71093ddb tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:21.010272 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41f76458-d37e-426c-b7f4-0a1e71093ddb tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1831 microversion: 2.1 time: 0.301661 Aug 04 05:03:21.011968 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2991/6086] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:20 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1831 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:21.045301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:21.049262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:21.058240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:21.058993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:21.060026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:21.060637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:21.135091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lazy-loading 'flavor' on Instance uuid 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:03:21.154931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Going to try to live migrate instance to another host {{(pid=119343) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 05:03:23.822384 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-80730c8a-6a5a-443f-9ea8-6e24ca22a1cd tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action" status: 202 len: 0 microversion: 2.1 time: 2.783600 Aug 04 05:03:23.828318 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3096/6087] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:03:21 2022] POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action => generated 0 bytes in 2791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:03:23.834308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:23.835736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:23.868046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:23.868850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:23.869896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:23.870727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:24.300934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:24.327569 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bdd11865-3f1b-4652-a550-ea2d347f05de tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.495222 Aug 04 05:03:24.329007 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2992/6088] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:23 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:25.378163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:25.380382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:25.395434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:25.399917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:25.401090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:25.403712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:25.482846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:26.011995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:26.029633 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6f08e1d3-c8a3-4971-b015-f762ded640fc tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.659619 Aug 04 05:03:26.036172 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3097/6089] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:25 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:26.437113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-614c07ed-67ed-4f59-b9fb-f399241b74dd req-6e167792-95aa-4ff6-b682-6796e5e079f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf0fb1-4729-4021-8ac4-26ac95f2fb07", "name": "network-vif-unplugged", "status": "completed", "tag": "4244eb38-f59a-4fce-b45a-1498a4e95ab0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:26.463257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-614c07ed-67ed-4f59-b9fb-f399241b74dd req-6e167792-95aa-4ff6-b682-6796e5e079f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:26.464010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-614c07ed-67ed-4f59-b9fb-f399241b74dd req-6e167792-95aa-4ff6-b682-6796e5e079f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:26.504187 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-614c07ed-67ed-4f59-b9fb-f399241b74dd req-6e167792-95aa-4ff6-b682-6796e5e079f4 service nova] Creating event network-vif-unplugged:4244eb38-f59a-4fce-b45a-1498a4e95ab0 for instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 on n-h2-851337-5 Aug 04 05:03:26.539497 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-614c07ed-67ed-4f59-b9fb-f399241b74dd req-6e167792-95aa-4ff6-b682-6796e5e079f4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.356090 Aug 04 05:03:26.540148 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2993/6090] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:27.064754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:27.066035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:27.093377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:27.094320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:27.096975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:27.097974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:28.379228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:28.392838 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6e1e98f8-965f-4026-a72a-9af50fd55282 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 1.334566 Aug 04 05:03:28.393705 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3098/6091] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:27 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:28.619745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a2792ccd-9dc5-49af-b10e-1c036d76b258 req-9bed2d6e-4d39-4c52-9ada-2b393a3a9239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf0fb1-4729-4021-8ac4-26ac95f2fb07", "tag": "4244eb38-f59a-4fce-b45a-1498a4e95ab0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:28.673520 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a2792ccd-9dc5-49af-b10e-1c036d76b258 req-9bed2d6e-4d39-4c52-9ada-2b393a3a9239 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:28.674412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a2792ccd-9dc5-49af-b10e-1c036d76b258 req-9bed2d6e-4d39-4c52-9ada-2b393a3a9239 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:28.718100 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a2792ccd-9dc5-49af-b10e-1c036d76b258 req-9bed2d6e-4d39-4c52-9ada-2b393a3a9239 service nova] Creating event network-changed:4244eb38-f59a-4fce-b45a-1498a4e95ab0 for instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 on n-h2-851337-5 Aug 04 05:03:28.737978 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a2792ccd-9dc5-49af-b10e-1c036d76b258 req-9bed2d6e-4d39-4c52-9ada-2b393a3a9239 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125583 Aug 04 05:03:28.739175 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2994/6092] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:29.417875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:29.418793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:29.434572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:29.435227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:29.435914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:29.436451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:29.773931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:29.786201 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0f6607f-526d-4e99-baf6-3b786c008a67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.372063 Aug 04 05:03:29.787049 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3099/6093] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:29 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:30.829902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:30.837733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:30.847939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:30.848782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:30.850117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:30.850943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:31.087089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:31.097304 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c8e2153-7bdc-4917-9fb5-e2070fbc1248 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.288710 Aug 04 05:03:31.098360 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2995/6094] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:30 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:31.473994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfd34ebc-6403-441d-8736-b8941e1e5c50 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:31.474873 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:03:31.474873 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:03:31.476083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd34ebc-6403-441d-8736-b8941e1e5c50 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:31.476546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd34ebc-6403-441d-8736-b8941e1e5c50 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:31.477356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd34ebc-6403-441d-8736-b8941e1e5c50 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:31.477976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfd34ebc-6403-441d-8736-b8941e1e5c50 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:31.507870 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bfd34ebc-6403-441d-8736-b8941e1e5c50 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.099229 Aug 04 05:03:31.508482 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3100/6095] 10.222.0.69 () {58 vars in 1185 bytes} [Thu Aug 4 05:03:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:31.638765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1155156208", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "availability_zone": "nova:n-h1-851337-5", "networks": [{"uuid": "e8b279cd-0681-4ac0-bf12-774e2e7b0a48"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:31.704957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] validate_networks() for [('e8b279cd-0681-4ac0-bf12-774e2e7b0a48', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:03:32.122993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:32.123661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:32.136104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:32.141872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:32.145376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:32.146393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:32.215495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:03:32.217109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:03:32.217828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:03:32.218456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:03:32.219126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:03:32.237476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:32.238583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:32.239940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:32.241290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:32.278379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Getting quotas for project 15a45a0d406e4c9694f602ccabb77cbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:03:32.295481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Getting quotas for user b63a33da8c004a00bf7e9ea24cea5132 and project 15a45a0d406e4c9694f602ccabb77cbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:03:32.352487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:03:32.356531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:03:32.438439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:32.447738 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d6ee5a44-600a-4693-833d-7bed99aac152 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.328785 Aug 04 05:03:32.450361 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3101/6096] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:32 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:32.478169 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d899b7d7-6404-405a-ad03-ca07b226c3cf tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842872 Aug 04 05:03:32.478848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2996/6097] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:03:32.489609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56de9e70-fe11-4a92-8bd8-287c524d18c7 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:32.490247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56de9e70-fe11-4a92-8bd8-287c524d18c7 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:32.614609 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56de9e70-fe11-4a92-8bd8-287c524d18c7 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1329 microversion: 2.1 time: 0.128814 Aug 04 05:03:32.615243 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3102/6098] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:32 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1329 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:33.469601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:33.470222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:33.488594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:33.489730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:33.490887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:33.491764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:33.642039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4dbed72b-cc46-49e7-b355-b6fa13a26215 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:33.642799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4dbed72b-cc46-49e7-b355-b6fa13a26215 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:33.646445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:33.656394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dbed72b-cc46-49e7-b355-b6fa13a26215 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:33.657278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dbed72b-cc46-49e7-b355-b6fa13a26215 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:33.658761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dbed72b-cc46-49e7-b355-b6fa13a26215 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:33.660179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4dbed72b-cc46-49e7-b355-b6fa13a26215 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:33.699444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:33.708508 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd534d23-7da6-499b-be30-51f932493686 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.242600 Aug 04 05:03:33.709100 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2997/6099] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:33 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:33.781023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4dbed72b-cc46-49e7-b355-b6fa13a26215 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1416 microversion: 2.1 time: 0.144366 Aug 04 05:03:33.781629 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3103/6100] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:33 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1416 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:34.730647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:34.732211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:34.740647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:34.741672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:34.742712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:34.743339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:34.802894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ebaad303-6f9b-4a64-89b2-e13a89a38438 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:34.804779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ebaad303-6f9b-4a64-89b2-e13a89a38438 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:34.840980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebaad303-6f9b-4a64-89b2-e13a89a38438 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:34.841451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebaad303-6f9b-4a64-89b2-e13a89a38438 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:34.845245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebaad303-6f9b-4a64-89b2-e13a89a38438 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:34.845879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ebaad303-6f9b-4a64-89b2-e13a89a38438 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:34.972849 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ebaad303-6f9b-4a64-89b2-e13a89a38438 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1422 microversion: 2.1 time: 0.173738 Aug 04 05:03:34.976930 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3104/6101] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:34 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1422 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:35.024792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:35.040567 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5aa1610-0bbb-4560-9ce6-aff98bd9a5af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.313095 Aug 04 05:03:35.040567 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2998/6102] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:34 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:35.994045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55a1116e-696c-4784-97a9-7b92922dd829 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:35.995278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55a1116e-696c-4784-97a9-7b92922dd829 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:36.013400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55a1116e-696c-4784-97a9-7b92922dd829 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:36.014514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55a1116e-696c-4784-97a9-7b92922dd829 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:36.015522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55a1116e-696c-4784-97a9-7b92922dd829 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:36.016408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55a1116e-696c-4784-97a9-7b92922dd829 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:36.064690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:36.065330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:36.098027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:36.098533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:36.099486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:36.111405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:36.393198 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55a1116e-696c-4784-97a9-7b92922dd829 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1464 microversion: 2.1 time: 0.403084 Aug 04 05:03:36.398271 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3105/6103] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:35 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1464 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:36.474230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:36.485745 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-458a61be-3422-4d44-9a02-785e70af79db tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.425766 Aug 04 05:03:36.490448 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 2999/6104] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:36 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:36.558014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-79958ebd-7435-46f6-b8dc-6d98ff79a649 req-ccfee29d-002c-4e59-983c-bef817f50b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5307cb-b4af-4981-9b3c-f2781f37b5fd", "tag": "27982cb6-005e-480b-8429-c645612e2c24"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:36.578948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-79958ebd-7435-46f6-b8dc-6d98ff79a649 req-ccfee29d-002c-4e59-983c-bef817f50b7f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:36.580747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-79958ebd-7435-46f6-b8dc-6d98ff79a649 req-ccfee29d-002c-4e59-983c-bef817f50b7f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:36.610341 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-79958ebd-7435-46f6-b8dc-6d98ff79a649 req-ccfee29d-002c-4e59-983c-bef817f50b7f service nova] Creating event network-changed:27982cb6-005e-480b-8429-c645612e2c24 for instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd on n-h1-851337-5 Aug 04 05:03:36.618671 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-79958ebd-7435-46f6-b8dc-6d98ff79a649 req-ccfee29d-002c-4e59-983c-bef817f50b7f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066299 Aug 04 05:03:36.620131 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3106/6105] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:37.421655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b53be337-946e-4d41-b803-be92c4accf9b tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:37.422812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b53be337-946e-4d41-b803-be92c4accf9b tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:37.430621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b53be337-946e-4d41-b803-be92c4accf9b tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:37.431228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b53be337-946e-4d41-b803-be92c4accf9b tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:37.431998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b53be337-946e-4d41-b803-be92c4accf9b tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:37.432429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b53be337-946e-4d41-b803-be92c4accf9b tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:37.514323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:37.515810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:37.524073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:37.524999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:37.526359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:37.526829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:37.627194 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b53be337-946e-4d41-b803-be92c4accf9b tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1464 microversion: 2.1 time: 0.209132 Aug 04 05:03:37.634556 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3000/6106] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:37 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1464 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:37.726981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:37.740550 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d2f1da8-4fee-47d2-89a3-cabce9a6b17b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.231003 Aug 04 05:03:37.742174 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3107/6107] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:37 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:38.656949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27c22f10-eae2-4623-bdec-d15f686b6f16 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:38.658227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27c22f10-eae2-4623-bdec-d15f686b6f16 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:38.666465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c22f10-eae2-4623-bdec-d15f686b6f16 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:38.666964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c22f10-eae2-4623-bdec-d15f686b6f16 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:38.667764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c22f10-eae2-4623-bdec-d15f686b6f16 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:38.668383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27c22f10-eae2-4623-bdec-d15f686b6f16 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:38.763517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:38.764151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:38.771594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:38.772586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:38.773386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:38.773842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:38.835910 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27c22f10-eae2-4623-bdec-d15f686b6f16 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1464 microversion: 2.1 time: 0.182748 Aug 04 05:03:38.847900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3001/6108] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:38 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1464 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:38.929408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:38.938716 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c2464a5-d955-44d1-8977-e9c0e6b5abc9 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.178887 Aug 04 05:03:38.950660 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3108/6109] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:38 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:39.858830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bc3c48f-d7b9-4665-9b2a-2ee5c299e053 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:39.862559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9bc3c48f-d7b9-4665-9b2a-2ee5c299e053 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:39.881752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bc3c48f-d7b9-4665-9b2a-2ee5c299e053 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:39.886237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bc3c48f-d7b9-4665-9b2a-2ee5c299e053 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:39.887358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bc3c48f-d7b9-4665-9b2a-2ee5c299e053 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:39.888687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bc3c48f-d7b9-4665-9b2a-2ee5c299e053 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:39.964069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:39.965571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:39.974238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:39.975894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:39.976938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:39.977554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:40.280207 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9bc3c48f-d7b9-4665-9b2a-2ee5c299e053 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1464 microversion: 2.1 time: 0.425895 Aug 04 05:03:40.281237 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3002/6110] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:39 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1464 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:40.327705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:40.347804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa4232c8-13b5-4777-80ef-6caf032c1ad4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1690 microversion: 2.1 time: 0.389995 Aug 04 05:03:40.353288 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3109/6111] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:39 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1690 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:41.303861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2d16edf8-76a0-4eb9-bebf-bbb2fd42112e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:41.304507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2d16edf8-76a0-4eb9-bebf-bbb2fd42112e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:41.312117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d16edf8-76a0-4eb9-bebf-bbb2fd42112e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.312643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d16edf8-76a0-4eb9-bebf-bbb2fd42112e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.313482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d16edf8-76a0-4eb9-bebf-bbb2fd42112e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.313863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d16edf8-76a0-4eb9-bebf-bbb2fd42112e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.373827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:41.374456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:41.382587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.384199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.386084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.386855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.489518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:41.494682 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2d16edf8-76a0-4eb9-bebf-bbb2fd42112e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1464 microversion: 2.1 time: 0.195320 Aug 04 05:03:41.499481 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3003/6112] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:41 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1464 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:41.559586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:41.568666 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0c34b723-408f-4580-a528-492415ff986f tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1680 microversion: 2.1 time: 0.198551 Aug 04 05:03:41.572987 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3110/6113] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:41 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:41.594092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-158af6b4-2b9f-45b0-aff8-fae079fd9a2b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:41.595046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-158af6b4-2b9f-45b0-aff8-fae079fd9a2b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:41.602725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-158af6b4-2b9f-45b0-aff8-fae079fd9a2b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.603476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-158af6b4-2b9f-45b0-aff8-fae079fd9a2b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.604461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-158af6b4-2b9f-45b0-aff8-fae079fd9a2b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.605067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-158af6b4-2b9f-45b0-aff8-fae079fd9a2b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.768804 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-158af6b4-2b9f-45b0-aff8-fae079fd9a2b tempest-TestNetworkAdvancedServerOps-1325776304 tempest-TestNetworkAdvancedServerOps-1325776304-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1831 microversion: 2.1 time: 0.181137 Aug 04 05:03:41.770067 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3004/6114] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:41 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1831 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:41.792259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:41.792966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:41.799220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.799748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.800596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.801151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.991956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:42.000335 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1109d1a-ead2-4309-a35b-5db1bedc0220 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1680 microversion: 2.1 time: 0.212445 Aug 04 05:03:42.001187 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3111/6115] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:41 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:42.102164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e0273ce-84aa-480d-908b-5143be9701d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:42.104872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e0273ce-84aa-480d-908b-5143be9701d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:42.111298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e0273ce-84aa-480d-908b-5143be9701d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:42.111758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e0273ce-84aa-480d-908b-5143be9701d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:42.112573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e0273ce-84aa-480d-908b-5143be9701d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:42.113313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e0273ce-84aa-480d-908b-5143be9701d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:42.174938 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e0273ce-84aa-480d-908b-5143be9701d1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action" status: 200 len: 38657 microversion: 2.1 time: 0.076426 Aug 04 05:03:42.177483 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3005/6116] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:03:42 2022] POST /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07/action => generated 38657 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:03:42.380624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b7dd9631-b5c0-4744-8812-b9d64aaed07c req-8b5dd4ee-b762-4f84-8144-b564b0cac5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5307cb-b4af-4981-9b3c-f2781f37b5fd", "name": "network-vif-plugged", "status": "completed", "tag": "27982cb6-005e-480b-8429-c645612e2c24"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:42.392960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b7dd9631-b5c0-4744-8812-b9d64aaed07c req-8b5dd4ee-b762-4f84-8144-b564b0cac5f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:42.393669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b7dd9631-b5c0-4744-8812-b9d64aaed07c req-8b5dd4ee-b762-4f84-8144-b564b0cac5f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:42.408567 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b7dd9631-b5c0-4744-8812-b9d64aaed07c req-8b5dd4ee-b762-4f84-8144-b564b0cac5f5 service nova] Creating event network-vif-plugged:27982cb6-005e-480b-8429-c645612e2c24 for instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd on n-h1-851337-5 Aug 04 05:03:42.414788 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b7dd9631-b5c0-4744-8812-b9d64aaed07c req-8b5dd4ee-b762-4f84-8144-b564b0cac5f5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037886 Aug 04 05:03:42.415626 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3112/6117] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:03:42.522584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-823e0a46-c4a3-4c73-8fb9-0199b22c2a8c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:42.523907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-823e0a46-c4a3-4c73-8fb9-0199b22c2a8c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:42.526647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:42.527708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:42.546899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-823e0a46-c4a3-4c73-8fb9-0199b22c2a8c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:42.548445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-823e0a46-c4a3-4c73-8fb9-0199b22c2a8c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:42.550809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-823e0a46-c4a3-4c73-8fb9-0199b22c2a8c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:42.551705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-823e0a46-c4a3-4c73-8fb9-0199b22c2a8c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:42.782071 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-823e0a46-c4a3-4c73-8fb9-0199b22c2a8c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1464 microversion: 2.1 time: 0.264209 Aug 04 05:03:42.796437 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3006/6118] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:42 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:43.374297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:43.374837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:43.376877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:43.386225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.386919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.387488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6f112c3e-d97b-4596-bdf1-5d6c029361bc req-69b5822f-8270-476e-80bf-37b937e1f612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf0fb1-4729-4021-8ac4-26ac95f2fb07", "tag": "4244eb38-f59a-4fce-b45a-1498a4e95ab0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:43.387628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.387936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.409950 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6f112c3e-d97b-4596-bdf1-5d6c029361bc req-69b5822f-8270-476e-80bf-37b937e1f612 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.410758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6f112c3e-d97b-4596-bdf1-5d6c029361bc req-69b5822f-8270-476e-80bf-37b937e1f612 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.417397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:03:43.444909 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6f112c3e-d97b-4596-bdf1-5d6c029361bc req-69b5822f-8270-476e-80bf-37b937e1f612 service nova] Creating event network-changed:4244eb38-f59a-4fce-b45a-1498a4e95ab0 for instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 on n-h1-851337-5 Aug 04 05:03:43.450828 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6f112c3e-d97b-4596-bdf1-5d6c029361bc req-69b5822f-8270-476e-80bf-37b937e1f612 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067929 Aug 04 05:03:43.452052 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3007/6119] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:03:43.515665 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63f215d9-1b90-412f-bff7-aa7bb3af2b0e tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 204 len: 0 microversion: 2.1 time: 0.145217 Aug 04 05:03:43.519580 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3113/6120] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:03:43 2022] DELETE /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:03:43.526033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:43.527031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:43.534348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.534893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.535798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.536476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.764440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:43.772830 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e4cac3c8-aab1-4670-b9a8-126ef0593090 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1686 microversion: 2.1 time: 0.251628 Aug 04 05:03:43.773589 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3008/6121] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:43 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1686 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:43.804906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fc8dad8a-3414-42a0-ad5f-258c7cd24c40 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:43.806260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fc8dad8a-3414-42a0-ad5f-258c7cd24c40 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:43.812985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc8dad8a-3414-42a0-ad5f-258c7cd24c40 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.813645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc8dad8a-3414-42a0-ad5f-258c7cd24c40 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.814714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc8dad8a-3414-42a0-ad5f-258c7cd24c40 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.815379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc8dad8a-3414-42a0-ad5f-258c7cd24c40 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:44.077984 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fc8dad8a-3414-42a0-ad5f-258c7cd24c40 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1464 microversion: 2.1 time: 0.277673 Aug 04 05:03:44.079021 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3114/6122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:43 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1464 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:44.802594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:44.803993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:44.818131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:44.818684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:44.819709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:44.820160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:44.878120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:45.102840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-34870e4b-a9b7-4ce5-883a-3da9a1885a53 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:45.104979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-34870e4b-a9b7-4ce5-883a-3da9a1885a53 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:45.123753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34870e4b-a9b7-4ce5-883a-3da9a1885a53 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:45.125746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34870e4b-a9b7-4ce5-883a-3da9a1885a53 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:45.129913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34870e4b-a9b7-4ce5-883a-3da9a1885a53 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:45.130627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34870e4b-a9b7-4ce5-883a-3da9a1885a53 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:45.157369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:45.248434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:45.261678 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2b8d52cf-fa38-421f-a18c-094491f75fd7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 200 len: 1686 microversion: 2.1 time: 0.466759 Aug 04 05:03:45.262546 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3009/6123] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:44 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 1686 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:45.468252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-04a29768-6a2a-4ea8-a8a6-6115dab8fad6 req-e39c0e14-73e7-49ad-9676-d36cab513437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf0fb1-4729-4021-8ac4-26ac95f2fb07", "name": "network-vif-deleted", "tag": "4244eb38-f59a-4fce-b45a-1498a4e95ab0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:45.493308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-04a29768-6a2a-4ea8-a8a6-6115dab8fad6 req-e39c0e14-73e7-49ad-9676-d36cab513437 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:45.493770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-04a29768-6a2a-4ea8-a8a6-6115dab8fad6 req-e39c0e14-73e7-49ad-9676-d36cab513437 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:45.514444 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-04a29768-6a2a-4ea8-a8a6-6115dab8fad6 req-e39c0e14-73e7-49ad-9676-d36cab513437 service nova] Creating event network-vif-deleted:4244eb38-f59a-4fce-b45a-1498a4e95ab0 for instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 on n-h1-851337-5 Aug 04 05:03:45.519825 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-04a29768-6a2a-4ea8-a8a6-6115dab8fad6 req-e39c0e14-73e7-49ad-9676-d36cab513437 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056128 Aug 04 05:03:45.521474 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3010/6124] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:45.814116 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-34870e4b-a9b7-4ce5-883a-3da9a1885a53 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1649 microversion: 2.1 time: 0.718371 Aug 04 05:03:45.814711 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3115/6125] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:45 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1649 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:45.837372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63cfc519-2a56-41d7-9c00-232eac701e13 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:45.838755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63cfc519-2a56-41d7-9c00-232eac701e13 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:45.846089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63cfc519-2a56-41d7-9c00-232eac701e13 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:45.846552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63cfc519-2a56-41d7-9c00-232eac701e13 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:45.847434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63cfc519-2a56-41d7-9c00-232eac701e13 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:45.848052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63cfc519-2a56-41d7-9c00-232eac701e13 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:45.997913 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63cfc519-2a56-41d7-9c00-232eac701e13 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1649 microversion: 2.1 time: 0.166110 Aug 04 05:03:45.998696 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3011/6126] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:45 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1649 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:46.018528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-31e08ef3-35a6-4a1b-a2ad-130ddd223812 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:46.019504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-31e08ef3-35a6-4a1b-a2ad-130ddd223812 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:46.037029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31e08ef3-35a6-4a1b-a2ad-130ddd223812 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.037523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31e08ef3-35a6-4a1b-a2ad-130ddd223812 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.038432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31e08ef3-35a6-4a1b-a2ad-130ddd223812 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.039279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-31e08ef3-35a6-4a1b-a2ad-130ddd223812 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.199551 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-31e08ef3-35a6-4a1b-a2ad-130ddd223812 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1649 microversion: 2.1 time: 0.184649 Aug 04 05:03:46.200500 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3116/6127] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:46 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1649 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:46.275006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1212783228", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "availability_zone": "nova:n-h2-851337-5", "networks": [{"uuid": "e8b279cd-0681-4ac0-bf12-774e2e7b0a48"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:46.290384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:46.291453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:46.298451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.299460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.300518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.301081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.316333 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] HTTP exception thrown: Instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 could not be found. Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Request method failure captured: Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 HTTP/1.1 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61GdXrmWyyfE0J7enPpcIyS3LbibZR7PXqlPp3pVVyYXeHezoFuAT9ZF9b7K8886gn6e2_GN0Rt88Tw2FVFNfZo60Q6Vfblx2XonnMcQkg2IArZTVP8WZoQSTyoQkYC3HCAudPfq8W-oRSVCIp2pGPcTSXLlrp9_fe9GWe5eWg1Vi9I Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_af3d0230675c48d8ba4d39a956313de9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 09e52c6cb3694904a605112a9901e18c Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 could not be found. Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6dbf0fb1-4729-4021-8ac4-26ac95f2fb07'} Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 could not be found. Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 could not be found. Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:46.318993 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 could not be found. Aug 04 05:03:46.322643 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:03:46.324060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Returning 404 to user: Instance 6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:03:46.328762 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bd869f3e-57f2-48a2-8182-fec5e36d1c03 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07" status: 404 len: 111 microversion: 2.1 time: 0.043180 Aug 04 05:03:46.328762 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3117/6128] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:46 2022] GET /compute/v2.1/servers/6dbf0fb1-4729-4021-8ac4-26ac95f2fb07 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:03:46.366254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] validate_networks() for [('e8b279cd-0681-4ac0-bf12-774e2e7b0a48', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:03:46.821257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:03:46.821689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:03:46.822448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:03:46.822877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:03:46.823383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:03:46.836634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.837371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.839699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.841760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.870054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Getting quotas for project 15a45a0d406e4c9694f602ccabb77cbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:03:46.876112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Getting quotas for user b63a33da8c004a00bf7e9ea24cea5132 and project 15a45a0d406e4c9694f602ccabb77cbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:03:46.895731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:03:46.898388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:03:46.963413 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba6f1a32-113f-419f-85dc-b31a7ef36a80 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691380 Aug 04 05:03:46.969476 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3012/6129] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:03:46.976328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4f5d95e-134f-4166-8abc-d5205737995a tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:46.976960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4f5d95e-134f-4166-8abc-d5205737995a tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:47.104792 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4f5d95e-134f-4166-8abc-d5205737995a tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1329 microversion: 2.1 time: 0.132253 Aug 04 05:03:47.109943 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3118/6130] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:46 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1329 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:48.133586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-925c02a1-7c82-4a5b-928a-50188db86cef tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:48.134201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-925c02a1-7c82-4a5b-928a-50188db86cef tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:48.179297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925c02a1-7c82-4a5b-928a-50188db86cef tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:48.180840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925c02a1-7c82-4a5b-928a-50188db86cef tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:48.185228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925c02a1-7c82-4a5b-928a-50188db86cef tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:48.185807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925c02a1-7c82-4a5b-928a-50188db86cef tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:48.315906 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-925c02a1-7c82-4a5b-928a-50188db86cef tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1416 microversion: 2.1 time: 0.186524 Aug 04 05:03:48.317141 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3013/6131] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:48 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1416 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:49.338753 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40ed08a0-6363-4015-b741-34d4a2c1521e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:49.340347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40ed08a0-6363-4015-b741-34d4a2c1521e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:49.354444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40ed08a0-6363-4015-b741-34d4a2c1521e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:49.355439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40ed08a0-6363-4015-b741-34d4a2c1521e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:49.356480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40ed08a0-6363-4015-b741-34d4a2c1521e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:49.357113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40ed08a0-6363-4015-b741-34d4a2c1521e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:49.468353 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40ed08a0-6363-4015-b741-34d4a2c1521e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1422 microversion: 2.1 time: 0.134283 Aug 04 05:03:49.468958 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3119/6132] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:49 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1422 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:50.490557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11779b21-d382-4c9e-bde3-b2bfdba8d066 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:50.491569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-11779b21-d382-4c9e-bde3-b2bfdba8d066 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:50.494470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:50.515296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11779b21-d382-4c9e-bde3-b2bfdba8d066 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:50.515760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11779b21-d382-4c9e-bde3-b2bfdba8d066 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:50.516571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11779b21-d382-4c9e-bde3-b2bfdba8d066 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:50.517185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11779b21-d382-4c9e-bde3-b2bfdba8d066 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:50.752190 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11779b21-d382-4c9e-bde3-b2bfdba8d066 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1464 microversion: 2.1 time: 0.265912 Aug 04 05:03:50.753957 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3014/6133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:50 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:51.531360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d24d68c8-2077-4b37-a983-f14cf5771fb0 req-d2ea85e5-12ac-43e3-86c2-3bdc8ca1325a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951848b9-fa01-45dc-9e52-c3007f90c52e", "tag": "2ada2c0f-0fd3-47fb-b16f-29e1b25b7915"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:51.556955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d24d68c8-2077-4b37-a983-f14cf5771fb0 req-d2ea85e5-12ac-43e3-86c2-3bdc8ca1325a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:51.557425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d24d68c8-2077-4b37-a983-f14cf5771fb0 req-d2ea85e5-12ac-43e3-86c2-3bdc8ca1325a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:51.581912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d24d68c8-2077-4b37-a983-f14cf5771fb0 req-d2ea85e5-12ac-43e3-86c2-3bdc8ca1325a service nova] Creating event network-changed:2ada2c0f-0fd3-47fb-b16f-29e1b25b7915 for instance 951848b9-fa01-45dc-9e52-c3007f90c52e on n-h2-851337-5 Aug 04 05:03:51.588681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d24d68c8-2077-4b37-a983-f14cf5771fb0 req-d2ea85e5-12ac-43e3-86c2-3bdc8ca1325a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063286 Aug 04 05:03:51.589882 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3120/6134] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:51.778320 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cf258603-ba2c-4504-8c8d-dd443895d18e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:51.779306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cf258603-ba2c-4504-8c8d-dd443895d18e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:51.793798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf258603-ba2c-4504-8c8d-dd443895d18e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:51.799643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf258603-ba2c-4504-8c8d-dd443895d18e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:51.800509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf258603-ba2c-4504-8c8d-dd443895d18e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:51.800967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cf258603-ba2c-4504-8c8d-dd443895d18e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:52.080107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3eb3e192-1ba1-47e7-9530-783e53443d92 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '.version_select at 0x7f19195c68b0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:52.119931 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3eb3e192-1ba1-47e7-9530-783e53443d92 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-790351635" status: 202 len: 0 microversion: 2.1 time: 0.044193 Aug 04 05:03:52.129291 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3121/6135] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 05:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-790351635 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 05:03:52.149642 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cf258603-ba2c-4504-8c8d-dd443895d18e tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1464 microversion: 2.1 time: 0.375199 Aug 04 05:03:52.150237 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3015/6136] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:51 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:52.160750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a528b4a-f128-4398-8156-12a91d89abf6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: .version_select at 0x7f191961f5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-286904531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHn+1h7s1lf6TBVQJSFeAMYmavBKM8qeRuuD5UHk4FctG76NuDxajsKy5HKAk+RKll27GKjIaHaJ7S4JWTv7TaJcjklYCoe3HQQj2E/TNvIAkGdAZXKgG8KICDbgMn8cw=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:52.177865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-8a528b4a-f128-4398-8156-12a91d89abf6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:03:52.184264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-8a528b4a-f128-4398-8156-12a91d89abf6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:03:52.211900 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8a528b4a-f128-4398-8156-12a91d89abf6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055066 Aug 04 05:03:52.213854 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3122/6137] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:03:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:53.171915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7ff9296-e6af-42b9-bf6a-cff58f75976c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:53.173221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7ff9296-e6af-42b9-bf6a-cff58f75976c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:53.180564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7ff9296-e6af-42b9-bf6a-cff58f75976c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:53.181081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7ff9296-e6af-42b9-bf6a-cff58f75976c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:53.181906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7ff9296-e6af-42b9-bf6a-cff58f75976c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:53.182647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7ff9296-e6af-42b9-bf6a-cff58f75976c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:53.436016 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7ff9296-e6af-42b9-bf6a-cff58f75976c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1464 microversion: 2.1 time: 0.266558 Aug 04 05:03:53.438573 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3016/6138] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:53 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:54.472164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea35eb0d-c4be-48e3-8951-3e8b4f7a7a7c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:54.472946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea35eb0d-c4be-48e3-8951-3e8b4f7a7a7c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:54.481401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea35eb0d-c4be-48e3-8951-3e8b4f7a7a7c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:54.482147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea35eb0d-c4be-48e3-8951-3e8b4f7a7a7c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:54.482964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea35eb0d-c4be-48e3-8951-3e8b4f7a7a7c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:54.483427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea35eb0d-c4be-48e3-8951-3e8b4f7a7a7c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:54.622996 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea35eb0d-c4be-48e3-8951-3e8b4f7a7a7c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1464 microversion: 2.1 time: 0.159367 Aug 04 05:03:54.623901 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3123/6139] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:54 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:55.674070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-520dfd1e-3bc9-46ed-a327-dadb435bbdac tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:55.675670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-520dfd1e-3bc9-46ed-a327-dadb435bbdac tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:55.684594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-520dfd1e-3bc9-46ed-a327-dadb435bbdac tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:55.692044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-520dfd1e-3bc9-46ed-a327-dadb435bbdac tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:55.695658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-520dfd1e-3bc9-46ed-a327-dadb435bbdac tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:55.696139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-520dfd1e-3bc9-46ed-a327-dadb435bbdac tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:55.971337 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-520dfd1e-3bc9-46ed-a327-dadb435bbdac tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1464 microversion: 2.1 time: 0.316639 Aug 04 05:03:55.973585 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3017/6140] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:55 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:56.997792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-028c0e91-e287-48b4-935d-0c1782330354 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:56.998416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-028c0e91-e287-48b4-935d-0c1782330354 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:57.006784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-028c0e91-e287-48b4-935d-0c1782330354 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:57.007529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-028c0e91-e287-48b4-935d-0c1782330354 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:57.008344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-028c0e91-e287-48b4-935d-0c1782330354 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:57.008963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-028c0e91-e287-48b4-935d-0c1782330354 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:57.154319 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-028c0e91-e287-48b4-935d-0c1782330354 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1464 microversion: 2.1 time: 0.160304 Aug 04 05:03:57.154916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3124/6141] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:56 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:57.964773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a677b71d-4c5b-4f2e-9dc6-64bbfac68205 req-6b5551fb-4d51-4151-9fa7-4379013d1d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951848b9-fa01-45dc-9e52-c3007f90c52e", "name": "network-vif-plugged", "status": "completed", "tag": "2ada2c0f-0fd3-47fb-b16f-29e1b25b7915"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:57.986967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:57.987734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:57.997423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a677b71d-4c5b-4f2e-9dc6-64bbfac68205 req-6b5551fb-4d51-4151-9fa7-4379013d1d5b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:57.997868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a677b71d-4c5b-4f2e-9dc6-64bbfac68205 req-6b5551fb-4d51-4151-9fa7-4379013d1d5b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:58.032811 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a677b71d-4c5b-4f2e-9dc6-64bbfac68205 req-6b5551fb-4d51-4151-9fa7-4379013d1d5b service nova] Creating event network-vif-plugged:2ada2c0f-0fd3-47fb-b16f-29e1b25b7915 for instance 951848b9-fa01-45dc-9e52-c3007f90c52e on n-h2-851337-5 Aug 04 05:03:58.059883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a677b71d-4c5b-4f2e-9dc6-64bbfac68205 req-6b5551fb-4d51-4151-9fa7-4379013d1d5b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106635 Aug 04 05:03:58.060545 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3018/6142] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:03:58.176968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc829347-20fd-4d1a-847f-f055da1606d0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:58.177730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc829347-20fd-4d1a-847f-f055da1606d0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:58.188999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc829347-20fd-4d1a-847f-f055da1606d0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:58.189479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc829347-20fd-4d1a-847f-f055da1606d0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:58.192505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc829347-20fd-4d1a-847f-f055da1606d0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:58.195094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc829347-20fd-4d1a-847f-f055da1606d0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:58.487752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc829347-20fd-4d1a-847f-f055da1606d0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1464 microversion: 2.1 time: 0.313068 Aug 04 05:03:58.492797 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3125/6143] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:58 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1464 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:58.997714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-99292280", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "f9cbb9d7-a5b3-4cb4-b0f4-3f5cec7b862b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-286904531", "security_groups": [{"name": "tempest-secgroup-smoke-1263062059"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:59.122178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] validate_networks() for [('f9cbb9d7-a5b3-4cb4-b0f4-3f5cec7b862b', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:03:59.524530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcecb4a4-e109-4007-abd3-dfda3297b3e5 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:59.525511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fcecb4a4-e109-4007-abd3-dfda3297b3e5 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:59.542862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecb4a4-e109-4007-abd3-dfda3297b3e5 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:59.543980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecb4a4-e109-4007-abd3-dfda3297b3e5 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:59.548670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecb4a4-e109-4007-abd3-dfda3297b3e5 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:59.549329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcecb4a4-e109-4007-abd3-dfda3297b3e5 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:59.742205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:03:59.742631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:03:59.743142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:03:59.744183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:03:59.744612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:03:59.796010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:59.796681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:59.803861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:59.803861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:59.855559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:03:59.858930 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcecb4a4-e109-4007-abd3-dfda3297b3e5 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1650 microversion: 2.1 time: 0.350942 Aug 04 05:03:59.871083 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3126/6144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:59 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1650 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:59.883773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Getting quotas for user 09e52c6cb3694904a605112a9901e18c and project af3d0230675c48d8ba4d39a956313de9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:03:59.893495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d482ae0-0eaf-48c3-a479-04d6b4831f01 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:59.895225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1d482ae0-0eaf-48c3-a479-04d6b4831f01 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:59.909639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d482ae0-0eaf-48c3-a479-04d6b4831f01 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:59.918040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d482ae0-0eaf-48c3-a479-04d6b4831f01 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:59.920177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d482ae0-0eaf-48c3-a479-04d6b4831f01 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:59.920833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d482ae0-0eaf-48c3-a479-04d6b4831f01 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:59.953127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:03:59.955736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:04:00.107842 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e951d6c-1fdd-426a-8b2b-64b763084a46 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.114582 Aug 04 05:04:00.111053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3019/6145] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:03:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:04:00.124047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5043bb48-d32e-477b-9f2b-79874afa201d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:00.124904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5043bb48-d32e-477b-9f2b-79874afa201d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:00.234339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5043bb48-d32e-477b-9f2b-79874afa201d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:00.250649 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5043bb48-d32e-477b-9f2b-79874afa201d tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1264 microversion: 2.1 time: 0.130819 Aug 04 05:04:00.251343 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3020/6146] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:00 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1264 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:00.331216 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d482ae0-0eaf-48c3-a479-04d6b4831f01 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1650 microversion: 2.1 time: 0.441180 Aug 04 05:04:00.346222 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3127/6147] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:59 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1650 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:04:00.361112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e0f20a61-0f82-45ac-8f4b-fa202513a84c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:00.362001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e0f20a61-0f82-45ac-8f4b-fa202513a84c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:00.372001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f20a61-0f82-45ac-8f4b-fa202513a84c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:00.373510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f20a61-0f82-45ac-8f4b-fa202513a84c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:00.374525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f20a61-0f82-45ac-8f4b-fa202513a84c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:00.375206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e0f20a61-0f82-45ac-8f4b-fa202513a84c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:00.618593 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e0f20a61-0f82-45ac-8f4b-fa202513a84c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1650 microversion: 2.1 time: 0.264598 Aug 04 05:04:00.619226 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3021/6148] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:00 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1650 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:00.644964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:00.645628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:00.671379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:00.672021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:00.673580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:00.679273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:00.749625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:04:00.949082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-33e8dac5-5f30-4b61-9307-1680f89208c2 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "DELETE /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 204 len: 0 microversion: 2.1 time: 0.308946 Aug 04 05:04:00.949696 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3128/6149] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:04:00 2022] DELETE /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:04:00.958060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2d3df982-28ea-49e7-b4b0-01cf99eefad0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:00.958945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2d3df982-28ea-49e7-b4b0-01cf99eefad0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:00.969366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d3df982-28ea-49e7-b4b0-01cf99eefad0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:00.969829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d3df982-28ea-49e7-b4b0-01cf99eefad0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:00.970609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d3df982-28ea-49e7-b4b0-01cf99eefad0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:00.971073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d3df982-28ea-49e7-b4b0-01cf99eefad0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:01.227782 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2d3df982-28ea-49e7-b4b0-01cf99eefad0 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1656 microversion: 2.1 time: 0.273612 Aug 04 05:04:01.244015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3022/6150] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:00 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1656 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:01.276088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:01.276926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:01.288055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:01.288825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:01.289811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:01.290476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:01.360814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:01.370731 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3a20e6fa-b8e2-4079-832e-87046ed7f005 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1268 microversion: 2.1 time: 0.100570 Aug 04 05:04:01.371593 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3129/6151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:01 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1268 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:02.250750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28533697-1d31-4818-a35c-d6542c163986 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:02.251399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-28533697-1d31-4818-a35c-d6542c163986 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:02.259581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28533697-1d31-4818-a35c-d6542c163986 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:02.260046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28533697-1d31-4818-a35c-d6542c163986 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:02.260835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28533697-1d31-4818-a35c-d6542c163986 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:02.261275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28533697-1d31-4818-a35c-d6542c163986 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:02.395384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:02.396724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:02.399959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:02.407728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:02.408192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:02.409011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:02.409476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:02.968999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:02.984736 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7f84027-b3a0-4f46-bcde-0d1851169258 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1316 microversion: 2.1 time: 0.595543 Aug 04 05:04:02.985572 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3130/6152] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:02 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:03.179986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-33028071-3c98-4064-b290-fe8d85960eb4 req-10fc0e1f-f2bc-410c-a58e-ef76f7f4f241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951848b9-fa01-45dc-9e52-c3007f90c52e", "name": "network-vif-deleted", "tag": "2ada2c0f-0fd3-47fb-b16f-29e1b25b7915"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:03.222129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-33028071-3c98-4064-b290-fe8d85960eb4 req-10fc0e1f-f2bc-410c-a58e-ef76f7f4f241 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:03.222593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-33028071-3c98-4064-b290-fe8d85960eb4 req-10fc0e1f-f2bc-410c-a58e-ef76f7f4f241 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:03.267491 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-33028071-3c98-4064-b290-fe8d85960eb4 req-10fc0e1f-f2bc-410c-a58e-ef76f7f4f241 service nova] Creating event network-vif-deleted:2ada2c0f-0fd3-47fb-b16f-29e1b25b7915 for instance 951848b9-fa01-45dc-9e52-c3007f90c52e on n-h2-851337-5 Aug 04 05:04:03.280263 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-33028071-3c98-4064-b290-fe8d85960eb4 req-10fc0e1f-f2bc-410c-a58e-ef76f7f4f241 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107736 Aug 04 05:04:03.298710 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3131/6153] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:03.301917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-28533697-1d31-4818-a35c-d6542c163986 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 200 len: 1656 microversion: 2.1 time: 1.052917 Aug 04 05:04:03.306202 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3023/6154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:02 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 1656 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:04.009603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:04.010936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:04.013912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:04.034993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.036238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.038490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.039566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.162964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:04.179314 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6cd6c8f9-bf77-4a9d-a398-7275241acf78 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1322 microversion: 2.1 time: 0.170072 Aug 04 05:04:04.180354 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3132/6155] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:04 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:04.325780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:04.326922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 951848b9-fa01-45dc-9e52-c3007f90c52e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:04.344385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.344837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.345631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.346256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.373427 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] HTTP exception thrown: Instance 951848b9-fa01-45dc-9e52-c3007f90c52e could not be found. Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Request method failure captured: Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e HTTP/1.1 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Mjf8HpAqV5SgBfiTE4gRkOd1JNZJIrq46vzBK3dmne0fCcg2n2EiqLPV5CbaJsuEJAcRjXUtx0C4UjxquL5344j8ahtfJESYdxCS1XHtfedNm0H0yDKazBAeErn_l0biR84ECHkZ-89uAV8Y9DqSlSZ-WRXaSzK80LG7FiI-Bi-to Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 15a45a0d406e4c9694f602ccabb77cbc Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestServerMultinode-1657319805 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15a45a0d406e4c9694f602ccabb77cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/15a45a0d406e4c9694f602ccabb77cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15a45a0d406e4c9694f602ccabb77cbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_15a45a0d406e4c9694f602ccabb77cbc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestServerMultinode-1657319805 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 15a45a0d406e4c9694f602ccabb77cbc Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestServerMultinode-1657319805 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestServerMultinode-1657319805-project-admin Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: b63a33da8c004a00bf7e9ea24cea5132 Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestServerMultinode-1657319805-project-admin Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 951848b9-fa01-45dc-9e52-c3007f90c52e could not be found. Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '951848b9-fa01-45dc-9e52-c3007f90c52e'} Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951848b9-fa01-45dc-9e52-c3007f90c52e could not be found. Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951848b9-fa01-45dc-9e52-c3007f90c52e could not be found. Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:04.376331 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:04.381881 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:04.381881 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:04.381881 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:04.381881 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:04:04.381881 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:04:04.381881 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951848b9-fa01-45dc-9e52-c3007f90c52e could not be found. Aug 04 05:04:04.381881 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:04.385128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Returning 404 to user: Instance 951848b9-fa01-45dc-9e52-c3007f90c52e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:04.387927 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5ff99dd1-8888-4488-8f0b-b2a2fa46b2d3 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e" status: 404 len: 111 microversion: 2.1 time: 0.065989 Aug 04 05:04:04.398515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:04.399699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:04.406668 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3024/6156] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:04 2022] GET /compute/v2.1/servers/951848b9-fa01-45dc-9e52-c3007f90c52e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:04:04.408978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.409718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.410745 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.411481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.457992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:04:04.542772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:04.600497 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-80632197-2ad8-46cb-bc5e-70fdfa9a9995 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "DELETE /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 204 len: 0 microversion: 2.1 time: 0.206564 Aug 04 05:04:04.601554 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3133/6157] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:04:04 2022] DELETE /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:04:04.611075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e110545-6072-4c4d-a30c-3d9ec70b5e98 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:04.611706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9e110545-6072-4c4d-a30c-3d9ec70b5e98 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:04.628455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e110545-6072-4c4d-a30c-3d9ec70b5e98 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.628951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e110545-6072-4c4d-a30c-3d9ec70b5e98 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.634256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e110545-6072-4c4d-a30c-3d9ec70b5e98 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:04.634840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9e110545-6072-4c4d-a30c-3d9ec70b5e98 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:04.961175 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e110545-6072-4c4d-a30c-3d9ec70b5e98 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1655 microversion: 2.1 time: 0.355224 Aug 04 05:04:04.962015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3025/6158] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:04 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1655 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:05.206797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:05.207569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:05.214866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:05.215362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:05.216356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:05.216811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:05.355593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-00d7b22f-d01e-4f08-ad0e-e7e0c1eb23c6 req-c56e657c-0287-469a-93fd-186c72f1d0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272fa58d-2b9c-4732-bebc-0afc6fa526b1", "tag": "951b5852-3c9b-479b-81e0-e2e32b25789c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:05.370869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-00d7b22f-d01e-4f08-ad0e-e7e0c1eb23c6 req-c56e657c-0287-469a-93fd-186c72f1d0b3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:05.371626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-00d7b22f-d01e-4f08-ad0e-e7e0c1eb23c6 req-c56e657c-0287-469a-93fd-186c72f1d0b3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:05.385194 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-00d7b22f-d01e-4f08-ad0e-e7e0c1eb23c6 req-c56e657c-0287-469a-93fd-186c72f1d0b3 service nova] Creating event network-changed:951b5852-3c9b-479b-81e0-e2e32b25789c for instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 on n-h2-851337-5 Aug 04 05:04:05.390596 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-00d7b22f-d01e-4f08-ad0e-e7e0c1eb23c6 req-c56e657c-0287-469a-93fd-186c72f1d0b3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039849 Aug 04 05:04:05.391474 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3026/6159] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:04:05.532138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:05.544293 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a2a346d2-296f-4fe6-a907-b2ff5dfe647b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1390 microversion: 2.1 time: 0.342534 Aug 04 05:04:05.556864 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3134/6160] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:05 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1390 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:05.986354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-637c56bb-7aa0-4e31-89cd-c7686df30328 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:05.987686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-637c56bb-7aa0-4e31-89cd-c7686df30328 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:05.997243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-637c56bb-7aa0-4e31-89cd-c7686df30328 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:05.997944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-637c56bb-7aa0-4e31-89cd-c7686df30328 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:05.998999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-637c56bb-7aa0-4e31-89cd-c7686df30328 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:05.999754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-637c56bb-7aa0-4e31-89cd-c7686df30328 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:06.168354 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-637c56bb-7aa0-4e31-89cd-c7686df30328 tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1655 microversion: 2.1 time: 0.186757 Aug 04 05:04:06.168934 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3027/6161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:05 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1655 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:06.565729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:06.566430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:06.574233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:06.574706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:06.575536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:06.575986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:06.853820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:06.863949 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d6b0010-5779-4b82-ba51-9e3e1d54bf4a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1390 microversion: 2.1 time: 0.302234 Aug 04 05:04:06.865320 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3135/6162] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:06 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:07.189753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:07.190980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:07.199521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:07.199978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:07.201069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:07.201549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:07.241738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:07.242474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:07.243166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lazy-loading 'fault' on Instance uuid 0a5307cb-b4af-4981-9b3c-f2781f37b5fd {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:04:07.305286 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16b8fa4e-7b8d-4c56-9c6e-39ea94aeab5c tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 200 len: 1454 microversion: 2.1 time: 0.119267 Aug 04 05:04:07.305885 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3028/6163] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:07 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:07.414247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-584fe76b-f4b7-4ec5-aef6-5c6a7107272a req-0ee2fa94-68dc-4061-a1bb-3fe25dd82fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5307cb-b4af-4981-9b3c-f2781f37b5fd", "name": "network-vif-deleted", "tag": "27982cb6-005e-480b-8429-c645612e2c24"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:07.424854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-584fe76b-f4b7-4ec5-aef6-5c6a7107272a req-0ee2fa94-68dc-4061-a1bb-3fe25dd82fb6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:07.425672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-584fe76b-f4b7-4ec5-aef6-5c6a7107272a req-0ee2fa94-68dc-4061-a1bb-3fe25dd82fb6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:07.440357 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-584fe76b-f4b7-4ec5-aef6-5c6a7107272a req-0ee2fa94-68dc-4061-a1bb-3fe25dd82fb6 service nova] Creating event network-vif-deleted:27982cb6-005e-480b-8429-c645612e2c24 for instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd on n-h1-851337-5 Aug 04 05:04:07.446207 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-584fe76b-f4b7-4ec5-aef6-5c6a7107272a req-0ee2fa94-68dc-4061-a1bb-3fe25dd82fb6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035548 Aug 04 05:04:07.449746 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3136/6164] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:07.888022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:07.888827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:07.895706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:07.896299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:07.897187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:07.897740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:08.059782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:08.070225 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0afe1ced-2004-400a-a005-0d73be826f32 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1390 microversion: 2.1 time: 0.187123 Aug 04 05:04:08.071198 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3029/6165] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:07 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:08.329543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:08.330293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] [instance: 0a5307cb-b4af-4981-9b3c-f2781f37b5fd] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:08.338475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:08.338935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:08.339740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:08.340188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:08.355592 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] HTTP exception thrown: Instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd could not be found. Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Request method failure captured: Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd HTTP/1.1 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Mjf8HpAqV5SgBfiTE4gRkOd1JNZJIrq46vzBK3dmne0fCcg2n2EiqLPV5CbaJsuEJAcRjXUtx0C4UjxquL5344j8ahtfJESYdxCS1XHtfedNm0H0yDKazBAeErn_l0biR84ECHkZ-89uAV8Y9DqSlSZ-WRXaSzK80LG7FiI-Bi-to Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 15a45a0d406e4c9694f602ccabb77cbc Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestServerMultinode-1657319805 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15a45a0d406e4c9694f602ccabb77cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/15a45a0d406e4c9694f602ccabb77cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15a45a0d406e4c9694f602ccabb77cbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_15a45a0d406e4c9694f602ccabb77cbc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestServerMultinode-1657319805 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 15a45a0d406e4c9694f602ccabb77cbc Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestServerMultinode-1657319805 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestServerMultinode-1657319805-project-admin Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: b63a33da8c004a00bf7e9ea24cea5132 Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestServerMultinode-1657319805-project-admin Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd could not be found. Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0a5307cb-b4af-4981-9b3c-f2781f37b5fd'} Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd could not be found. Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd could not be found. Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:08.357259 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd could not be found. Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] Returning 404 to user: Instance 0a5307cb-b4af-4981-9b3c-f2781f37b5fd could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-237ab8e2-bfaa-4cde-b661-b4993c5b0def tempest-TestServerMultinode-1657319805 tempest-TestServerMultinode-1657319805-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd" status: 404 len: 111 microversion: 2.1 time: 0.033649 Aug 04 05:04:08.361221 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3137/6166] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:08 2022] GET /compute/v2.1/servers/0a5307cb-b4af-4981-9b3c-f2781f37b5fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:04:09.092391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:09.093887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:09.105279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:09.105718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:09.106497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:09.106936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:09.302044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:09.306230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:09.312521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82ad1996-5a4a-463c-ab89-d8e10a9364ff tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1390 microversion: 2.1 time: 0.224000 Aug 04 05:04:09.313108 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3030/6167] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:09 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:09.727966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-56ab7b7c-268d-4cb9-8825-07973184c694 req-85eac30c-1c1a-4467-ac28-b5705d374f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272fa58d-2b9c-4732-bebc-0afc6fa526b1", "name": "network-vif-plugged", "status": "completed", "tag": "951b5852-3c9b-479b-81e0-e2e32b25789c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:09.743948 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-56ab7b7c-268d-4cb9-8825-07973184c694 req-85eac30c-1c1a-4467-ac28-b5705d374f74 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:09.744725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-56ab7b7c-268d-4cb9-8825-07973184c694 req-85eac30c-1c1a-4467-ac28-b5705d374f74 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:09.758058 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-56ab7b7c-268d-4cb9-8825-07973184c694 req-85eac30c-1c1a-4467-ac28-b5705d374f74 service nova] Creating event network-vif-plugged:951b5852-3c9b-479b-81e0-e2e32b25789c for instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 on n-h2-851337-5 Aug 04 05:04:09.788914 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-56ab7b7c-268d-4cb9-8825-07973184c694 req-85eac30c-1c1a-4467-ac28-b5705d374f74 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065469 Aug 04 05:04:09.789854 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3138/6168] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:10.334253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:10.334876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:10.342830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:10.356970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:10.363014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:10.363727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:10.365266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:10.365715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:10.545683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:10.554275 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34607b9b-9d14-4624-844e-dd167b58b525 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1390 microversion: 2.1 time: 0.224442 Aug 04 05:04:10.555499 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3031/6169] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:10 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:10.835878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a532f73-6377-4dda-9a79-62ccdef9dcc9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:10.838370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8a532f73-6377-4dda-9a79-62ccdef9dcc9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:10.853084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a532f73-6377-4dda-9a79-62ccdef9dcc9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:10.857518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a532f73-6377-4dda-9a79-62ccdef9dcc9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:10.858496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a532f73-6377-4dda-9a79-62ccdef9dcc9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:10.858983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a532f73-6377-4dda-9a79-62ccdef9dcc9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:10.919283 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8a532f73-6377-4dda-9a79-62ccdef9dcc9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088318 Aug 04 05:04:10.925549 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3139/6170] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:04:10 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:04:11.017920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:11.018616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:11.025758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.026455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:11.028082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.028917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:11.065068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:04:11.210374 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b606ca6-b825-4144-885d-5764f4c2d125 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 204 len: 0 microversion: 2.1 time: 0.196007 Aug 04 05:04:11.211742 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3032/6171] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:04:11 2022] DELETE /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:04:11.220402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:11.221346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:11.228329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.229057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:11.230021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.230635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:11.425079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:11.435325 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24c2606d-9e3f-47f8-9e73-fc8ccff88be9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1672 microversion: 2.1 time: 0.218898 Aug 04 05:04:11.436527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3140/6172] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:11 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:11.576515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:11.577253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:11.585402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.585858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:11.586705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.587453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:11.736619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:11.745485 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1596afb1-762d-4db9-bc6c-345cfa500efe tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1562 microversion: 2.1 time: 0.173228 Aug 04 05:04:11.746077 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3033/6173] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:11 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:11.766294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:11.766933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:11.790368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.790847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:11.793190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:11.796375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:12.048236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:12.058929 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17926783-5c40-4746-8672-b1ae83b19e9c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1562 microversion: 2.1 time: 0.296556 Aug 04 05:04:12.059850 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3141/6174] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:11 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1562 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:12.461719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:12.462382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:12.490708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:12.491234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:12.492382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:12.492842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:12.836427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:12.850663 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c6a0208d-881d-4d4e-a41a-1f6b334cd999 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1672 microversion: 2.1 time: 0.393872 Aug 04 05:04:12.854427 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3034/6175] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:12 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1672 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:13.885687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:13.886324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:13.906947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.907684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.908696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.909305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:14.343638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:14.353742 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3b94ebd3-7182-4c91-a654-dc4e9368c24b tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1672 microversion: 2.1 time: 0.471732 Aug 04 05:04:14.354921 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3142/6176] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:13 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1672 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:14.547480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:14.556198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c1f809a5-105c-4d91-aa83-aeb2e3a5beb2 req-9e9a09fc-2fd2-414b-bc35-f341d5fa8a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272fa58d-2b9c-4732-bebc-0afc6fa526b1", "tag": "951b5852-3c9b-479b-81e0-e2e32b25789c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:14.559931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:14.573122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:14.573574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:14.574359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:14.574797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:14.583604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c1f809a5-105c-4d91-aa83-aeb2e3a5beb2 req-9e9a09fc-2fd2-414b-bc35-f341d5fa8a09 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:14.584069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c1f809a5-105c-4d91-aa83-aeb2e3a5beb2 req-9e9a09fc-2fd2-414b-bc35-f341d5fa8a09 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:14.602124 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c1f809a5-105c-4d91-aa83-aeb2e3a5beb2 req-9e9a09fc-2fd2-414b-bc35-f341d5fa8a09 service nova] Creating event network-changed:951b5852-3c9b-479b-81e0-e2e32b25789c for instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 on n-h2-851337-5 Aug 04 05:04:14.618147 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c1f809a5-105c-4d91-aa83-aeb2e3a5beb2 req-9e9a09fc-2fd2-414b-bc35-f341d5fa8a09 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079682 Aug 04 05:04:14.619337 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3143/6177] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:15.035445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:15.060844 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e2169656-a6f9-4c94-ae17-70cb8102b1af tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1562 microversion: 2.1 time: 0.525713 Aug 04 05:04:15.069571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3035/6178] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:14 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1562 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:15.377056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:15.377786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:15.400894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:15.401371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:15.402190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:15.402645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:15.611972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:15.623265 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8215a774-2f5a-4751-a3da-f8eddf5c88c2 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1605 microversion: 2.1 time: 0.251221 Aug 04 05:04:15.624617 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3144/6179] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:15 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:16.651636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:16.652223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:16.660593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:16.661088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:16.662442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:16.662880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:16.797128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:16.834582 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dec6915e-a53d-4a7e-bff9-567d1d5af2ff tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 200 len: 1605 microversion: 2.1 time: 0.182702 Aug 04 05:04:16.840969 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3036/6180] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:16 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 1605 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:16.893610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f3d27206-e6bb-4572-a54a-5b1ac2c2a7a1 req-31f89476-8411-4f7c-ae40-79235af9d082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0693875a-57c5-4180-a006-46160ba75de5", "name": "network-vif-deleted", "tag": "8ff06d33-06eb-4e19-8005-e1f5e6279307"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:16.957759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f3d27206-e6bb-4572-a54a-5b1ac2c2a7a1 req-31f89476-8411-4f7c-ae40-79235af9d082 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:16.961546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f3d27206-e6bb-4572-a54a-5b1ac2c2a7a1 req-31f89476-8411-4f7c-ae40-79235af9d082 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:17.034534 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f3d27206-e6bb-4572-a54a-5b1ac2c2a7a1 req-31f89476-8411-4f7c-ae40-79235af9d082 service nova] Creating event network-vif-deleted:8ff06d33-06eb-4e19-8005-e1f5e6279307 for instance 0693875a-57c5-4180-a006-46160ba75de5 on n-h1-851337-5 Aug 04 05:04:17.063067 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f3d27206-e6bb-4572-a54a-5b1ac2c2a7a1 req-31f89476-8411-4f7c-ae40-79235af9d082 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174476 Aug 04 05:04:17.068721 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3145/6181] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:04:17.866450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:17.880574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:17.889850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:17.890571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:17.891568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:17.892194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:17.913131 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] HTTP exception thrown: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Request method failure captured: Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 HTTP/1.1 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61JDzTMVzdd-koDo05_eC1g_UcJiqZFdYoUgxNXOi_Uw1HkdVe0mbR_Zq2rj6Hxosz3dVHLxJ969cU8qRWdBphq2oZraBdf_uND87ihR5AUQNwjYoFp8v48UB7Lzt8c_0YkLHHUsvoJv3oTBsqRXR0VDgH0g1aKFQnULA8Y_uVs9PZc Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92a8935bd6624e6a832843d52384cf89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5adbe69f2bf94f02a0bbf0ea913481a4 Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0693875a-57c5-4180-a006-46160ba75de5'} Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:17.916515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:17.922186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:17.922186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:17.922186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:17.922186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:04:17.922186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:04:17.922186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:04:17.922186 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:04:17.924951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Returning 404 to user: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:17.925895 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc4ff784-60c0-4db6-8344-f78445f16d66 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 404 len: 111 microversion: 2.1 time: 0.065757 Aug 04 05:04:17.931427 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3037/6182] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:17 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:04:17.935806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-577785b1-4d3a-49a1-b7c0-f0c706e340c5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '.version_select at 0x7f19195feaf0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:17.985965 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-577785b1-4d3a-49a1-b7c0-f0c706e340c5 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830437874" status: 202 len: 0 microversion: 2.1 time: 0.054575 Aug 04 05:04:17.987219 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3146/6183] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 05:04:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830437874 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:04:19.728966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81a2bbfd-02dc-48da-a34d-8edc98501dfb tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'create', calling method: .version_select at 0x7f19189a8dc0>, body: {"keypair": {"name": "tempest-keypair-46826943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3f0YKCYmH26u7rRhUrP2P2cG5ltSbmteZ7KOLDoojhw+Ald3qvlaLDWK1j7WcwAmWBcmWv81LhTt3TSJhrnnG/2md9s8l0yFsqaem9mrWwZEXcRTpzAba1cL5rop4uA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:19.754091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-81a2bbfd-02dc-48da-a34d-8edc98501dfb tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for project 92a8935bd6624e6a832843d52384cf89. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:04:19.762540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-81a2bbfd-02dc-48da-a34d-8edc98501dfb tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for user 5adbe69f2bf94f02a0bbf0ea913481a4 and project 92a8935bd6624e6a832843d52384cf89. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:04:19.805940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81a2bbfd-02dc-48da-a34d-8edc98501dfb tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.082190 Aug 04 05:04:19.815705 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3038/6184] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:04:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:22.183318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-687122525", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd46842b-be85-491f-a3b3-166799a5ee38"}], "security_groups": [{"name": "tempest-securitygroup--1960397162"}], "key_name": "tempest-keypair-46826943", "user_data": "}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:22.395218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] validate_networks() for [('bd46842b-be85-491f-a3b3-166799a5ee38', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:04:23.001025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:04:23.001465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:04:23.001965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:04:23.002397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:04:23.002830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:04:23.032389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:23.032861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:23.033838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:23.034296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:23.082554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for project 92a8935bd6624e6a832843d52384cf89. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:04:23.093710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Getting quotas for user 5adbe69f2bf94f02a0bbf0ea913481a4 and project 92a8935bd6624e6a832843d52384cf89. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:04:23.111147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:04:23.113636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:04:23.166448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40c6fcd6-a88f-4a07-b73d-92911e5cdefa tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.988574 Aug 04 05:04:23.167685 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3147/6185] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:04:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:04:23.179883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7945e368-8509-4250-b3f7-5b57443c1752 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:23.181215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7945e368-8509-4250-b3f7-5b57443c1752 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:23.186002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:23.316206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7945e368-8509-4250-b3f7-5b57443c1752 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:23.341302 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7945e368-8509-4250-b3f7-5b57443c1752 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1235 microversion: 2.1 time: 0.166588 Aug 04 05:04:23.344441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3039/6186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:23 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1235 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:24.367018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:24.368357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:24.389755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:24.391412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:24.392881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:24.393961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:24.479180 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:24.488181 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7aae2f99-891a-44d7-96e2-43f1691a33c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1287 microversion: 2.1 time: 0.127080 Aug 04 05:04:24.503177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3148/6187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:24 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:25.512219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:25.513432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:25.534719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:25.535204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:25.536252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:25.537491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:25.935114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:25.943955 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f041005-8a1f-4c73-9f45-1d4766170ee9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1361 microversion: 2.1 time: 0.436292 Aug 04 05:04:25.944727 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3040/6188] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:25 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1361 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:26.479703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ced9aa6f-ecdb-470c-94c4-3c9178202d4d req-f523f4c3-fc6d-4d7f-b264-fffcac0ad2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce", "tag": "b18585d8-6b49-4912-ac12-6c7d63589abf"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:26.504206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ced9aa6f-ecdb-470c-94c4-3c9178202d4d req-f523f4c3-fc6d-4d7f-b264-fffcac0ad2b8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:26.506197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ced9aa6f-ecdb-470c-94c4-3c9178202d4d req-f523f4c3-fc6d-4d7f-b264-fffcac0ad2b8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:26.525704 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ced9aa6f-ecdb-470c-94c4-3c9178202d4d req-f523f4c3-fc6d-4d7f-b264-fffcac0ad2b8 service nova] Creating event network-changed:b18585d8-6b49-4912-ac12-6c7d63589abf for instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce on n-h1-851337-5 Aug 04 05:04:26.531167 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ced9aa6f-ecdb-470c-94c4-3c9178202d4d req-f523f4c3-fc6d-4d7f-b264-fffcac0ad2b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055439 Aug 04 05:04:26.532028 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3149/6189] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:26.970909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:26.971660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:26.990907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:26.991462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:26.992321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:26.992775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:27.164538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:27.172659 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd72453f-9d16-46e5-9791-9a6deb0f4587 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1361 microversion: 2.1 time: 0.206046 Aug 04 05:04:27.178284 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3041/6190] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:26 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:28.197662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:28.199874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:28.206927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:28.207411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:28.208201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:28.208650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:28.359296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:28.368181 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee42eab1-8bac-49a1-a219-7493e6cd59d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1361 microversion: 2.1 time: 0.175784 Aug 04 05:04:28.368724 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3150/6191] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:28 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:29.388949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:29.389566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:29.404111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:29.404597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:29.405577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:29.406093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:30.001854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:30.011080 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-34bc056d-4058-4049-bf52-d4f2a2a3b418 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1361 microversion: 2.1 time: 0.625805 Aug 04 05:04:30.015848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3042/6192] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:29 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1361 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:04:31.036063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:31.038079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:31.051270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:31.063724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:31.064832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:31.065455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:31.231280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:31.243064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d528288e-5eba-470d-aa3e-a66a4ff22320 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1361 microversion: 2.1 time: 0.210690 Aug 04 05:04:31.243777 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3151/6193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:31 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:32.276059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:32.277407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:32.284333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:32.284790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:32.285573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:32.286017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:32.451794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:32.459996 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4fd81fc-0e9d-4c8f-aec9-977d2a2b77f1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1361 microversion: 2.1 time: 0.188348 Aug 04 05:04:32.460596 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3043/6194] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:32 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:32.522828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-682a5198-9021-4a6e-9b24-30969f625154 req-2846af94-bc6b-431d-b1fb-e5c19b54ad4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce", "name": "network-vif-plugged", "status": "completed", "tag": "b18585d8-6b49-4912-ac12-6c7d63589abf"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:32.558945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-682a5198-9021-4a6e-9b24-30969f625154 req-2846af94-bc6b-431d-b1fb-e5c19b54ad4b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:32.560158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-682a5198-9021-4a6e-9b24-30969f625154 req-2846af94-bc6b-431d-b1fb-e5c19b54ad4b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:32.582442 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-682a5198-9021-4a6e-9b24-30969f625154 req-2846af94-bc6b-431d-b1fb-e5c19b54ad4b service nova] Creating event network-vif-plugged:b18585d8-6b49-4912-ac12-6c7d63589abf for instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce on n-h1-851337-5 Aug 04 05:04:32.587678 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-682a5198-9021-4a6e-9b24-30969f625154 req-2846af94-bc6b-431d-b1fb-e5c19b54ad4b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069830 Aug 04 05:04:32.588858 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3152/6195] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:04:33.480780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:33.481414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:33.484209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:33.490046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:33.490505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:33.491317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:33.491761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:33.634163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:33.646107 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b428903-bfaf-4adb-b819-a8a3c46dcf4f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1361 microversion: 2.1 time: 0.169144 Aug 04 05:04:33.659876 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3044/6196] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:33 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:34.663594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:34.664870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:34.670279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:34.671079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:34.672976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:34.680752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:34.681438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:34.682388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:34.682694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:34.686578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:34.820700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:34.828686 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dff9355f-6c9e-4a86-b1e9-9db08154e3af tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1548 microversion: 2.1 time: 0.166020 Aug 04 05:04:34.829282 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3153/6197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:34 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:34.848669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6a5c0c2-ca89-4367-8a90-9752b62d2e74 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:34.849908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6a5c0c2-ca89-4367-8a90-9752b62d2e74 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:34.857053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a5c0c2-ca89-4367-8a90-9752b62d2e74 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:34.857602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a5c0c2-ca89-4367-8a90-9752b62d2e74 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:34.858452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a5c0c2-ca89-4367-8a90-9752b62d2e74 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:34.858996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a5c0c2-ca89-4367-8a90-9752b62d2e74 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:34.956021 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6a5c0c2-ca89-4367-8a90-9752b62d2e74 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111116 Aug 04 05:04:34.956551 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3045/6198] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 05:04:34 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:35.798291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c4869dba-f3e0-4de0-8835-77144749347a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:35.801223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c4869dba-f3e0-4de0-8835-77144749347a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:35.809949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4869dba-f3e0-4de0-8835-77144749347a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:35.810419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4869dba-f3e0-4de0-8835-77144749347a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:35.811386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4869dba-f3e0-4de0-8835-77144749347a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:35.811847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c4869dba-f3e0-4de0-8835-77144749347a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:35.880214 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c4869dba-f3e0-4de0-8835-77144749347a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1/action" status: 200 len: 24567 microversion: 2.1 time: 0.086397 Aug 04 05:04:35.881762 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3154/6199] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:04:35 2022] POST /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1/action => generated 24567 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:04:35.964348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9b4ede2a-b5ca-4c5f-b37e-8e08daf1b90e req-d7e166a7-d6cf-4a15-ae95-69f889f9aeee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce", "tag": "b18585d8-6b49-4912-ac12-6c7d63589abf"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:35.977451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9b4ede2a-b5ca-4c5f-b37e-8e08daf1b90e req-d7e166a7-d6cf-4a15-ae95-69f889f9aeee service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:35.977823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9b4ede2a-b5ca-4c5f-b37e-8e08daf1b90e req-d7e166a7-d6cf-4a15-ae95-69f889f9aeee service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:35.990563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9b4ede2a-b5ca-4c5f-b37e-8e08daf1b90e req-d7e166a7-d6cf-4a15-ae95-69f889f9aeee service nova] Creating event network-changed:b18585d8-6b49-4912-ac12-6c7d63589abf for instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce on n-h1-851337-5 Aug 04 05:04:35.996372 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9b4ede2a-b5ca-4c5f-b37e-8e08daf1b90e req-d7e166a7-d6cf-4a15-ae95-69f889f9aeee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037682 Aug 04 05:04:35.997355 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3046/6200] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:38.883467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2fd5ff33-7153-4fc2-90f6-8c273e6618be tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Action: 'create', calling method: .version_select at 0x7f19194449d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-31748105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0wzHlxmy0GhG12xAmKDSO0Dnm0h/VVE0pYjUBzO5JNFPFzhgyHtLA9RBT6LhmPmmv5cHBg4Tm8CZ+zvYiatvwgiy8YtXDg94gJYbf24fy2fknvkyESU0EC3ENvxYwajw=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:38.901508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-2fd5ff33-7153-4fc2-90f6-8c273e6618be tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Getting quotas for project 7eda7e8089f84d5cb0b7bd86cc9df32c. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:04:38.907235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-2fd5ff33-7153-4fc2-90f6-8c273e6618be tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Getting quotas for user cd8593ffdffd4648b2260b5f81113671 and project 7eda7e8089f84d5cb0b7bd86cc9df32c. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:04:38.936683 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2fd5ff33-7153-4fc2-90f6-8c273e6618be tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.057913 Aug 04 05:04:38.937212 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3155/6201] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:04:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:40.050929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1357332605", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3d45c47b-ff2a-436b-9325-86c1575d0cfd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-31748105", "security_groups": [{"name": "tempest-secgroup-smoke-1018469989"}], "networks": [{"uuid": "3a389f92-fa40-4c57-bf22-c5121bcedc76"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:40.178997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] validate_networks() for [('3a389f92-fa40-4c57-bf22-c5121bcedc76', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:04:40.563261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:04:40.563697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:04:40.564181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:04:40.564597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:04:40.565038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:04:40.575207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:40.575674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:40.576530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:40.576981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:40.584165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:40.597300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Getting quotas for project 7eda7e8089f84d5cb0b7bd86cc9df32c. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:04:40.602726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Getting quotas for user cd8593ffdffd4648b2260b5f81113671 and project 7eda7e8089f84d5cb0b7bd86cc9df32c. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:04:40.666380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:04:40.668684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d45c47b-ff2a-436b-9325-86c1575d0cfd',volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:04:40.810976 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-07517141-e9bc-4f13-8ced-79e2baffd302 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764198 Aug 04 05:04:40.811728 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3047/6202] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:04:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:04:40.822835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d85bbb4-630f-444f-ba90-cb0c63360f9b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:40.823785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d85bbb4-630f-444f-ba90-cb0c63360f9b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:40.889481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d85bbb4-630f-444f-ba90-cb0c63360f9b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:40.899568 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d85bbb4-630f-444f-ba90-cb0c63360f9b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1097 microversion: 2.1 time: 0.080817 Aug 04 05:04:40.900273 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3156/6203] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:40 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1097 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:41.923019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:41.923671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:41.937740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:41.938207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:41.939045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:41.939497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:42.046104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:42.056531 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91ff3f6e-3880-42a6-84d7-82654d29d52c tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1203 microversion: 2.1 time: 0.138538 Aug 04 05:04:42.057486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3048/6204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:41 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1203 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:43.077846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:43.078401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:43.100521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:43.101773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:43.102758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:43.103405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:43.345558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:43.356806 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a2b16a3-350c-4a89-955e-f3744fd5a271 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1281 microversion: 2.1 time: 0.282585 Aug 04 05:04:43.372433 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3157/6205] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:43 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1281 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:43.592062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1b596465-add1-420b-8d56-5f677dd4530f req-d710a9be-7320-48e6-a338-fbdcfcce0ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba35d73-8eb8-4ea6-9925-522270c396b9", "tag": "80804caf-34eb-4662-aefd-23988ce8a90d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:43.616753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1b596465-add1-420b-8d56-5f677dd4530f req-d710a9be-7320-48e6-a338-fbdcfcce0ffd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:43.617781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1b596465-add1-420b-8d56-5f677dd4530f req-d710a9be-7320-48e6-a338-fbdcfcce0ffd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:43.638479 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1b596465-add1-420b-8d56-5f677dd4530f req-d710a9be-7320-48e6-a338-fbdcfcce0ffd service nova] Creating event network-changed:80804caf-34eb-4662-aefd-23988ce8a90d for instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 on n-h1-851337-5 Aug 04 05:04:43.648232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1b596465-add1-420b-8d56-5f677dd4530f req-d710a9be-7320-48e6-a338-fbdcfcce0ffd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059360 Aug 04 05:04:43.649590 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3049/6206] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:44.380366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:44.381004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:44.389589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:44.390067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:44.396456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:44.396927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:44.661089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:44.672186 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01d9cb67-e30a-41ad-8725-4aa710561b04 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1281 microversion: 2.1 time: 0.295541 Aug 04 05:04:44.672898 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3158/6207] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:44 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:45.695554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:45.696313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:45.703303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:45.703762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:45.704649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:45.705100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:45.879765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:45.892722 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-500036a4-e7ab-456d-9021-911f001d4b90 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1281 microversion: 2.1 time: 0.202481 Aug 04 05:04:45.893573 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3050/6208] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:45 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1281 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:46.856882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:46.860869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:46.869904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:46.870371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:46.871236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:46.871698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:46.916212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:46.918316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:46.927187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:46.927744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:46.929607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:46.930085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:46.971211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:04:46.971667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:04:46.972170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:04:46.972608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:04:46.973055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:04:47.072972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:47.081057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:47.081652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:47.082490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:47.082945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:47.119302 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2bf99677-9e38-4458-af04-b07ce0c8b98c tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1/action" status: 202 len: 1135 microversion: 2.1 time: 0.266963 Aug 04 05:04:47.131095 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3159/6209] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:04:46 2022] POST /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1/action => generated 1135 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 05:04:47.143536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:47.144173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:47.152813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:47.153700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:47.154069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:47.154522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:47.177056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:47.192452 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c35bedc-8e5b-4152-870b-d21954b3ecba tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1281 microversion: 2.1 time: 0.276852 Aug 04 05:04:47.203558 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3051/6210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:46 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1281 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:47.367584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:47.388117 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6fd36ebf-a551-4e6f-83b2-69e66a7206f6 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.250277 Aug 04 05:04:47.389094 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3160/6211] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:47 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:04:48.216644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:48.217281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:48.224225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:48.224676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:48.225437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:48.225891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:48.361678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:48.369396 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a20e0b9-599b-408f-a82e-b6ec10738ff1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.156626 Aug 04 05:04:48.369966 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3052/6212] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:48 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:48.409871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:48.410508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:48.417559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:48.418010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:48.418804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:48.419339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:48.560933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:48.577244 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3484ed3-29a3-4bd9-aa7c-a8cf5a4aaa8b tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.171086 Aug 04 05:04:48.577926 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3161/6213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:48 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:49.390536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:49.391236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:49.398597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:49.399084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:49.400059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:49.400497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:49.536038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:49.543868 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93f7a26b-d672-4e01-9958-5d2b8000441b tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.157367 Aug 04 05:04:49.544649 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3053/6214] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:49 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:49.598830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:49.599494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:49.606934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:49.607441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:49.608239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:49.608695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:49.756154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:49.763967 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5d4579d4-d41a-428a-ae74-dcef31192f67 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.169019 Aug 04 05:04:49.764517 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3162/6215] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:49 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:50.565590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:50.566252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:50.574449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:50.574904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:50.575719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:50.576164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:50.595385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:50.611449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:50.716024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:50.724225 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa27444e-0853-4d72-a2c0-bea9e6cf6093 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.162608 Aug 04 05:04:50.737473 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3054/6216] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:50 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:50.787715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:50.788451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:50.795930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:50.796399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:50.797194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:50.797650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:50.895573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:51.249431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:51.258335 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-199204e0-0010-420a-bca4-7e0c5060e423 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.474641 Aug 04 05:04:51.259050 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3163/6217] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:50 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:51.745533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:51.746155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:51.753282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:51.753736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:51.754510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:51.754962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:51.906792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:51.920294 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0aaf5f4d-d74f-43f2-b735-b0bc7a835d37 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.178204 Aug 04 05:04:51.921861 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3055/6218] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:51 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:52.280672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:52.281200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:52.289262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:52.289725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:52.290736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:52.291217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:52.441627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:52.449513 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b650c7f5-6e88-448c-b7ce-8f711f7eecbf tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.173006 Aug 04 05:04:52.450305 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3164/6219] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:52 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:52.942079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:52.942697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:52.950348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:52.950818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:52.951655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:52.952102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:53.119352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:53.127186 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ddb73ea5-1ab3-4918-b3dd-094a3983b3c7 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.189103 Aug 04 05:04:53.127829 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3056/6220] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:52 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:53.471489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:53.472236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:53.479845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:53.480388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:53.481250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:53.481778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:53.627384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:53.636397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a8025a7e-2057-457a-b8c4-d57746fc34e5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.168869 Aug 04 05:04:53.637319 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3165/6221] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:53 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:54.148782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:54.149407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:54.152208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:54.157680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:54.158531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:54.159313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:54.159752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:54.302868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:54.310893 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ac1ef7f-5ed7-4fbc-b683-bf7cffe618b1 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.166295 Aug 04 05:04:54.311502 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3057/6222] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:54 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:54.658076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:54.658812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:54.666788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:54.667370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:54.668228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:54.668930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:54.811643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:54.821913 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8117476c-0ea5-431c-b436-d3e582a22681 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.167912 Aug 04 05:04:54.822521 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3166/6223] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:54 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:55.333739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:55.334329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:55.342485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:55.342937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:55.343927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:55.344517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:55.503961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:55.512736 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5607ef8-a1b6-4e33-8665-cf2e3c41f8b0 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.183564 Aug 04 05:04:55.513721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3058/6224] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:55 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:04:55.847537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:55.848867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:55.858543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:55.860185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:55.861056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:55.862029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:56.023561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:56.031190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-262513a7-068d-4a0a-9e85-765b2d6751bb tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.190470 Aug 04 05:04:56.032021 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3167/6225] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:55 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:56.534652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:56.535665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:56.542744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:56.543306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:56.544159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:56.544663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:56.691860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:56.700483 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1c55383-28eb-43a0-8721-36678a0f8a89 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.170222 Aug 04 05:04:56.701441 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3059/6226] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:56 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:57.055587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:57.057053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:57.064568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:57.065034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:57.065837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:57.066288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:57.309624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:57.317608 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ededbd30-ecb1-4ee2-acac-7c84fac43b09 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.267584 Aug 04 05:04:57.318372 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3168/6227] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:57 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:57.721638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:57.722276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:57.730124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:57.730618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:57.731419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:57.731920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:57.908951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:57.918169 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-504bebf8-2b78-4f11-87a5-2ea286d709dc tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.200284 Aug 04 05:04:57.918783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3060/6228] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:57 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:58.339375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:58.339928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:58.347015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:58.347488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:58.348289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:58.348744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:58.488394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:58.497105 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0c7a2b0-3d63-41b6-935c-7de413a170c5 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.161709 Aug 04 05:04:58.499053 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3169/6229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:58 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:58.596890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-83db16ae-09bf-416a-a7b0-2c8806ea23ed req-9b1367b4-a830-4d39-9453-005f171430a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba35d73-8eb8-4ea6-9925-522270c396b9", "name": "network-vif-plugged", "status": "completed", "tag": "80804caf-34eb-4662-aefd-23988ce8a90d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:58.606216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-83db16ae-09bf-416a-a7b0-2c8806ea23ed req-9b1367b4-a830-4d39-9453-005f171430a1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:58.606657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-83db16ae-09bf-416a-a7b0-2c8806ea23ed req-9b1367b4-a830-4d39-9453-005f171430a1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:58.622354 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-83db16ae-09bf-416a-a7b0-2c8806ea23ed req-9b1367b4-a830-4d39-9453-005f171430a1 service nova] Creating event network-vif-plugged:80804caf-34eb-4662-aefd-23988ce8a90d for instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 on n-h1-851337-5 Aug 04 05:04:58.628758 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-83db16ae-09bf-416a-a7b0-2c8806ea23ed req-9b1367b4-a830-4d39-9453-005f171430a1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Aug 04 05:04:58.630133 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3061/6230] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:58.938326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:58.938980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:58.945658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:58.946121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:58.946904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:58.947381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:58.950109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:59.091391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:59.109314 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3010c217-283c-46fb-bf38-cd78faf1fdd5 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.174562 Aug 04 05:04:59.109645 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3170/6231] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:58 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:59.520677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:59.521288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:59.527600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:59.528049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:59.528811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:59.529244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:59.665305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:04:59.672965 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ba77a17a-11e6-4084-ad00-5b41f3cfe2f7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.157469 Aug 04 05:04:59.673544 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3062/6232] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:59 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:04:59.831486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:59.832039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:59.839666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:59.840165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:59.840952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:59.841398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:59.871051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:04:59.958871 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f21f425a-1b3a-47ba-8bb3-833368436539 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 204 len: 0 microversion: 2.1 time: 0.130022 Aug 04 05:04:59.960763 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3171/6233] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:04:59 2022] DELETE /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:04:59.969497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:59.970253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:59.977223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:59.977725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:59.978500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:59.979149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:00.120092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:00.128190 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-841d50e0-0d6e-49ba-bddc-799b708bc492 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1577 microversion: 2.1 time: 0.162711 Aug 04 05:05:00.139057 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3063/6234] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:59 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:00.139291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:00.139291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:00.139291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:00.139657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:00.140723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:00.141409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:00.302824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:00.312319 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-51745122-909d-4039-9408-064269027344 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1269 microversion: 2.1 time: 0.184930 Aug 04 05:05:00.313593 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3172/6235] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:00 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:00.695945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:00.696493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:00.703441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:00.703897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:00.704690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:00.705127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:00.842900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:00.850461 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-192243d5-3da7-4abe-926c-c71610d66eaa tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.159235 Aug 04 05:05:00.851155 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3064/6236] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:00 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:01.151045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:01.151588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:01.158526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.158984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:01.159766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.160215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:01.303465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:01.312578 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a0906ebb-a551-4162-bb9c-90f78582a3f0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1577 microversion: 2.1 time: 0.165454 Aug 04 05:05:01.313264 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3173/6237] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:01 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:01.334548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:01.335875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:01.342470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.342934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:01.343767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.344365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:01.516551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:01.522624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:01.525650 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50d2bff8-6b42-486d-8434-9bfde0993713 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1459 microversion: 2.1 time: 0.195117 Aug 04 05:05:01.526244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3065/6238] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:01 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1459 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:01.546157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:01.546791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:01.552942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.553412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:01.554917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.555404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:01.791526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:01.800138 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37e736d0-545d-4d64-bd7a-66d8f8c4fbec tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1459 microversion: 2.1 time: 0.257781 Aug 04 05:05:01.800876 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3174/6239] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:01 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1459 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:01.873877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:01.874484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:01.881840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.882599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:01.883582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:01.884015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:02.159372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:02.174697 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f556174-ebdd-43da-987e-b353abbe78f4 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.304963 Aug 04 05:05:02.183968 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3066/6240] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:01 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:02.334068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:02.335946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:02.343772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:02.344524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:02.345588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:02.346257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:02.453227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:02.468019 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23a612c1-d3a6-447b-aeb7-c8dfc47fcca9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1510 microversion: 2.1 time: 0.138134 Aug 04 05:05:02.469392 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3175/6241] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:02 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1510 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:02.714854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a1e7c77a-0c94-43d2-8f7c-1ed6f9bc2fb1 req-0e0ce039-361e-4b78-b4b2-26fad7a3712a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1", "name": "network-vif-deleted", "tag": "03b7583b-80b3-42bb-b803-016872ae27ce"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:02.725072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a1e7c77a-0c94-43d2-8f7c-1ed6f9bc2fb1 req-0e0ce039-361e-4b78-b4b2-26fad7a3712a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:02.726321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a1e7c77a-0c94-43d2-8f7c-1ed6f9bc2fb1 req-0e0ce039-361e-4b78-b4b2-26fad7a3712a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:02.742463 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a1e7c77a-0c94-43d2-8f7c-1ed6f9bc2fb1 req-0e0ce039-361e-4b78-b4b2-26fad7a3712a service nova] Creating event network-vif-deleted:03b7583b-80b3-42bb-b803-016872ae27ce for instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 on n-h2-851337-5 Aug 04 05:05:02.748183 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a1e7c77a-0c94-43d2-8f7c-1ed6f9bc2fb1 req-0e0ce039-361e-4b78-b4b2-26fad7a3712a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036959 Aug 04 05:05:02.749088 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3067/6242] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:03.199067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:03.200241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:03.208001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:03.208784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:03.209869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:03.211348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:03.409736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:03.429274 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dfc40c5b-98cf-4513-aba0-241621a0b842 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1689 microversion: 2.1 time: 0.234615 Aug 04 05:05:03.430500 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3176/6243] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:03 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:03.491579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:03.492487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:03.499332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:03.499793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:03.500581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:03.501200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:03.589190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:03.598562 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-516ca182-e00d-4355-af13-85ade4bd3b7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1510 microversion: 2.1 time: 0.112411 Aug 04 05:05:03.599433 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3068/6244] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:03 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1510 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:04.066262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-cf25c0f0-a023-42e9-a70b-1d5d67c3b5c0 req-30a13831-aa8d-4c5d-b13e-811459685870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba35d73-8eb8-4ea6-9925-522270c396b9", "tag": "80804caf-34eb-4662-aefd-23988ce8a90d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:04.099481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cf25c0f0-a023-42e9-a70b-1d5d67c3b5c0 req-30a13831-aa8d-4c5d-b13e-811459685870 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:04.101611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cf25c0f0-a023-42e9-a70b-1d5d67c3b5c0 req-30a13831-aa8d-4c5d-b13e-811459685870 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:04.138219 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-cf25c0f0-a023-42e9-a70b-1d5d67c3b5c0 req-30a13831-aa8d-4c5d-b13e-811459685870 service nova] Creating event network-changed:80804caf-34eb-4662-aefd-23988ce8a90d for instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 on n-h1-851337-5 Aug 04 05:05:04.145705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-cf25c0f0-a023-42e9-a70b-1d5d67c3b5c0 req-30a13831-aa8d-4c5d-b13e-811459685870 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082067 Aug 04 05:05:04.151475 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3177/6245] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:04.451355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:04.452252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:04.463484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:04.464140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:04.465101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:04.475706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:04.623968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:04.625537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:04.646988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:04.651867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:04.653236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:04.653971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:04.834663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:04.845065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c7d115ea-a401-412d-8571-594ab94be2b5 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1225 microversion: 2.1 time: 0.228171 Aug 04 05:05:04.848690 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3178/6246] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:04 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1225 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:04.873967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:04.882173 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a860a439-0cb1-4688-a998-ccbcdad8cf10 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1695 microversion: 2.1 time: 0.434523 Aug 04 05:05:04.902551 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3069/6247] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:04 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1695 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:05.871843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:05.874701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:05.889112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:05.899133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:05.899871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:05.905108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:05.909027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:05.910328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:05.911723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:05.930227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:05.931062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:05.934167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:05.936105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:06.098333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:06.124472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a308000d-5f1d-4710-a5a2-ab99e4075e81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1225 microversion: 2.1 time: 0.243010 Aug 04 05:05:06.143163 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3179/6248] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:05 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1225 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:06.365606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:06.389367 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b12aa4bb-f56c-4122-8e32-80c6733d30ad tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1695 microversion: 2.1 time: 0.481143 Aug 04 05:05:06.414819 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3070/6249] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:05 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1695 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:06.458142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2cc4693f-1a2b-4e4f-8bed-d3510ecdfc7d req-41636838-af79-4835-b034-b1014155edc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba35d73-8eb8-4ea6-9925-522270c396b9", "tag": "80804caf-34eb-4662-aefd-23988ce8a90d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:06.478619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2cc4693f-1a2b-4e4f-8bed-d3510ecdfc7d req-41636838-af79-4835-b034-b1014155edc7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:06.479469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2cc4693f-1a2b-4e4f-8bed-d3510ecdfc7d req-41636838-af79-4835-b034-b1014155edc7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:06.504155 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2cc4693f-1a2b-4e4f-8bed-d3510ecdfc7d req-41636838-af79-4835-b034-b1014155edc7 service nova] Creating event network-changed:80804caf-34eb-4662-aefd-23988ce8a90d for instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 on n-h1-851337-5 Aug 04 05:05:06.512752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2cc4693f-1a2b-4e4f-8bed-d3510ecdfc7d req-41636838-af79-4835-b034-b1014155edc7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059063 Aug 04 05:05:06.520267 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3180/6250] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:07.154018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:07.154785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:07.162051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:07.162866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:07.164604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:07.165261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:07.257037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:07.266873 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0254928a-b8a9-47ec-968c-ab5910fd73c1 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1225 microversion: 2.1 time: 0.116682 Aug 04 05:05:07.267795 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3071/6251] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:07 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:07.420903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:07.421630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:07.433774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:07.434281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:07.439584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:07.440585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:07.666251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:07.681715 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-266203ec-d02b-458b-8f77-6019e9cfd893 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1680 microversion: 2.1 time: 0.265294 Aug 04 05:05:07.683578 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3181/6252] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:07 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1680 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:08.086144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-158d6c4b-6a11-4f81-b34d-550ee8990fa5 req-58de279d-082f-4b20-b341-b3dd37718012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272fa58d-2b9c-4732-bebc-0afc6fa526b1", "name": "network-vif-plugged", "status": "completed", "tag": "951b5852-3c9b-479b-81e0-e2e32b25789c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:08.127380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-158d6c4b-6a11-4f81-b34d-550ee8990fa5 req-58de279d-082f-4b20-b341-b3dd37718012 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:08.128744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-158d6c4b-6a11-4f81-b34d-550ee8990fa5 req-58de279d-082f-4b20-b341-b3dd37718012 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:08.152683 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-158d6c4b-6a11-4f81-b34d-550ee8990fa5 req-58de279d-082f-4b20-b341-b3dd37718012 service nova] Creating event network-vif-plugged:951b5852-3c9b-479b-81e0-e2e32b25789c for instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 on n-h2-851337-5 Aug 04 05:05:08.158256 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-158d6c4b-6a11-4f81-b34d-550ee8990fa5 req-58de279d-082f-4b20-b341-b3dd37718012 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079009 Aug 04 05:05:08.159555 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3072/6253] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:08.289504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:08.290305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:08.297303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:08.298085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:08.299179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:08.299893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:08.366394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:08.375174 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ca1714e5-e01f-4c72-8618-406a6dbfe113 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1225 microversion: 2.1 time: 0.090361 Aug 04 05:05:08.388523 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3182/6254] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:08 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:08.544100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5b8a52d7-8f1b-4f11-bf5e-184100b8cef9 req-4db4f4ad-aea2-42bd-98cb-4dc64327c7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba35d73-8eb8-4ea6-9925-522270c396b9", "tag": "80804caf-34eb-4662-aefd-23988ce8a90d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:08.557196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5b8a52d7-8f1b-4f11-bf5e-184100b8cef9 req-4db4f4ad-aea2-42bd-98cb-4dc64327c7f3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:08.557860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5b8a52d7-8f1b-4f11-bf5e-184100b8cef9 req-4db4f4ad-aea2-42bd-98cb-4dc64327c7f3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:08.570046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5b8a52d7-8f1b-4f11-bf5e-184100b8cef9 req-4db4f4ad-aea2-42bd-98cb-4dc64327c7f3 service nova] Creating event network-changed:80804caf-34eb-4662-aefd-23988ce8a90d for instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 on n-h1-851337-5 Aug 04 05:05:08.580548 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5b8a52d7-8f1b-4f11-bf5e-184100b8cef9 req-4db4f4ad-aea2-42bd-98cb-4dc64327c7f3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040812 Aug 04 05:05:08.581684 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3073/6255] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:09.398071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:09.401250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:09.417282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:09.417751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:09.418543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:09.419021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:09.509128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:09.517385 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae7b14b4-7815-4318-8390-9992b54a3dc2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 200 len: 1225 microversion: 2.1 time: 0.123767 Aug 04 05:05:09.532019 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3183/6256] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:09 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:10.542846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:10.543887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:10.550892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:10.551483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:10.552388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:10.552973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:10.567473 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 HTTP/1.1 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1'} Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:05:10.569145 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-facdacf8-65c6-4100-9aa5-e5195b797f73 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 404 len: 111 microversion: 2.1 time: 0.035233 Aug 04 05:05:10.573656 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3074/6257] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:10 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:05:10.676883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1325801949", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-328461503", "security_groups": [{"name": "tempest-secgroup-smoke-880733176"}], "block_device_mapping_v2": [{"uuid": "8dcae657-4a8e-4497-b250-329a38c0b603", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:10.807839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:05:11.231050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:05:11.231532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:05:11.232030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:05:11.232462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:05:11.232890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:05:11.244341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:11.244341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:11.245233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:11.245694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:11.264438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:05:11.270135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:05:11.333011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:05:11.335558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dcae657-4a8e-4497-b250-329a38c0b603',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:05:11.482282 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f97350dc-917a-4f52-a7e6-c926fde44a56 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809113 Aug 04 05:05:11.488896 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3184/6258] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:05:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:05:11.495566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b42d3175-bd8d-431c-84f3-9f9ba6444cdf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:11.496672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b42d3175-bd8d-431c-84f3-9f9ba6444cdf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:11.566154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b42d3175-bd8d-431c-84f3-9f9ba6444cdf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:11.575894 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b42d3175-bd8d-431c-84f3-9f9ba6444cdf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1094 microversion: 2.1 time: 0.084736 Aug 04 05:05:11.576477 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3075/6259] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:11 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:12.598427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:12.599029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:12.608348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:12.608933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:12.609796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:12.610322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:12.723934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:12.732234 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d424c130-a7a0-4182-bb30-dd7be930fb7e tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1200 microversion: 2.1 time: 0.137745 Aug 04 05:05:12.732741 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3185/6260] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:12 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1200 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:13.755550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:13.758329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:13.776422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:13.777302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:13.780081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:13.782123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:14.042143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:14.062575 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-93564dac-3c72-4f2d-ba4c-854e1217f0df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1277 microversion: 2.1 time: 0.312515 Aug 04 05:05:14.063553 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3076/6261] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:13 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:14.510243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3957666b-b21d-4aa4-8875-9071b9f5eec3 req-edcf7162-8555-4b66-abee-7603211fd51f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4034aee-c0bd-424f-b0b2-6492cad5cc1e", "tag": "426f6023-0061-4ea0-aa0c-67eceef05ebe"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:14.533761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3957666b-b21d-4aa4-8875-9071b9f5eec3 req-edcf7162-8555-4b66-abee-7603211fd51f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:14.536558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3957666b-b21d-4aa4-8875-9071b9f5eec3 req-edcf7162-8555-4b66-abee-7603211fd51f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:14.548735 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3957666b-b21d-4aa4-8875-9071b9f5eec3 req-edcf7162-8555-4b66-abee-7603211fd51f service nova] Creating event network-changed:426f6023-0061-4ea0-aa0c-67eceef05ebe for instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e on n-h2-851337-5 Aug 04 05:05:14.556081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3957666b-b21d-4aa4-8875-9071b9f5eec3 req-edcf7162-8555-4b66-abee-7603211fd51f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052818 Aug 04 05:05:14.557267 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3186/6262] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:15.084966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:15.085730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:15.094170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:15.094975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:15.096024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:15.096690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:15.342343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:15.351984 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d0c872ce-fa74-4be4-b6df-15a286a01f8b tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1277 microversion: 2.1 time: 0.270597 Aug 04 05:05:15.352680 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3077/6263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:15 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:16.373618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:16.374339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:16.381071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:16.381538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:16.382334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:16.382792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:16.525406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:16.527827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:16.535328 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f07b4a83-ad8c-4339-b4d6-09b8ada426a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1277 microversion: 2.1 time: 0.166864 Aug 04 05:05:16.535924 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3187/6264] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:16 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:17.556793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:17.557415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:17.564551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:17.565010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:17.565800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:17.566248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:17.720405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:17.729422 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aeb98c46-f19e-4760-9b5c-d3a391ac8a99 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1277 microversion: 2.1 time: 0.177201 Aug 04 05:05:17.730276 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3078/6265] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:17 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:18.752713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:18.753361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:18.761751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:18.762221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:18.763065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:18.763526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:18.902229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:18.910109 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8cecf366-54ed-470f-9e7c-816777ec78a6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1277 microversion: 2.1 time: 0.162660 Aug 04 05:05:18.910737 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3188/6266] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:18 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:19.934290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:19.934935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:19.941949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:19.942399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:19.943206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:19.943665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:20.085958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:20.093868 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aa26119d-e530-431e-b4ca-c1dd6aca71e6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.163480 Aug 04 05:05:20.094456 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3079/6267] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:19 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:21.118114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:21.118870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:21.125498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:21.125969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:21.126767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:21.127337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:21.253684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:21.269918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:21.278028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:21.281086 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8abf6c7-8960-4272-b03a-076ff3c4869c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.170067 Aug 04 05:05:21.291470 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3189/6268] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:21 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:22.306625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:22.307308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:22.310234 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:22.316135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:22.316583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:22.317388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:22.317852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:22.464383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:22.472347 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-de769454-49d3-4846-b09f-b4c653d711ed tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.170259 Aug 04 05:05:22.472942 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3080/6269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:22 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:23.494192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:23.494828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:23.507044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:23.508062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:23.508853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:23.509348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:23.653637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:23.662188 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2623c98f-c24d-43f2-ace0-6a97b09d2f83 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.172320 Aug 04 05:05:23.663025 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3190/6270] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:23 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:24.684813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:24.685650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:24.688575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=50 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.695529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:24.696178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:24.697015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:24.697497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:24.861216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:24.872756 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f74ce337-dce4-41c7-8739-73543198c200 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.190070 Aug 04 05:05:24.874497 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3081/6271] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:24 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:25.897234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:25.898145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:25.904464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:25.904935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:25.905742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:25.906264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:26.064027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:26.071670 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-34dea8dc-8466-4445-8902-04e353194382 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.179547 Aug 04 05:05:26.072243 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3191/6272] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:25 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:27.092648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:27.093270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:27.099940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:27.100396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:27.101238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:27.101683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:27.350054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:27.361559 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-925bfec6-b961-4819-81e1-83f03f8b1324 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.272952 Aug 04 05:05:27.375204 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3082/6273] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:27 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:28.384088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:28.384960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:28.392186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:28.392756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:28.393544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:28.393995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:28.562068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:28.571929 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f9b8c27f-0304-43c8-9f8c-8830e9477518 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.192325 Aug 04 05:05:28.572521 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3192/6274] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:28 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:29.594328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:29.594969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:29.602141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:29.602610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:29.603405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:29.603846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:29.751032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:29.760458 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a290e101-49d1-4616-a60d-ea6de3f85b11 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.170097 Aug 04 05:05:29.761135 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3083/6275] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:29 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:29.971967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63673696-6013-4b64-92d5-9bbe7b2eab69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:29.973962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63673696-6013-4b64-92d5-9bbe7b2eab69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:29.982758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63673696-6013-4b64-92d5-9bbe7b2eab69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:29.983253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63673696-6013-4b64-92d5-9bbe7b2eab69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:29.984064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63673696-6013-4b64-92d5-9bbe7b2eab69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:29.984524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63673696-6013-4b64-92d5-9bbe7b2eab69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:30.040110 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63673696-6013-4b64-92d5-9bbe7b2eab69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "POST /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1/action" status: 200 len: 24564 microversion: 2.1 time: 0.072002 Aug 04 05:05:30.041019 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3193/6276] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:05:29 2022] POST /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1/action => generated 24564 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:05:30.258395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-801a02c8-bc78-41ca-a5be-878d10f80424 req-4ccb07f5-6b2e-4943-b901-52321c68dffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4034aee-c0bd-424f-b0b2-6492cad5cc1e", "name": "network-vif-plugged", "status": "completed", "tag": "426f6023-0061-4ea0-aa0c-67eceef05ebe"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:30.268009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-801a02c8-bc78-41ca-a5be-878d10f80424 req-4ccb07f5-6b2e-4943-b901-52321c68dffe service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:30.268452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-801a02c8-bc78-41ca-a5be-878d10f80424 req-4ccb07f5-6b2e-4943-b901-52321c68dffe service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:30.280252 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-801a02c8-bc78-41ca-a5be-878d10f80424 req-4ccb07f5-6b2e-4943-b901-52321c68dffe service nova] Creating event network-vif-plugged:426f6023-0061-4ea0-aa0c-67eceef05ebe for instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e on n-h2-851337-5 Aug 04 05:05:30.300216 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-801a02c8-bc78-41ca-a5be-878d10f80424 req-4ccb07f5-6b2e-4943-b901-52321c68dffe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198496 Aug 04 05:05:30.300866 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3084/6277] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:30.782371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:30.783124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:30.790653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:30.791162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:30.792033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:30.792493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:30.932097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:30.939653 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b55a7894-9127-418a-a520-963fde77f1b8 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1265 microversion: 2.1 time: 0.161633 Aug 04 05:05:30.940227 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3194/6278] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:30 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:31.962622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:31.963354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:31.969851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:31.970302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:31.971100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:31.971540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:31.974178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=90 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:32.115215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:32.124722 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e53bc990-2bdd-4031-ad09-2a7b6a45b800 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1452 microversion: 2.1 time: 0.167802 Aug 04 05:05:32.125336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3085/6279] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:31 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:32.150329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:32.150979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:32.161693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:32.162246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:32.163194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:32.163756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:32.298097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:32.306084 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d98beef3-e75e-4381-bf45-b18e784da083 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1452 microversion: 2.1 time: 0.159490 Aug 04 05:05:32.307770 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3195/6280] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:32 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:34.053279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a5e4248c-fd3c-4023-8ded-42752b915622 req-f82a16c9-2deb-4190-aa8a-ab11ae5196c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4034aee-c0bd-424f-b0b2-6492cad5cc1e", "tag": "426f6023-0061-4ea0-aa0c-67eceef05ebe"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:34.064894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a5e4248c-fd3c-4023-8ded-42752b915622 req-f82a16c9-2deb-4190-aa8a-ab11ae5196c1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:34.065593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a5e4248c-fd3c-4023-8ded-42752b915622 req-f82a16c9-2deb-4190-aa8a-ab11ae5196c1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:34.078395 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a5e4248c-fd3c-4023-8ded-42752b915622 req-f82a16c9-2deb-4190-aa8a-ab11ae5196c1 service nova] Creating event network-changed:426f6023-0061-4ea0-aa0c-67eceef05ebe for instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e on n-h2-851337-5 Aug 04 05:05:34.083868 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a5e4248c-fd3c-4023-8ded-42752b915622 req-f82a16c9-2deb-4190-aa8a-ab11ae5196c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034183 Aug 04 05:05:34.084814 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3086/6281] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:38.454394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:38.455683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:38.463119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9592e84f-55ad-418e-ac8b-7b73ac10cef7 req-cc417e06-6c2a-4e7b-ad68-7fd0b69d6b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba35d73-8eb8-4ea6-9925-522270c396b9", "tag": "80804caf-34eb-4662-aefd-23988ce8a90d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:38.474476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9592e84f-55ad-418e-ac8b-7b73ac10cef7 req-cc417e06-6c2a-4e7b-ad68-7fd0b69d6b89 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:38.475195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9592e84f-55ad-418e-ac8b-7b73ac10cef7 req-cc417e06-6c2a-4e7b-ad68-7fd0b69d6b89 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:38.496538 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9592e84f-55ad-418e-ac8b-7b73ac10cef7 req-cc417e06-6c2a-4e7b-ad68-7fd0b69d6b89 service nova] Creating event network-changed:80804caf-34eb-4662-aefd-23988ce8a90d for instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 on n-h1-851337-5 Aug 04 05:05:38.504985 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9592e84f-55ad-418e-ac8b-7b73ac10cef7 req-cc417e06-6c2a-4e7b-ad68-7fd0b69d6b89 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052222 Aug 04 05:05:38.506143 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3087/6282] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:38.515070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:38.531384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:38.532238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:38.533299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:38.533844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:38.565075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:05:38.721304 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7431b70a-99be-4e6e-89e4-d2debd2fec35 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 204 len: 0 microversion: 2.1 time: 0.271472 Aug 04 05:05:38.722431 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3196/6283] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:05:38 2022] DELETE /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:38.732901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:38.733905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:38.741586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:38.743895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:38.745590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:38.746506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:38.939238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:38.949678 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8909997d-141b-4d5b-acd7-274f93e16afa tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1584 microversion: 2.1 time: 0.222229 Aug 04 05:05:38.950654 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3088/6284] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:38 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1584 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:39.973926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:39.974643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:39.981566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:39.982030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:39.982813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:39.983290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:40.165922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:40.177824 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a4ff082-133c-49c6-8818-0f09fd1cb7a2 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1584 microversion: 2.1 time: 0.208153 Aug 04 05:05:40.178429 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3197/6285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:39 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1584 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:41.199900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:41.200723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:41.207694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:41.208447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:41.209534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:41.210081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:41.298007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:41.308402 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d279579e-39e5-4f45-b163-baa45e45a033 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1397 microversion: 2.1 time: 0.113027 Aug 04 05:05:41.310175 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3089/6286] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:41 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1397 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:41.364445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3a6a5715-6bde-4331-9c32-b2dc4604aa1c req-4511c841-df34-4492-aa30-b815fd9906d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba35d73-8eb8-4ea6-9925-522270c396b9", "name": "network-vif-deleted", "tag": "80804caf-34eb-4662-aefd-23988ce8a90d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:41.378652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3a6a5715-6bde-4331-9c32-b2dc4604aa1c req-4511c841-df34-4492-aa30-b815fd9906d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:41.379447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3a6a5715-6bde-4331-9c32-b2dc4604aa1c req-4511c841-df34-4492-aa30-b815fd9906d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:41.399364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3a6a5715-6bde-4331-9c32-b2dc4604aa1c req-4511c841-df34-4492-aa30-b815fd9906d5 service nova] Creating event network-vif-deleted:80804caf-34eb-4662-aefd-23988ce8a90d for instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 on n-h1-851337-5 Aug 04 05:05:41.405313 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3a6a5715-6bde-4331-9c32-b2dc4604aa1c req-4511c841-df34-4492-aa30-b815fd9906d5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044656 Aug 04 05:05:41.406180 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3198/6287] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:42.171041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-19aecde7-97a4-48f7-b522-f49071e4ab2b req-4e888ecc-9ce5-46b9-b50e-3642a19e05fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272fa58d-2b9c-4732-bebc-0afc6fa526b1", "tag": "951b5852-3c9b-479b-81e0-e2e32b25789c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:42.172485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:42.172990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:42.191336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:42.191855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:42.192680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:42.193127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:42.198183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-19aecde7-97a4-48f7-b522-f49071e4ab2b req-4e888ecc-9ce5-46b9-b50e-3642a19e05fd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:42.198671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-19aecde7-97a4-48f7-b522-f49071e4ab2b req-4e888ecc-9ce5-46b9-b50e-3642a19e05fd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:42.227120 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-19aecde7-97a4-48f7-b522-f49071e4ab2b req-4e888ecc-9ce5-46b9-b50e-3642a19e05fd service nova] Creating event network-changed:951b5852-3c9b-479b-81e0-e2e32b25789c for instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 on n-h2-851337-5 Aug 04 05:05:42.232989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-19aecde7-97a4-48f7-b522-f49071e4ab2b req-4e888ecc-9ce5-46b9-b50e-3642a19e05fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065683 Aug 04 05:05:42.233461 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3199/6288] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:42.242573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:05:42.332831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:42.333637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:42.363936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:42.364485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:42.366083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:42.366770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:42.441401 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a845e590-8455-47ea-bce2-289be64482e7 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 204 len: 0 microversion: 2.1 time: 0.278075 Aug 04 05:05:42.442808 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3090/6289] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:05:42 2022] DELETE /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:42.457872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:42.460802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:42.484074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:42.484775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:42.486074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:42.487010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:42.535730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:42.546935 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5800872e-2b04-428c-8b2c-2475e7e8cbe4 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1228 microversion: 2.1 time: 0.218424 Aug 04 05:05:42.559070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3200/6290] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:42 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1228 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:42.684326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:42.694413 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3d64484-99c4-46a3-a616-382d23caeb84 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1686 microversion: 2.1 time: 0.246218 Aug 04 05:05:42.695418 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3091/6291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:42 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1686 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:43.571460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:43.572092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:43.589828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:43.590153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:43.591022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:43.591663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:43.707001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:43.718679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:43.719997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:43.720599 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00db3997-f2f0-44da-be43-380ad132a240 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1228 microversion: 2.1 time: 0.150265 Aug 04 05:05:43.721269 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3201/6292] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:43 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:43.739778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:43.745725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:43.746868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:43.747358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:44.119104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e52c6cb3694904a605112a9901e18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0230675c48d8ba4d39a956313de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:44.132646 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-479130f3-6f13-44c5-b09b-dbd0e03dfa9a tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 200 len: 1686 microversion: 2.1 time: 0.418668 Aug 04 05:05:44.133240 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3092/6293] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:43 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 1686 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:44.381016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c5add2ad-4bef-4e61-8666-f4ac58c9d524 req-4413b81e-915e-41cb-b720-07c0e7a84dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272fa58d-2b9c-4732-bebc-0afc6fa526b1", "name": "network-vif-deleted", "tag": "951b5852-3c9b-479b-81e0-e2e32b25789c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:44.394307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5add2ad-4bef-4e61-8666-f4ac58c9d524 req-4413b81e-915e-41cb-b720-07c0e7a84dd5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:44.395448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c5add2ad-4bef-4e61-8666-f4ac58c9d524 req-4413b81e-915e-41cb-b720-07c0e7a84dd5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:44.412261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c5add2ad-4bef-4e61-8666-f4ac58c9d524 req-4413b81e-915e-41cb-b720-07c0e7a84dd5 service nova] Creating event network-vif-deleted:951b5852-3c9b-479b-81e0-e2e32b25789c for instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 on n-h2-851337-5 Aug 04 05:05:44.418734 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c5add2ad-4bef-4e61-8666-f4ac58c9d524 req-4413b81e-915e-41cb-b720-07c0e7a84dd5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042361 Aug 04 05:05:44.420234 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3202/6294] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:44.744893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:44.746198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:44.754684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:44.755397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:44.756330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:44.756916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:44.843186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:44.870701 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-375dd9e4-d21d-4834-b1b0-8d3b0398d60f tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1228 microversion: 2.1 time: 0.130808 Aug 04 05:05:44.871543 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3093/6295] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:44 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1228 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:45.155048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:45.155855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] [instance: 272fa58d-2b9c-4732-bebc-0afc6fa526b1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:45.163409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:45.165967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:45.166894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:45.167537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:45.182549 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] HTTP exception thrown: Instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 could not be found. Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Request method failure captured: Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 HTTP/1.1 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61GdXrmWyyfE0J7enPpcIyS3LbibZR7PXqlPp3pVVyYXeHezoFuAT9ZF9b7K8886gn6e2_GN0Rt88Tw2FVFNfZo60Q6Vfblx2XonnMcQkg2IArZTVP8WZoQSTyoQkYC3HCAudPfq8W-oRSVCIp2pGPcTSXLlrp9_fe9GWe5eWg1Vi9I Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/af3d0230675c48d8ba4d39a956313de9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_af3d0230675c48d8ba4d39a956313de9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: af3d0230675c48d8ba4d39a956313de9 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1568861087 Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 09e52c6cb3694904a605112a9901e18c Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1568861087-project Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 could not be found. Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '272fa58d-2b9c-4732-bebc-0afc6fa526b1'} Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 could not be found. Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 could not be found. Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:45.184401 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 could not be found. Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Returning 404 to user: Instance 272fa58d-2b9c-4732-bebc-0afc6fa526b1 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:05:45.189174 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b609e300-774e-4e26-9141-9c0241523d69 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1" status: 404 len: 111 microversion: 2.1 time: 0.037153 Aug 04 05:05:45.192065 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3203/6296] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:45 2022] GET /compute/v2.1/servers/272fa58d-2b9c-4732-bebc-0afc6fa526b1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:05:45.894396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:45.895310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:45.907662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:45.909596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:45.910624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:45.913585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:46.028587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8593ffdffd4648b2260b5f81113671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda7e8089f84d5cb0b7bd86cc9df32c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:46.039784 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c4dbc2d-96ff-4d00-98a2-a699ee59ff19 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 200 len: 1228 microversion: 2.1 time: 0.151704 Aug 04 05:05:46.062292 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3094/6297] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:45 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 1228 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:47.068841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:47.070404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] [instance: 9ba35d73-8eb8-4ea6-9925-522270c396b9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:47.083336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:47.084788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:47.085891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:47.087500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:47.108417 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] HTTP exception thrown: Instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 could not be found. Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Request method failure captured: Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 HTTP/1.1 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61K_4VUDhsDOSm37VvfyovAid6coATNZGCdVgh110HkfaJLqoicDgQPqV4uODWFA5mrzAd-6PqTuYrUSLuRA9nYS3qopnwlurQC28J-Howu_HQVhyelfCOJdjApWPh73t91MmNw8O_UZUl23KZI6k16yzZc_QlfofUmsogZ5F0kGv6c Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 7eda7e8089f84d5cb0b7bd86cc9df32c Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBackupRestore-347549417 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7eda7e8089f84d5cb0b7bd86cc9df32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7eda7e8089f84d5cb0b7bd86cc9df32c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7eda7e8089f84d5cb0b7bd86cc9df32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7eda7e8089f84d5cb0b7bd86cc9df32c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBackupRestore-347549417 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 7eda7e8089f84d5cb0b7bd86cc9df32c Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBackupRestore-347549417 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBackupRestore-347549417-project Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: cd8593ffdffd4648b2260b5f81113671 Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBackupRestore-347549417-project Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 could not be found. Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '9ba35d73-8eb8-4ea6-9925-522270c396b9'} Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 could not be found. Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 could not be found. Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:05:47.110489 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 could not be found. Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Returning 404 to user: Instance 9ba35d73-8eb8-4ea6-9925-522270c396b9 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:05:47.115080 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e702b7b1-2e15-4f31-8300-76b88dcbed06 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9" status: 404 len: 111 microversion: 2.1 time: 0.054505 Aug 04 05:05:47.131923 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3204/6298] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:47 2022] GET /compute/v2.1/servers/9ba35d73-8eb8-4ea6-9925-522270c396b9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:05:47.390032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-da57d72e-ce7f-478f-9579-bc4f0d022f55 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] Calling method '.version_select at 0x7f1918c71670>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:47.418928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-da57d72e-ce7f-478f-9579-bc4f0d022f55 tempest-TestVolumeBackupRestore-347549417 tempest-TestVolumeBackupRestore-347549417-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-31748105" status: 202 len: 0 microversion: 2.1 time: 0.032672 Aug 04 05:05:47.420440 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3095/6299] 10.222.0.69 () {58 vars in 1263 bytes} [Thu Aug 4 05:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-31748105 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:05:49.514336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-012c6708-5f46-49ef-8b50-f5bf26fb2af1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] Calling method '.version_select at 0x7f19195c6af0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:49.561581 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-012c6708-5f46-49ef-8b50-f5bf26fb2af1 tempest-TestNetworkAdvancedServerOps-1568861087 tempest-TestNetworkAdvancedServerOps-1568861087-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-286904531" status: 202 len: 0 microversion: 2.1 time: 0.055503 Aug 04 05:05:49.567039 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3205/6300] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 05:05:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-286904531 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:05:51.967981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-09111ae0-e29f-4059-8cba-e0ecd1c11417 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:51.968780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-09111ae0-e29f-4059-8cba-e0ecd1c11417 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:52.005806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09111ae0-e29f-4059-8cba-e0ecd1c11417 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:52.006286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09111ae0-e29f-4059-8cba-e0ecd1c11417 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:52.007180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09111ae0-e29f-4059-8cba-e0ecd1c11417 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:52.007656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09111ae0-e29f-4059-8cba-e0ecd1c11417 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:52.080195 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-09111ae0-e29f-4059-8cba-e0ecd1c11417 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/ips" status: 200 len: 147 microversion: 2.1 time: 0.867325 Aug 04 05:05:52.089089 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3096/6301] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Aug 4 05:05:51 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/ips => generated 147 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:54.966084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67f4bd18-f18d-4481-a86e-316faa6e5910 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02e2f95e-592e-4f84-b029-69da7d3703f8"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:54.968618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67f4bd18-f18d-4481-a86e-316faa6e5910 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:54.978432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f4bd18-f18d-4481-a86e-316faa6e5910 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:54.979027 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f4bd18-f18d-4481-a86e-316faa6e5910 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:54.980018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f4bd18-f18d-4481-a86e-316faa6e5910 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:54.980521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f4bd18-f18d-4481-a86e-316faa6e5910 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:54.983628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:55.339619 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67f4bd18-f18d-4481-a86e-316faa6e5910 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378039 Aug 04 05:05:55.351468 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3206/6302] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:05:54 2022] POST /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:05:58.098288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1278092922", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "7e767704-645c-422b-abe4-6c81e9689aaf"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:05:58.114135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:58.179418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] validate_networks() for [('7e767704-645c-422b-abe4-6c81e9689aaf', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:05:58.901236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:05:58.901774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:05:58.902375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:05:58.902891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:05:58.903444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:05:58.935227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:58.935680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:58.936582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:05:58.937125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:05:58.959759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Getting quotas for project 4fef35be201e4585980b399dcd9d5a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:05:58.968631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Getting quotas for user fc413eb2dd98451eba4536498afc1446 and project 4fef35be201e4585980b399dcd9d5a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:05:58.985142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:05:58.987527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:05:59.057895 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-765eda4e-d729-42cc-ab01-5fcf50931954 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215950 Aug 04 05:05:59.058971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3097/6303] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:05:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:05:59.072221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64d3f66c-239a-4a66-8146-57b80ebe147f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:59.072950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-64d3f66c-239a-4a66-8146-57b80ebe147f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:05:59.176099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-64d3f66c-239a-4a66-8146-57b80ebe147f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:05:59.186862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64d3f66c-239a-4a66-8146-57b80ebe147f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1215 microversion: 2.1 time: 0.120380 Aug 04 05:05:59.188081 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3207/6304] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:05:59 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:00.210525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:00.213417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:00.225029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:00.225686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:00.228504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:00.229220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:00.345891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:00.356483 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ecfe8bfc-55af-4605-bd3f-7728c63236e5 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1267 microversion: 2.1 time: 0.151192 Aug 04 05:06:00.357629 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3098/6305] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:00 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:01.379197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:01.380092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:01.398249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:01.401619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:01.404560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:01.405212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:01.542402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:01.553276 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-efd1bbdc-392f-47ac-beeb-61679562991b tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1273 microversion: 2.1 time: 0.177640 Aug 04 05:06:01.561570 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3208/6306] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:01 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:02.578642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:02.581485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:02.595218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:02.597488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:02.600807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:02.601493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:02.610467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:03.007219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6a000b6f-b87e-4658-9c23-a1cd30cdf64f req-044b80b1-5ae7-49c8-8633-b98e8e930912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30", "tag": "e27395cb-69bc-4ba8-b0c3-e0aa5f1bf422"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:03.027930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a000b6f-b87e-4658-9c23-a1cd30cdf64f req-044b80b1-5ae7-49c8-8633-b98e8e930912 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:03.028905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a000b6f-b87e-4658-9c23-a1cd30cdf64f req-044b80b1-5ae7-49c8-8633-b98e8e930912 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:03.045905 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6a000b6f-b87e-4658-9c23-a1cd30cdf64f req-044b80b1-5ae7-49c8-8633-b98e8e930912 service nova] Creating event network-changed:e27395cb-69bc-4ba8-b0c3-e0aa5f1bf422 for instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 on n-h1-851337-5 Aug 04 05:06:03.052463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:03.054102 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6a000b6f-b87e-4658-9c23-a1cd30cdf64f req-044b80b1-5ae7-49c8-8633-b98e8e930912 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052299 Aug 04 05:06:03.056357 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3209/6307] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:03.067316 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4f897dfb-94a4-4f5e-adff-3ba068d1c4a2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1315 microversion: 2.1 time: 0.492018 Aug 04 05:06:03.069285 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3099/6308] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:02 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:04.097562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:04.098520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:04.126619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:04.129019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:04.132014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:04.135824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:04.160348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1270939231", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "d64442aa-d1e2-48df-88bf-88fecf1a8c0d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:04.285439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] validate_networks() for [('d64442aa-d1e2-48df-88bf-88fecf1a8c0d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:06:04.471014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:04.481478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e1cb956-5641-42bf-b379-5af24e7f12bc tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1315 microversion: 2.1 time: 0.391008 Aug 04 05:06:04.482301 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3210/6309] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:04 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:04.962867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:06:04.963813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:06:04.964439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:06:04.965099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:06:04.965556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:06:04.977792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:04.978514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:04.979527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:04.980764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:05.013465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Getting quotas for project 893df5beff3648809935af6a9b4972f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:06:05.023538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Getting quotas for user 90d1308e506e491589aec0be4194b992 and project 893df5beff3648809935af6a9b4972f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:06:05.045229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:06:05.048073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:06:05.116966 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-75a22ab1-5715-4c2a-9567-916e9a42fc34 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960212 Aug 04 05:06:05.117804 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3100/6310] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:06:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:06:05.131294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65f50abe-4115-4895-a904-53c7d55e5332 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:05.131995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-65f50abe-4115-4895-a904-53c7d55e5332 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:05.199680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-65f50abe-4115-4895-a904-53c7d55e5332 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:05.208883 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65f50abe-4115-4895-a904-53c7d55e5332 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1219 microversion: 2.1 time: 0.083180 Aug 04 05:06:05.210144 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3211/6311] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:05 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:05.505508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:05.506123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:05.513540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:05.513989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:05.514962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:05.515463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:05.670522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:05.679933 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6cafca8-b8cf-45a0-b6c8-291039a56671 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1315 microversion: 2.1 time: 0.179715 Aug 04 05:06:05.680525 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3101/6312] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:05 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:06.230920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:06.240303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:06.262200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:06.262679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:06.263519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:06.263980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:06.352003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:06.361333 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95a72c31-06cf-41cf-8435-932501a11341 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1289 microversion: 2.1 time: 0.135037 Aug 04 05:06:06.362347 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3212/6313] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:06 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:06.701954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:06.702681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:06.714542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:06.718725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:06.719787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:06.720314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:06.917836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:06.926115 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-43d647aa-97c7-42f3-ac36-f84e029b7ac8 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1315 microversion: 2.1 time: 0.228341 Aug 04 05:06:06.936486 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3102/6314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:06 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:07.383828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:07.384957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:07.392528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:07.392993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:07.393797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:07.394248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:07.569057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:07.578754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-79dd400e-c505-4f9d-be84-853e4f16fa48 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1319 microversion: 2.1 time: 0.198953 Aug 04 05:06:07.579375 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3213/6315] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:07 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:07.697062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0f7ba0b4-bf41-42ae-992d-d9538dfd1895 req-0bd1bcf2-3c02-4f4f-9424-6cf5579298d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db13c58-3b0b-4a16-bfd4-c82dc8e5da57", "tag": "7f533ec1-804f-4614-ac03-8258f9acc34f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:07.710132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0f7ba0b4-bf41-42ae-992d-d9538dfd1895 req-0bd1bcf2-3c02-4f4f-9424-6cf5579298d0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:07.710824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0f7ba0b4-bf41-42ae-992d-d9538dfd1895 req-0bd1bcf2-3c02-4f4f-9424-6cf5579298d0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:07.723594 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0f7ba0b4-bf41-42ae-992d-d9538dfd1895 req-0bd1bcf2-3c02-4f4f-9424-6cf5579298d0 service nova] Creating event network-changed:7f533ec1-804f-4614-ac03-8258f9acc34f for instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 on n-h2-851337-5 Aug 04 05:06:07.729432 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0f7ba0b4-bf41-42ae-992d-d9538dfd1895 req-0bd1bcf2-3c02-4f4f-9424-6cf5579298d0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037183 Aug 04 05:06:07.730040 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3103/6316] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:07.947933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:07.948486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:07.954688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:07.955193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:07.955995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:07.956527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:08.090218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:08.098076 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9db8986d-daf2-4bdc-91c8-e0e9e15f087e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1315 microversion: 2.1 time: 0.154759 Aug 04 05:06:08.098795 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3214/6317] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:07 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:08.600226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:08.601055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:08.607771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:08.608215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:08.608980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:08.609821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:08.747654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:08.755663 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2644281a-8d5f-4434-bcf5-545aaab8591d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1319 microversion: 2.1 time: 0.159580 Aug 04 05:06:08.756343 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3104/6318] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:08 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:08.866001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-5d1af658-c881-4b05-91b9-9a21cf107a93 req-11e7f923-08e5-4d18-b544-58bf07d3ecae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30", "name": "network-vif-plugged", "status": "completed", "tag": "e27395cb-69bc-4ba8-b0c3-e0aa5f1bf422"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:08.872903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:08.879832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5d1af658-c881-4b05-91b9-9a21cf107a93 req-11e7f923-08e5-4d18-b544-58bf07d3ecae service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:08.880294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5d1af658-c881-4b05-91b9-9a21cf107a93 req-11e7f923-08e5-4d18-b544-58bf07d3ecae service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:08.894756 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-5d1af658-c881-4b05-91b9-9a21cf107a93 req-11e7f923-08e5-4d18-b544-58bf07d3ecae service nova] Creating event network-vif-plugged:e27395cb-69bc-4ba8-b0c3-e0aa5f1bf422 for instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 on n-h1-851337-5 Aug 04 05:06:08.899788 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-5d1af658-c881-4b05-91b9-9a21cf107a93 req-11e7f923-08e5-4d18-b544-58bf07d3ecae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037622 Aug 04 05:06:08.900397 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3215/6319] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:09.119927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:09.120448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:09.126473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:09.126919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:09.129205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:09.129409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:09.263222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:09.270848 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-88a3abae-ae3b-4805-a8fa-f2876615a27e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1315 microversion: 2.1 time: 0.155128 Aug 04 05:06:09.271484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3105/6320] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:09 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:09.777675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:09.778393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:09.785070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:09.785535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:09.786506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:09.786770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:09.924704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:09.932956 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-911b5e3a-e5f7-47cc-b1ea-b0e8e9924271 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1319 microversion: 2.1 time: 0.159754 Aug 04 05:06:09.933547 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3216/6321] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:09 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:10.294638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:10.295343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:10.302380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:10.303213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:10.303672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:10.304111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:10.439064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:10.446877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bda488ea-8f18-4d89-92f8-c9da223530aa tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1315 microversion: 2.1 time: 0.157321 Aug 04 05:06:10.447500 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3106/6322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:10 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:10.959788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:10.960420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:10.968154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:10.968553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:10.969350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:10.969798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.101891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:11.109446 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c163220a-2399-481b-a115-aef998eb70bb tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1319 microversion: 2.1 time: 0.153553 Aug 04 05:06:11.110020 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3217/6323] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:10 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:11.468357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:11.469006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:11.476038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.476488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.477256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.478219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.612006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:11.621059 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-79947446-5e29-4968-8b92-789ae55e6bdb tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1501 microversion: 2.1 time: 0.157012 Aug 04 05:06:11.621645 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3107/6324] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:11 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:06:11.641409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:11.642153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:11.648490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.648957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.649822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.650280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.782026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:11.789625 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c95cb4e-2d8e-45b7-8d49-b9b32e7bd42e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1501 microversion: 2.1 time: 0.152194 Aug 04 05:06:11.790816 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3218/6325] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:11 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:06:11.810273 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:11.810813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:11.817131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.817601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.818381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.818826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.842094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lazy-loading 'flavor' on Instance uuid 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:06:11.893644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4f2756dd-292e-4ec8-82a2-97ace35ec08a tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:11.896162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4f2756dd-292e-4ec8-82a2-97ace35ec08a tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:11.902866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f2756dd-292e-4ec8-82a2-97ace35ec08a tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.903352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f2756dd-292e-4ec8-82a2-97ace35ec08a tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.904145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f2756dd-292e-4ec8-82a2-97ace35ec08a tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.904594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f2756dd-292e-4ec8-82a2-97ace35ec08a tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.914902 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2ef41ffd-8f9b-4b8a-8d80-97cb6f8d2c41 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action" status: 202 len: 0 microversion: 2.1 time: 0.108274 Aug 04 05:06:11.919289 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3108/6326] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:06:11 2022] POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:06:11.927727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:11.928760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:11.940215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.941557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.942710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.944002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.956896 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4f2756dd-292e-4ec8-82a2-97ace35ec08a tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067985 Aug 04 05:06:11.957883 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3219/6327] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:06:11 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:06:11.969199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57f27018-a347-49d9-9c86-4289e571f848 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:11.970322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-57f27018-a347-49d9-9c86-4289e571f848 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:11.978331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f27018-a347-49d9-9c86-4289e571f848 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.979251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f27018-a347-49d9-9c86-4289e571f848 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:11.980273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f27018-a347-49d9-9c86-4289e571f848 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:11.981092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57f27018-a347-49d9-9c86-4289e571f848 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:12.011289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57f27018-a347-49d9-9c86-4289e571f848 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/02e2f95e-592e-4f84-b029-69da7d3703f8" status: 200 len: 194 microversion: 2.1 time: 0.045913 Aug 04 05:06:12.012042 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3220/6328] 10.222.0.69 () {58 vars in 1413 bytes} [Thu Aug 4 05:06:11 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/02e2f95e-592e-4f84-b029-69da7d3703f8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:06:12.090837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:12.098941 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f9fc6386-b0ab-4e2b-8076-636b4b8b7fc0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1509 microversion: 2.1 time: 0.177900 Aug 04 05:06:12.103249 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3109/6329] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:11 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:12.131084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:12.131802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:12.138136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:12.138746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:12.139701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:12.140264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:12.284712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-afd3d0d9-53b1-425c-8b97-669fdfc016f3 req-62e62432-bdb6-4ec7-9bf7-c174258d1c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db13c58-3b0b-4a16-bfd4-c82dc8e5da57", "name": "network-vif-plugged", "status": "completed", "tag": "7f533ec1-804f-4614-ac03-8258f9acc34f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:12.297716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-afd3d0d9-53b1-425c-8b97-669fdfc016f3 req-62e62432-bdb6-4ec7-9bf7-c174258d1c7c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:12.298236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-afd3d0d9-53b1-425c-8b97-669fdfc016f3 req-62e62432-bdb6-4ec7-9bf7-c174258d1c7c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:12.308133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:12.316683 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-afd3d0d9-53b1-425c-8b97-669fdfc016f3 req-62e62432-bdb6-4ec7-9bf7-c174258d1c7c service nova] Creating event network-vif-plugged:7f533ec1-804f-4614-ac03-8258f9acc34f for instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 on n-h2-851337-5 Aug 04 05:06:12.324374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-26f41a0a-1e39-48a3-826a-44cecab11dea tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1319 microversion: 2.1 time: 0.195394 Aug 04 05:06:12.324836 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-afd3d0d9-53b1-425c-8b97-669fdfc016f3 req-62e62432-bdb6-4ec7-9bf7-c174258d1c7c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043399 Aug 04 05:06:12.325944 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3110/6330] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:06:12.326189 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3221/6331] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:12 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:13.122101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:13.122724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:13.130497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.131952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.131952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.132233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.283293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:13.292428 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b79234d2-f927-48b8-889f-2b330f1633e4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1492 microversion: 2.1 time: 0.175504 Aug 04 05:06:13.293258 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3111/6332] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:13 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1492 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:13.314125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-edfe2c4f-d005-4640-b7da-f7f0430ea9f9 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:13.314717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-edfe2c4f-d005-4640-b7da-f7f0430ea9f9 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:13.322521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfe2c4f-d005-4640-b7da-f7f0430ea9f9 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.323324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfe2c4f-d005-4640-b7da-f7f0430ea9f9 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.323816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfe2c4f-d005-4640-b7da-f7f0430ea9f9 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.324272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfe2c4f-d005-4640-b7da-f7f0430ea9f9 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.346138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:13.346749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:13.352869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.353543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.354119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.354557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.397451 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-edfe2c4f-d005-4640-b7da-f7f0430ea9f9 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action" status: 202 len: 0 microversion: 2.1 time: 0.087008 Aug 04 05:06:13.398073 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3222/6333] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:06:13 2022] POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:06:13.413299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:13.414686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:13.422684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.423193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.424020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.424477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.631820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:13.649428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:13.650287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f2b8677f-b12a-458a-abf7-466abe72eb44 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1319 microversion: 2.1 time: 0.307883 Aug 04 05:06:13.651516 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3112/6334] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:13 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:06:13.656418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cef5326f-c8bf-4314-9ac2-ddd1b4d388c1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c286f135-69ab-43f6-92a5-dc15db3ce345"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:13.662800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:13.667590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cef5326f-c8bf-4314-9ac2-ddd1b4d388c1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:13.674283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cef5326f-c8bf-4314-9ac2-ddd1b4d388c1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.674835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cef5326f-c8bf-4314-9ac2-ddd1b4d388c1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.675904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cef5326f-c8bf-4314-9ac2-ddd1b4d388c1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:13.676426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cef5326f-c8bf-4314-9ac2-ddd1b4d388c1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:13.677658 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b14df9f-72bf-487e-9060-8b44436ff0e2 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1498 microversion: 2.1 time: 0.269886 Aug 04 05:06:13.678258 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3223/6335] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:13 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1498 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:13.953509 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cef5326f-c8bf-4314-9ac2-ddd1b4d388c1 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "POST /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300655 Aug 04 05:06:13.954270 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3113/6336] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:06:13 2022] POST /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:14.672789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:14.673433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:14.682711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:14.683551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:14.684774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:14.685425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:14.700812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:14.701509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:14.707767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:14.708181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:14.708947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:14.709606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:15.001241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.034848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.207133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.240168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:15.244400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:15.247335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.249472 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-efd9f374-74c1-4ce1-9b58-7551a7c24d8e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1508 microversion: 2.1 time: 0.580854 Aug 04 05:06:15.250332 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3224/6337] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:14 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1508 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:15.261554 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ecc3d380-17a3-4e3c-9318-93b0c15f73fe tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1498 microversion: 2.1 time: 0.565750 Aug 04 05:06:15.277789 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3114/6338] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:14 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1498 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:06:16.285999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:16.288880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:16.295691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:16.296227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:16.297690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:16.298510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:16.448033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:16.456359 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-299fcdd1-6966-4e24-b96c-9a7b478e981e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1501 microversion: 2.1 time: 0.174471 Aug 04 05:06:16.457218 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3225/6339] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:16 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:16.479068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:16.480134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:16.489010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:16.489559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:16.490421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:16.491184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:16.517337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lazy-loading 'flavor' on Instance uuid 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:06:16.600249 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-81eb2bd8-b242-476c-a77d-9c513b4680b4 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action" status: 202 len: 0 microversion: 2.1 time: 0.126121 Aug 04 05:06:16.604067 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3115/6340] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:06:16 2022] POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:06:16.610450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:16.611390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:16.619413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:16.620394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:16.621430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:16.622034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:16.809582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:16.820786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-33d52913-5786-4970-98d3-139ef138a749 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1509 microversion: 2.1 time: 0.214053 Aug 04 05:06:16.823101 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3226/6341] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:16 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:17.844131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:17.844931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:17.858886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:17.859580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:17.860391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:17.860990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:18.012084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:18.021516 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d8ad0ef-1229-4bb8-b731-d9eb73ccce31 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1492 microversion: 2.1 time: 0.181486 Aug 04 05:06:18.022121 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3116/6342] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:17 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1492 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:18.043052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-afa2750e-95bc-4e06-9650-a441e0a2db22 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:18.043587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-afa2750e-95bc-4e06-9650-a441e0a2db22 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:18.053040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afa2750e-95bc-4e06-9650-a441e0a2db22 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:18.053755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afa2750e-95bc-4e06-9650-a441e0a2db22 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:18.054844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afa2750e-95bc-4e06-9650-a441e0a2db22 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:18.056160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-afa2750e-95bc-4e06-9650-a441e0a2db22 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:18.135702 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-afa2750e-95bc-4e06-9650-a441e0a2db22 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action" status: 202 len: 0 microversion: 2.1 time: 0.096873 Aug 04 05:06:18.136847 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3227/6343] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:06:18 2022] POST /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:06:18.147425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:18.148302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:18.158112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:18.158849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:18.159919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:18.160932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:18.345036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:18.354338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1d14101c-2a96-4636-9acd-8e7c805939d0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1498 microversion: 2.1 time: 0.211352 Aug 04 05:06:18.363034 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3117/6344] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:18 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:19.377722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:19.378479 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:19.385788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:19.386258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:19.387108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:19.387567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:19.530622 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:19.538410 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-80ad6434-c899-4332-96ce-f3ddcbbc5af0 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1498 microversion: 2.1 time: 0.166497 Aug 04 05:06:19.539008 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3228/6345] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:19 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:20.559782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:20.560870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:20.568074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:20.568519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:20.569300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:20.569736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:20.715270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:20.723328 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bc2cdb3-ae73-4b36-8beb-d5ac38eafd42 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1501 microversion: 2.1 time: 0.167404 Aug 04 05:06:20.724113 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3118/6346] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:20 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:20.744635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:20.745441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:20.752381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:20.752846 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:20.753639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:20.754093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:20.781071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:06:20.863948 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9a7c9020-25f7-4a2a-b5e3-0fa5c4cef64d tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 204 len: 0 microversion: 2.1 time: 0.123153 Aug 04 05:06:20.864606 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3229/6347] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:06:20 2022] DELETE /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:20.874977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:20.875714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:20.881912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:20.882484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:20.883278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:20.883723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:21.021361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:21.031424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b593e670-cd38-4751-92d0-685119650e2e tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1507 microversion: 2.1 time: 0.161094 Aug 04 05:06:21.032186 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3119/6348] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:20 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:22.053185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:22.053914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:22.061419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:22.061960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:22.062828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:22.063398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:22.228153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:22.236989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e84ae2de-213f-4f1a-b426-ccca4d6eae26 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1507 microversion: 2.1 time: 0.188154 Aug 04 05:06:22.237652 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3230/6349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:22 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:23.259839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:23.260515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:23.267880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:23.268344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:23.269129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:23.269706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:23.436631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc413eb2dd98451eba4536498afc1446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fef35be201e4585980b399dcd9d5a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:23.447780 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1df6c41d-2343-4bda-8899-5f7552f8230f tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 200 len: 1507 microversion: 2.1 time: 0.192486 Aug 04 05:06:23.448508 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3120/6350] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:23 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:06:23.464503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-99d3cdd4-a02e-4472-87c6-55659444960e req-dafb64bd-e819-4046-a0eb-6e813f46a2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30", "name": "network-vif-deleted", "tag": "e27395cb-69bc-4ba8-b0c3-e0aa5f1bf422"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:23.475999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-99d3cdd4-a02e-4472-87c6-55659444960e req-dafb64bd-e819-4046-a0eb-6e813f46a2ec service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:23.476461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-99d3cdd4-a02e-4472-87c6-55659444960e req-dafb64bd-e819-4046-a0eb-6e813f46a2ec service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:23.489251 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-99d3cdd4-a02e-4472-87c6-55659444960e req-dafb64bd-e819-4046-a0eb-6e813f46a2ec service nova] Creating event network-vif-deleted:e27395cb-69bc-4ba8-b0c3-e0aa5f1bf422 for instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 on n-h1-851337-5 Aug 04 05:06:23.495277 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-99d3cdd4-a02e-4472-87c6-55659444960e req-dafb64bd-e819-4046-a0eb-6e813f46a2ec service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Aug 04 05:06:23.496500 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3231/6351] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:06:24.473028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:24.473845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] [instance: 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:24.482945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:24.483368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:24.484202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:24.484666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:24.500562 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] HTTP exception thrown: Instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 could not be found. Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Request method failure captured: Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 HTTP/1.1 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61OzGL94Op0_FXR4vKzlc-JRTXVpcJomZKxGpbZh55oDSDAd-Zv-MiW7cJ6KYMXETJxnSCfDm0QnucxsykzDonqD2USIovi_I-BVYyWRvT124HUSmnb2D3xWLSUsBLzG6a5Khj2TLKKfUh6I9DlCv-W9wXDV1KaD9hFuz9XlwlWorgQ Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 4fef35be201e4585980b399dcd9d5a97 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestServerAdvancedOps-1302832203 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4fef35be201e4585980b399dcd9d5a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4fef35be201e4585980b399dcd9d5a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4fef35be201e4585980b399dcd9d5a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4fef35be201e4585980b399dcd9d5a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestServerAdvancedOps-1302832203 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 4fef35be201e4585980b399dcd9d5a97 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestServerAdvancedOps-1302832203 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestServerAdvancedOps-1302832203-project Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: fc413eb2dd98451eba4536498afc1446 Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestServerAdvancedOps-1302832203-project Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 could not be found. Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30'} Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 could not be found. Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 could not be found. Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:24.502334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 could not be found. Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] Returning 404 to user: Instance 5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-00fb390b-4d20-43bd-aaa6-3840e3ce5e85 tempest-TestServerAdvancedOps-1302832203 tempest-TestServerAdvancedOps-1302832203-project] 10.222.0.69 "GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30" status: 404 len: 111 microversion: 2.1 time: 0.035779 Aug 04 05:06:24.508584 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3121/6352] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:24 2022] GET /compute/v2.1/servers/5f50e4b4-29bb-46fa-a8e4-f6c7b52a9e30 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:06:25.859926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-befb01e1-aab8-4ccd-9141-e53365d0028c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:25.863184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-befb01e1-aab8-4ccd-9141-e53365d0028c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:25.871524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-befb01e1-aab8-4ccd-9141-e53365d0028c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:25.872817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-befb01e1-aab8-4ccd-9141-e53365d0028c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:25.873880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-befb01e1-aab8-4ccd-9141-e53365d0028c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:25.875270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-befb01e1-aab8-4ccd-9141-e53365d0028c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:25.920727 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-befb01e1-aab8-4ccd-9141-e53365d0028c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066061 Aug 04 05:06:25.922413 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3232/6353] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:06:25 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:26.068264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6ba21927-0531-4d9c-8280-396743f49c3f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:26.069479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6ba21927-0531-4d9c-8280-396743f49c3f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:26.081251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ba21927-0531-4d9c-8280-396743f49c3f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:26.082191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ba21927-0531-4d9c-8280-396743f49c3f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:26.083287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ba21927-0531-4d9c-8280-396743f49c3f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:26.084048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ba21927-0531-4d9c-8280-396743f49c3f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:26.121327 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6ba21927-0531-4d9c-8280-396743f49c3f tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/02e2f95e-592e-4f84-b029-69da7d3703f8" status: 200 len: 194 microversion: 2.1 time: 0.061417 Aug 04 05:06:26.122211 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3122/6354] 10.222.0.69 () {58 vars in 1413 bytes} [Thu Aug 4 05:06:26 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/02e2f95e-592e-4f84-b029-69da7d3703f8 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:26.133511 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:26.134050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:26.141169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:26.141634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:26.142419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:26.142872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:26.263414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lazy-loading 'services' on Instance uuid ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:06:26.398176 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e6098422-df59-4b0b-b81b-24b6357b6895 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/02e2f95e-592e-4f84-b029-69da7d3703f8" status: 202 len: 0 microversion: 2.1 time: 0.268996 Aug 04 05:06:26.398606 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3233/6355] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:06:26 2022] DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/02e2f95e-592e-4f84-b029-69da7d3703f8 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:06:31.940361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8090a06e-05c0-45d4-ac38-0c0041497a57 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:31.940971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8090a06e-05c0-45d4-ac38-0c0041497a57 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:31.944004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:31.950130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090a06e-05c0-45d4-ac38-0c0041497a57 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:31.950565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090a06e-05c0-45d4-ac38-0c0041497a57 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:31.951378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090a06e-05c0-45d4-ac38-0c0041497a57 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:31.951818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8090a06e-05c0-45d4-ac38-0c0041497a57 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:31.983032 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8090a06e-05c0-45d4-ac38-0c0041497a57 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/c286f135-69ab-43f6-92a5-dc15db3ce345" status: 200 len: 194 microversion: 2.1 time: 0.046652 Aug 04 05:06:31.983954 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3123/6356] 10.222.0.69 () {58 vars in 1413 bytes} [Thu Aug 4 05:06:31 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/c286f135-69ab-43f6-92a5-dc15db3ce345 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:31.996764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:31.997369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:32.004108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:32.004566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:32.005373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:32.005901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:32.093335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lazy-loading 'services' on Instance uuid ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:06:32.171524 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a5b3176-9e69-4458-b388-46eb1453a7d8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/c286f135-69ab-43f6-92a5-dc15db3ce345" status: 202 len: 0 microversion: 2.1 time: 0.180560 Aug 04 05:06:32.172160 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3234/6357] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:06:31 2022] DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments/c286f135-69ab-43f6-92a5-dc15db3ce345 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:06:32.835070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4d73798-62f3-45d8-9ad1-74b852dfc22c tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "279315c3-86e5-4c35-972f-c985c1459b3b", "device": "/dev/sdb"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:32.837570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4d73798-62f3-45d8-9ad1-74b852dfc22c tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:32.845126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d73798-62f3-45d8-9ad1-74b852dfc22c tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:32.845580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d73798-62f3-45d8-9ad1-74b852dfc22c tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:32.846365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d73798-62f3-45d8-9ad1-74b852dfc22c tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:32.846841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4d73798-62f3-45d8-9ad1-74b852dfc22c tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:33.106805 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4d73798-62f3-45d8-9ad1-74b852dfc22c tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "POST /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275756 Aug 04 05:06:33.107511 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3124/6358] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:06:32 2022] POST /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:37.065218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e469b5c-5c02-4774-8d03-f14e778d8dad tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:37.067566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7e469b5c-5c02-4774-8d03-f14e778d8dad tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:37.074025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e469b5c-5c02-4774-8d03-f14e778d8dad tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.074494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e469b5c-5c02-4774-8d03-f14e778d8dad tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.075311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e469b5c-5c02-4774-8d03-f14e778d8dad tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.075778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7e469b5c-5c02-4774-8d03-f14e778d8dad tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.110572 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e469b5c-5c02-4774-8d03-f14e778d8dad tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050701 Aug 04 05:06:37.116491 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3235/6359] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:06:37 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:06:37.229496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa9a71e6-27f0-4117-9e58-02061087386c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:37.231815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa9a71e6-27f0-4117-9e58-02061087386c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:37.238247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa9a71e6-27f0-4117-9e58-02061087386c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.238704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa9a71e6-27f0-4117-9e58-02061087386c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.239509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa9a71e6-27f0-4117-9e58-02061087386c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.239952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa9a71e6-27f0-4117-9e58-02061087386c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.270058 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa9a71e6-27f0-4117-9e58-02061087386c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046222 Aug 04 05:06:37.270618 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3125/6360] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:06:37 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:06:37.333687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:37.334208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:37.340950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.341411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.342201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.342842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.368684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:06:37.383768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.452008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-258210c0-ae51-42a6-8293-43087f2f1177 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 204 len: 0 microversion: 2.1 time: 0.121774 Aug 04 05:06:37.453111 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3236/6361] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:06:37 2022] DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:37.461934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:37.462543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:37.468904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.469350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.470109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:37.470537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:37.609894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:37.618005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7c149724-c714-4a00-8545-4db7f0ddbaea tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1673 microversion: 2.1 time: 0.160532 Aug 04 05:06:37.619400 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3126/6362] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:37 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:06:38.641670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:38.642650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:38.652699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:38.653311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:38.654641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:38.655217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:38.795815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:38.803535 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f477399-9f62-4a28-9ab3-49e1e915a291 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1673 microversion: 2.1 time: 0.166229 Aug 04 05:06:38.804118 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3237/6363] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:38 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:39.830149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:39.832132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:39.855744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:39.856195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:39.857193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:39.857631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:40.012357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:40.021016 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2d0f7c9d-d006-472f-a3b8-80478cb6e72d tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1673 microversion: 2.1 time: 0.199270 Aug 04 05:06:40.021958 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3127/6364] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:39 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:40.756213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4adacd59-1450-4e32-b2ca-01df770c1488 req-4c465a05-63d7-48a6-8801-5f3f2e5e139a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce", "name": "network-vif-deleted", "tag": "b18585d8-6b49-4912-ac12-6c7d63589abf"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:06:40.764897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:40.780796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4adacd59-1450-4e32-b2ca-01df770c1488 req-4c465a05-63d7-48a6-8801-5f3f2e5e139a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:40.781557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4adacd59-1450-4e32-b2ca-01df770c1488 req-4c465a05-63d7-48a6-8801-5f3f2e5e139a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:40.795897 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4adacd59-1450-4e32-b2ca-01df770c1488 req-4c465a05-63d7-48a6-8801-5f3f2e5e139a service nova] Creating event network-vif-deleted:b18585d8-6b49-4912-ac12-6c7d63589abf for instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce on n-h1-851337-5 Aug 04 05:06:40.801946 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4adacd59-1450-4e32-b2ca-01df770c1488 req-4c465a05-63d7-48a6-8801-5f3f2e5e139a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236109 Aug 04 05:06:40.803900 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3238/6365] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:06:41.046185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:41.047438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:41.055471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:41.056452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:41.057245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:41.057685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:41.092736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:41.093361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:41.093973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lazy-loading 'fault' on Instance uuid ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:06:41.147867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adbe69f2bf94f02a0bbf0ea913481a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a8935bd6624e6a832843d52384cf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:06:41.150113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:41.156285 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9cdc2a92-832f-418b-85b9-9247cd741d29 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 200 len: 1325 microversion: 2.1 time: 0.116443 Aug 04 05:06:41.157151 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3128/6366] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:41 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 1325 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:42.183707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:42.184991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:42.193169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:42.193642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:42.194447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:42.194907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:42.211482 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] HTTP exception thrown: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Request method failure captured: Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce HTTP/1.1 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61JDzTMVzdd-koDo05_eC1g_UcJiqZFdYoUgxNXOi_Uw1HkdVe0mbR_Zq2rj6Hxosz3dVHLxJ969cU8qRWdBphq2oZraBdf_uND87ihR5AUQNwjYoFp8v48UB7Lzt8c_0YkLHHUsvoJv3oTBsqRXR0VDgH0g1aKFQnULA8Y_uVs9PZc Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92a8935bd6624e6a832843d52384cf89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 5adbe69f2bf94f02a0bbf0ea913481a4 Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce'} Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:42.213827 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Returning 404 to user: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9985d3ae-7c85-459c-92e6-a7c9fb659d2e tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 404 len: 111 microversion: 2.1 time: 0.036174 Aug 04 05:06:42.218660 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3239/6367] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:42 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:06:42.224379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca268c02-0a04-4ba0-91f3-603aabe0bfa7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '.version_select at 0x7f191896d940>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:42.244720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca268c02-0a04-4ba0-91f3-603aabe0bfa7 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46826943" status: 202 len: 0 microversion: 2.1 time: 0.024179 Aug 04 05:06:42.245561 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3129/6368] 10.222.0.69 () {58 vars in 1215 bytes} [Thu Aug 4 05:06:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46826943 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:06:49.426866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:49.428037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:49.442555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:49.444535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:49.448791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:49.449440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:49.474432 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] HTTP exception thrown: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Request method failure captured: Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce HTTP/1.1 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61JDzTMVzdd-koDo05_eC1g_UcJiqZFdYoUgxNXOi_Uw1HkdVe0mbR_Zq2rj6Hxosz3dVHLxJ969cU8qRWdBphq2oZraBdf_uND87ihR5AUQNwjYoFp8v48UB7Lzt8c_0YkLHHUsvoJv3oTBsqRXR0VDgH0g1aKFQnULA8Y_uVs9PZc Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92a8935bd6624e6a832843d52384cf89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 5adbe69f2bf94f02a0bbf0ea913481a4 Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce'} Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:06:49.477162 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Returning 404 to user: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b0713b4-093d-47cd-8119-480e34ece1c9 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 404 len: 111 microversion: 2.1 time: 0.068814 Aug 04 05:06:49.487728 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3240/6369] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:06:49 2022] DELETE /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:06:49.495463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:49.497932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:49.507325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:49.508421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:49.509877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:49.511576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:49.543836 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] HTTP exception thrown: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Request method failure captured: Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce HTTP/1.1 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61JDzTMVzdd-koDo05_eC1g_UcJiqZFdYoUgxNXOi_Uw1HkdVe0mbR_Zq2rj6Hxosz3dVHLxJ969cU8qRWdBphq2oZraBdf_uND87ihR5AUQNwjYoFp8v48UB7Lzt8c_0YkLHHUsvoJv3oTBsqRXR0VDgH0g1aKFQnULA8Y_uVs9PZc Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92a8935bd6624e6a832843d52384cf89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5adbe69f2bf94f02a0bbf0ea913481a4 Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce'} Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:49.546515 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Returning 404 to user: Instance ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:49.550433 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b1eeaef-a8ba-4001-b5ec-740c9180cb9c tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce" status: 404 len: 111 microversion: 2.1 time: 0.059365 Aug 04 05:06:49.552848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3130/6370] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:49 2022] GET /compute/v2.1/servers/ca13598e-29ee-44b5-bed8-aaa6ab7cb7ce => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:06:52.862311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:52.862867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:52.871369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:52.871841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:52.872648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:52.873104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:52.887921 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] HTTP exception thrown: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Request method failure captured: Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 HTTP/1.1 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61JDzTMVzdd-koDo05_eC1g_UcJiqZFdYoUgxNXOi_Uw1HkdVe0mbR_Zq2rj6Hxosz3dVHLxJ969cU8qRWdBphq2oZraBdf_uND87ihR5AUQNwjYoFp8v48UB7Lzt8c_0YkLHHUsvoJv3oTBsqRXR0VDgH0g1aKFQnULA8Y_uVs9PZc Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92a8935bd6624e6a832843d52384cf89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 5adbe69f2bf94f02a0bbf0ea913481a4 Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0693875a-57c5-4180-a006-46160ba75de5'} Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:06:52.889515 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Returning 404 to user: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:52.893557 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c5253701-0851-4ee0-a691-5696638bb020 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 404 len: 111 microversion: 2.1 time: 0.033098 Aug 04 05:06:52.894989 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3241/6371] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:06:52 2022] DELETE /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:06:52.901549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:06:52.902393 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] [instance: 0693875a-57c5-4180-a006-46160ba75de5] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:06:52.910137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:52.910667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:52.911649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:06:52.912166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:06:52.927155 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] HTTP exception thrown: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Request method failure captured: Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 HTTP/1.1 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61JDzTMVzdd-koDo05_eC1g_UcJiqZFdYoUgxNXOi_Uw1HkdVe0mbR_Zq2rj6Hxosz3dVHLxJ969cU8qRWdBphq2oZraBdf_uND87ihR5AUQNwjYoFp8v48UB7Lzt8c_0YkLHHUsvoJv3oTBsqRXR0VDgH0g1aKFQnULA8Y_uVs9PZc Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92a8935bd6624e6a832843d52384cf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92a8935bd6624e6a832843d52384cf89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 92a8935bd6624e6a832843d52384cf89 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2071597240 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 5adbe69f2bf94f02a0bbf0ea913481a4 Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-AttachVolumeTestJSON-2071597240-project Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '0693875a-57c5-4180-a006-46160ba75de5'} Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:52.929132 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] Returning 404 to user: Instance 0693875a-57c5-4180-a006-46160ba75de5 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:52.933875 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ebb3ad3-c052-44e8-97e7-38438cbc5dc8 tempest-AttachVolumeTestJSON-2071597240 tempest-AttachVolumeTestJSON-2071597240-project] 10.222.0.69 "GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5" status: 404 len: 111 microversion: 2.1 time: 0.034308 Aug 04 05:06:52.935128 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3131/6372] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:06:52 2022] GET /compute/v2.1/servers/0693875a-57c5-4180-a006-46160ba75de5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:07:01.002606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:01.003499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:01.013055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:01.013577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:01.014588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:01.015075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:01.100384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lazy-loading 'services' on Instance uuid 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:07:01.175296 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1701a411-32ba-490f-8233-0da320263b6e tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57/os-volume_attachments/279315c3-86e5-4c35-972f-c985c1459b3b" status: 202 len: 0 microversion: 2.1 time: 0.179437 Aug 04 05:07:01.175637 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3242/6373] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:07:00 2022] DELETE /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57/os-volume_attachments/279315c3-86e5-4c35-972f-c985c1459b3b => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:07:06.579641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:06.580216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:06.582746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:06.583524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:06.589382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:06.589840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:06.590628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:06.591093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:06.619035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:07:06.698496 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eba66154-113d-4606-88d8-93fc88230ed4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 204 len: 0 microversion: 2.1 time: 0.122648 Aug 04 05:07:06.699492 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3132/6374] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:07:06 2022] DELETE /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:07:06.711357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:06.712631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:06.720249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:06.720706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:06.721496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:06.721968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:06.913335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:06.922092 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91a87ab3-171b-496f-af8b-5c0b5d8f1eda tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1514 microversion: 2.1 time: 0.216804 Aug 04 05:07:06.922786 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3243/6375] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:06 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:07.946441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:07.947195 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:07.953828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:07.954277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:07.955081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:07.955542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:08.150468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:08.158083 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69979d5b-e087-4577-be62-c2a501aba6a9 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1514 microversion: 2.1 time: 0.216101 Aug 04 05:07:08.158682 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3133/6376] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:07 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:08.783688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0f46c37d-df2f-483a-89ee-507bcd35696b req-e495ae09-e05d-412e-985f-28c3132f2269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db13c58-3b0b-4a16-bfd4-c82dc8e5da57", "name": "network-vif-deleted", "tag": "7f533ec1-804f-4614-ac03-8258f9acc34f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:08.807991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0f46c37d-df2f-483a-89ee-507bcd35696b req-e495ae09-e05d-412e-985f-28c3132f2269 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:08.808450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0f46c37d-df2f-483a-89ee-507bcd35696b req-e495ae09-e05d-412e-985f-28c3132f2269 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:08.820073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:08.823686 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0f46c37d-df2f-483a-89ee-507bcd35696b req-e495ae09-e05d-412e-985f-28c3132f2269 service nova] Creating event network-vif-deleted:7f533ec1-804f-4614-ac03-8258f9acc34f for instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 on n-h2-851337-5 Aug 04 05:07:08.829173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0f46c37d-df2f-483a-89ee-507bcd35696b req-e495ae09-e05d-412e-985f-28c3132f2269 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056628 Aug 04 05:07:08.830222 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3244/6377] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:07:09.179982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:09.180604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:09.189134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:09.189857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:09.190814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:09.191562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:09.225199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:09.225921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:09.226580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lazy-loading 'fault' on Instance uuid 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:07:09.276289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:09.285564 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4781c9f5-d547-42e6-95b7-b73b6eeaa09f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 200 len: 1309 microversion: 2.1 time: 0.109735 Aug 04 05:07:09.286241 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3134/6378] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:09 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:10.309996 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:10.310711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:10.318018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:10.318484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:10.319306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:10.319755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:10.334332 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] HTTP exception thrown: Instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 could not be found. Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Request method failure captured: Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 HTTP/1.1 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61N504dXLT8yAiLdYtDMMeG2WBvuCsDmro6TM32saLXsO5ElyYM4ZEwTqyPG4smzt-fK5mBvP2wi_cHxuvDZuRNKjTSLMwe8G6H21AmnfkowiPRjfXFkKLaMBy0PkhrCS9n7eN84IBUk3tb2Rb70rzdx4itVaezDxq29e-Q201KASzI Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 893df5beff3648809935af6a9b4972f9 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1000649771 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/893df5beff3648809935af6a9b4972f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/893df5beff3648809935af6a9b4972f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/893df5beff3648809935af6a9b4972f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_893df5beff3648809935af6a9b4972f9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-VolumesSnapshotTestJSON-1000649771 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 893df5beff3648809935af6a9b4972f9 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1000649771 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-VolumesSnapshotTestJSON-1000649771-project Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 90d1308e506e491589aec0be4194b992 Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-VolumesSnapshotTestJSON-1000649771-project Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 could not be found. Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '4db13c58-3b0b-4a16-bfd4-c82dc8e5da57'} Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 could not be found. Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 could not be found. Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:10.335940 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 could not be found. Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Returning 404 to user: Instance 4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-82fc87c2-a099-4b20-8a90-f4933c87f77b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57" status: 404 len: 111 microversion: 2.1 time: 0.033333 Aug 04 05:07:10.341536 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3245/6379] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:10 2022] GET /compute/v2.1/servers/4db13c58-3b0b-4a16-bfd4-c82dc8e5da57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:07:17.306617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-549979955", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "d64442aa-d1e2-48df-88bf-88fecf1a8c0d"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:17.371173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] validate_networks() for [('d64442aa-d1e2-48df-88bf-88fecf1a8c0d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:07:18.082211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:07:18.082822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:07:18.083325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:07:18.083738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:07:18.084150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:07:18.094623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:18.094902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:18.096179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:18.096618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:18.116242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Getting quotas for project 893df5beff3648809935af6a9b4972f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:07:18.123885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Getting quotas for user 90d1308e506e491589aec0be4194b992 and project 893df5beff3648809935af6a9b4972f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:07:18.138944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:07:18.141656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:07:18.190173 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bca9487e-254d-4610-b793-91390bbe4b9a tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890615 Aug 04 05:07:18.195117 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3135/6380] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:07:18.203474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6e77adf-2a92-43d0-810d-e45bd80433c8 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:18.204286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6e77adf-2a92-43d0-810d-e45bd80433c8 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:18.210942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=16 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:18.269942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f6e77adf-2a92-43d0-810d-e45bd80433c8 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:18.279648 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6e77adf-2a92-43d0-810d-e45bd80433c8 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1218 microversion: 2.1 time: 0.081261 Aug 04 05:07:18.280439 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3246/6381] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:18 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:07:19.302033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:19.303546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:19.312506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:19.313491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:19.314536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:19.315898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:19.397745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:19.408553 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e734caa-57ae-4d35-877a-2aa5fa173d07 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1278 microversion: 2.1 time: 0.110921 Aug 04 05:07:19.415047 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3136/6382] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:19 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:20.432071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:20.433420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:20.437621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:20.442314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:20.443559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:20.444586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:20.445379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:20.687486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:20.700962 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c381357-56d9-4637-885a-5f06d3a13cb3 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.272671 Aug 04 05:07:20.704075 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3247/6383] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:20 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:21.341490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d10b8c44-bd3b-47c2-82c1-add063adb7d6 req-c9dd14bb-0f47-45ab-a3f3-55650e75fa08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60de4df5-82e6-4821-9567-2b927a36d47f", "tag": "20a1c5ac-fc29-4c97-84ec-79516b06e196"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:21.358090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d10b8c44-bd3b-47c2-82c1-add063adb7d6 req-c9dd14bb-0f47-45ab-a3f3-55650e75fa08 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:21.358798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d10b8c44-bd3b-47c2-82c1-add063adb7d6 req-c9dd14bb-0f47-45ab-a3f3-55650e75fa08 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:21.390351 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d10b8c44-bd3b-47c2-82c1-add063adb7d6 req-c9dd14bb-0f47-45ab-a3f3-55650e75fa08 service nova] Creating event network-changed:20a1c5ac-fc29-4c97-84ec-79516b06e196 for instance 60de4df5-82e6-4821-9567-2b927a36d47f on n-h1-851337-5 Aug 04 05:07:21.401924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d10b8c44-bd3b-47c2-82c1-add063adb7d6 req-c9dd14bb-0f47-45ab-a3f3-55650e75fa08 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062970 Aug 04 05:07:21.402896 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3137/6384] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:07:21.738515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:21.742865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:21.766035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:21.767299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:21.768337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:21.768801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:22.078848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:22.093365 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-75d02d2d-9808-4643-9d1a-eaf8281dd857 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.367828 Aug 04 05:07:22.097130 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3248/6385] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:21 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:23.129991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:23.133037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:23.142199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:23.143211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:23.147769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:23.147769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:23.308893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:23.320625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f1bdbb95-5146-4aef-8a65-7fec9c868731 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.199270 Aug 04 05:07:23.322360 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3138/6386] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:23 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:24.344914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:24.346371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:24.355424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:24.356018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:24.357204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:24.358016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:24.566843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:24.576769 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0ae627c4-d5e5-4272-8865-b9d0177fd2b0 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.237729 Aug 04 05:07:24.577939 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3249/6387] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:24 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:25.601113 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:25.601723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:25.610134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:25.610795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:25.611766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:25.612364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:25.811937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:25.821128 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-da2a2dba-834b-4e4d-8143-1d7fbba913d1 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.224133 Aug 04 05:07:25.836412 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3139/6388] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:25 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:26.424456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1625689206", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-328461503", "security_groups": [{"name": "tempest-secgroup-smoke-880733176"}], "block_device_mapping_v2": [{"uuid": "d29957c9-db75-4eac-8a81-c55f7743539f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fb28dc-5e3c-495e-8afe-3187e3414707"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:26.572373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] validate_networks() for [('b2fb28dc-5e3c-495e-8afe-3187e3414707', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:07:26.842795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:26.843460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:26.850494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:26.850945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:26.851788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:26.852182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:27.166411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:27.174286 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-535c729f-965d-4e2a-90c6-b9b808feb83d tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.335254 Aug 04 05:07:27.174883 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3140/6389] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:26 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:07:27.328264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:07:27.328707 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:07:27.329202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:07:27.329630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:07:27.330729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:07:27.339992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:27.340520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:27.341361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:27.341838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:27.360230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:07:27.365911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Getting quotas for user 6c283d053e8747468d90a2d54773e90d and project 37c98bbf61634f9e88d49ff4401c4514. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:07:27.453458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:07:27.455784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d29957c9-db75-4eac-8a81-c55f7743539f',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:07:27.600698 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e767815c-62c7-4261-a6b6-75a009af5a1d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.179878 Aug 04 05:07:27.601843 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3250/6390] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:07:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:07:27.613409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8f94535a-0f75-43a9-b99b-9a3ded8cce09 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:27.614042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8f94535a-0f75-43a9-b99b-9a3ded8cce09 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:27.681936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8f94535a-0f75-43a9-b99b-9a3ded8cce09 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:27.689681 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8f94535a-0f75-43a9-b99b-9a3ded8cce09 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1094 microversion: 2.1 time: 0.080507 Aug 04 05:07:27.690601 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3141/6391] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:27 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:28.195887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:28.196528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:28.203839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:28.204245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:28.205641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:28.206103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:28.475510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:28.484490 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f12afc2-cdef-4099-9ce4-4402a8f0a324 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.292401 Aug 04 05:07:28.485086 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3251/6392] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:28 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:28.713815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:28.715385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:28.718262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:28.725327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:28.726093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:28.727144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:28.727887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:28.844073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:28.855833 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26b6d048-f8d3-4608-8dc2-035b6fb1d991 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1200 microversion: 2.1 time: 0.145998 Aug 04 05:07:28.865871 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3142/6393] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:28 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1200 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:29.271597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-cdd683d5-2ee3-49d0-acb8-9fa8b3780725 req-11bed756-4789-46ee-b3bb-d964643f88a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60de4df5-82e6-4821-9567-2b927a36d47f", "name": "network-vif-plugged", "status": "completed", "tag": "20a1c5ac-fc29-4c97-84ec-79516b06e196"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:29.292801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cdd683d5-2ee3-49d0-acb8-9fa8b3780725 req-11bed756-4789-46ee-b3bb-d964643f88a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:29.293752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cdd683d5-2ee3-49d0-acb8-9fa8b3780725 req-11bed756-4789-46ee-b3bb-d964643f88a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:29.309550 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-cdd683d5-2ee3-49d0-acb8-9fa8b3780725 req-11bed756-4789-46ee-b3bb-d964643f88a4 service nova] Creating event network-vif-plugged:20a1c5ac-fc29-4c97-84ec-79516b06e196 for instance 60de4df5-82e6-4821-9567-2b927a36d47f on n-h1-851337-5 Aug 04 05:07:29.317156 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-cdd683d5-2ee3-49d0-acb8-9fa8b3780725 req-11bed756-4789-46ee-b3bb-d964643f88a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051603 Aug 04 05:07:29.318541 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3252/6394] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:07:29.509445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:29.510280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:29.517961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:29.518147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:29.519263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:29.519891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:29.789531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:29.809151 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-78e177b9-8ae5-4d32-90ff-011559afacc5 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.304867 Aug 04 05:07:29.809945 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3143/6395] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:29 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:29.877086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:29.878439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:29.886927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:29.887694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:29.888677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:29.889296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:30.125280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:30.135420 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8153e3a-a5b8-4924-af47-67dbc5df2988 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1277 microversion: 2.1 time: 0.262362 Aug 04 05:07:30.157428 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3253/6396] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:29 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1277 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:30.746263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-efe11f09-0c2c-41e1-a713-2d34f58bb643 req-f0f9b765-b586-4a4a-ae10-b4c9746164db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd7b239-214e-4690-9253-50aa2bd54956", "tag": "5104f60b-1d69-45b2-bf0d-47c86816a80c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:30.786555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-efe11f09-0c2c-41e1-a713-2d34f58bb643 req-f0f9b765-b586-4a4a-ae10-b4c9746164db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:30.788728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-efe11f09-0c2c-41e1-a713-2d34f58bb643 req-f0f9b765-b586-4a4a-ae10-b4c9746164db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:30.832358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:30.833778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:30.848810 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-efe11f09-0c2c-41e1-a713-2d34f58bb643 req-f0f9b765-b586-4a4a-ae10-b4c9746164db service nova] Creating event network-changed:5104f60b-1d69-45b2-bf0d-47c86816a80c for instance 1bd7b239-214e-4690-9253-50aa2bd54956 on n-h2-851337-5 Aug 04 05:07:30.858088 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-efe11f09-0c2c-41e1-a713-2d34f58bb643 req-f0f9b765-b586-4a4a-ae10-b4c9746164db service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117172 Aug 04 05:07:30.859680 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3144/6397] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:07:30.863619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:30.866218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:30.867556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:30.868157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:31.161928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:31.163246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:31.178697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:31.182071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:31.183822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:31.186593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:31.211197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:31.223936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-40182af3-9b40-4aa5-930f-7b860c3b5699 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1318 microversion: 2.1 time: 0.397859 Aug 04 05:07:31.229525 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3254/6398] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:30 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:31.501396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:31.511095 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b10eba34-5d7c-4f87-bb4c-2c96ad480fdd tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1277 microversion: 2.1 time: 0.355444 Aug 04 05:07:31.512428 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3145/6399] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:31 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1277 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:32.254034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:32.254837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:32.264576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:32.265387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:32.266312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:32.267158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:32.488903 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:32.501092 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b9cbdf7-4f21-4857-ab59-c1a8b4d7e0a7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1507 microversion: 2.1 time: 0.252332 Aug 04 05:07:32.501764 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3255/6400] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:32 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:32.524133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b7191919-60a8-431f-93fe-e88cd363770f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee358519-3911-4fc9-a6e2-4cfbbc88ba82", "device": "/dev/sdb"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:32.529741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b7191919-60a8-431f-93fe-e88cd363770f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:32.535291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:32.536701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:32.544855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:32.545082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7191919-60a8-431f-93fe-e88cd363770f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:32.545574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:32.546088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7191919-60a8-431f-93fe-e88cd363770f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:32.546987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7191919-60a8-431f-93fe-e88cd363770f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:32.547569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:32.547690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b7191919-60a8-431f-93fe-e88cd363770f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:32.548398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:32.831146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:32.848245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-daac65f1-38ee-4b6a-b6cf-6b14d0dea78a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1277 microversion: 2.1 time: 0.318453 Aug 04 05:07:32.850182 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3256/6401] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:32 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1277 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:32.952931 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b7191919-60a8-431f-93fe-e88cd363770f tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "POST /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433564 Aug 04 05:07:32.954201 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3146/6402] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:07:32 2022] POST /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:07:33.872653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:33.873290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:33.888988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:33.889466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:33.903866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:33.904350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:34.094644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:34.103851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b05ac785-02f6-40bd-ba0a-38c6001c6e6c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1277 microversion: 2.1 time: 0.237760 Aug 04 05:07:34.115917 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3257/6403] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:33 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:35.129233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:35.129942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:35.140691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:35.141447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:35.142386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:35.146314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:35.329077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:35.347473 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e1a4dc00-a3e2-467f-9828-5714afacfcf9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.223386 Aug 04 05:07:35.348795 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3147/6404] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:35 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:07:36.369969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:36.371051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:36.379705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:36.380174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:36.381293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:36.381930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:36.543638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:36.556412 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f617e759-258c-43b2-a64f-4cbbbb1c1a76 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.189215 Aug 04 05:07:36.557467 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3258/6405] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:36 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:37.577618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:37.578629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:37.582655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:37.598343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:37.599133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:37.600348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:37.601012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:37.608966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:37.689670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:37.783015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:37.791276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f301836c-9196-4cf7-b381-d1ab037933df tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.217957 Aug 04 05:07:37.794998 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3148/6406] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:37 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:38.813477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:38.814018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:38.816481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:38.818220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:38.827044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:38.827527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:38.828370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:38.828841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:39.086933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:39.094641 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-41231ebc-f718-431c-9348-95d922fb1bbc tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.285441 Aug 04 05:07:39.095534 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3259/6407] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:38 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:40.116128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:40.116754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:40.124786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:40.125239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:40.126020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:40.126459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:40.285337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:40.296658 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4d49f378-0a76-40e7-b725-873b524898af tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.184366 Aug 04 05:07:40.298996 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3149/6408] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:40 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:41.317553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:41.318529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:41.327348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:41.328939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:41.329785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:41.330241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:41.559257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:41.567833 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1e15a442-cf41-4430-a8dd-7487c8fe0e41 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.254634 Aug 04 05:07:41.568693 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3260/6409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:41 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:42.590543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:42.591951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:42.604863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:42.605327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:42.606189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:42.607403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:42.859477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:42.870187 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41ad9439-d677-42eb-84c8-4033e2c88df0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.283215 Aug 04 05:07:42.870819 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3150/6410] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:42 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:43.894773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:43.895428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:43.906703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:43.907541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:43.908681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:43.909559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:44.091100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:44.102222 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6e0f7af-1722-418a-be21-42a14611f71f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.211179 Aug 04 05:07:44.105534 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3261/6411] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:43 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:07:44.775632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-7134a478-06ff-4e11-aa41-e70da94c019a req-c0bc6850-876d-4aea-9a97-6ce159fc4c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd7b239-214e-4690-9253-50aa2bd54956", "name": "network-vif-plugged", "status": "completed", "tag": "5104f60b-1d69-45b2-bf0d-47c86816a80c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:44.795709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7134a478-06ff-4e11-aa41-e70da94c019a req-c0bc6850-876d-4aea-9a97-6ce159fc4c68 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:44.800972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7134a478-06ff-4e11-aa41-e70da94c019a req-c0bc6850-876d-4aea-9a97-6ce159fc4c68 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:44.824817 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-7134a478-06ff-4e11-aa41-e70da94c019a req-c0bc6850-876d-4aea-9a97-6ce159fc4c68 service nova] Creating event network-vif-plugged:5104f60b-1d69-45b2-bf0d-47c86816a80c for instance 1bd7b239-214e-4690-9253-50aa2bd54956 on n-h2-851337-5 Aug 04 05:07:44.831103 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-7134a478-06ff-4e11-aa41-e70da94c019a req-c0bc6850-876d-4aea-9a97-6ce159fc4c68 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062546 Aug 04 05:07:44.832029 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3151/6412] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:07:45.125970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:45.127286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:45.135427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:45.136271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:45.137155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:45.137825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:45.301457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:45.310687 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a880a8a2-3feb-4067-af4c-8696422ffafe tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.188813 Aug 04 05:07:45.311725 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3262/6413] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:45 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:46.335516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:46.337602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:46.367780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:46.368476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:46.369388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:46.370786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:46.624419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:46.634697 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6a75da9a-0140-449b-a417-c8f9f6885724 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1265 microversion: 2.1 time: 0.303435 Aug 04 05:07:46.635326 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3152/6414] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:46 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:47.656584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:47.658836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:47.667740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:47.668443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:47.669552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:47.670156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:47.972408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:47.984198 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d4181043-4236-4183-be96-0ef864b68727 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1452 microversion: 2.1 time: 0.331913 Aug 04 05:07:47.995927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3263/6415] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:47 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1452 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:07:48.004699 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:48.005317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:48.012832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:48.013287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:48.014064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:48.014502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:48.247270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:07:48.262336 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4cc9cbca-aaf3-49f4-bffd-4d8017391250 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1452 microversion: 2.1 time: 0.261296 Aug 04 05:07:48.263532 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3153/6416] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:07:47 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1452 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:07:51.065601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-63e98be0-0aae-4eb3-8890-62d803a751bc req-e0ed555d-6de3-440a-8cf0-874f955c7790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd7b239-214e-4690-9253-50aa2bd54956", "tag": "5104f60b-1d69-45b2-bf0d-47c86816a80c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:07:51.088692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:51.107674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-63e98be0-0aae-4eb3-8890-62d803a751bc req-e0ed555d-6de3-440a-8cf0-874f955c7790 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:51.109861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-63e98be0-0aae-4eb3-8890-62d803a751bc req-e0ed555d-6de3-440a-8cf0-874f955c7790 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:51.120516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:51.133305 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-63e98be0-0aae-4eb3-8890-62d803a751bc req-e0ed555d-6de3-440a-8cf0-874f955c7790 service nova] Creating event network-changed:5104f60b-1d69-45b2-bf0d-47c86816a80c for instance 1bd7b239-214e-4690-9253-50aa2bd54956 on n-h2-851337-5 Aug 04 05:07:51.143519 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-63e98be0-0aae-4eb3-8890-62d803a751bc req-e0ed555d-6de3-440a-8cf0-874f955c7790 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083592 Aug 04 05:07:51.144635 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3264/6417] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:07:56.708144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:56.710623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:07:56.722220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:56.723622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:56.724581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:07:56.725169 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:07:57.043762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lazy-loading 'services' on Instance uuid 60de4df5-82e6-4821-9567-2b927a36d47f {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:07:57.151504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d69a4940-2813-4dde-916d-00d786952b2b tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "DELETE /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f/os-volume_attachments/ee358519-3911-4fc9-a6e2-4cfbbc88ba82" status: 202 len: 0 microversion: 2.1 time: 0.453820 Aug 04 05:07:57.155751 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3154/6418] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:07:56 2022] DELETE /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f/os-volume_attachments/ee358519-3911-4fc9-a6e2-4cfbbc88ba82 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:08:02.597665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:02.603352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:02.608774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:08:02.609398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:08:02.621428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:02.622163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:02.623193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:02.623906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:02.656390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:08:02.767688 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2f264c3-542f-4567-b6d0-e6e57e2e4eba tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "DELETE /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 204 len: 0 microversion: 2.1 time: 0.170941 Aug 04 05:08:02.771922 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3265/6419] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:08:02 2022] DELETE /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:08:02.779848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:08:02.781633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:08:02.792443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:02.792946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:02.793683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:02.794122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:03.059834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:08:03.067460 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-31bbac6a-1234-4d93-af41-8ac59f77be31 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1513 microversion: 2.1 time: 0.293095 Aug 04 05:08:03.068046 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3155/6420] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:08:02 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:08:04.088750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:08:04.089518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:08:04.097000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:04.097501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:04.098453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:04.098907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:04.362985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:08:04.372352 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2b90f801-d946-4f5c-beb6-70473e7c0ff4 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1513 microversion: 2.1 time: 0.287750 Aug 04 05:08:04.373117 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3266/6421] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:08:04 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:08:05.158250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-eb9ac73d-75a5-4f16-bd77-d07e8433858f req-7a69cf19-2ea6-4b93-bd60-73e25e571d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60de4df5-82e6-4821-9567-2b927a36d47f", "name": "network-vif-deleted", "tag": "20a1c5ac-fc29-4c97-84ec-79516b06e196"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:08:05.191726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-eb9ac73d-75a5-4f16-bd77-d07e8433858f req-7a69cf19-2ea6-4b93-bd60-73e25e571d72 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:05.192378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-eb9ac73d-75a5-4f16-bd77-d07e8433858f req-7a69cf19-2ea6-4b93-bd60-73e25e571d72 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:05.206069 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-eb9ac73d-75a5-4f16-bd77-d07e8433858f req-7a69cf19-2ea6-4b93-bd60-73e25e571d72 service nova] Creating event network-vif-deleted:20a1c5ac-fc29-4c97-84ec-79516b06e196 for instance 60de4df5-82e6-4821-9567-2b927a36d47f on n-h1-851337-5 Aug 04 05:08:05.212805 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-eb9ac73d-75a5-4f16-bd77-d07e8433858f req-7a69cf19-2ea6-4b93-bd60-73e25e571d72 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057467 Aug 04 05:08:05.213732 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3156/6422] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:08:05.394309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:08:05.395097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:08:05.402656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:05.403203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:05.404149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:05.404682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:05.442634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:05.443211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:05.443784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lazy-loading 'fault' on Instance uuid 60de4df5-82e6-4821-9567-2b927a36d47f {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:08:05.492465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1308e506e491589aec0be4194b992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893df5beff3648809935af6a9b4972f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:08:05.506565 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-188fdb07-53c2-41e2-b984-2f4fa18c98b7 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 200 len: 1308 microversion: 2.1 time: 0.116412 Aug 04 05:08:05.528681 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3267/6423] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:08:05 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:08:06.537575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:08:06.538271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] [instance: 60de4df5-82e6-4821-9567-2b927a36d47f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:08:06.546336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:06.546794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:06.547780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:08:06.548384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:08:06.563000 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] HTTP exception thrown: Instance 60de4df5-82e6-4821-9567-2b927a36d47f could not be found. Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Request method failure captured: Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f HTTP/1.1 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61N504dXLT8yAiLdYtDMMeG2WBvuCsDmro6TM32saLXsO5ElyYM4ZEwTqyPG4smzt-fK5mBvP2wi_cHxuvDZuRNKjTSLMwe8G6H21AmnfkowiPRjfXFkKLaMBy0PkhrCS9n7eN84IBUk3tb2Rb70rzdx4itVaezDxq29e-Q201KASzI Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 893df5beff3648809935af6a9b4972f9 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1000649771 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/893df5beff3648809935af6a9b4972f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/893df5beff3648809935af6a9b4972f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/893df5beff3648809935af6a9b4972f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_893df5beff3648809935af6a9b4972f9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-VolumesSnapshotTestJSON-1000649771 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 893df5beff3648809935af6a9b4972f9 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1000649771 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-VolumesSnapshotTestJSON-1000649771-project Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 90d1308e506e491589aec0be4194b992 Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-VolumesSnapshotTestJSON-1000649771-project Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 60de4df5-82e6-4821-9567-2b927a36d47f could not be found. Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '60de4df5-82e6-4821-9567-2b927a36d47f'} Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60de4df5-82e6-4821-9567-2b927a36d47f could not be found. Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60de4df5-82e6-4821-9567-2b927a36d47f could not be found. Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:08:06.564813 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60de4df5-82e6-4821-9567-2b927a36d47f could not be found. Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] Returning 404 to user: Instance 60de4df5-82e6-4821-9567-2b927a36d47f could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5f7c210d-83d8-4c67-bb90-58fbe6a81758 tempest-VolumesSnapshotTestJSON-1000649771 tempest-VolumesSnapshotTestJSON-1000649771-project] 10.222.0.69 "GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f" status: 404 len: 111 microversion: 2.1 time: 0.033204 Aug 04 05:08:06.569244 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3157/6424] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:08:06 2022] GET /compute/v2.1/servers/60de4df5-82e6-4821-9567-2b927a36d47f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:09:28.252742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:28.253991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:28.398423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2444e07-3c64-422e-89b6-e0b2b9807693 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1107943334", "availability_zone": "foo_zone"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:28.401539 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:28.401539 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:09:28.403128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.aggregate [None req-b2444e07-3c64-422e-89b6-e0b2b9807693 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Generated uuid 5df908d3-809b-4146-b885-8823eae4296a for aggregate {{(pid=119343) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 05:09:28.444346 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2444e07-3c64-422e-89b6-e0b2b9807693 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.194261 Aug 04 05:09:28.445017 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3268/6425] 10.222.0.69 () {60 vars in 1164 bytes} [Thu Aug 4 05:09:28 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:28.454942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=19 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:28.455727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:28.460209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9e6beb87-83d7-4ba2-8218-dcfa800e7f07 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:28.462898 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:28.462898 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 05:09:28.473454 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e6beb87-83d7-4ba2-8218-dcfa800e7f07 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] [1b3553b0-2080-4552-b69c-cd78772dd193] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:09:29.481568 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e6beb87-83d7-4ba2-8218-dcfa800e7f07 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] [1b3553b0-2080-4552-b69c-cd78772dd193] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 57148. Aug 04 05:09:29.501942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9e6beb87-83d7-4ba2-8218-dcfa800e7f07 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 1.048988 Aug 04 05:09:29.502883 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3158/6426] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 05:09:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:29.515512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1679184-db74-4467-8d50-0c58c72ff687 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:29.518186 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:29.518186 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:09:29.519674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1679184-db74-4467-8d50-0c58c72ff687 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:29.520162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1679184-db74-4467-8d50-0c58c72ff687 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:29.520999 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1679184-db74-4467-8d50-0c58c72ff687 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:29.521474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1679184-db74-4467-8d50-0c58c72ff687 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:29.553104 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b1679184-db74-4467-8d50-0c58c72ff687 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042673 Aug 04 05:09:29.556576 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3269/6427] 10.222.0.69 () {58 vars in 1176 bytes} [Thu Aug 4 05:09:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:29.565716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41c862c4-fb9e-4c69-850e-5bae09434fc5 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:29.566481 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:29.566481 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 05:09:29.573832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41c862c4-fb9e-4c69-850e-5bae09434fc5 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.012201 Aug 04 05:09:29.574403 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3159/6428] 10.222.0.69 () {58 vars in 1143 bytes} [Thu Aug 4 05:09:29 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:29.586819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64dd746b-a82a-4c33-9ca0-625f863fc083 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-5"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:29.589446 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:29.589446 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:09:29.599465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64dd746b-a82a-4c33-9ca0-625f863fc083 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:29.600233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64dd746b-a82a-4c33-9ca0-625f863fc083 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:29.861875 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64dd746b-a82a-4c33-9ca0-625f863fc083 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.279379 Aug 04 05:09:29.862472 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3270/6429] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 05:09:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:09:29.873491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8183732-79aa-414b-8385-1e8723a10eba tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:29.874564 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:29.874564 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 05:09:29.883739 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b8183732-79aa-414b-8385-1e8723a10eba tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013768 Aug 04 05:09:29.884412 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3160/6430] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 05:09:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:09:29.896162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6305373f-1fec-4791-8b99-76b43d4213e1 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-453085807", "availability_zone": "foo_zone"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:29.899044 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:29.899044 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:09:29.943363 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6305373f-1fec-4791-8b99-76b43d4213e1 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.050866 Aug 04 05:09:29.944625 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3271/6431] 10.222.0.69 () {60 vars in 1173 bytes} [Thu Aug 4 05:09:29 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:29.956651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2ee6aa36-a312-48cd-a8f8-de511119a2b8 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:29.959164 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:29.959164 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 05:09:30.000158 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2ee6aa36-a312-48cd-a8f8-de511119a2b8 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.047118 Aug 04 05:09:30.000846 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3161/6432] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 05:09:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:30.014095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7e37aac8-9e34-4565-9050-7ccb30c6a069 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:30.016530 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:30.016530 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:09:30.026272 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7e37aac8-9e34-4565-9050-7ccb30c6a069 tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.017596 Aug 04 05:09:30.026980 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3272/6433] 10.222.0.69 () {58 vars in 1152 bytes} [Thu Aug 4 05:09:30 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:30.039012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2ec1557b-5f6c-493c-a436-dcbf9c1831dd tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-5"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:30.041530 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:30.041530 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 05:09:30.049606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ec1557b-5f6c-493c-a436-dcbf9c1831dd tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:30.050068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ec1557b-5f6c-493c-a436-dcbf9c1831dd tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:30.249876 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2ec1557b-5f6c-493c-a436-dcbf9c1831dd tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.214591 Aug 04 05:09:30.250446 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3162/6434] 10.222.0.69 () {60 vars in 1194 bytes} [Thu Aug 4 05:09:30 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:09:30.261969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-454522a1-3b9a-47aa-9572-8fcacf0301cd tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:30.262604 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:09:30.262604 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:09:30.286969 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-454522a1-3b9a-47aa-9572-8fcacf0301cd tempest-TestAggregatesBasicOps-1483903414 tempest-TestAggregatesBasicOps-1483903414-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.028748 Aug 04 05:09:30.287763 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3273/6435] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Aug 4 05:09:30 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 05:09:34.391730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1f9b8379-e09c-476c-bacb-6af33cd0f388 req-245dc653-44fd-4386-8443-d1929aac9626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd7b239-214e-4690-9253-50aa2bd54956", "tag": "5104f60b-1d69-45b2-bf0d-47c86816a80c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:34.398327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:34.398834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:34.414435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:34.414908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:34.415951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:34.416391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:34.418501 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1f9b8379-e09c-476c-bacb-6af33cd0f388 req-245dc653-44fd-4386-8443-d1929aac9626 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:34.430973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1f9b8379-e09c-476c-bacb-6af33cd0f388 req-245dc653-44fd-4386-8443-d1929aac9626 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:34.446399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:09:34.448311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1f9b8379-e09c-476c-bacb-6af33cd0f388 req-245dc653-44fd-4386-8443-d1929aac9626 service nova] Creating event network-changed:5104f60b-1d69-45b2-bf0d-47c86816a80c for instance 1bd7b239-214e-4690-9253-50aa2bd54956 on n-h2-851337-5 Aug 04 05:09:34.459484 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1f9b8379-e09c-476c-bacb-6af33cd0f388 req-245dc653-44fd-4386-8443-d1929aac9626 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072680 Aug 04 05:09:34.460929 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3274/6436] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:34.604126 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38e1a86d-9dab-4f1e-910f-6434976475c2 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 204 len: 0 microversion: 2.1 time: 0.221387 Aug 04 05:09:34.609257 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3163/6437] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:09:34 2022] DELETE /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:09:34.617866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:34.618900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:34.633034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:34.634779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:34.635698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:34.644388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:34.993191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:35.005454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d19194dc-aac4-41b9-aab7-ddbd0b101bbf tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1577 microversion: 2.1 time: 0.388479 Aug 04 05:09:35.015467 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3275/6438] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:34 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1577 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:36.041140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:36.042843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:36.062151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:36.065651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:36.067129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:36.067889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:36.752199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:36.760563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39701535-75ad-48fb-9286-aa2972983de0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1577 microversion: 2.1 time: 0.740529 Aug 04 05:09:36.761140 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3164/6439] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:36 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1577 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:37.449876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9b040ccc-da2f-4f91-8c93-3b953ccf0d00 req-14886870-ddab-444b-b573-b040dac273fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd7b239-214e-4690-9253-50aa2bd54956", "name": "network-vif-deleted", "tag": "5104f60b-1d69-45b2-bf0d-47c86816a80c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:37.461958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b040ccc-da2f-4f91-8c93-3b953ccf0d00 req-14886870-ddab-444b-b573-b040dac273fb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:37.462609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9b040ccc-da2f-4f91-8c93-3b953ccf0d00 req-14886870-ddab-444b-b573-b040dac273fb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:37.476705 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9b040ccc-da2f-4f91-8c93-3b953ccf0d00 req-14886870-ddab-444b-b573-b040dac273fb service nova] Creating event network-vif-deleted:5104f60b-1d69-45b2-bf0d-47c86816a80c for instance 1bd7b239-214e-4690-9253-50aa2bd54956 on n-h2-851337-5 Aug 04 05:09:37.482726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9b040ccc-da2f-4f91-8c93-3b953ccf0d00 req-14886870-ddab-444b-b573-b040dac273fb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120284 Aug 04 05:09:37.483937 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3276/6440] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:37.782609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:37.783954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:37.797114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:37.799580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:37.802313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:37.805086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:37.906404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:37.915414 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dc7e30d9-b372-4119-bda5-cc8526cbbf8c tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1225 microversion: 2.1 time: 0.136564 Aug 04 05:09:37.928739 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3165/6441] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:37 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:38.938667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:38.939451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:38.946162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:38.946549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:38.947623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:38.948127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:39.028431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:39.037952 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0eb22540-24da-420d-b906-f4c8e7a2fb3a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1225 microversion: 2.1 time: 0.104898 Aug 04 05:09:39.047198 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3277/6442] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:38 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:40.060266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:40.060886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:40.068360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:40.068819 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:40.069786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:40.070235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:40.136342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:40.149894 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a167bf1e-1de3-4253-8ffe-f8d61744b574 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1225 microversion: 2.1 time: 0.093411 Aug 04 05:09:40.151014 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3166/6443] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:40 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:09:41.171857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:41.172486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:41.176219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:41.181527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:41.181993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:41.182791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:41.183884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:41.548474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:41.556743 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70259952-64a7-43f3-8a0c-e40902e4ea81 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 200 len: 1225 microversion: 2.1 time: 0.389401 Aug 04 05:09:41.557689 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3278/6444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:41 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 1225 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:42.578139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:42.578781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: 1bd7b239-214e-4690-9253-50aa2bd54956] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:42.585587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:42.586041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:42.586829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:42.587296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:42.601934 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance 1bd7b239-214e-4690-9253-50aa2bd54956 could not be found. Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 HTTP/1.1 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 1bd7b239-214e-4690-9253-50aa2bd54956 could not be found. Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '1bd7b239-214e-4690-9253-50aa2bd54956'} Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd7b239-214e-4690-9253-50aa2bd54956 could not be found. Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd7b239-214e-4690-9253-50aa2bd54956 could not be found. Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:42.603698 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd7b239-214e-4690-9253-50aa2bd54956 could not be found. Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance 1bd7b239-214e-4690-9253-50aa2bd54956 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f68f44e-d41a-4879-b279-b24cb4d85050 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956" status: 404 len: 111 microversion: 2.1 time: 0.031405 Aug 04 05:09:42.610567 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3167/6445] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:42 2022] GET /compute/v2.1/servers/1bd7b239-214e-4690-9253-50aa2bd54956 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:09:46.693022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d1976fbd-2730-4038-962c-924c3d26587f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'create', calling method: .version_select at 0x7f191835c430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1407105456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb6L7Hj3a2y+ePLVhnZi1uvHKa12iAGT2DaS6h2Quuide+F7nFIonkKlRdWUIPADv0WpypNjOIGUqJsnlRylLigRNRdsbsiutWZGXpSxeP0Pq2ZaKi1igww/cq01Pd8OQ=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:46.718107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d1976fbd-2730-4038-962c-924c3d26587f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for project 8062d7fd38794f5c9879bb8714628689. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:09:46.726916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d1976fbd-2730-4038-962c-924c3d26587f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for user 9193f7efbeba44e0805c025bf2b7b052 and project 8062d7fd38794f5c9879bb8714628689. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:09:46.771858 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d1976fbd-2730-4038-962c-924c3d26587f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.084105 Aug 04 05:09:46.772680 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3279/6446] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:09:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:48.178803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1771832831", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "496a1bf0-1894-4e41-a40b-5e2aa3c3cc3f"}], "key_name": "tempest-TestNetworkBasicOps-1407105456", "security_groups": [{"name": "tempest-secgroup-smoke-753915706"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:48.294262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] validate_networks() for [('496a1bf0-1894-4e41-a40b-5e2aa3c3cc3f', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:09:48.816815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:09:48.817359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:09:48.818082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:09:48.818574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:09:48.819127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:09:48.829860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:48.830222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:48.831220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:48.831497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:48.857326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for project 8062d7fd38794f5c9879bb8714628689. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:09:48.864189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for user 9193f7efbeba44e0805c025bf2b7b052 and project 8062d7fd38794f5c9879bb8714628689. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:09:48.879958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:09:48.883123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:09:48.935414 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ae03c418-d8fb-4b8a-8a92-518268d664c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760524 Aug 04 05:09:48.941892 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3168/6447] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:09:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:09:48.947128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c7a8ccb-6a51-4a56-9d69-609f347a10c1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:48.947801 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c7a8ccb-6a51-4a56-9d69-609f347a10c1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:49.036328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c7a8ccb-6a51-4a56-9d69-609f347a10c1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:49.044548 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c7a8ccb-6a51-4a56-9d69-609f347a10c1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1249 microversion: 2.1 time: 0.100830 Aug 04 05:09:49.046466 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3280/6448] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:48 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:49.550575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:49.551222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:49.558922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:49.559291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:49.564136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:49.564826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:49.566818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3a4b3a26-606d-492f-9ff5-b04d5a2c5345 req-4bfec182-ab31-4974-b6d3-0dae56eb5c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4034aee-c0bd-424f-b0b2-6492cad5cc1e", "tag": "426f6023-0061-4ea0-aa0c-67eceef05ebe"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:49.577539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3a4b3a26-606d-492f-9ff5-b04d5a2c5345 req-4bfec182-ab31-4974-b6d3-0dae56eb5c34 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:49.578257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3a4b3a26-606d-492f-9ff5-b04d5a2c5345 req-4bfec182-ab31-4974-b6d3-0dae56eb5c34 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:49.590912 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3a4b3a26-606d-492f-9ff5-b04d5a2c5345 req-4bfec182-ab31-4974-b6d3-0dae56eb5c34 service nova] Creating event network-changed:426f6023-0061-4ea0-aa0c-67eceef05ebe for instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e on n-h2-851337-5 Aug 04 05:09:49.597329 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3a4b3a26-606d-492f-9ff5-b04d5a2c5345 req-4bfec182-ab31-4974-b6d3-0dae56eb5c34 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Aug 04 05:09:49.602064 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3281/6449] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:49.604581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:09:49.755274 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16ad5272-28fb-4daf-bf39-281d1363c55a tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 204 len: 0 microversion: 2.1 time: 0.209822 Aug 04 05:09:49.757162 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3169/6450] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:09:49 2022] DELETE /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:09:49.766995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:49.767724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:49.778863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:49.783577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:49.784687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:49.785453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:49.940099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:49.947938 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-71e0ae7e-9a26-410c-8db6-9bc5486653c0 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1577 microversion: 2.1 time: 0.185341 Aug 04 05:09:49.950252 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3282/6451] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:49 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:09:50.067193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:50.068186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:50.074724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:50.076011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:50.077186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:50.077923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:50.154317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:50.164246 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-529aa4f7-bfa7-45aa-be7d-857b1d314701 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1309 microversion: 2.1 time: 0.101932 Aug 04 05:09:50.165211 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3170/6452] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:50 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:50.975789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:50.977462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:50.986381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:50.986858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:50.987690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:50.988179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:51.137579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:51.145575 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1ac37a53-68be-4c31-aced-b2a6211de968 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1577 microversion: 2.1 time: 0.177805 Aug 04 05:09:51.160050 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3283/6453] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:50 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:51.185988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:51.186604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:51.200263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:51.200723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:51.201515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:51.201954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:51.370170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:51.378134 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-71f6a74e-6c50-410c-ab23-168f978ac6b5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1374 microversion: 2.1 time: 0.195979 Aug 04 05:09:51.378704 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3171/6454] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:51 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:52.066600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-59639dcc-1c90-451d-8aec-dc8900132d93 req-581ca9b6-5003-4c18-8a76-b6b86cd7aa08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4034aee-c0bd-424f-b0b2-6492cad5cc1e", "name": "network-vif-deleted", "tag": "426f6023-0061-4ea0-aa0c-67eceef05ebe"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:52.090782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-59639dcc-1c90-451d-8aec-dc8900132d93 req-581ca9b6-5003-4c18-8a76-b6b86cd7aa08 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:52.099025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-59639dcc-1c90-451d-8aec-dc8900132d93 req-581ca9b6-5003-4c18-8a76-b6b86cd7aa08 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:52.119538 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-59639dcc-1c90-451d-8aec-dc8900132d93 req-581ca9b6-5003-4c18-8a76-b6b86cd7aa08 service nova] Creating event network-vif-deleted:426f6023-0061-4ea0-aa0c-67eceef05ebe for instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e on n-h2-851337-5 Aug 04 05:09:52.125656 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-59639dcc-1c90-451d-8aec-dc8900132d93 req-581ca9b6-5003-4c18-8a76-b6b86cd7aa08 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064589 Aug 04 05:09:52.127301 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3284/6455] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:09:52.166624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:52.167374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:52.174875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:52.176582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:52.177892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:52.178659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:52.255944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:52.268579 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82ad306e-681a-48cd-9d54-95d85188f5f3 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1225 microversion: 2.1 time: 0.105840 Aug 04 05:09:52.269161 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3172/6456] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:52 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:52.399266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:52.400730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:52.407826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:52.408567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:52.409548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:52.410342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:52.583054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:52.591831 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ecba48fd-c115-4441-8384-4ea9fc790279 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1374 microversion: 2.1 time: 0.196726 Aug 04 05:09:52.592419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3285/6457] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:52 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:53.289577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:53.290230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:53.297484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:53.297933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:53.298711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:53.300988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:53.364359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:53.372611 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca147bb0-ab95-4d72-9e3e-99aabd747131 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1225 microversion: 2.1 time: 0.087061 Aug 04 05:09:53.373181 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3173/6458] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:53 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:53.612514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:53.613051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:53.620146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:53.621098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:53.621893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:53.622341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:53.763300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:53.771560 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2dcb74eb-4042-48d1-8be6-c0ac9ded6e87 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1374 microversion: 2.1 time: 0.162859 Aug 04 05:09:53.772154 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3286/6459] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:53 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:54.143714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-61abb305-68d4-4954-ab7e-a817c88c990a req-035ab00d-831e-40b8-ad8e-dee1ed5c5986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85044a9b-38cb-40e9-9b76-97b9155d0964", "tag": "fb249e32-dea3-4a0c-8ebb-c3e25bf59632"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:54.154257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-61abb305-68d4-4954-ab7e-a817c88c990a req-035ab00d-831e-40b8-ad8e-dee1ed5c5986 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:54.154795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-61abb305-68d4-4954-ab7e-a817c88c990a req-035ab00d-831e-40b8-ad8e-dee1ed5c5986 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:54.165900 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-61abb305-68d4-4954-ab7e-a817c88c990a req-035ab00d-831e-40b8-ad8e-dee1ed5c5986 service nova] Creating event network-changed:fb249e32-dea3-4a0c-8ebb-c3e25bf59632 for instance 85044a9b-38cb-40e9-9b76-97b9155d0964 on n-h1-851337-5 Aug 04 05:09:54.171687 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-61abb305-68d4-4954-ab7e-a817c88c990a req-035ab00d-831e-40b8-ad8e-dee1ed5c5986 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031640 Aug 04 05:09:54.172286 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3174/6460] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:09:54.393458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:54.394222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:54.400499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:54.401047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:54.402326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:54.402797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:54.468636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:54.476734 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c2730982-5ce4-4322-9c98-9d4279709064 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1225 microversion: 2.1 time: 0.087090 Aug 04 05:09:54.477334 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3287/6461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:54 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:54.793874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:54.794781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:54.801407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:54.801946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:54.802791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:54.803368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:54.958831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:54.967521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-148556b7-d055-4cf9-b79b-cd300105f8b9 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1374 microversion: 2.1 time: 0.178889 Aug 04 05:09:54.968390 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3175/6462] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:54 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:55.497992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:55.498640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:55.506029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:55.506500 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:55.507325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:55.507783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:55.570658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:55.579053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20b041a8-84bd-4286-87ae-0fda1d5c926d tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1225 microversion: 2.1 time: 0.084977 Aug 04 05:09:55.579842 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3288/6463] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:55 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:55.989147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:55.989796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:55.997042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:55.997499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:55.998280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:55.999056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:56.145636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:56.154827 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-89a01b70-14dc-43e3-ab4b-4fc27e72723f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1374 microversion: 2.1 time: 0.169578 Aug 04 05:09:56.155493 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3176/6464] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:55 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:56.601232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:56.601881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:56.610439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:56.610917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:56.611720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:56.612188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:56.648270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:56.648878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:56.649676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lazy-loading 'fault' on Instance uuid d4034aee-c0bd-424f-b0b2-6492cad5cc1e {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:09:56.695344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c283d053e8747468d90a2d54773e90d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98bbf61634f9e88d49ff4401c4514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:56.702367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46178b78-88f3-4b0a-bcab-fb681175c0b9 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 200 len: 1184 microversion: 2.1 time: 0.105765 Aug 04 05:09:56.702947 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3289/6465] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:56 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 1184 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:57.175982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:57.176632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:57.184204 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:57.184657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:57.185429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:57.185868 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:57.204365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:57.327236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:57.334703 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f5eae15-fcac-4abc-9de3-b36f44620928 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1374 microversion: 2.1 time: 0.162623 Aug 04 05:09:57.335323 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3177/6466] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:57 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:57.723762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:57.725046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: d4034aee-c0bd-424f-b0b2-6492cad5cc1e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:57.732638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:57.733098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:57.733882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:57.734620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:57.748586 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e could not be found. Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e HTTP/1.1 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e could not be found. Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'd4034aee-c0bd-424f-b0b2-6492cad5cc1e'} Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e could not be found. Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e could not be found. Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:57.750278 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e could not be found. Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance d4034aee-c0bd-424f-b0b2-6492cad5cc1e could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe9bafe3-e3fe-4f6f-a71b-2bebd6f9ac94 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e" status: 404 len: 111 microversion: 2.1 time: 0.032106 Aug 04 05:09:57.754907 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3290/6467] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:57 2022] GET /compute/v2.1/servers/d4034aee-c0bd-424f-b0b2-6492cad5cc1e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:09:57.774263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6ad1ffdb-f3e8-493e-9a69-3598f26e1896 req-cff48a23-0958-4fa8-936a-1ddf145abd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85044a9b-38cb-40e9-9b76-97b9155d0964", "name": "network-vif-plugged", "status": "completed", "tag": "fb249e32-dea3-4a0c-8ebb-c3e25bf59632"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:09:57.785074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ad1ffdb-f3e8-493e-9a69-3598f26e1896 req-cff48a23-0958-4fa8-936a-1ddf145abd39 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:57.785536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ad1ffdb-f3e8-493e-9a69-3598f26e1896 req-cff48a23-0958-4fa8-936a-1ddf145abd39 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:57.798079 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6ad1ffdb-f3e8-493e-9a69-3598f26e1896 req-cff48a23-0958-4fa8-936a-1ddf145abd39 service nova] Creating event network-vif-plugged:fb249e32-dea3-4a0c-8ebb-c3e25bf59632 for instance 85044a9b-38cb-40e9-9b76-97b9155d0964 on n-h1-851337-5 Aug 04 05:09:57.803320 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6ad1ffdb-f3e8-493e-9a69-3598f26e1896 req-cff48a23-0958-4fa8-936a-1ddf145abd39 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Aug 04 05:09:57.803921 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3178/6468] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:09:58.327613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:58.328134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:58.330163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:58.335870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:58.336340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:58.337136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:58.337593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:58.342141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=79 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:58.359692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:58.360460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:58.362771 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 HTTP/1.1 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1'} Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:09:58.365656 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a81ed8a8-616e-4446-bbe9-9e9092a842c6 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 404 len: 111 microversion: 2.1 time: 0.044173 Aug 04 05:09:58.370726 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3291/6469] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:09:58 2022] DELETE /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:09:58.371836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:58.371836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:58.371836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:58.371836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:58.375654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:58.376289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] [instance: a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:58.383615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:58.384087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:58.384889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:58.385344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:58.399672 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] HTTP exception thrown: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Request method failure captured: Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 HTTP/1.1 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Fjq5UsoFfM6JuvpZeRoFB2LCb5I3kaL7FhV1iNwp-COS_sPJLV6x0w3N96MNTVjuzosnMJkAgjABPx60Y5iIklD5YJGTbcyHi-IZG5ISIYxrUWvKTeLGlBRapIBEdu-o0y8lfqKlSOnsKzB1tvGeyr80anwejcLv4wEuvt1bUzqNg Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/37c98bbf61634f9e88d49ff4401c4514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_37c98bbf61634f9e88d49ff4401c4514", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 37c98bbf61634f9e88d49ff4401c4514 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestVolumeBootPattern-266732045 Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 6c283d053e8747468d90a2d54773e90d Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestVolumeBootPattern-266732045-project Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1'} Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:09:58.401164 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Returning 404 to user: Instance a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f12f5fe1-4ad3-4ad3-ac2b-6a78a814b251 tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1" status: 404 len: 111 microversion: 2.1 time: 0.031308 Aug 04 05:09:58.407160 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3292/6470] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:58 2022] GET /compute/v2.1/servers/a4abb8b0-4f2c-4125-8cac-7d5ebd5dfff1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:09:58.533811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:58.541484 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-affd7037-d8da-4bc7-8431-9230c839a524 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1374 microversion: 2.1 time: 0.190176 Aug 04 05:09:58.542063 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3179/6471] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:58 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:09:59.561583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:59.562221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:59.564988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:59.571448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:59.571923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:59.572730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:59.573174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:59.729815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:09:59.738187 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b06c0736-6c86-471c-a102-eb775962176f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1545 microversion: 2.1 time: 0.180496 Aug 04 05:09:59.738758 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3293/6472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:59 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1545 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:09:59.759060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:09:59.759716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:09:59.762328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:59.763194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:59.765054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:59.772099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:59.772432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:09:59.773215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:09:59.773656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:00.240511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:10:00.248026 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-72456d43-9a37-4dc4-9644-7ec54c8af1f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1545 microversion: 2.1 time: 0.492959 Aug 04 05:10:00.248602 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3180/6473] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:09:59 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1545 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:10:01.872920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2753e8b4-06b7-4b39-80e6-1ebec851d26f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] Calling method '.version_select at 0x7f191963ff70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:10:01.904796 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2753e8b4-06b7-4b39-80e6-1ebec851d26f tempest-TestVolumeBootPattern-266732045 tempest-TestVolumeBootPattern-266732045-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-328461503" status: 202 len: 0 microversion: 2.1 time: 0.036166 Aug 04 05:10:01.908874 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3294/6474] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Aug 4 05:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-328461503 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:10:02.320981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1ff26941-9e9f-42d9-87de-c4a578ce815a req-b22251ea-88e7-4f2f-a4b5-04a4a5404e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85044a9b-38cb-40e9-9b76-97b9155d0964", "tag": "fb249e32-dea3-4a0c-8ebb-c3e25bf59632"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:10:02.338963 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1ff26941-9e9f-42d9-87de-c4a578ce815a req-b22251ea-88e7-4f2f-a4b5-04a4a5404e63 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:02.339977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1ff26941-9e9f-42d9-87de-c4a578ce815a req-b22251ea-88e7-4f2f-a4b5-04a4a5404e63 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:02.360671 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1ff26941-9e9f-42d9-87de-c4a578ce815a req-b22251ea-88e7-4f2f-a4b5-04a4a5404e63 service nova] Creating event network-changed:fb249e32-dea3-4a0c-8ebb-c3e25bf59632 for instance 85044a9b-38cb-40e9-9b76-97b9155d0964 on n-h1-851337-5 Aug 04 05:10:02.373351 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1ff26941-9e9f-42d9-87de-c4a578ce815a req-b22251ea-88e7-4f2f-a4b5-04a4a5404e63 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055990 Aug 04 05:10:02.373966 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3181/6475] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:10:34.683061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=9 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:34.683899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:34.688908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2d049fe8-4715-438a-97a0-6144559ff8c7 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:10:34.691111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2d049fe8-4715-438a-97a0-6144559ff8c7 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:10:34.701447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d049fe8-4715-438a-97a0-6144559ff8c7 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:34.701919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d049fe8-4715-438a-97a0-6144559ff8c7 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:34.702716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d049fe8-4715-438a-97a0-6144559ff8c7 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:34.703836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2d049fe8-4715-438a-97a0-6144559ff8c7 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:34.767754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2d049fe8-4715-438a-97a0-6144559ff8c7 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964/action" status: 200 len: 24565 microversion: 2.1 time: 0.086798 Aug 04 05:10:34.768424 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3295/6476] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:10:34 2022] POST /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964/action => generated 24565 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:11:09.588175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:09.588925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=18 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:09.593471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d6b4246-4ada-4978-b345-1a364a7993af tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'create', calling method: .version_select at 0x7f191891faf0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1396506526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWNSAgHyhaRfoi9v7U2Hh7kOTSqZdWhhAmBRYYK97hu05zC4/CYVcGRRnnshdF5EfHmgEqs4YgoM6ZqFEj2o9PQyyTnBOgErcs536m7OaS9W15hyVNJ3ZS1D3enqgwaxQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:11:09.610219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4d6b4246-4ada-4978-b345-1a364a7993af tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for project 8062d7fd38794f5c9879bb8714628689. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:11:09.615510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-4d6b4246-4ada-4978-b345-1a364a7993af tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for user 9193f7efbeba44e0805c025bf2b7b052 and project 8062d7fd38794f5c9879bb8714628689. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:11:09.647685 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4d6b4246-4ada-4978-b345-1a364a7993af tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.061628 Aug 04 05:11:09.648306 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3182/6477] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:11:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:11:10.780017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1920833277", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "876d62d5-51cf-4ac8-9e37-91a3b2f2405d"}], "key_name": "tempest-TestNetworkBasicOps-1396506526", "security_groups": [{"name": "tempest-secgroup-smoke-859584583"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:11:10.789393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:10.790068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:10.898081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] validate_networks() for [('876d62d5-51cf-4ac8-9e37-91a3b2f2405d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:11:11.490218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:11:11.490876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:11:11.491662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:11:11.492096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:11:11.492531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:11:11.502018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:11.502486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:11.503345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:11.503800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:11.522001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for project 8062d7fd38794f5c9879bb8714628689. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:11:11.528956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for user 9193f7efbeba44e0805c025bf2b7b052 and project 8062d7fd38794f5c9879bb8714628689. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:11:11.541539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:11:11.543952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:11:11.592522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c0bea55-7b4a-4264-8025-7ae35d49ab23 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816818 Aug 04 05:11:11.599389 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3296/6478] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:11:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:11:11.606484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d1b48e2-5f6c-4d2d-85a0-2a5b72cbe042 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:11.607303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d1b48e2-5f6c-4d2d-85a0-2a5b72cbe042 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:11.669677 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d1b48e2-5f6c-4d2d-85a0-2a5b72cbe042 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:11.677167 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d1b48e2-5f6c-4d2d-85a0-2a5b72cbe042 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1249 microversion: 2.1 time: 0.075679 Aug 04 05:11:11.677739 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3183/6479] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:11 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:11:12.698778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:12.699610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:12.707599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:12.708073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:12.708876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:12.709574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:12.775430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:12.784305 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2ba9c60e-027a-4c19-8328-d78e3f3d3569 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1319 microversion: 2.1 time: 0.090212 Aug 04 05:11:12.785134 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3297/6480] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:12 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:13.805707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:13.806495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:13.814053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:13.814494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:13.815312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:13.815733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:13.952221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:13.960306 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f5aee0d-a2de-4acf-bdef-1f4247c0dc6f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1374 microversion: 2.1 time: 0.158647 Aug 04 05:11:13.960940 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3184/6481] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:13 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:14.044557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3676b302-d7f0-42f7-af0b-2ecdeef9a1c1 req-a2d60188-c441-4b80-8921-11c8c899fe2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4114e290-e185-49a4-a4fb-033a10a8732d", "tag": "818e65bd-2693-45e0-aa9d-e0a927704c67"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:11:14.058802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3676b302-d7f0-42f7-af0b-2ecdeef9a1c1 req-a2d60188-c441-4b80-8921-11c8c899fe2a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:14.059300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3676b302-d7f0-42f7-af0b-2ecdeef9a1c1 req-a2d60188-c441-4b80-8921-11c8c899fe2a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:14.071350 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3676b302-d7f0-42f7-af0b-2ecdeef9a1c1 req-a2d60188-c441-4b80-8921-11c8c899fe2a service nova] Creating event network-changed:818e65bd-2693-45e0-aa9d-e0a927704c67 for instance 4114e290-e185-49a4-a4fb-033a10a8732d on n-h2-851337-5 Aug 04 05:11:14.076329 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3676b302-d7f0-42f7-af0b-2ecdeef9a1c1 req-a2d60188-c441-4b80-8921-11c8c899fe2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036442 Aug 04 05:11:14.076945 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3298/6482] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:11:14.985947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:14.986858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:14.994621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:14.995293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:14.996199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:14.996737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:15.432221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:15.440894 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9913bb73-86e5-4f0e-9197-1817ecc51b01 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1374 microversion: 2.1 time: 0.458994 Aug 04 05:11:15.441588 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3185/6483] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:14 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1374 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:16.463329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:16.464067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:16.471019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:16.471491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:16.472278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:16.472729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:16.606726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:16.614826 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ce0fd59-8cd5-4a01-abfe-0e095db7fab4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1374 microversion: 2.1 time: 0.156681 Aug 04 05:11:16.615358 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3299/6484] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:16 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:17.636114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:17.636724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:17.644281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:17.644766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:17.645550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:17.645990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:17.794148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:17.801801 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6c76413-80ef-4027-927a-e67683078332 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1374 microversion: 2.1 time: 0.169657 Aug 04 05:11:17.802396 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3186/6485] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:17 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:11:17.998098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-85910b65-5ad8-4a71-9819-7e1b48fb2d82 req-23129590-bf8b-4cdc-80ef-ebef3798f9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4114e290-e185-49a4-a4fb-033a10a8732d", "name": "network-vif-plugged", "status": "completed", "tag": "818e65bd-2693-45e0-aa9d-e0a927704c67"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:11:18.010054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-85910b65-5ad8-4a71-9819-7e1b48fb2d82 req-23129590-bf8b-4cdc-80ef-ebef3798f9b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:18.010513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-85910b65-5ad8-4a71-9819-7e1b48fb2d82 req-23129590-bf8b-4cdc-80ef-ebef3798f9b5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:18.024007 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-85910b65-5ad8-4a71-9819-7e1b48fb2d82 req-23129590-bf8b-4cdc-80ef-ebef3798f9b5 service nova] Creating event network-vif-plugged:818e65bd-2693-45e0-aa9d-e0a927704c67 for instance 4114e290-e185-49a4-a4fb-033a10a8732d on n-h2-851337-5 Aug 04 05:11:18.029063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-85910b65-5ad8-4a71-9819-7e1b48fb2d82 req-23129590-bf8b-4cdc-80ef-ebef3798f9b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180480 Aug 04 05:11:18.029654 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3300/6486] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:11:18.822360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:18.823027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:18.829937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:18.830388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:18.831180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:18.831616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:18.963062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:18.971343 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91ace2e5-98af-4a95-a068-f7b32513f079 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1374 microversion: 2.1 time: 0.152778 Aug 04 05:11:18.971924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3187/6487] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:18 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:19.993686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:19.994310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:20.001294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:20.001757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:20.002529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:20.003019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:20.135113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:20.142745 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b7093694-d13e-4138-8498-2257b930f001 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1546 microversion: 2.1 time: 0.154243 Aug 04 05:11:20.143373 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3301/6488] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:19 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:20.165213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:20.165213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:20.170719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:20.171202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:20.171970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:20.172906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:20.308602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:20.316113 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53aee42f-683b-4968-9121-ee643ea279c5 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1546 microversion: 2.1 time: 0.156944 Aug 04 05:11:20.316688 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3188/6489] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:20 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:46.147160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:46.148253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:46.150696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:46.152020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:46.153009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:46.153900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=24 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:46.164019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:46.164492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:46.165295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:46.165744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:46.194766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:11:46.275953 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc35d797-424d-40c8-b7b1-94e70ed50610 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 204 len: 0 microversion: 2.1 time: 0.134490 Aug 04 05:11:46.280139 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3302/6490] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:11:46 2022] DELETE /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:11:46.286074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:46.286690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:46.288622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:46.289728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:46.290568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=30 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:46.298203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:46.298685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:46.299511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:46.299945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:46.442568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:46.451736 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76de1b4a-3500-43f5-946b-bf27e4316608 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1552 microversion: 2.1 time: 0.169856 Aug 04 05:11:46.452327 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3189/6491] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:46 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:47.476735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:47.477460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:47.484582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:47.485058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:47.485860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:47.486321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:47.620593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:47.628890 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f3290ac4-ce36-4b10-9a85-dfd44d3cda68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 200 len: 1552 microversion: 2.1 time: 0.156461 Aug 04 05:11:47.629471 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3303/6492] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:47 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:48.142105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2f79f7dd-bae4-4c97-8972-793f266b3676 req-9c072ad0-701f-45a9-a3b9-65462a19e630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4114e290-e185-49a4-a4fb-033a10a8732d", "name": "network-vif-deleted", "tag": "818e65bd-2693-45e0-aa9d-e0a927704c67"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:11:48.153926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2f79f7dd-bae4-4c97-8972-793f266b3676 req-9c072ad0-701f-45a9-a3b9-65462a19e630 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:48.154371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2f79f7dd-bae4-4c97-8972-793f266b3676 req-9c072ad0-701f-45a9-a3b9-65462a19e630 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:48.167358 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2f79f7dd-bae4-4c97-8972-793f266b3676 req-9c072ad0-701f-45a9-a3b9-65462a19e630 service nova] Creating event network-vif-deleted:818e65bd-2693-45e0-aa9d-e0a927704c67 for instance 4114e290-e185-49a4-a4fb-033a10a8732d on n-h2-851337-5 Aug 04 05:11:48.172688 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2f79f7dd-bae4-4c97-8972-793f266b3676 req-9c072ad0-701f-45a9-a3b9-65462a19e630 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112586 Aug 04 05:11:48.173465 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3190/6493] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:11:48.651063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:48.651599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 4114e290-e185-49a4-a4fb-033a10a8732d] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:48.658980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:48.659460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:48.660238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:48.660686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:48.675171 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] HTTP exception thrown: Instance 4114e290-e185-49a4-a4fb-033a10a8732d could not be found. Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Request method failure captured: Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d HTTP/1.1 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61STtjtX6Wq9LzEzwtufeunFuPu9OHeihB10kVlOKjZQ83a7rp4NbJfdpXv3YL5oPUJjFz-2cf0xSZAHTbesksD-f16tSBgEwrq2RYekifkae8KUYxTfoT3wtezNv-7ERG-G9i7k3cr1QnN41t1SyBSAEJtvnMTFAFqZCUuPr97UE4U Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 8062d7fd38794f5c9879bb8714628689 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8062d7fd38794f5c9879bb8714628689", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 8062d7fd38794f5c9879bb8714628689 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestNetworkBasicOps-2100028427-project Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 9193f7efbeba44e0805c025bf2b7b052 Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestNetworkBasicOps-2100028427-project Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 4114e290-e185-49a4-a4fb-033a10a8732d could not be found. Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '4114e290-e185-49a4-a4fb-033a10a8732d'} Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4114e290-e185-49a4-a4fb-033a10a8732d could not be found. Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4114e290-e185-49a4-a4fb-033a10a8732d could not be found. Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:11:48.676864 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4114e290-e185-49a4-a4fb-033a10a8732d could not be found. Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Returning 404 to user: Instance 4114e290-e185-49a4-a4fb-033a10a8732d could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3fdd8787-a5be-42aa-a543-62c864a461f4 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d" status: 404 len: 111 microversion: 2.1 time: 0.031251 Aug 04 05:11:48.682206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3304/6494] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:48 2022] GET /compute/v2.1/servers/4114e290-e185-49a4-a4fb-033a10a8732d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:11:48.853521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b6e24a53-889f-4ae9-a7b5-ae938f1f9cf0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '.version_select at 0x7f1918b70d30>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:48.875830 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b6e24a53-889f-4ae9-a7b5-ae938f1f9cf0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1396506526" status: 202 len: 0 microversion: 2.1 time: 0.026056 Aug 04 05:11:48.876450 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3191/6495] 10.222.0.69 () {58 vars in 1257 bytes} [Thu Aug 4 05:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1396506526 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:11:50.589832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:50.596865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-f9b30357-a900-4048-ab32-5b0750066341 req-98337183-f245-4d9d-b6ee-3bc2675c6d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85044a9b-38cb-40e9-9b76-97b9155d0964", "tag": "fb249e32-dea3-4a0c-8ebb-c3e25bf59632"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:11:50.597567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:50.605486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:50.606048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:50.606933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:50.607412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:50.607956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f9b30357-a900-4048-ab32-5b0750066341 req-98337183-f245-4d9d-b6ee-3bc2675c6d3d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:50.608412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-f9b30357-a900-4048-ab32-5b0750066341 req-98337183-f245-4d9d-b6ee-3bc2675c6d3d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:50.620188 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-f9b30357-a900-4048-ab32-5b0750066341 req-98337183-f245-4d9d-b6ee-3bc2675c6d3d service nova] Creating event network-changed:fb249e32-dea3-4a0c-8ebb-c3e25bf59632 for instance 85044a9b-38cb-40e9-9b76-97b9155d0964 on n-h1-851337-5 Aug 04 05:11:50.625706 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-f9b30357-a900-4048-ab32-5b0750066341 req-98337183-f245-4d9d-b6ee-3bc2675c6d3d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034036 Aug 04 05:11:50.626468 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3192/6496] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:11:50.637480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:11:50.723164 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe8d3899-3c08-465f-a93f-66c88a296431 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "DELETE /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 204 len: 0 microversion: 2.1 time: 0.136846 Aug 04 05:11:50.724454 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3305/6497] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:11:50 2022] DELETE /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:11:50.733442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:50.734159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:50.740920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:50.741378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:50.742160 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:50.742605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:50.891801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:50.900151 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e023c60-b8fe-4ecc-80b9-f72dee900cd1 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1669 microversion: 2.1 time: 0.171127 Aug 04 05:11:50.900718 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3193/6498] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:50 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:51.922362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:51.923112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:51.930936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:51.931431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:51.932231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:51.932686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:52.072644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:52.080821 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffbc93ab-1afb-49b4-86d1-c15383423b0a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1669 microversion: 2.1 time: 0.162919 Aug 04 05:11:52.081399 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3306/6499] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:51 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:52.720117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3a4cc194-e69d-45c3-9f49-7bdbc5395a97 req-168cee4b-6cc8-4046-b256-2c3b699b2011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85044a9b-38cb-40e9-9b76-97b9155d0964", "name": "network-vif-deleted", "tag": "fb249e32-dea3-4a0c-8ebb-c3e25bf59632"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:11:52.731636 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3a4cc194-e69d-45c3-9f49-7bdbc5395a97 req-168cee4b-6cc8-4046-b256-2c3b699b2011 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:52.732092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3a4cc194-e69d-45c3-9f49-7bdbc5395a97 req-168cee4b-6cc8-4046-b256-2c3b699b2011 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:52.744006 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3a4cc194-e69d-45c3-9f49-7bdbc5395a97 req-168cee4b-6cc8-4046-b256-2c3b699b2011 service nova] Creating event network-vif-deleted:fb249e32-dea3-4a0c-8ebb-c3e25bf59632 for instance 85044a9b-38cb-40e9-9b76-97b9155d0964 on n-h1-851337-5 Aug 04 05:11:52.749893 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3a4cc194-e69d-45c3-9f49-7bdbc5395a97 req-168cee4b-6cc8-4046-b256-2c3b699b2011 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 Aug 04 05:11:52.751133 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3194/6500] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:11:53.105339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:53.107817 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:53.118114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:53.118585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:53.119836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:53.120582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:53.162347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:53.162825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:53.163350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lazy-loading 'fault' on Instance uuid 85044a9b-38cb-40e9-9b76-97b9155d0964 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:11:53.210264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:11:53.218309 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20f1cc91-f526-4031-b889-c84db73925eb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 200 len: 1339 microversion: 2.1 time: 0.119332 Aug 04 05:11:53.218916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3307/6501] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:53 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 1339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:11:54.242298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:54.243028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 85044a9b-38cb-40e9-9b76-97b9155d0964] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:11:54.249392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:54.249851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:54.250621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:11:54.251090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:11:54.265048 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] HTTP exception thrown: Instance 85044a9b-38cb-40e9-9b76-97b9155d0964 could not be found. Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Request method failure captured: Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 HTTP/1.1 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61STtjtX6Wq9LzEzwtufeunFuPu9OHeihB10kVlOKjZQ83a7rp4NbJfdpXv3YL5oPUJjFz-2cf0xSZAHTbesksD-f16tSBgEwrq2RYekifkae8KUYxTfoT3wtezNv-7ERG-G9i7k3cr1QnN41t1SyBSAEJtvnMTFAFqZCUuPr97UE4U Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 8062d7fd38794f5c9879bb8714628689 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8062d7fd38794f5c9879bb8714628689", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 8062d7fd38794f5c9879bb8714628689 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestNetworkBasicOps-2100028427-project Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 9193f7efbeba44e0805c025bf2b7b052 Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestNetworkBasicOps-2100028427-project Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 85044a9b-38cb-40e9-9b76-97b9155d0964 could not be found. Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '85044a9b-38cb-40e9-9b76-97b9155d0964'} Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85044a9b-38cb-40e9-9b76-97b9155d0964 could not be found. Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85044a9b-38cb-40e9-9b76-97b9155d0964 could not be found. Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:11:54.266720 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85044a9b-38cb-40e9-9b76-97b9155d0964 could not be found. Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Returning 404 to user: Instance 85044a9b-38cb-40e9-9b76-97b9155d0964 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb084690-9c58-4a04-9a00-dc2edd757a14 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964" status: 404 len: 111 microversion: 2.1 time: 0.031084 Aug 04 05:11:54.272182 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3195/6502] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:11:54 2022] GET /compute/v2.1/servers/85044a9b-38cb-40e9-9b76-97b9155d0964 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:11:54.432737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67cf6bed-95fe-42eb-ba20-2a2683b4788d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '.version_select at 0x7f1919538940>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:11:54.462406 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67cf6bed-95fe-42eb-ba20-2a2683b4788d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1407105456" status: 202 len: 0 microversion: 2.1 time: 0.033401 Aug 04 05:11:54.462994 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3308/6503] 10.222.0.69 () {58 vars in 1257 bytes} [Thu Aug 4 05:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1407105456 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:12:02.828714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-661ad24a-bf4c-4fdb-8d6d-570195ef3e45 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'create', calling method: .version_select at 0x7f1918fb23a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-676794194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbF/YT+BBn1/TYEl3g/6j+E9nmSVBqGq5vJoqO342CFrJ+IYg+NOCCBPCFyI3cM+h+DprMDLhEv6RFor8xGw9y5Rm0969nKEBs6HJA4AV0fm4HL/c0KY9w51zL1NBk7mg=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:12:02.867114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-661ad24a-bf4c-4fdb-8d6d-570195ef3e45 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for project 8062d7fd38794f5c9879bb8714628689. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:12:02.873718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-661ad24a-bf4c-4fdb-8d6d-570195ef3e45 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for user 9193f7efbeba44e0805c025bf2b7b052 and project 8062d7fd38794f5c9879bb8714628689. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:12:02.919491 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-661ad24a-bf4c-4fdb-8d6d-570195ef3e45 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.099998 Aug 04 05:12:02.920097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3196/6504] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:12:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:12:04.025463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-378925439", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "a68668a6-52e7-4fe5-b34e-d26f33d7747b"}], "key_name": "tempest-TestNetworkBasicOps-676794194", "security_groups": [{"name": "tempest-secgroup-smoke-1834489945"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:12:04.040054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:04.145440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] validate_networks() for [('a68668a6-52e7-4fe5-b34e-d26f33d7747b', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:12:04.923050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:12:04.924188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:12:04.924811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:12:04.925315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:12:04.925856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:12:04.936071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:04.936543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:04.937372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:04.937829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:04.957228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for project 8062d7fd38794f5c9879bb8714628689. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:12:04.963596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Getting quotas for user 9193f7efbeba44e0805c025bf2b7b052 and project 8062d7fd38794f5c9879bb8714628689. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:12:04.977879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:12:04.980359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:12:05.029356 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5d29206-ad4c-4294-b173-f4a70f449394 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.012700 Aug 04 05:12:05.031116 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3309/6505] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:12:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:12:05.041077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9f9e5792-cbf9-42bf-9ac9-3d1c8b94fc62 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:05.041689 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9f9e5792-cbf9-42bf-9ac9-3d1c8b94fc62 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:05.045096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=20 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:05.105484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9f9e5792-cbf9-42bf-9ac9-3d1c8b94fc62 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:05.112994 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9f9e5792-cbf9-42bf-9ac9-3d1c8b94fc62 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1247 microversion: 2.1 time: 0.075921 Aug 04 05:12:05.114001 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3197/6506] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:05 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:06.133666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3545ce69-cb27-4cd0-815e-278e5f49ff8f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:06.134398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3545ce69-cb27-4cd0-815e-278e5f49ff8f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:06.193383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3545ce69-cb27-4cd0-815e-278e5f49ff8f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:06.201223 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3545ce69-cb27-4cd0-815e-278e5f49ff8f tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1247 microversion: 2.1 time: 0.072096 Aug 04 05:12:06.201794 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3310/6507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:06 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:07.222416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0ec240a2-a4a9-4bd6-a74f-66f251d8d211 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:07.223186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0ec240a2-a4a9-4bd6-a74f-66f251d8d211 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:07.276607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0ec240a2-a4a9-4bd6-a74f-66f251d8d211 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:07.286265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0ec240a2-a4a9-4bd6-a74f-66f251d8d211 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1247 microversion: 2.1 time: 0.067796 Aug 04 05:12:07.288294 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3198/6508] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:07 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:08.308179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c5cd38ae-5bbe-4b42-bafa-ed0afb582a72 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:08.308803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c5cd38ae-5bbe-4b42-bafa-ed0afb582a72 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:08.361446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c5cd38ae-5bbe-4b42-bafa-ed0afb582a72 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:08.368226 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c5cd38ae-5bbe-4b42-bafa-ed0afb582a72 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1247 microversion: 2.1 time: 0.063924 Aug 04 05:12:08.368824 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3311/6509] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:08 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1247 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:09.389737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:09.390336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:09.399263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:09.399732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:09.400527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:09.400979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:09.464022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:09.472113 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c2f4f27c-926c-4797-9b63-c8a0087fa0f0 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1251 microversion: 2.1 time: 0.086275 Aug 04 05:12:09.472727 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3199/6510] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:09 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1251 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:10.493300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:10.493723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:10.503442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:10.504061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:10.505013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:10.506003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:10.590246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:10.597890 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a033cb87-d08a-4d38-bcf2-de8519bc7cbd tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1305 microversion: 2.1 time: 0.108758 Aug 04 05:12:10.598474 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3312/6511] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:10 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:11.570538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0c658923-6201-4691-9731-22db3c3e374f req-c3ef508d-48c4-42b9-ac05-8a9a1dab0b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f66e1c0-f57d-4f67-a6f5-6d748d819d0f", "tag": "713f1632-f8b4-474b-b5de-ba9eba461c76"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:12:11.584472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0c658923-6201-4691-9731-22db3c3e374f req-c3ef508d-48c4-42b9-ac05-8a9a1dab0b9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:11.584909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0c658923-6201-4691-9731-22db3c3e374f req-c3ef508d-48c4-42b9-ac05-8a9a1dab0b9d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:11.598026 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0c658923-6201-4691-9731-22db3c3e374f req-c3ef508d-48c4-42b9-ac05-8a9a1dab0b9d service nova] Creating event network-changed:713f1632-f8b4-474b-b5de-ba9eba461c76 for instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f on n-h1-851337-5 Aug 04 05:12:11.603774 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0c658923-6201-4691-9731-22db3c3e374f req-c3ef508d-48c4-42b9-ac05-8a9a1dab0b9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038691 Aug 04 05:12:11.604786 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3200/6512] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:12:11.621796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:11.622540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:11.631247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:11.632057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:11.632897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:11.633355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:11.857302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:11.865225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-68ff0465-f025-4ef4-a7f2-cd017c876ec2 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1373 microversion: 2.1 time: 0.249373 Aug 04 05:12:11.865810 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3313/6513] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:11 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1373 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:12.886652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:12.887383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:12.895140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:12.895633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:12.896407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:12.896851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:13.032979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:13.041024 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b141514d-7faf-4bde-a34f-1f6811e8342d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1373 microversion: 2.1 time: 0.158691 Aug 04 05:12:13.041597 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3201/6514] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:12 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:14.062314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:14.062936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:14.074255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:14.074734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:14.075620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:14.076084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:14.221794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:14.230379 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9522a5a-e1b2-4e67-bb35-1991d72a820e tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1373 microversion: 2.1 time: 0.172102 Aug 04 05:12:14.230995 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3314/6515] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:14 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:15.251900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:15.252523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:15.260936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:15.261371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:15.262147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:15.262588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:15.394971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:15.402752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7f9ae8f9-71a2-454f-8a0c-6c3791ccc2b3 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1373 microversion: 2.1 time: 0.154873 Aug 04 05:12:15.403363 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3202/6516] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:15 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:16.423660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:16.424301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:16.426895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:16.428247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:16.434172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:16.434657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:16.435481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:16.435941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:16.580585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:16.588499 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-318d7f7c-af6a-48e5-8e9f-a0a0d4d83dbf tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1373 microversion: 2.1 time: 0.168931 Aug 04 05:12:16.589065 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3315/6517] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:16 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:17.609763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:17.610311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:17.613778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:17.614454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:17.620326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:17.620785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:17.621600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:17.622049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:17.760790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:17.768420 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd8c5d03-d5d3-4496-a7e9-59639a1998b6 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1373 microversion: 2.1 time: 0.162669 Aug 04 05:12:17.769010 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3203/6518] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:17 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:18.373669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7f726c96-4607-4eba-b8c1-8e570438e47a req-030083ac-b65a-492a-a602-c754eac62fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f66e1c0-f57d-4f67-a6f5-6d748d819d0f", "name": "network-vif-plugged", "status": "completed", "tag": "713f1632-f8b4-474b-b5de-ba9eba461c76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:12:18.380335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:18.387228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f726c96-4607-4eba-b8c1-8e570438e47a req-030083ac-b65a-492a-a602-c754eac62fe2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:18.387697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7f726c96-4607-4eba-b8c1-8e570438e47a req-030083ac-b65a-492a-a602-c754eac62fe2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:18.399445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7f726c96-4607-4eba-b8c1-8e570438e47a req-030083ac-b65a-492a-a602-c754eac62fe2 service nova] Creating event network-vif-plugged:713f1632-f8b4-474b-b5de-ba9eba461c76 for instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f on n-h1-851337-5 Aug 04 05:12:18.404452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7f726c96-4607-4eba-b8c1-8e570438e47a req-030083ac-b65a-492a-a602-c754eac62fe2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034649 Aug 04 05:12:18.405061 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3316/6519] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:12:18.789335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:18.789952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:18.796889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:18.797349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:18.798122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:18.798560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:18.928966 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:18.936433 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f6a4a39-4dc1-4409-b1ac-e24d882242df tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1373 microversion: 2.1 time: 0.151022 Aug 04 05:12:18.937009 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3204/6520] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:18 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:19.959993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:19.960619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:19.968079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:19.968605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:19.969384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:19.973045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:20.115961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:20.123552 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-81c680a4-b2d6-408d-aa4a-c03ceadacdeb tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1546 microversion: 2.1 time: 0.169390 Aug 04 05:12:20.124145 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3317/6521] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:19 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:20.143874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:12:20.144569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:20.151864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:20.152316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:20.153078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:20.153508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:20.283545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:12:20.291065 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0c82b5b5-c70b-4adf-8e9b-d65a16a1bc68 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1546 microversion: 2.1 time: 0.150951 Aug 04 05:12:20.291639 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3205/6522] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:12:20 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:12:21.886379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-71a48c72-8e17-4190-853b-b707848ec0b6 req-bb2909a2-e5b1-4e1b-8337-0049381f1507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f66e1c0-f57d-4f67-a6f5-6d748d819d0f", "tag": "713f1632-f8b4-474b-b5de-ba9eba461c76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:12:21.903283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-71a48c72-8e17-4190-853b-b707848ec0b6 req-bb2909a2-e5b1-4e1b-8337-0049381f1507 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:21.903754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-71a48c72-8e17-4190-853b-b707848ec0b6 req-bb2909a2-e5b1-4e1b-8337-0049381f1507 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:21.916332 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-71a48c72-8e17-4190-853b-b707848ec0b6 req-bb2909a2-e5b1-4e1b-8337-0049381f1507 service nova] Creating event network-changed:713f1632-f8b4-474b-b5de-ba9eba461c76 for instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f on n-h1-851337-5 Aug 04 05:12:21.921519 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-71a48c72-8e17-4190-853b-b707848ec0b6 req-bb2909a2-e5b1-4e1b-8337-0049381f1507 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038933 Aug 04 05:12:21.922120 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3318/6523] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:12:53.923842 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:12:53.924441 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:12:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:12:54.237343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-797071d2-750a-4354-9535-e3041696712b tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:12:54.239487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-797071d2-750a-4354-9535-e3041696712b tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:12:54.242139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=5 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:54.242807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=38 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:54.249007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-797071d2-750a-4354-9535-e3041696712b tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:54.249471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-797071d2-750a-4354-9535-e3041696712b tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:54.250252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-797071d2-750a-4354-9535-e3041696712b tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:12:54.250696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-797071d2-750a-4354-9535-e3041696712b tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:12:54.311831 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-797071d2-750a-4354-9535-e3041696712b tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f/action" status: 200 len: 24573 microversion: 2.1 time: 0.078624 Aug 04 05:12:54.312469 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3206/6524] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:12:54 2022] POST /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f/action => generated 24573 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:13:25.164712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=7 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:25.165432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=36 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:25.170368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8073200a-4803-458a-901a-466311d2692d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:25.172725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8073200a-4803-458a-901a-466311d2692d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:25.180696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8073200a-4803-458a-901a-466311d2692d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:25.181161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8073200a-4803-458a-901a-466311d2692d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:25.181956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8073200a-4803-458a-901a-466311d2692d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:25.182412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8073200a-4803-458a-901a-466311d2692d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:25.245885 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8073200a-4803-458a-901a-466311d2692d tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "POST /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f/action" status: 200 len: 32650 microversion: 2.1 time: 0.084152 Aug 04 05:13:25.246573 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3319/6525] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:13:25 2022] POST /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f/action => generated 32650 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:13:26.329461 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:26.330064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:26.332181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e95e839e-02af-426d-a26b-079900bd5cb3 req-48c4ff63-4975-4060-b6b8-b269480ecf4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f66e1c0-f57d-4f67-a6f5-6d748d819d0f", "tag": "713f1632-f8b4-474b-b5de-ba9eba461c76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:26.333590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:26.334488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:26.341311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:26.341782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:26.342570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:26.343044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:26.345261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e95e839e-02af-426d-a26b-079900bd5cb3 req-48c4ff63-4975-4060-b6b8-b269480ecf4b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:26.345738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e95e839e-02af-426d-a26b-079900bd5cb3 req-48c4ff63-4975-4060-b6b8-b269480ecf4b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:26.358503 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e95e839e-02af-426d-a26b-079900bd5cb3 req-48c4ff63-4975-4060-b6b8-b269480ecf4b service nova] Creating event network-changed:713f1632-f8b4-474b-b5de-ba9eba461c76 for instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f on n-h1-851337-5 Aug 04 05:13:26.363948 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e95e839e-02af-426d-a26b-079900bd5cb3 req-48c4ff63-4975-4060-b6b8-b269480ecf4b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036392 Aug 04 05:13:26.364891 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3320/6526] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:13:26.371532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:13:26.460212 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a1ccab7-1987-481c-bcb5-986a600c0112 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 204 len: 0 microversion: 2.1 time: 0.134801 Aug 04 05:13:26.461878 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3207/6527] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:13:26 2022] DELETE /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:13:26.472645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:26.473838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:26.482718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:26.483220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:26.484053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:26.484625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:26.727287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:26.735363 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0e3660fc-586a-4bb3-973c-5b001887254a tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1671 microversion: 2.1 time: 0.267410 Aug 04 05:13:26.735927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3321/6528] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:26 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1671 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:27.758333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:27.759060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:27.766745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:27.767218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:27.767991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:27.768423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:28.016388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:28.023992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a3fa7c1-1354-4ab3-9c99-3a8ad1a15e04 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1671 microversion: 2.1 time: 0.270668 Aug 04 05:13:28.024573 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3208/6529] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:27 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1671 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:28.666852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0115d3bb-cff1-4af3-a5cd-384ca37ca2e7 req-ec00d09c-2fa9-421b-8cf7-13be8cc15d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f66e1c0-f57d-4f67-a6f5-6d748d819d0f", "name": "network-vif-deleted", "tag": "713f1632-f8b4-474b-b5de-ba9eba461c76"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:28.679057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0115d3bb-cff1-4af3-a5cd-384ca37ca2e7 req-ec00d09c-2fa9-421b-8cf7-13be8cc15d70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:28.679524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0115d3bb-cff1-4af3-a5cd-384ca37ca2e7 req-ec00d09c-2fa9-421b-8cf7-13be8cc15d70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:28.690989 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0115d3bb-cff1-4af3-a5cd-384ca37ca2e7 req-ec00d09c-2fa9-421b-8cf7-13be8cc15d70 service nova] Creating event network-vif-deleted:713f1632-f8b4-474b-b5de-ba9eba461c76 for instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f on n-h1-851337-5 Aug 04 05:13:28.696668 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0115d3bb-cff1-4af3-a5cd-384ca37ca2e7 req-ec00d09c-2fa9-421b-8cf7-13be8cc15d70 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033858 Aug 04 05:13:28.697456 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3322/6530] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:29.045619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:29.046378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:29.057419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:29.058082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:29.059279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:29.059827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:29.099444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:29.099905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:29.100369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lazy-loading 'fault' on Instance uuid 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:13:29.144327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9193f7efbeba44e0805c025bf2b7b052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8062d7fd38794f5c9879bb8714628689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:29.152504 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83b76696-a6b9-48ce-aa29-d456a0617d94 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 200 len: 1337 microversion: 2.1 time: 0.110744 Aug 04 05:13:29.153090 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3209/6531] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:29 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:30.174154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:30.174858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] [instance: 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:30.181803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:30.182258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:30.183053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:30.183505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:30.196772 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] HTTP exception thrown: Instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f could not be found. Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Request method failure captured: Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f HTTP/1.1 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61STtjtX6Wq9LzEzwtufeunFuPu9OHeihB10kVlOKjZQ83a7rp4NbJfdpXv3YL5oPUJjFz-2cf0xSZAHTbesksD-f16tSBgEwrq2RYekifkae8KUYxTfoT3wtezNv-7ERG-G9i7k3cr1QnN41t1SyBSAEJtvnMTFAFqZCUuPr97UE4U Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 8062d7fd38794f5c9879bb8714628689 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8062d7fd38794f5c9879bb8714628689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8062d7fd38794f5c9879bb8714628689", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 8062d7fd38794f5c9879bb8714628689 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestNetworkBasicOps-2100028427 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestNetworkBasicOps-2100028427-project Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 9193f7efbeba44e0805c025bf2b7b052 Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestNetworkBasicOps-2100028427-project Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f could not be found. Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6f66e1c0-f57d-4f67-a6f5-6d748d819d0f'} Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f could not be found. Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f could not be found. Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:30.198405 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f could not be found. Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Returning 404 to user: Instance 6f66e1c0-f57d-4f67-a6f5-6d748d819d0f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ddf16e67-7244-49bc-9e74-4fb176cfdc52 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f" status: 404 len: 111 microversion: 2.1 time: 0.030749 Aug 04 05:13:30.204311 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3323/6532] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:30 2022] GET /compute/v2.1/servers/6f66e1c0-f57d-4f67-a6f5-6d748d819d0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:13:30.360152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03b83ebb-1dc7-42d4-aea7-2547a3b50330 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] Calling method '.version_select at 0x7f19188831f0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:30.383713 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03b83ebb-1dc7-42d4-aea7-2547a3b50330 tempest-TestNetworkBasicOps-2100028427 tempest-TestNetworkBasicOps-2100028427-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-676794194" status: 202 len: 0 microversion: 2.1 time: 0.027270 Aug 04 05:13:30.384223 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3210/6533] 10.222.0.69 () {58 vars in 1254 bytes} [Thu Aug 4 05:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-676794194 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:13:45.544044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=10 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:45.544914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=16 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:45.657417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1644502579", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:45.709267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] validate_networks() for None {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:13:45.902527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:13:45.903006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:13:45.903512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:13:45.903944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:13:45.904390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:13:45.913410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:45.913877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:45.915885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:45.915885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:45.932232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Getting quotas for project c190b081121447d39653f651c58da6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:13:45.937572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Getting quotas for user 50ad8c1e6ea44dae993f2e6e8ef19571 and project c190b081121447d39653f651c58da6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:13:45.950643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:13:45.952914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:13:45.998614 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fc711964-0326-448a-b976-e973e8308401 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.460999 Aug 04 05:13:45.999623 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3324/6534] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:13:46.011064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:46.012238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:46.016597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0652449a-6526-44ea-aef8-02f64a31d5d8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:46.017227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0652449a-6526-44ea-aef8-02f64a31d5d8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:46.080139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0652449a-6526-44ea-aef8-02f64a31d5d8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:46.087035 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0652449a-6526-44ea-aef8-02f64a31d5d8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1222 microversion: 2.1 time: 0.078769 Aug 04 05:13:46.087708 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3211/6535] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:46 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:13:47.111716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:47.112363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:47.119845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:47.120315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:47.121129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:47.121966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:47.192669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:47.201980 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-45fd2bab-1931-4764-8103-f042c6ffec57 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1282 microversion: 2.1 time: 0.095534 Aug 04 05:13:47.210139 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3325/6536] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:47 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:48.226114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:48.228084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:48.235056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:48.235521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:48.236306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:48.236956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:48.381144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:48.389098 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7acfadef-1763-45cb-a1db-c1585bc6f8d0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1322 microversion: 2.1 time: 0.167058 Aug 04 05:13:48.389679 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3212/6537] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:48 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:13:48.571076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-74c6b20c-0952-4594-853c-ea968a84de2f req-8d9a86aa-bcb9-49ee-b045-1502ddc17887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e6214b-4a82-400b-a8a9-f7a3c634003e", "tag": "7b8d8052-503b-4831-8f3e-60b9aee41ba9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:48.588562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-74c6b20c-0952-4594-853c-ea968a84de2f req-8d9a86aa-bcb9-49ee-b045-1502ddc17887 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:48.588947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-74c6b20c-0952-4594-853c-ea968a84de2f req-8d9a86aa-bcb9-49ee-b045-1502ddc17887 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:48.604005 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-74c6b20c-0952-4594-853c-ea968a84de2f req-8d9a86aa-bcb9-49ee-b045-1502ddc17887 service nova] Creating event network-changed:7b8d8052-503b-4831-8f3e-60b9aee41ba9 for instance 94e6214b-4a82-400b-a8a9-f7a3c634003e on n-h2-851337-5 Aug 04 05:13:48.609036 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-74c6b20c-0952-4594-853c-ea968a84de2f req-8d9a86aa-bcb9-49ee-b045-1502ddc17887 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043962 Aug 04 05:13:48.609656 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3326/6538] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:49.410696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:49.411313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:49.418782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:49.419280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:49.420047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:49.420481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:49.552175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:49.560301 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-458a0c5a-bdac-4080-ae2d-01d462de7de8 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1322 microversion: 2.1 time: 0.153463 Aug 04 05:13:49.560885 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3213/6539] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:49 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:50.582464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:50.583115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:50.589633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:50.590102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:50.590895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:50.591384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:50.722607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:50.730204 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62bdad7c-9b8a-4ecf-9ef4-bac2d35884ac tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1322 microversion: 2.1 time: 0.152946 Aug 04 05:13:50.730773 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3327/6540] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:50 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:51.751569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:51.752198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:51.759957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:51.760414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:51.761185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:51.761626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:51.893578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:51.901803 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3f5d5f7c-8bc4-4bf9-974e-2dd67c7dd031 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1322 microversion: 2.1 time: 0.154119 Aug 04 05:13:51.902379 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3214/6541] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:51 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:52.922864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:52.923592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:52.930640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:52.931153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:52.932347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:52.932485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:53.066039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:53.073463 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5a9b3bb2-892f-4fa3-9ce8-08d09cac8fbf tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1322 microversion: 2.1 time: 0.154823 Aug 04 05:13:53.074030 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3328/6542] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:52 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:54.094404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:54.094998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:54.101987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:54.102451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:54.103769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:54.104212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:54.234920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:54.242934 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6a2368f-16ff-4e7b-b40a-87a0423d4441 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1322 microversion: 2.1 time: 0.152536 Aug 04 05:13:54.243856 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3215/6543] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:54 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:54.584294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-074a00d5-16c4-417a-bf56-68ae7f3df2ec req-1d207699-5c81-4da8-a8a1-d2e8482fc03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e6214b-4a82-400b-a8a9-f7a3c634003e", "name": "network-vif-plugged", "status": "completed", "tag": "7b8d8052-503b-4831-8f3e-60b9aee41ba9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:54.595374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-074a00d5-16c4-417a-bf56-68ae7f3df2ec req-1d207699-5c81-4da8-a8a1-d2e8482fc03e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:54.595979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-074a00d5-16c4-417a-bf56-68ae7f3df2ec req-1d207699-5c81-4da8-a8a1-d2e8482fc03e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:54.609059 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-074a00d5-16c4-417a-bf56-68ae7f3df2ec req-1d207699-5c81-4da8-a8a1-d2e8482fc03e service nova] Creating event network-vif-plugged:7b8d8052-503b-4831-8f3e-60b9aee41ba9 for instance 94e6214b-4a82-400b-a8a9-f7a3c634003e on n-h2-851337-5 Aug 04 05:13:54.614263 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-074a00d5-16c4-417a-bf56-68ae7f3df2ec req-1d207699-5c81-4da8-a8a1-d2e8482fc03e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034076 Aug 04 05:13:54.614875 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3329/6544] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:55.265256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:55.265865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:55.273278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:55.273737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:55.274515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:55.274989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:55.406369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:55.413981 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5aba901-92bd-4cc1-b634-501e589e6eda tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1322 microversion: 2.1 time: 0.152979 Aug 04 05:13:55.414550 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3216/6545] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:55 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:13:56.433808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:56.434684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:56.440462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:56.441411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:56.449646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:56.450115 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:56.450911 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:56.451391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:56.592634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:56.600494 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-65107879-e9f9-4dc3-b72f-a9095c0573b0 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1471 microversion: 2.1 time: 0.169075 Aug 04 05:13:56.601077 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3330/6546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:56 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:56.620739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:56.680931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3602932b-b2bd-49b5-800a-f296143e773f tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Calling method '.version_select at 0x7f1923982f70>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:56.751100 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3602932b-b2bd-49b5-800a-f296143e773f tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/4acb992d09ab4a658fbf36eda8296201" status: 200 len: 371 microversion: 2.1 time: 0.131178 Aug 04 05:13:56.751688 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3217/6547] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 05:13:56 2022] GET /compute/v2.1/os-quota-sets/4acb992d09ab4a658fbf36eda8296201 => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:56.764049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-992a4759-aa71-490b-a620-e4b3f5731bd8 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1982532663", "id": 2063607441, "os-flavor-access:is_public": "True"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:56.766926 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:56.766926 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:13:56.781426 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-992a4759-aa71-490b-a620-e4b3f5731bd8 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021011 Aug 04 05:13:56.782007 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3331/6548] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:13:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:56.793756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2063607441"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:56.796121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:56.802235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:56.802688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:56.803487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:56.803930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:56.888267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1806d7ab7e2c48d5a2e2556d53f23a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acb992d09ab4a658fbf36eda8296201', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:56.894694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1982532663 {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:13:56.901235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:56.901683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:56.902504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:56.902942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:56.923213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Getting quotas for project c190b081121447d39653f651c58da6c4. Resources: {'ram', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:13:56.928183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Getting quotas for user 50ad8c1e6ea44dae993f2e6e8ef19571 and project c190b081121447d39653f651c58da6c4. Resources: {'ram', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:13:56.940546 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.compute.api [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] ram quota exceeded for 4acb992d09ab4a658fbf36eda8296201, tried to resize instance. Aug 04 05:13:56.941089 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Request method failure captured: Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e/action HTTP/1.1 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 39 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61WJynpxWdTVi7OsevZC0kQftX3oufLeMYsAJ2vieeqXIrvhTbCdl8XH2Mhi2PjPYtCFnfxfDivBa5p7I4RxWtmna8PS6fEzpHqExSICxfOj_bhukLgsQQ5QaXj29PWb8augwiZvzD0UdTcV2bxQNcAYewngP08KCBecPxG1ZPUBjLU Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 4acb992d09ab4a658fbf36eda8296201 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1969707824 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader,admin Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader,admin Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4acb992d09ab4a658fbf36eda8296201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4acb992d09ab4a658fbf36eda8296201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4acb992d09ab4a658fbf36eda8296201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4acb992d09ab4a658fbf36eda8296201", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1969707824 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 4acb992d09ab4a658fbf36eda8296201 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1969707824 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-1969707824-project-admin Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 1806d7ab7e2c48d5a2e2556d53f23a39 Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1969707824-project-admin Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: {"resize": {"flavorRef": "2063607441"}} Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '94e6214b-4a82-400b-a8a9-f7a3c634003e', 'body': {'resize': {'flavorRef': '2063607441'}}} Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:13:56.945157 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8b8d8185-1100-47f0-8385-c10df02ff345 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e/action" status: 403 len: 118 microversion: 2.1 time: 0.156732 Aug 04 05:13:56.950543 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3218/6549] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:13:56 2022] POST /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e/action => generated 118 bytes in 158 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:13:56.955579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-60eb3a17-01ea-4913-9d79-ab1b32895aa4 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:56.956335 n-d-851337-5 devstack@n-api.service[119343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:56.956335 n-d-851337-5 devstack@n-api.service[119343]: warnings.warn(msg) Aug 04 05:13:56.972660 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-60eb3a17-01ea-4913-9d79-ab1b32895aa4 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/2063607441" status: 202 len: 0 microversion: 2.1 time: 0.020733 Aug 04 05:13:56.973218 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3332/6550] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 05:13:56 2022] DELETE /compute/v2.1/flavors/2063607441 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:13:56.981775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e7ce0872-4ec0-4579-9816-e831f7753616 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:57.002396 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e7ce0872-4ec0-4579-9816-e831f7753616 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024821 Aug 04 05:13:57.002975 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3219/6551] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 05:13:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:57.022217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a25b635-9d3a-4347-a5c3-147b1658c0e3 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Calling method '.version_select at 0x7f191835df70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:57.091815 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a25b635-9d3a-4347-a5c3-147b1658c0e3 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/4acb992d09ab4a658fbf36eda8296201" status: 200 len: 371 microversion: 2.1 time: 0.073195 Aug 04 05:13:57.092384 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3333/6552] 10.222.0.69 () {58 vars in 1242 bytes} [Thu Aug 4 05:13:57 2022] GET /compute/v2.1/os-quota-sets/4acb992d09ab4a658fbf36eda8296201 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:57.104299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cb7ff625-7275-4b5c-96c4-73c85bea6d45 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1482976686", "id": 1146225077, "os-flavor-access:is_public": "True"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:57.107269 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:57.107269 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 05:13:57.122664 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cb7ff625-7275-4b5c-96c4-73c85bea6d45 tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022618 Aug 04 05:13:57.123346 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3220/6553] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:13:57 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:57.135229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1146225077"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:57.137610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:57.143850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.144321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.145140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.145603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.235483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1806d7ab7e2c48d5a2e2556d53f23a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acb992d09ab4a658fbf36eda8296201', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:57.242021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1482976686 {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:13:57.248510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.248980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.249799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.250254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.270532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Getting quotas for project c190b081121447d39653f651c58da6c4. Resources: {'ram', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:13:57.276164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Getting quotas for user 50ad8c1e6ea44dae993f2e6e8ef19571 and project c190b081121447d39653f651c58da6c4. Resources: {'ram', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:13:57.288207 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] cores quota exceeded for 4acb992d09ab4a658fbf36eda8296201, tried to resize instance. Aug 04 05:13:57.288778 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Request method failure captured: Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e/action HTTP/1.1 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 39 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61WJynpxWdTVi7OsevZC0kQftX3oufLeMYsAJ2vieeqXIrvhTbCdl8XH2Mhi2PjPYtCFnfxfDivBa5p7I4RxWtmna8PS6fEzpHqExSICxfOj_bhukLgsQQ5QaXj29PWb8augwiZvzD0UdTcV2bxQNcAYewngP08KCBecPxG1ZPUBjLU Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 4acb992d09ab4a658fbf36eda8296201 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1969707824 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader,admin Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader,admin Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4acb992d09ab4a658fbf36eda8296201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4acb992d09ab4a658fbf36eda8296201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4acb992d09ab4a658fbf36eda8296201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4acb992d09ab4a658fbf36eda8296201", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1969707824 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 4acb992d09ab4a658fbf36eda8296201 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1969707824 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersAdminNegativeTestJSON-1969707824-project-admin Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 1806d7ab7e2c48d5a2e2556d53f23a39 Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1969707824-project-admin Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: {"resize": {"flavorRef": "1146225077"}} Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '94e6214b-4a82-400b-a8a9-f7a3c634003e', 'body': {'resize': {'flavorRef': '1146225077'}}} Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:13:57.291457 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ff21df7-8cbe-454f-9401-1bcc7003288a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e/action" status: 403 len: 113 microversion: 2.1 time: 0.161835 Aug 04 05:13:57.296144 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3334/6554] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:13:57 2022] POST /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e/action => generated 113 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:13:57.301622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a91b53a-373f-4939-abf1-d3a80b385d9a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:57.302388 n-d-851337-5 devstack@n-api.service[119342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:57.302388 n-d-851337-5 devstack@n-api.service[119342]: warnings.warn(msg) Aug 04 05:13:57.319751 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a91b53a-373f-4939-abf1-d3a80b385d9a tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1146225077" status: 202 len: 0 microversion: 2.1 time: 0.021708 Aug 04 05:13:57.320555 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3221/6555] 10.222.0.69 () {58 vars in 1161 bytes} [Thu Aug 4 05:13:57 2022] DELETE /compute/v2.1/flavors/1146225077 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:13:57.329215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4b9a481c-8a23-449b-9c25-7417b7a1747b tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:57.349836 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4b9a481c-8a23-449b-9c25-7417b7a1747b tempest-ServersAdminNegativeTestJSON-1969707824 tempest-ServersAdminNegativeTestJSON-1969707824-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024312 Aug 04 05:13:57.350398 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3335/6556] 10.222.0.69 () {58 vars in 1146 bytes} [Thu Aug 4 05:13:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:13:57.370573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:57.371109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:57.377106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.377550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.378321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.378749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.404855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:13:57.487277 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-173baf7f-689b-4e5c-a521-e576c2188eb1 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "DELETE /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 204 len: 0 microversion: 2.1 time: 0.120022 Aug 04 05:13:57.487814 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3222/6557] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:13:57 2022] DELETE /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:13:57.496565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:57.497319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:57.504422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.504896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.505706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:57.506237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:57.641498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:57.649308 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c34a7f38-bc33-4dc8-a11d-cf0ca5a138f6 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1477 microversion: 2.1 time: 0.156640 Aug 04 05:13:57.650485 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3336/6558] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:57 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:58.670809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:58.671543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:58.678414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:58.678862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:58.679658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:58.680093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:58.813611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad8c1e6ea44dae993f2e6e8ef19571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c190b081121447d39653f651c58da6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:13:58.821512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d5613dbc-52cc-440d-b058-1f146e32229a tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 200 len: 1477 microversion: 2.1 time: 0.154967 Aug 04 05:13:58.822069 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3223/6559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:58 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:13:59.191751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a91b7a34-e1c6-4b7f-84e9-1aabf256c38b req-2fd93cb2-c735-48ad-a1d1-06e39ec59349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e6214b-4a82-400b-a8a9-f7a3c634003e", "name": "network-vif-deleted", "tag": "7b8d8052-503b-4831-8f3e-60b9aee41ba9"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:13:59.205090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a91b7a34-e1c6-4b7f-84e9-1aabf256c38b req-2fd93cb2-c735-48ad-a1d1-06e39ec59349 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:59.205496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a91b7a34-e1c6-4b7f-84e9-1aabf256c38b req-2fd93cb2-c735-48ad-a1d1-06e39ec59349 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:59.219868 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a91b7a34-e1c6-4b7f-84e9-1aabf256c38b req-2fd93cb2-c735-48ad-a1d1-06e39ec59349 service nova] Creating event network-vif-deleted:7b8d8052-503b-4831-8f3e-60b9aee41ba9 for instance 94e6214b-4a82-400b-a8a9-f7a3c634003e on n-h2-851337-5 Aug 04 05:13:59.225487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a91b7a34-e1c6-4b7f-84e9-1aabf256c38b req-2fd93cb2-c735-48ad-a1d1-06e39ec59349 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037341 Aug 04 05:13:59.226156 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3337/6560] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:13:59.842046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:13:59.842571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] [instance: 94e6214b-4a82-400b-a8a9-f7a3c634003e] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:13:59.849666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:59.850123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:59.850898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:13:59.851368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:13:59.865106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] HTTP exception thrown: Instance 94e6214b-4a82-400b-a8a9-f7a3c634003e could not be found. Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Request method failure captured: Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e HTTP/1.1 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61WIIks2bzPZ6b0jRIn5opr-nk5WLyyv0zTYqwrfNG7-xXr5QYSDsIYl331udq2P4nl_4zhL5jo8kVBLsmPor3LUz3WBECWsdsdgObtuz36AYMfi2FqoU-egNSWrEAnsgjW4XTUQgWWLpHwjhfIlMKXnF9Di_Bla-3GC_xi_VvemjxY Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: c190b081121447d39653f651c58da6c4 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1840838188 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c190b081121447d39653f651c58da6c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c190b081121447d39653f651c58da6c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c190b081121447d39653f651c58da6c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c190b081121447d39653f651c58da6c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1840838188 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: c190b081121447d39653f651c58da6c4 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1840838188 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersAdminNegativeTestJSON-1840838188-project Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 50ad8c1e6ea44dae993f2e6e8ef19571 Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1840838188-project Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 94e6214b-4a82-400b-a8a9-f7a3c634003e could not be found. Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '94e6214b-4a82-400b-a8a9-f7a3c634003e'} Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e6214b-4a82-400b-a8a9-f7a3c634003e could not be found. Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e6214b-4a82-400b-a8a9-f7a3c634003e could not be found. Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:59.866778 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e6214b-4a82-400b-a8a9-f7a3c634003e could not be found. Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] Returning 404 to user: Instance 94e6214b-4a82-400b-a8a9-f7a3c634003e could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bcfcf52f-df8a-4e73-8894-363b9aec2430 tempest-ServersAdminNegativeTestJSON-1840838188 tempest-ServersAdminNegativeTestJSON-1840838188-project] 10.222.0.69 "GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e" status: 404 len: 111 microversion: 2.1 time: 0.030193 Aug 04 05:13:59.873334 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3224/6561] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:13:59 2022] GET /compute/v2.1/servers/94e6214b-4a82-400b-a8a9-f7a3c634003e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:14:06.391121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1375325336", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "24edcbd5-ac1d-418a-a209-1a7969f53582"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:06.450133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] validate_networks() for [('24edcbd5-ac1d-418a-a209-1a7969f53582', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:14:06.861731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:14:06.862172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:14:06.862667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:14:06.863138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:14:06.863568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:14:06.873637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:06.874364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:06.874878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:06.875366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:06.893043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Getting quotas for project be2c5991d8c84fd7addfcc9c98e07b33. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:14:06.898545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Getting quotas for user be2dfbf92ac2442ab71f923bb327a297 and project be2c5991d8c84fd7addfcc9c98e07b33. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:14:06.911101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:14:06.913469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:14:06.959928 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b78f02bb-0cbb-4420-8695-96f2d259dceb tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731476 Aug 04 05:14:06.960583 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3338/6562] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:14:06.973228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9334431-2222-4ebf-9655-571cbea62a0e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:06.974089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f9334431-2222-4ebf-9655-571cbea62a0e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:06.976955 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:06.978799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:07.037078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9334431-2222-4ebf-9655-571cbea62a0e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:07.045304 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f9334431-2222-4ebf-9655-571cbea62a0e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1215 microversion: 2.1 time: 0.076900 Aug 04 05:14:07.045984 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3225/6563] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:06 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:08.066791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:08.068205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:08.076293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:08.077050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:08.078054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:08.078510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:08.158670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:08.171475 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e0c6b636-1ef9-473e-a996-e4b3823c1683 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1285 microversion: 2.1 time: 0.109492 Aug 04 05:14:08.172391 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3339/6564] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:08 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:09.192971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:09.193905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:09.208549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:09.209260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:09.210267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:09.210708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:09.358306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:09.366884 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-37b437fa-e18e-4075-83f9-0e0428967c58 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.177763 Aug 04 05:14:09.367897 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3226/6565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:09 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:09.424738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a30d3c93-6581-4b5c-8272-358686d8c93e req-7094fa8b-6d05-45ed-93ef-fc60c087c361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f313153-e9c4-468b-8f0b-3dabb439baf4", "tag": "145a8dae-8281-4a41-8173-3068d58c6c5f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:09.440626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a30d3c93-6581-4b5c-8272-358686d8c93e req-7094fa8b-6d05-45ed-93ef-fc60c087c361 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:09.441218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a30d3c93-6581-4b5c-8272-358686d8c93e req-7094fa8b-6d05-45ed-93ef-fc60c087c361 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:09.455729 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a30d3c93-6581-4b5c-8272-358686d8c93e req-7094fa8b-6d05-45ed-93ef-fc60c087c361 service nova] Creating event network-changed:145a8dae-8281-4a41-8173-3068d58c6c5f for instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 on n-h1-851337-5 Aug 04 05:14:09.462439 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a30d3c93-6581-4b5c-8272-358686d8c93e req-7094fa8b-6d05-45ed-93ef-fc60c087c361 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043406 Aug 04 05:14:09.463952 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3340/6566] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:14:10.389523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:10.390143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:10.397335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:10.397719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:10.398501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:10.398943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:10.538802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:10.546808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f206e9c3-5686-4d72-a7b0-73fd951c60e3 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.161232 Aug 04 05:14:10.547416 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3227/6567] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:10 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:11.569215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:11.569858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:11.576461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.576926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.577704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.578182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.714520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:11.722409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55cc988d-52bb-4da3-ad20-5a5470268b3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.158296 Aug 04 05:14:11.723080 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3341/6568] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:11 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:12.744743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:12.745394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:12.752386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:12.752842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:12.753619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:12.754060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:12.886886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:12.894521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76d37844-4ef2-48a0-8962-1f1892c45879 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.154328 Aug 04 05:14:12.895094 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3228/6569] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:12 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:13.915763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:13.916313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:13.924091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:13.924572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:13.925380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:13.925840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:14.064117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:14.072376 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea47afe8-8933-4eff-9736-1045fe236c1d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.160715 Aug 04 05:14:14.076401 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3342/6570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:13 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:15.093697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:15.094321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:15.101513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.101968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.103258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.103706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.250672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:15.259055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4b10c012-1b05-42ea-8c27-454638925732 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.169262 Aug 04 05:14:15.259653 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3229/6571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:15 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:16.279957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:16.280580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:16.283165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:16.288601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:16.289063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:16.289849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:16.290297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:16.293692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=74 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:16.428716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:16.436888 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-96a5e376-8eb6-4790-a366-b09689719f5c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.160707 Aug 04 05:14:16.437471 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3343/6572] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:16 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:16.978531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-422bd42c-8231-4747-b95f-aca3f2a364ff req-dbf5d3ac-ddc6-48f4-9b7c-a40e8b171368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f313153-e9c4-468b-8f0b-3dabb439baf4", "name": "network-vif-plugged", "status": "completed", "tag": "145a8dae-8281-4a41-8173-3068d58c6c5f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:16.985139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:16.992182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-422bd42c-8231-4747-b95f-aca3f2a364ff req-dbf5d3ac-ddc6-48f4-9b7c-a40e8b171368 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:16.992638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-422bd42c-8231-4747-b95f-aca3f2a364ff req-dbf5d3ac-ddc6-48f4-9b7c-a40e8b171368 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:16.997324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:17.006944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-422bd42c-8231-4747-b95f-aca3f2a364ff req-dbf5d3ac-ddc6-48f4-9b7c-a40e8b171368 service nova] Creating event network-vif-plugged:145a8dae-8281-4a41-8173-3068d58c6c5f for instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 on n-h1-851337-5 Aug 04 05:14:17.012351 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-422bd42c-8231-4747-b95f-aca3f2a364ff req-dbf5d3ac-ddc6-48f4-9b7c-a40e8b171368 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038493 Aug 04 05:14:17.012973 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3230/6573] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:17.457327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:17.457959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:17.459831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=5 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:17.460526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=8 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:17.467201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:17.467660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:17.468452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:17.468887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:17.606520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:17.614111 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2c1211da-e4f3-4614-a88f-203bf9b24fb2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1315 microversion: 2.1 time: 0.160728 Aug 04 05:14:17.614693 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3344/6574] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:17 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:18.636813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:18.637498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:18.640309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:18.646772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.647257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:18.648101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.648547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:18.782927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:18.790590 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-132863b5-c190-4389-acd3-094cb1ae7684 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1501 microversion: 2.1 time: 0.159105 Aug 04 05:14:18.791186 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3231/6575] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:18 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:18.811441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:18.813766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:18.820729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.821686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:18.822498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.822971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:18.852131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:18.858059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Old instance type m1.heat2, new instance type m1.heat {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:14:18.864172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:14:18.864602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:14:18.865086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:14:18.865507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:14:18.865940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:14:18.937650 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-560913cf-89cc-4d07-8e7d-cbb316340ca8 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "POST /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4/action" status: 202 len: 0 microversion: 2.1 time: 0.130458 Aug 04 05:14:18.938296 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3345/6576] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:14:18 2022] POST /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:14:18.950806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:18.951418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:18.957407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.957860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:18.958628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.959096 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:19.097308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:19.105338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4eae6045-a3a5-40f3-bdc6-96b9e5f46cd2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1510 microversion: 2.1 time: 0.158972 Aug 04 05:14:19.106053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3232/6577] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:18 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:14:20.127981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:20.128572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:20.136751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:20.137189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:20.137988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:20.138451 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:20.273536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:20.282401 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0eb3e90c-3363-4f8d-8aaa-70aa1bc465e2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1510 microversion: 2.1 time: 0.159159 Aug 04 05:14:20.283013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3346/6578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:20 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:21.304107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:21.304719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:21.311729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:21.312167 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:21.312951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:21.313413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:21.443282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:21.450821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-95ff705e-aed6-4f4b-a9ab-97c1e79221f1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.150598 Aug 04 05:14:21.451430 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3233/6579] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:21 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:22.472224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:22.472890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:22.480337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:22.480812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:22.481604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:22.482064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:22.614869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:22.623173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0dac7cc7-ebb5-4692-b9b4-f16e495a196a tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.155059 Aug 04 05:14:22.623753 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3347/6580] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:22 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:23.644417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:23.645042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:23.652199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:23.652657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:23.653436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:23.653881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:23.788521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:23.796365 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f32a3d07-613a-4df6-8dcd-d9490db1e244 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.155877 Aug 04 05:14:23.797010 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3234/6581] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:23 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:24.817604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:24.818241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:24.826018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:24.826599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:24.827434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:24.827896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:24.973785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:24.982055 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-20b5c868-b0f2-41af-a0c1-99bb23f561f7 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.168459 Aug 04 05:14:24.982675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3348/6582] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:24 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:26.004198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:26.004840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:26.011929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:26.012380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:26.013154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:26.013593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:26.154123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:26.161692 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b671ecf-0ddd-47c0-9dd4-893801a652ae tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.161716 Aug 04 05:14:26.162271 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3235/6583] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:25 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:27.183306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:27.183933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:27.191056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:27.191528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:27.192299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:27.192752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:27.326196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:27.334352 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf47a772-ad76-4170-8310-1f41c9cad4cf tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.155553 Aug 04 05:14:27.334927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3349/6584] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:27 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:28.357059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:28.357671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:28.364717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:28.365287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:28.366056 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:28.366519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:28.504337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:28.512376 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ed49c360-0294-412d-8218-92575583f86b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.159130 Aug 04 05:14:28.512971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3236/6585] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:28 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:29.533706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:29.534371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:29.541548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:29.542016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:29.542804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:29.543303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:29.676542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:29.684667 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9c86e9f-17ca-4d6d-917e-58ab69dce965 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.154998 Aug 04 05:14:29.685237 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3350/6586] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:29 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:30.706323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:30.707029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:30.714679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:30.715185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:30.715951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:30.716402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:30.849033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:30.856602 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b19e3973-f362-4deb-a37c-2fb064b777a0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.154453 Aug 04 05:14:30.857186 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3237/6587] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:30 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:31.877802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:31.878441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:31.885828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:31.886299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:31.887156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:31.887614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:32.024504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:32.032502 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-de8849ad-3c61-4261-b100-ad8fe1f0ee68 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.158987 Aug 04 05:14:32.033334 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3351/6588] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:31 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:14:33.053922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:33.054469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:33.062266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:33.062728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:33.063541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:33.063985 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:33.203293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:33.211481 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9003a858-28fd-4dd9-a74b-dead48018192 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.161523 Aug 04 05:14:33.212642 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3238/6589] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:33 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:34.233887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:34.234521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:34.241641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:34.242116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:34.242900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:34.243379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:34.350936 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:14:34.351202 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 (ip 10.222.0.69) !!! Aug 04 05:14:34.382134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:34.390505 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d9e261f-725e-4c3e-8432-b5bac93d760e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.160511 Aug 04 05:14:34.391106 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3352/6590] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:34 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:35.411967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:35.412590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:35.420244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:35.420701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:35.421482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:35.421928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:35.552802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:35.560579 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e82743e2-8151-4126-8809-3ebb290c1795 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.152528 Aug 04 05:14:35.561137 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3239/6591] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:35 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:36.581698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:36.582362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:36.589514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:36.589981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:36.590780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:36.591270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:36.725190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:36.733179 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3e74d6a-7033-4ee9-997c-14e526167331 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.155446 Aug 04 05:14:36.733757 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3353/6592] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:36 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:37.755267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:37.755878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:37.763833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:37.764295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:37.765071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:37.765519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:37.898862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:37.906521 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3169ae27-bfbb-4099-b895-411d021a8b52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.155154 Aug 04 05:14:37.907108 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3240/6593] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:37 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:38.929240 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:38.929958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:38.938154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:38.939048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:38.940485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:38.941346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:39.081701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:39.090321 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-80313077-a331-46d6-a627-e597268c3e21 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.165093 Aug 04 05:14:39.090912 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3354/6594] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:38 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:40.111265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:40.111906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:40.118902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:40.119378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:40.120140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:40.120573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:40.257630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:40.265512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dfccab94-96ba-4fc2-b3a3-cf700194f689 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.158211 Aug 04 05:14:40.266097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3241/6595] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:40 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:41.287807 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:41.288640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:41.297002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:41.297463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:41.298253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:41.298703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:41.429550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:41.437357 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e0292073-9d72-40d6-a785-f4b1e0c327b2 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.153697 Aug 04 05:14:41.437935 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3355/6596] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:41 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:42.458443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:42.459127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:42.466177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:42.466667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:42.467478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:42.467926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:42.603780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:42.611564 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-edb24331-a879-443e-80f1-426ed019880d tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.157457 Aug 04 05:14:42.612135 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3242/6597] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:42 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:43.633862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:43.635048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:43.642103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:43.642583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:43.643408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:43.643871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:43.773013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:43.781222 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8c15921-182f-46a2-9811-025297daef3c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.151585 Aug 04 05:14:43.781801 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3356/6598] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:43 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:44.802796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:44.803538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:44.811317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:44.811780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:44.812563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:44.813008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:44.959756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:44.967497 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44af0c9d-091c-4095-97d2-295b175414d6 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.168532 Aug 04 05:14:44.968083 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3243/6599] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:44 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:45.991814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:45.992390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:45.999634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:46.001161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:46.003221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:46.003692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:46.144121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:46.152247 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-513ab424-dd09-4468-ba88-8816a7046247 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.165412 Aug 04 05:14:46.152502 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3357/6600] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:45 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:47.172855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:47.173571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:47.180490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:47.180944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:47.181721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:47.182355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:47.316463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:47.324762 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a3c1b689-9f8a-4adc-9f12-f1b79b0c8b48 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1515 microversion: 2.1 time: 0.156003 Aug 04 05:14:47.325352 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3244/6601] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:47 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:48.348045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:48.348720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:48.351401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=34 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:48.359976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:48.360499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:48.361315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:48.361776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:48.368017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:48.515670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:48.523880 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea4be974-3136-4b2e-b562-653071e96a28 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1514 microversion: 2.1 time: 0.179926 Aug 04 05:14:48.524482 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3358/6602] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:48 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:14:48.543175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-29faa437-bd1d-4e48-80f0-f01a41a0c098 req-c00f33ed-4c65-441b-8654-92e31b3effc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f313153-e9c4-468b-8f0b-3dabb439baf4", "name": "network-vif-unplugged", "status": "completed", "tag": "145a8dae-8281-4a41-8173-3068d58c6c5f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:48.554729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-29faa437-bd1d-4e48-80f0-f01a41a0c098 req-c00f33ed-4c65-441b-8654-92e31b3effc9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:48.555521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-29faa437-bd1d-4e48-80f0-f01a41a0c098 req-c00f33ed-4c65-441b-8654-92e31b3effc9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:48.568260 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-29faa437-bd1d-4e48-80f0-f01a41a0c098 req-c00f33ed-4c65-441b-8654-92e31b3effc9 service nova] Creating event network-vif-unplugged:145a8dae-8281-4a41-8173-3068d58c6c5f for instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 on n-h2-851337-5 Aug 04 05:14:48.574260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-29faa437-bd1d-4e48-80f0-f01a41a0c098 req-c00f33ed-4c65-441b-8654-92e31b3effc9 service nova] Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:14:48.585978 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-29faa437-bd1d-4e48-80f0-f01a41a0c098 req-c00f33ed-4c65-441b-8654-92e31b3effc9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046762 Aug 04 05:14:48.586766 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3245/6603] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:49.546319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:49.547060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:49.554531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:49.555183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:49.556023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:49.556531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:49.690710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:49.698520 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5de9408e-9573-45b9-afcb-aa3a9371b2b1 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1512 microversion: 2.1 time: 0.156808 Aug 04 05:14:49.699143 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3359/6604] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:49 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:50.619035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-92f0012b-6942-4f5c-9075-31f4c6d1ce84 req-4a4ac2e2-4072-4b0b-9ef6-1af009d1c9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f313153-e9c4-468b-8f0b-3dabb439baf4", "tag": "145a8dae-8281-4a41-8173-3068d58c6c5f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:50.624467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=32 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:50.630405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-92f0012b-6942-4f5c-9075-31f4c6d1ce84 req-4a4ac2e2-4072-4b0b-9ef6-1af009d1c9a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:50.630851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-92f0012b-6942-4f5c-9075-31f4c6d1ce84 req-4a4ac2e2-4072-4b0b-9ef6-1af009d1c9a4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:50.633855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=90 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:50.644721 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-92f0012b-6942-4f5c-9075-31f4c6d1ce84 req-4a4ac2e2-4072-4b0b-9ef6-1af009d1c9a4 service nova] Creating event network-changed:145a8dae-8281-4a41-8173-3068d58c6c5f for instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 on n-h2-851337-5 Aug 04 05:14:50.650404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-92f0012b-6942-4f5c-9075-31f4c6d1ce84 req-4a4ac2e2-4072-4b0b-9ef6-1af009d1c9a4 service nova] Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:14:50.665563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-92f0012b-6942-4f5c-9075-31f4c6d1ce84 req-4a4ac2e2-4072-4b0b-9ef6-1af009d1c9a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051315 Aug 04 05:14:50.666044 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3246/6605] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:50.720263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:50.720917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:50.728094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:50.728651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:50.729521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:50.730724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:50.901653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:50.910223 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e138dd92-0fc0-4235-9e29-d4df62afdb52 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1512 microversion: 2.1 time: 0.193876 Aug 04 05:14:50.910792 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3360/6606] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:50 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:51.934416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:51.935162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:51.941504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.941965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:51.942737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.943214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:52.078086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:52.085809 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f4f495c3-b1bf-4d08-8269-b35df4dc26b0 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1509 microversion: 2.1 time: 0.156507 Aug 04 05:14:52.086386 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3247/6607] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:51 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:52.107169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:52.107696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:52.114787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:52.115293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:52.116090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:52.116570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:52.142385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:14:52.192368 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Found an unconfirmed migration during delete, id: 16, status: finished Aug 04 05:14:53.729786 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba0ced89-cb63-43b8-8ae2-335a09d5e61b tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 204 len: 0 microversion: 2.1 time: 1.626723 Aug 04 05:14:53.731385 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3361/6608] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:14:52 2022] DELETE /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 0 bytes in 1629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:14:53.739398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:53.740022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:53.747127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:53.747583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:53.748388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:53.748830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:53.882348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:53.890707 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bb0b7b23-283a-4fd8-ba0f-9b56b1f821ed tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1501 microversion: 2.1 time: 0.155193 Aug 04 05:14:53.891451 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3248/6609] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:53 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:54.913662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:54.914456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:54.922498 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:54.923089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:54.923974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:54.924495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:54.924888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a8abacb1-1e0b-4fde-86ff-ec22870ec4e9 req-d6952cbc-f30d-4774-bfdf-291e46fd7a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f313153-e9c4-468b-8f0b-3dabb439baf4", "name": "network-vif-plugged", "status": "completed", "tag": "145a8dae-8281-4a41-8173-3068d58c6c5f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:54.936427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a8abacb1-1e0b-4fde-86ff-ec22870ec4e9 req-d6952cbc-f30d-4774-bfdf-291e46fd7a9e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:54.936883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a8abacb1-1e0b-4fde-86ff-ec22870ec4e9 req-d6952cbc-f30d-4774-bfdf-291e46fd7a9e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:54.948754 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a8abacb1-1e0b-4fde-86ff-ec22870ec4e9 req-d6952cbc-f30d-4774-bfdf-291e46fd7a9e service nova] Creating event network-vif-plugged:145a8dae-8281-4a41-8173-3068d58c6c5f for instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 on n-h2-851337-5 Aug 04 05:14:54.953964 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a8abacb1-1e0b-4fde-86ff-ec22870ec4e9 req-d6952cbc-f30d-4774-bfdf-291e46fd7a9e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032843 Aug 04 05:14:54.954579 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3249/6610] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:14:55.068380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2dfbf92ac2442ab71f923bb327a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2c5991d8c84fd7addfcc9c98e07b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:55.076377 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37cb39bf-0181-438d-810b-8073e138a67e tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 200 len: 1501 microversion: 2.1 time: 0.167332 Aug 04 05:14:55.076977 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3362/6611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:54 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:55.730870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-13977ef0-2992-4698-a046-d781c56c1851 req-2910d857-5576-4117-9f97-125515cef8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f313153-e9c4-468b-8f0b-3dabb439baf4", "name": "network-vif-deleted", "tag": "145a8dae-8281-4a41-8173-3068d58c6c5f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:55.741402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-13977ef0-2992-4698-a046-d781c56c1851 req-2910d857-5576-4117-9f97-125515cef8c1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:55.741857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-13977ef0-2992-4698-a046-d781c56c1851 req-2910d857-5576-4117-9f97-125515cef8c1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:55.754465 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-13977ef0-2992-4698-a046-d781c56c1851 req-2910d857-5576-4117-9f97-125515cef8c1 service nova] Creating event network-vif-deleted:145a8dae-8281-4a41-8173-3068d58c6c5f for instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 on n-h2-851337-5 Aug 04 05:14:55.759595 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-13977ef0-2992-4698-a046-d781c56c1851 req-2910d857-5576-4117-9f97-125515cef8c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032907 Aug 04 05:14:55.760523 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3250/6612] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:56.097731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:56.098399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:56.105331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.105792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.107089 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.107544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.120765 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] HTTP exception thrown: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Request method failure captured: Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 HTTP/1.1 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Wen3i_wdmx-tGnqaXwfaMBRaBc7g63-L1iW0b69foXL-uNqEMHL-bk2vrLRVXBlpoaguRtMVdub4BqHgMgdHoaou25mdmbQwB_8c3-leVQqGKStAeXKpmpjuKE0wjxXlGH1n4uki3RVft1ElERWmRJHVXVHf486wj449o2cHYSoNg Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: be2c5991d8c84fd7addfcc9c98e07b33 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_be2c5991d8c84fd7addfcc9c98e07b33", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: be2c5991d8c84fd7addfcc9c98e07b33 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1237971686-project Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: be2dfbf92ac2442ab71f923bb327a297 Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1237971686-project Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1f313153-e9c4-468b-8f0b-3dabb439baf4'} Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:56.123091 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Returning 404 to user: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ea5532d2-f544-479e-b201-1c363d0fb20c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 404 len: 111 microversion: 2.1 time: 0.030914 Aug 04 05:14:56.128964 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3363/6613] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:56 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:14:56.140702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:56.141304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:56.147634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.148094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.148870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.149313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.162707 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] HTTP exception thrown: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Request method failure captured: Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: request: DELETE /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 HTTP/1.1 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61Wen3i_wdmx-tGnqaXwfaMBRaBc7g63-L1iW0b69foXL-uNqEMHL-bk2vrLRVXBlpoaguRtMVdub4BqHgMgdHoaou25mdmbQwB_8c3-leVQqGKStAeXKpmpjuKE0wjxXlGH1n4uki3RVft1ElERWmRJHVXVHf486wj449o2cHYSoNg Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: be2c5991d8c84fd7addfcc9c98e07b33 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_be2c5991d8c84fd7addfcc9c98e07b33", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: be2c5991d8c84fd7addfcc9c98e07b33 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-DeleteServersTestJSON-1237971686-project Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: be2dfbf92ac2442ab71f923bb327a297 Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-DeleteServersTestJSON-1237971686-project Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '1f313153-e9c4-468b-8f0b-3dabb439baf4'} Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:14:56.164414 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Returning 404 to user: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-df2676ad-0745-43b1-99ad-0f3f59df6a9c tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 404 len: 111 microversion: 2.1 time: 0.029877 Aug 04 05:14:56.170021 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3251/6614] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:14:56 2022] DELETE /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:14:56.174777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:56.175439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] [instance: 1f313153-e9c4-468b-8f0b-3dabb439baf4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:56.181531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.182006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.182795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.183288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.197698 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] HTTP exception thrown: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Request method failure captured: Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 HTTP/1.1 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61Wen3i_wdmx-tGnqaXwfaMBRaBc7g63-L1iW0b69foXL-uNqEMHL-bk2vrLRVXBlpoaguRtMVdub4BqHgMgdHoaou25mdmbQwB_8c3-leVQqGKStAeXKpmpjuKE0wjxXlGH1n4uki3RVft1ElERWmRJHVXVHf486wj449o2cHYSoNg Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: be2c5991d8c84fd7addfcc9c98e07b33 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/be2c5991d8c84fd7addfcc9c98e07b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_be2c5991d8c84fd7addfcc9c98e07b33", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: be2c5991d8c84fd7addfcc9c98e07b33 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1237971686 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-DeleteServersTestJSON-1237971686-project Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: be2dfbf92ac2442ab71f923bb327a297 Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-DeleteServersTestJSON-1237971686-project Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1f313153-e9c4-468b-8f0b-3dabb439baf4'} Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:56.199301 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] Returning 404 to user: Instance 1f313153-e9c4-468b-8f0b-3dabb439baf4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-57205dae-d610-4340-9a5e-0ce5da7163d9 tempest-DeleteServersTestJSON-1237971686 tempest-DeleteServersTestJSON-1237971686-project] 10.222.0.69 "GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4" status: 404 len: 111 microversion: 2.1 time: 0.029836 Aug 04 05:14:56.204751 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3364/6615] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:56 2022] GET /compute/v2.1/servers/1f313153-e9c4-468b-8f0b-3dabb439baf4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:15:05.104702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1231667064", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "2ac84e58-7a32-4dff-9095-f896e573f5b8"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:05.162624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] validate_networks() for [('2ac84e58-7a32-4dff-9095-f896e573f5b8', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:15:05.656932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:15:05.657445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:15:05.657999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:15:05.658439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:15:05.659060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:15:05.669304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:05.669754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:05.670576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:05.671222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:05.688995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Getting quotas for project 8bd84b6f135c48c9a5cb176961d338cf. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:15:05.694724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Getting quotas for user 9217ed9ac8f94594928283c2b93840a5 and project 8bd84b6f135c48c9a5cb176961d338cf. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:15:05.708555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:15:05.710759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:15:05.759622 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec556d93-e515-4abb-b303-83e276971b3b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788870 Aug 04 05:15:05.759622 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3252/6616] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:15:05.770943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0925b7d6-f442-48b3-adf9-f99c60432de9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:05.771604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0925b7d6-f442-48b3-adf9-f99c60432de9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:05.835440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0925b7d6-f442-48b3-adf9-f99c60432de9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:05.843555 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0925b7d6-f442-48b3-adf9-f99c60432de9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1218 microversion: 2.1 time: 0.076260 Aug 04 05:15:05.844153 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3365/6617] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:05 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:06.867680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:06.869306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:06.879387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:06.880330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:06.881335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:06.882826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:06.956846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:06.964618 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7742dccd-dd03-437b-9b7a-152f479bf08e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1288 microversion: 2.1 time: 0.103887 Aug 04 05:15:06.974038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3253/6618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:06 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:07.986850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:07.987697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:07.990623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:08.000104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:08.000824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:08.001746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:08.002318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:08.164157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:08.176105 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2cb370d5-9d0e-4157-97f4-849ea8bac090 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.192332 Aug 04 05:15:08.181346 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3366/6619] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:07 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:08.283562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b618acfc-c8c1-432e-b95e-428b1bd53f2b req-1061527e-41b2-4575-b5f8-0b1750223bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a349a271-a93f-4d36-bc35-2f735219a9b2", "tag": "80d6ac13-9268-496b-b509-d24027444fd2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:08.300638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b618acfc-c8c1-432e-b95e-428b1bd53f2b req-1061527e-41b2-4575-b5f8-0b1750223bc4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:08.301094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b618acfc-c8c1-432e-b95e-428b1bd53f2b req-1061527e-41b2-4575-b5f8-0b1750223bc4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:08.316424 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b618acfc-c8c1-432e-b95e-428b1bd53f2b req-1061527e-41b2-4575-b5f8-0b1750223bc4 service nova] Creating event network-changed:80d6ac13-9268-496b-b509-d24027444fd2 for instance a349a271-a93f-4d36-bc35-2f735219a9b2 on n-h1-851337-5 Aug 04 05:15:08.324754 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b618acfc-c8c1-432e-b95e-428b1bd53f2b req-1061527e-41b2-4575-b5f8-0b1750223bc4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044889 Aug 04 05:15:08.328184 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3254/6620] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:09.197896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:09.198536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:09.206348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:09.206756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:09.207583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:09.208061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:09.343765 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:09.351291 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5f2a65c8-3abe-4f00-a57a-a05664f409f4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.157308 Aug 04 05:15:09.351888 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3367/6621] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:09 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:10.372545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:10.373244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:10.379529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:10.379975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:10.380733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:10.381170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:10.514165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:10.522233 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11723de7-1244-4d2e-8147-fe38d9ecba9e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.154689 Aug 04 05:15:10.522849 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3255/6622] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:10 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:11.545191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:11.545825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:11.552788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:11.553254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:11.554036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:11.554491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:11.686939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:11.694673 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-26c21197-a1e4-41a9-868f-b77d38c3a277 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.154038 Aug 04 05:15:11.695295 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3368/6623] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:11 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:12.716692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:12.717321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:12.724360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:12.724823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:12.725599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:12.726078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:12.859733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:12.867284 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69004b20-d743-4aac-932d-66837f10cc45 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.154782 Aug 04 05:15:12.867860 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3256/6624] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:12 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:13.888750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:13.889344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:13.896353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:13.896826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:13.897617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:13.898075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:14.030006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:14.037945 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3f635220-ba9c-477a-819d-2ad65f08100d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.153187 Aug 04 05:15:14.038541 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3369/6625] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:13 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:15.059069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:15.060439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:15.067691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:15.068152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:15.068936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:15.069378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:15.221556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:15.231073 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1f7a335d-1423-4ef9-af32-3ec74d998eab tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.175863 Aug 04 05:15:15.232946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3257/6626] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:15 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:15.259651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6a1b0cf6-be1d-431f-9264-293edcb88cdc req-3f9867fe-04fe-4285-9ade-73e23c38652b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a349a271-a93f-4d36-bc35-2f735219a9b2", "name": "network-vif-plugged", "status": "completed", "tag": "80d6ac13-9268-496b-b509-d24027444fd2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:15.276280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a1b0cf6-be1d-431f-9264-293edcb88cdc req-3f9867fe-04fe-4285-9ade-73e23c38652b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:15.276744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6a1b0cf6-be1d-431f-9264-293edcb88cdc req-3f9867fe-04fe-4285-9ade-73e23c38652b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:15.290051 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6a1b0cf6-be1d-431f-9264-293edcb88cdc req-3f9867fe-04fe-4285-9ade-73e23c38652b service nova] Creating event network-vif-plugged:80d6ac13-9268-496b-b509-d24027444fd2 for instance a349a271-a93f-4d36-bc35-2f735219a9b2 on n-h1-851337-5 Aug 04 05:15:15.296854 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6a1b0cf6-be1d-431f-9264-293edcb88cdc req-3f9867fe-04fe-4285-9ade-73e23c38652b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041756 Aug 04 05:15:15.298007 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3370/6627] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:15:16.254194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:16.254803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:16.256807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:16.257492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:16.265282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:16.265742 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:16.266628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:16.267101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:16.398760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:16.406369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dba8e8b3-0ce9-4f67-b153-24ba3ce0a26d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1318 microversion: 2.1 time: 0.156129 Aug 04 05:15:16.406969 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3258/6628] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:16 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:17.429106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:17.429832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:17.431900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:17.438379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.438844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:17.439660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.440112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:17.574595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:17.582676 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6cc6b0f1-c5c5-4988-b7c9-f7a43e634de7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1508 microversion: 2.1 time: 0.158082 Aug 04 05:15:17.583286 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3371/6629] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:17 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:17.602733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:17.603443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:17.610683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.611183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:17.611965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.612415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:17.743539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:17.751797 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0d43e783-47ce-4453-84b0-6fde90074975 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1508 microversion: 2.1 time: 0.153032 Aug 04 05:15:17.752523 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3259/6630] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:17 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:17.771892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8a73ea47-f043-43d5-90bc-5dd675685697 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:17.774310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8a73ea47-f043-43d5-90bc-5dd675685697 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:17.780592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a73ea47-f043-43d5-90bc-5dd675685697 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.781125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a73ea47-f043-43d5-90bc-5dd675685697 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:17.781970 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a73ea47-f043-43d5-90bc-5dd675685697 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.782423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8a73ea47-f043-43d5-90bc-5dd675685697 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:17.846895 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8a73ea47-f043-43d5-90bc-5dd675685697 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "PUT /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1080 microversion: 2.1 time: 0.078370 Aug 04 05:15:17.850988 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3372/6631] 10.222.0.69 () {60 vars in 1256 bytes} [Thu Aug 4 05:15:17 2022] PUT /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1080 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:17.865398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:17.865959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:17.872187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.872651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:17.874222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:17.874748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:18.006749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:18.014862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-897c9209-a234-4f35-8dea-dc473ee7a0b7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1506 microversion: 2.1 time: 0.153498 Aug 04 05:15:18.015474 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3260/6632] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:17 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:18.035324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:18.035964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:18.042069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:18.042542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:18.043358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:18.043816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:18.181370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:18.189577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e0e06004-9618-4639-ab6c-b01794cbf3de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1506 microversion: 2.1 time: 0.158171 Aug 04 05:15:18.190150 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3373/6633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:18 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:18.209605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:18.212060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:18.218657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:18.219153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:18.219930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:18.220374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:18.248743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:18.254544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Old instance type m1.heat2, new instance type m1.heat {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:15:18.261359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:15:18.261792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:15:18.262276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:15:18.262701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:15:18.263173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:15:18.332805 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2872693c-a527-4572-b9ee-c9deb213c1eb tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "POST /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2/action" status: 202 len: 0 microversion: 2.1 time: 0.127112 Aug 04 05:15:18.333418 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3261/6634] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:15:18 2022] POST /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:15:18.341802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:18.343058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:18.349249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:18.349717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:18.350521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:18.350990 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:18.485132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:18.492868 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-654e72c5-c47a-4a40-aa31-10accde8c42e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1517 microversion: 2.1 time: 0.155047 Aug 04 05:15:18.493438 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3374/6635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:18 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:19.514287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:19.514828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:19.521799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:19.522249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:19.523037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:19.523484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:19.667004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:19.675854 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e12b209d-a1fb-4d4e-bebd-6512a2c855ff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1517 microversion: 2.1 time: 0.165590 Aug 04 05:15:19.676478 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3262/6636] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:19 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:20.697693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:20.698544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:20.701572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:20.707381 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:20.707845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:20.708635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:20.709082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:20.842842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:20.850509 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67183c05-58b2-40e2-94a7-6cba5f9beb51 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.156962 Aug 04 05:15:20.851124 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3375/6637] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:20 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:21.871531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:21.872165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:21.875507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:21.881243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:21.881798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:21.882482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:21.882925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:21.886745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:22.019255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:22.026818 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11b6073a-f7b2-4881-b1a7-01c5556ecdfa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.159252 Aug 04 05:15:22.027417 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3263/6638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:21 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:23.048518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:23.049106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:23.056128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:23.056603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:23.057390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:23.057845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:23.192299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:23.199956 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a03b854d-d9ba-4af6-b56c-7c2c706ec111 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.155985 Aug 04 05:15:23.200535 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3376/6639] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:23 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:24.222065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:24.222712 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:24.229752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:24.230201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:24.230988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:24.231492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:24.364103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:24.371753 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15e8119d-4c2a-4d71-bc50-4209f2c28fc3 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.154094 Aug 04 05:15:24.372363 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3264/6640] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:24 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:25.393255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:25.393895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:25.401187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:25.401655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:25.402438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:25.402892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:25.536868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:25.544745 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c5704ddf-5161-44d8-ba6a-2b4be7aa61a5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.155575 Aug 04 05:15:25.545336 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3377/6641] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:25 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:26.566650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:26.567305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:26.574023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:26.574479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:26.575283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:26.575725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:26.708879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:26.716493 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c860e33a-7a85-41ba-8d93-e1462ee22f5b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.153985 Aug 04 05:15:26.717080 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3265/6642] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:26 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:15:27.737889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:27.738547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:27.745620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:27.746081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:27.746871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:27.747331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:27.885987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:27.894388 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e71bd5c9-a02c-4474-9e4e-261ce94c12ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.160495 Aug 04 05:15:27.895097 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3378/6643] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:27 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:28.915899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:28.916528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:28.924089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:28.924550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:28.925348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:28.925799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:29.062836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:29.070374 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a4df2a2-cd68-4bf9-8da5-1124a1603c60 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.158467 Aug 04 05:15:29.070969 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3266/6644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:28 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:30.092035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:30.093202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:30.100356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:30.100823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:30.101611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:30.102066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:30.231754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:30.240189 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-024e619a-5289-4793-a471-9bb3abab85ca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.152068 Aug 04 05:15:30.240772 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3379/6645] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:30 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:31.261750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:31.262363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:31.269502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:31.269952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:31.270719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:31.271192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:31.405849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:31.413549 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3676dec5-a694-4b34-b2cd-2e06bc4cc5d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.156146 Aug 04 05:15:31.414148 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3267/6646] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:31 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:32.434606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:32.435257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:32.442392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:32.442855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:32.443674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:32.444129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:32.578508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:32.586150 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da4b1f2c-45b7-49a8-8f5f-06eb60c17598 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.155439 Aug 04 05:15:32.586775 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3380/6647] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:32 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:33.608603 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:33.609242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:33.616458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:33.616913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:33.617692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:33.618143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:33.756486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:33.764470 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cc2f5f78-8df1-4c23-b09c-5e472e87b4bf tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.160638 Aug 04 05:15:33.765061 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3268/6648] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:33 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:34.785933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:34.786559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:34.793525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:34.793983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:34.794763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:34.795238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:34.932612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:34.940292 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4891ace-90f0-4d2f-8ae0-69ec7fb377fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.158281 Aug 04 05:15:34.940873 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3381/6649] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:34 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:35.962331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:35.962903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:35.969895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:35.970351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:35.971232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:35.971675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:36.113765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:36.121280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-266e5d7e-15e3-4554-a7b2-484937280a03 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.162964 Aug 04 05:15:36.121848 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3269/6650] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:35 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:37.143488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:37.144158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:37.151284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:37.151757 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:37.152553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:37.153013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:37.171352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:37.287901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:37.295917 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4abcdc03-e1e7-4067-a02a-8ef335a76da6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.156485 Aug 04 05:15:37.296495 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3382/6651] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:37 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:38.317527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:38.318147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:38.325389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:38.325844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:38.326609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:38.327086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:38.459208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:38.466723 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-435eab6f-7dac-4c61-9480-600d2b00a63c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.153106 Aug 04 05:15:38.467933 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3270/6652] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:38 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:39.488972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:39.489653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:39.496680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:39.497159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:39.497925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:39.498366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:39.644165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:39.652081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8dd128da-ed3b-44f3-9665-bc83d6f1ee91 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.167148 Aug 04 05:15:39.652668 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3383/6653] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:39 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:40.673141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:40.673752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:40.680815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:40.681262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:40.682031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:40.682470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:40.817474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:40.825225 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e564f39e-307a-44e5-b7ba-3c451a4ae8d5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.156018 Aug 04 05:15:40.825803 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3271/6654] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:40 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:41.847044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:41.847653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:41.854651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:41.855155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:41.855938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:41.856387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:41.989898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:41.997618 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fd5d0ebb-7da2-460d-8024-8fc51c4dca11 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.155121 Aug 04 05:15:41.998216 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3384/6655] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:41 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:43.025793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:43.026758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:43.037587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:43.038282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:43.039512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:43.040213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:43.182429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:43.189966 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd84ee8a-050c-473d-8708-330d4e8dd42f tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.170762 Aug 04 05:15:43.190555 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3272/6656] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:43 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:44.211084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:44.211716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:44.219969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:44.220435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:44.221230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:44.221686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:44.351776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:44.359357 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-828986d3-045b-4b58-8b61-3e6d529a2f2a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.152201 Aug 04 05:15:44.359949 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3385/6657] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:44 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:45.379927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:45.380550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:45.387863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:45.388297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:45.389563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:45.389998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:45.522880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:45.531076 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-782235c5-712f-4723-bfb3-6b754d1bcf6e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.155107 Aug 04 05:15:45.531644 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3273/6658] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:45 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:46.552850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:46.553523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:46.560314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:46.560781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:46.561570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:46.562026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:46.697489 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:46.705023 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-feb54ce5-afb8-4417-abc5-1e4655c202a4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1522 microversion: 2.1 time: 0.156384 Aug 04 05:15:46.705595 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3386/6659] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:46 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:47.725982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:47.726706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:47.734456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:47.734914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:47.735735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:47.736174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:47.874274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-cdaec6a0-f07b-4f70-a0bb-abaf21251aac req-22656a2f-29f4-40de-a05a-f2090d5fc74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a349a271-a93f-4d36-bc35-2f735219a9b2", "name": "network-vif-unplugged", "status": "completed", "tag": "80d6ac13-9268-496b-b509-d24027444fd2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:47.882087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:47.893335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-62002ed0-f937-421f-9646-93143ef22437 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1521 microversion: 2.1 time: 0.171336 Aug 04 05:15:47.894160 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3274/6660] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:47 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:47.897716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cdaec6a0-f07b-4f70-a0bb-abaf21251aac req-22656a2f-29f4-40de-a05a-f2090d5fc74f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:47.898170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cdaec6a0-f07b-4f70-a0bb-abaf21251aac req-22656a2f-29f4-40de-a05a-f2090d5fc74f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:47.911246 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-cdaec6a0-f07b-4f70-a0bb-abaf21251aac req-22656a2f-29f4-40de-a05a-f2090d5fc74f service nova] Creating event network-vif-unplugged:80d6ac13-9268-496b-b509-d24027444fd2 for instance a349a271-a93f-4d36-bc35-2f735219a9b2 on n-h2-851337-5 Aug 04 05:15:47.916717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-cdaec6a0-f07b-4f70-a0bb-abaf21251aac req-22656a2f-29f4-40de-a05a-f2090d5fc74f service nova] Instance a349a271-a93f-4d36-bc35-2f735219a9b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:15:47.927752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-cdaec6a0-f07b-4f70-a0bb-abaf21251aac req-22656a2f-29f4-40de-a05a-f2090d5fc74f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057203 Aug 04 05:15:47.928369 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3387/6661] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:15:48.915767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:48.916395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:48.924013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:48.924475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:48.925242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:48.925708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:49.056897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:49.064998 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-22719e03-1e0d-49d2-bcec-55ddf6a5cab5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1519 microversion: 2.1 time: 0.153254 Aug 04 05:15:49.065588 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3275/6662] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:48 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:49.954373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-6e605d27-7aa9-48fc-9dc8-fe7ea66b6e7f req-ee82126d-1a28-4a31-87da-572d447a207f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a349a271-a93f-4d36-bc35-2f735219a9b2", "tag": "80d6ac13-9268-496b-b509-d24027444fd2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:49.963966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6e605d27-7aa9-48fc-9dc8-fe7ea66b6e7f req-ee82126d-1a28-4a31-87da-572d447a207f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:49.964419 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-6e605d27-7aa9-48fc-9dc8-fe7ea66b6e7f req-ee82126d-1a28-4a31-87da-572d447a207f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:49.975824 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-6e605d27-7aa9-48fc-9dc8-fe7ea66b6e7f req-ee82126d-1a28-4a31-87da-572d447a207f service nova] Creating event network-changed:80d6ac13-9268-496b-b509-d24027444fd2 for instance a349a271-a93f-4d36-bc35-2f735219a9b2 on n-h2-851337-5 Aug 04 05:15:49.981171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-6e605d27-7aa9-48fc-9dc8-fe7ea66b6e7f req-ee82126d-1a28-4a31-87da-572d447a207f service nova] Instance a349a271-a93f-4d36-bc35-2f735219a9b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:15:49.993530 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-6e605d27-7aa9-48fc-9dc8-fe7ea66b6e7f req-ee82126d-1a28-4a31-87da-572d447a207f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044285 Aug 04 05:15:49.994133 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3388/6663] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:50.085724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:50.086836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:50.094982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.095912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.097451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.098165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.243208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:50.251639 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1dd760d3-55ba-4f8b-83ab-d8d48e909da4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1516 microversion: 2.1 time: 0.169689 Aug 04 05:15:50.252131 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3276/6664] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:50 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:50.272835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e7b5095-690d-4aaa-854c-ea1bd3004b99 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:50.273628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e7b5095-690d-4aaa-854c-ea1bd3004b99 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:50.280869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e7b5095-690d-4aaa-854c-ea1bd3004b99 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.281663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e7b5095-690d-4aaa-854c-ea1bd3004b99 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.282491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e7b5095-690d-4aaa-854c-ea1bd3004b99 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.282989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e7b5095-690d-4aaa-854c-ea1bd3004b99 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.347415 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e7b5095-690d-4aaa-854c-ea1bd3004b99 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "POST /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2/action" status: 204 len: 0 microversion: 2.1 time: 0.078511 Aug 04 05:15:50.347953 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3389/6665] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:15:50 2022] POST /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:15:50.356173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:50.357380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:50.365250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.366117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.367435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.368063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.586417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:50.596058 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-190e425c-3ebf-4e99-867b-c4c1baf185a0 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1516 microversion: 2.1 time: 0.243807 Aug 04 05:15:50.596669 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3277/6666] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:50 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:51.619084 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:51.619804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:51.621789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=30 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:51.628323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:51.628788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:51.629573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:51.630025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:51.769335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:51.777008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4d090a62-b7cf-4237-9d7c-5873c5c1777e tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1516 microversion: 2.1 time: 0.163281 Aug 04 05:15:51.777577 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3390/6667] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:51 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:52.798523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:52.799179 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:52.801879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=30 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:52.807936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:52.808386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:52.809155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:52.809591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:52.812911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=90 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:52.953304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:52.961041 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-67911de9-347d-4879-9a9c-9d25a299a1c4 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1508 microversion: 2.1 time: 0.166585 Aug 04 05:15:52.961611 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3278/6668] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:52 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:52.981519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:52.982153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:52.989490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:52.990022 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:52.990839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:52.991366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:53.131406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:53.139625 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d5647141-2563-493d-8e8d-eb5ad97108a8 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1508 microversion: 2.1 time: 0.161406 Aug 04 05:15:53.140204 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3391/6669] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:52 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:53.163901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96fe3994-65f2-420d-bdd3-8b6f932da940 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'create', calling method: .version_select at 0x7f1919fff1f0>, body: {"keypair": {"name": "tempest-keypair-870060171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4K2VKuuuiS/O6/97mkQvO/vOHPXC9uB3mRUwYnsMHKAB8f+V/LUoalwKlbxnhJRmF9jxDT6BzJvfr6WDw0qTQXTe9rxGIZaAxFytkIMrVFfVZ5YF83NcZ1b6M/RWLa3A=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:53.179414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-96fe3994-65f2-420d-bdd3-8b6f932da940 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Getting quotas for project 8bd84b6f135c48c9a5cb176961d338cf. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:15:53.184574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-96fe3994-65f2-420d-bdd3-8b6f932da940 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Getting quotas for user 9217ed9ac8f94594928283c2b93840a5 and project 8bd84b6f135c48c9a5cb176961d338cf. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:15:53.211766 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96fe3994-65f2-420d-bdd3-8b6f932da940 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051884 Aug 04 05:15:53.212562 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3279/6670] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:15:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:54.434242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:54.434878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:54.442449 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:54.442913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:54.443758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:54.444207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:54.578566 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:54.586183 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2e9b0fc8-1f62-4c22-961c-f8e7c0c594fa tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 200 len: 1508 microversion: 2.1 time: 0.155824 Aug 04 05:15:54.586752 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3392/6671] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:54 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:54.608845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:54.609368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:54.616308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:54.616767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:54.617548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:54.617993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:54.642870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:15:54.741875 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-16958520-ec6f-4710-ade3-195f7bfc38a7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 204 len: 0 microversion: 2.1 time: 0.138197 Aug 04 05:15:54.742759 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3280/6672] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:15:54 2022] DELETE /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:15:54.805595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1616393648", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "2ac84e58-7a32-4dff-9095-f896e573f5b8"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:54.858775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] validate_networks() for [('2ac84e58-7a32-4dff-9095-f896e573f5b8', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:15:55.239994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-add8b57c-a165-4b6e-a611-41377ffeee78 req-cec2f1e0-12b4-4fd1-9454-eb34817a7cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a349a271-a93f-4d36-bc35-2f735219a9b2", "name": "network-vif-plugged", "status": "completed", "tag": "80d6ac13-9268-496b-b509-d24027444fd2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:55.250818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:15:55.251470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-add8b57c-a165-4b6e-a611-41377ffeee78 req-cec2f1e0-12b4-4fd1-9454-eb34817a7cb1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:55.251597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:15:55.251931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-add8b57c-a165-4b6e-a611-41377ffeee78 req-cec2f1e0-12b4-4fd1-9454-eb34817a7cb1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:55.252164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:15:55.252623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:15:55.253050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:15:55.264701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:55.265166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:55.265401 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-add8b57c-a165-4b6e-a611-41377ffeee78 req-cec2f1e0-12b4-4fd1-9454-eb34817a7cb1 service nova] Creating event network-vif-plugged:80d6ac13-9268-496b-b509-d24027444fd2 for instance a349a271-a93f-4d36-bc35-2f735219a9b2 on n-h2-851337-5 Aug 04 05:15:55.265977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:55.266426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:55.270704 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-add8b57c-a165-4b6e-a611-41377ffeee78 req-cec2f1e0-12b4-4fd1-9454-eb34817a7cb1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034789 Aug 04 05:15:55.271713 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3281/6673] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:15:55.285883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Getting quotas for project 8bd84b6f135c48c9a5cb176961d338cf. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:15:55.291335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Getting quotas for user 9217ed9ac8f94594928283c2b93840a5 and project 8bd84b6f135c48c9a5cb176961d338cf. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:15:55.303958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:15:55.306234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:15:55.350651 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7072321-501a-4296-80e4-3a6a3eb28455 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548910 Aug 04 05:15:55.351397 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3393/6674] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:15:55.364266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4bc7d792-5f6e-4034-80c1-d5945843de1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:55.364598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4bc7d792-5f6e-4034-80c1-d5945843de1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:55.419305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4bc7d792-5f6e-4034-80c1-d5945843de1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:55.426096 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4bc7d792-5f6e-4034-80c1-d5945843de1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1218 microversion: 2.1 time: 0.067022 Aug 04 05:15:55.426677 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3282/6675] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:55 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:56.449190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:56.450018 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:56.460580 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:56.461052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:56.461860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:56.462322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:56.531597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:56.540045 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-61b7aed2-ccd1-4419-9b16-566af24a1fff tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1276 microversion: 2.1 time: 0.098008 Aug 04 05:15:56.540512 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3394/6676] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:56 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:56.663349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5ed69639-83c7-4994-81cc-06a872dd98d0 req-d794c6fb-8054-44ec-9c08-bb6fbd871b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a349a271-a93f-4d36-bc35-2f735219a9b2", "name": "network-vif-deleted", "tag": "80d6ac13-9268-496b-b509-d24027444fd2"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:56.677343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5ed69639-83c7-4994-81cc-06a872dd98d0 req-d794c6fb-8054-44ec-9c08-bb6fbd871b85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:56.678126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5ed69639-83c7-4994-81cc-06a872dd98d0 req-d794c6fb-8054-44ec-9c08-bb6fbd871b85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:56.699377 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5ed69639-83c7-4994-81cc-06a872dd98d0 req-d794c6fb-8054-44ec-9c08-bb6fbd871b85 service nova] Creating event network-vif-deleted:80d6ac13-9268-496b-b509-d24027444fd2 for instance a349a271-a93f-4d36-bc35-2f735219a9b2 on n-h2-851337-5 Aug 04 05:15:56.704966 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5ed69639-83c7-4994-81cc-06a872dd98d0 req-d794c6fb-8054-44ec-9c08-bb6fbd871b85 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045237 Aug 04 05:15:56.706726 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3283/6677] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:57.562520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:57.563199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:57.570195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:57.570652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:57.571474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:57.571943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:57.706113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:57.714057 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d3e7130e-583e-4e29-8b59-b2b52e06181d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1318 microversion: 2.1 time: 0.155695 Aug 04 05:15:57.714645 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3395/6678] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:57 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:58.722171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-bc6cd800-ece7-4a3b-b16d-9ac339e1c3bf req-399b355c-84c2-4008-80e7-190b505a4afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95efca2e-b3c9-4e91-9acd-098cf13d96cf", "tag": "8ea72f21-6b70-4023-9265-0e2ee19e3cdb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:58.732067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bc6cd800-ece7-4a3b-b16d-9ac339e1c3bf req-399b355c-84c2-4008-80e7-190b505a4afd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:58.733222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bc6cd800-ece7-4a3b-b16d-9ac339e1c3bf req-399b355c-84c2-4008-80e7-190b505a4afd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:58.734979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:58.735617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:58.742551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:58.743046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:58.743828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:58.744275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:58.744988 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-bc6cd800-ece7-4a3b-b16d-9ac339e1c3bf req-399b355c-84c2-4008-80e7-190b505a4afd service nova] Creating event network-changed:8ea72f21-6b70-4023-9265-0e2ee19e3cdb for instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf on n-h1-851337-5 Aug 04 05:15:58.750270 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-bc6cd800-ece7-4a3b-b16d-9ac339e1c3bf req-399b355c-84c2-4008-80e7-190b505a4afd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033637 Aug 04 05:15:58.750877 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3284/6679] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:58.880295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:58.888087 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcd019b1-6877-4330-97dd-d5cb027056de tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1318 microversion: 2.1 time: 0.157651 Aug 04 05:15:58.889187 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3396/6680] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:58 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:15:59.909517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:59.910216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:59.917582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:59.917981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:59.918761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:59.919230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:00.053428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:00.061095 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-51bbf5e6-cfd8-4834-80cc-5aac44c8d238 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1318 microversion: 2.1 time: 0.155935 Aug 04 05:16:00.061681 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3285/6681] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:59 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:01.082548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:01.083161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:01.090277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.090749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.091575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.092068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.220178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:01.227815 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-093e2352-b378-4c80-8ade-7703b101c9af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1318 microversion: 2.1 time: 0.149364 Aug 04 05:16:01.228405 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3397/6682] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:01 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:02.249577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:02.250190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:02.257037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:02.257485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:02.258253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:02.258687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:02.391340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:02.399077 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f66f7d60-57db-449c-b7bc-98351f6597d2 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1318 microversion: 2.1 time: 0.153835 Aug 04 05:16:02.399665 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3286/6683] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:02 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:03.419837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:03.420480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:03.427653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:03.428123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:03.428922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:03.429386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:03.558378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-804418a8-204d-4567-972c-bf59ca2bee74 req-3ccc55a4-73fe-43c4-b094-bc428961e800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95efca2e-b3c9-4e91-9acd-098cf13d96cf", "name": "network-vif-plugged", "status": "completed", "tag": "8ea72f21-6b70-4023-9265-0e2ee19e3cdb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:03.568937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:03.577203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-804418a8-204d-4567-972c-bf59ca2bee74 req-3ccc55a4-73fe-43c4-b094-bc428961e800 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:03.577654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-804418a8-204d-4567-972c-bf59ca2bee74 req-3ccc55a4-73fe-43c4-b094-bc428961e800 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:03.585329 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-345e4da4-81b7-42fe-955d-cbaf4bfba4dc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1318 microversion: 2.1 time: 0.169374 Aug 04 05:16:03.585927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3398/6684] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:03 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:03.596495 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-804418a8-204d-4567-972c-bf59ca2bee74 req-3ccc55a4-73fe-43c4-b094-bc428961e800 service nova] Creating event network-vif-plugged:8ea72f21-6b70-4023-9265-0e2ee19e3cdb for instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf on n-h1-851337-5 Aug 04 05:16:03.601904 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-804418a8-204d-4567-972c-bf59ca2bee74 req-3ccc55a4-73fe-43c4-b094-bc428961e800 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048206 Aug 04 05:16:03.602702 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3287/6685] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:04.606832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:04.608060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:04.615074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:04.615537 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:04.616316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:04.616760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:04.631628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:04.750965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:04.758488 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f3874ac0-5070-4efa-a6fe-cb63c9f4b9b6 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1318 microversion: 2.1 time: 0.155674 Aug 04 05:16:04.759085 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3399/6686] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:04 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:05.781622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:05.782243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:05.785210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:05.791097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.791551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:05.792331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.792771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:05.949560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:05.957764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8f9a9e31-81de-43d6-adbe-8e4b554106fc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1507 microversion: 2.1 time: 0.181258 Aug 04 05:16:05.958358 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3288/6687] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:05 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:05.979686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:05.980477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:05.982481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:05.983193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:05.992095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.992542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:05.993355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.993803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.136198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:06.144747 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ac1e1fdc-e6e4-4937-b363-4b8bff89fb01 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1507 microversion: 2.1 time: 0.169522 Aug 04 05:16:06.145355 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3400/6688] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:05 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:06.165798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:06.168226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:06.174255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.174706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.175596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.176327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.207345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:06.213596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Old instance type m1.heat2, new instance type m1.heat {{(pid=119342) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:16:06.219949 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:16:06.220421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:16:06.221180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:16:06.221914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:16:06.222522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:16:06.287870 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8c5ef512-bdcd-4607-98ae-485492327d09 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "POST /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf/action" status: 202 len: 0 microversion: 2.1 time: 0.125980 Aug 04 05:16:06.288491 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3289/6689] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:16:06 2022] POST /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:16:06.297066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:06.297704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:06.303752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.304220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.305012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.305462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.457987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:06.466709 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-50f00aef-e4ba-4461-b0f0-29ff5a14d27c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1514 microversion: 2.1 time: 0.173848 Aug 04 05:16:06.467366 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3401/6690] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:06 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:07.487954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:07.488651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:07.495794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:07.496226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:07.497086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:07.497567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:07.644958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:07.652694 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35623f91-0c02-4db9-a54d-fdeb90ae3110 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1514 microversion: 2.1 time: 0.168826 Aug 04 05:16:07.653371 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3290/6691] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:07 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:08.674703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:08.675379 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:08.682452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.682919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.683739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.684198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.816611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:08.824277 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b642997-04a1-4943-9cf5-4f269151ee85 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.153980 Aug 04 05:16:08.824863 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3402/6692] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:08 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:09.845658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:09.846221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:09.854114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:09.854565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:09.855370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:09.855808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:10.001556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:10.009081 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6246098a-a525-4c79-869f-1b03ae04cb43 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.167469 Aug 04 05:16:10.009901 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3291/6693] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:09 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:11.031669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:11.032239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:11.039213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:11.039766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:11.040562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:11.041020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:11.174534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:11.182289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ef246ab7-2d76-4d20-8e05-87ce4b19784c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.155296 Aug 04 05:16:11.182874 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3403/6694] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:11 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:12.204726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:12.205346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:12.212354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:12.212805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:12.213586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:12.214012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:12.346800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:12.354701 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7bf8252c-d849-4308-862d-87b3de5ad395 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.154406 Aug 04 05:16:12.355325 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3292/6695] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:12 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:13.376710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:13.377373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:13.384516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:13.385230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:13.386006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:13.386455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:13.516799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:13.524428 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a7ad93e-7f0e-46d5-850c-3d33145e78af tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.152009 Aug 04 05:16:13.525007 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3404/6696] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:13 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:16:14.544694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:14.545250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:14.552209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:14.552653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:14.553415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:14.553850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:14.703539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:14.711234 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85fd02c3-b318-4a30-8e29-0585c10374dd tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.170507 Aug 04 05:16:14.711813 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3293/6697] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:14 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:15.732939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:15.733574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:15.740380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:15.740849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:15.741632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:15.742086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:15.877375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:15.885546 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e7060c5-2265-48ba-b4f0-d279e21fe9ed tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.156548 Aug 04 05:16:15.886137 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3405/6698] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:15 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:16.907883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:16.908529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:16.915529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:16.915983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:16.916750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:16.917188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:17.049324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:17.057107 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bbf047e2-f34c-4eef-9bb0-aeb045376865 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.153807 Aug 04 05:16:17.057687 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3294/6699] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:16 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:18.078050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:18.078701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:18.085843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:18.086309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:18.087121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:18.087573 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:18.222858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:18.230347 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ec3430f-865e-4a42-a660-1ae6d6cedbca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.156268 Aug 04 05:16:18.230926 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3406/6700] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:18 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:19.252747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:19.253360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:19.260696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:19.261153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:19.261926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:19.262370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:19.390860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:19.398648 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0e82fe87-1d43-4249-a495-185ad2fde0d7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.150487 Aug 04 05:16:19.399257 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3295/6701] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:19 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:20.419715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:20.420355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:20.426942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:20.427446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:20.428234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:20.428689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:20.559438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:20.567547 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9cca072e-76a5-42b3-b612-56973da3b9e5 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.151905 Aug 04 05:16:20.568131 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3407/6702] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:20 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:21.589185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:21.589794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:21.597650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:21.598107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:21.598884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:21.599352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:21.614257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:21.733023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:21.740564 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c1081951-b6b0-4e49-977e-1f866fb45da9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.155365 Aug 04 05:16:21.741138 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3296/6703] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:21 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:22.761819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:22.762519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:22.765408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:22.771254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:22.771728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:22.772526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:22.772972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:22.913337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:22.920998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-586f708f-8420-48c5-aaf6-e0d712d27423 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.163364 Aug 04 05:16:22.921728 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3408/6704] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:22 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:23.942557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:23.943146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:23.945857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:23.951645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:23.952109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:23.952933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:23.953382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:24.094545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:24.102221 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9071c69a-fc26-41a6-952b-ae0c4153834c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.163697 Aug 04 05:16:24.102790 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3297/6705] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:23 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:25.125787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:25.126342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:25.133581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:25.134147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:25.135480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:25.136118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:25.269589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:25.277620 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7c8f3b79-a887-45dc-8b93-2c97abda7a9d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.157562 Aug 04 05:16:25.278198 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3409/6706] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:25 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:26.299510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:26.300171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:26.306709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:26.307209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:26.307990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:26.308443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:26.442947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:26.450647 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-594ddc16-16fb-49a7-b5ad-5317418d1af7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.155377 Aug 04 05:16:26.451291 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3298/6707] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:26 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:27.473431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:27.474066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:27.481131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:27.481626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:27.482418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:27.482873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:27.613853 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:27.621661 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7b3d4603-72a6-4d67-afd1-8effdc3e8851 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.152119 Aug 04 05:16:27.626601 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3410/6708] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:27 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:28.643359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:28.643917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:28.650934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:28.651411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:28.652181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:28.652615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:28.787370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:28.794883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bf79a303-69de-4415-94dc-eb9c640848cc tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.155586 Aug 04 05:16:28.795485 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3299/6709] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:28 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:29.817214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:29.817837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:29.825050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:29.825516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:29.826306 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:29.826763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:29.956868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:29.964381 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c2efbe72-54fc-4b24-a7a4-45c97d0dabca tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.151861 Aug 04 05:16:29.964962 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3411/6710] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:29 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:30.986308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:30.986890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:30.994334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:30.994792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:30.995604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:30.996052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:31.124507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:31.132691 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2ec0ad32-80e7-4825-8d9f-78b7bc9a3c1a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.150733 Aug 04 05:16:31.133277 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3300/6711] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:30 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:32.153594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:32.154224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:32.162129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:32.162626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:32.163590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:32.164046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:32.629935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:32.637685 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e58b5d31-5079-4381-83a5-91c2205a2f97 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.488021 Aug 04 05:16:32.638260 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3412/6712] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:32 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:33.658363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:33.659006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:33.666330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:33.666796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:33.667639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:33.668116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:33.796898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:33.804397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-826ac247-9132-4386-b41f-031707726a0a tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.150656 Aug 04 05:16:33.804962 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3301/6713] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:33 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:34.825985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:34.826612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:34.834169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:34.834625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:34.835450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:34.835889 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:34.838458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=82 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:34.976321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:34.984582 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d18b0880-0c34-44dc-a800-353665083ee7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1519 microversion: 2.1 time: 0.162451 Aug 04 05:16:34.985182 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3413/6714] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:34 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:35.522785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-580a1926-53e1-4da2-b119-87012a5a1cd7 req-af5992ea-3f93-409b-a757-f4ddf6cd438a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95efca2e-b3c9-4e91-9acd-098cf13d96cf", "name": "network-vif-unplugged", "status": "completed", "tag": "8ea72f21-6b70-4023-9265-0e2ee19e3cdb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:35.534042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-580a1926-53e1-4da2-b119-87012a5a1cd7 req-af5992ea-3f93-409b-a757-f4ddf6cd438a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:35.534497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-580a1926-53e1-4da2-b119-87012a5a1cd7 req-af5992ea-3f93-409b-a757-f4ddf6cd438a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:35.546698 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-580a1926-53e1-4da2-b119-87012a5a1cd7 req-af5992ea-3f93-409b-a757-f4ddf6cd438a service nova] Creating event network-vif-unplugged:8ea72f21-6b70-4023-9265-0e2ee19e3cdb for instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf on n-h2-851337-5 Aug 04 05:16:35.552301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-580a1926-53e1-4da2-b119-87012a5a1cd7 req-af5992ea-3f93-409b-a757-f4ddf6cd438a service nova] Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:16:35.565783 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-580a1926-53e1-4da2-b119-87012a5a1cd7 req-af5992ea-3f93-409b-a757-f4ddf6cd438a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045241 Aug 04 05:16:35.565783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3302/6715] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:36.006770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:36.007564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:36.015134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:36.015607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:36.016409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:36.016869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:36.243570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:36.251328 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b7998db6-84c3-4c28-b0fb-7f138f718d1d tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1518 microversion: 2.1 time: 0.248977 Aug 04 05:16:36.251913 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3414/6716] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:36 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:16:37.274466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:37.275221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:37.281534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:37.281997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:37.282768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:37.283390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:37.419940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:37.428146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ef6b45e8-0abb-4b11-95ee-a1eb98e482a1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1516 microversion: 2.1 time: 0.159123 Aug 04 05:16:37.428726 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3303/6717] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:37 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:37.579683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-94fd3041-8a7b-44ea-b2e4-e96eb9bf0e45 req-77ba67d2-e100-4736-9107-cdb73c4ba4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95efca2e-b3c9-4e91-9acd-098cf13d96cf", "tag": "8ea72f21-6b70-4023-9265-0e2ee19e3cdb"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:37.590010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-94fd3041-8a7b-44ea-b2e4-e96eb9bf0e45 req-77ba67d2-e100-4736-9107-cdb73c4ba4eb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:37.590467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-94fd3041-8a7b-44ea-b2e4-e96eb9bf0e45 req-77ba67d2-e100-4736-9107-cdb73c4ba4eb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:37.602324 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-94fd3041-8a7b-44ea-b2e4-e96eb9bf0e45 req-77ba67d2-e100-4736-9107-cdb73c4ba4eb service nova] Creating event network-changed:8ea72f21-6b70-4023-9265-0e2ee19e3cdb for instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf on n-h2-851337-5 Aug 04 05:16:37.607586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-94fd3041-8a7b-44ea-b2e4-e96eb9bf0e45 req-77ba67d2-e100-4736-9107-cdb73c4ba4eb service nova] Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:16:37.618902 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-94fd3041-8a7b-44ea-b2e4-e96eb9bf0e45 req-77ba67d2-e100-4736-9107-cdb73c4ba4eb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042937 Aug 04 05:16:37.619526 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3415/6718] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:38.451946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:38.453493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:38.460997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:38.461464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:38.462248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:38.462698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:38.663680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:38.671983 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-65f34ef2-8cb6-4af5-9365-9a37949b023c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1513 microversion: 2.1 time: 0.225003 Aug 04 05:16:38.672571 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3304/6719] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:38 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:38.694243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7115bea8-2076-4e6a-9997-eec002fda92c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:38.694907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7115bea8-2076-4e6a-9997-eec002fda92c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:38.701219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7115bea8-2076-4e6a-9997-eec002fda92c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:38.701684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7115bea8-2076-4e6a-9997-eec002fda92c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:38.702466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7115bea8-2076-4e6a-9997-eec002fda92c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:38.703028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7115bea8-2076-4e6a-9997-eec002fda92c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:38.771125 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7115bea8-2076-4e6a-9997-eec002fda92c tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "POST /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf/action" status: 204 len: 0 microversion: 2.1 time: 0.081759 Aug 04 05:16:38.771794 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3416/6720] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:16:38 2022] POST /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:16:38.779941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:38.780571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:38.787395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:38.788545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:38.788914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:38.789654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:38.929527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:38.937821 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-10fbc3a1-2b1a-44d0-bf1c-603b43e19e93 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1513 microversion: 2.1 time: 0.161268 Aug 04 05:16:38.938625 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3305/6721] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:38 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:39.963407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:39.964132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:39.970618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:39.971142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:39.971940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:39.972400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.116851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:40.124557 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a75dc045-3a02-4d4a-81a0-3bcbd107aa15 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1505 microversion: 2.1 time: 0.166666 Aug 04 05:16:40.125773 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3417/6722] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:39 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:40.146474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:40.147138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:40.153999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.154450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.155237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.155701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.288753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:40.300678 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-18ba049a-f95c-4206-8eb7-6621681c71e7 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1505 microversion: 2.1 time: 0.158017 Aug 04 05:16:40.301283 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3306/6723] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:40 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:40.321421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:40.322064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:40.328230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.328702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.329494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.329956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.470024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:40.477648 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22469bb2-19af-4e98-b770-59db57fa5af9 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1505 microversion: 2.1 time: 0.160108 Aug 04 05:16:40.478221 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3418/6724] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:40 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:40.498307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:40.498850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:40.505279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.505733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.506509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.506947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.533729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:16:40.612239 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-368f6833-869d-4cf0-ba7c-0338d32264d1 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "DELETE /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 204 len: 0 microversion: 2.1 time: 0.116772 Aug 04 05:16:40.613798 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3307/6725] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:16:40 2022] DELETE /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:16:40.628331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:40.628847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:40.634933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.635681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.636458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.636908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.665538 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:16:40.712015 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.compute.api [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Instance is already in deleting state, ignoring this request Aug 04 05:16:40.712863 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4bc0e3fb-7c58-45f2-b4eb-bd371a687763 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "DELETE /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 204 len: 0 microversion: 2.1 time: 0.088573 Aug 04 05:16:40.713426 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3419/6726] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:16:40 2022] DELETE /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:16:40.722679 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:40.723385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:40.730390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.730887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.732042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:40.732488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:40.868069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:40.876200 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8bd9e3f8-cecb-4692-9fb1-43d5739b210b tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1511 microversion: 2.1 time: 0.158396 Aug 04 05:16:40.876813 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3308/6727] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:40 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:41.897550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:41.898269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:41.905164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:41.906004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:41.907226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:41.908021 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:42.134902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9217ed9ac8f94594928283c2b93840a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd84b6f135c48c9a5cb176961d338cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:42.142701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-750cd814-7697-49a2-8d2d-fb384ec59720 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 200 len: 1511 microversion: 2.1 time: 0.249094 Aug 04 05:16:42.143318 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3420/6728] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:41 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:42.513511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b3ace975-502a-434c-abe5-3fb54e9f4cb7 req-31661375-afa4-4002-90eb-95e9fcac7efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95efca2e-b3c9-4e91-9acd-098cf13d96cf", "name": "network-vif-deleted", "tag": "8ea72f21-6b70-4023-9265-0e2ee19e3cdb"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:42.524018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b3ace975-502a-434c-abe5-3fb54e9f4cb7 req-31661375-afa4-4002-90eb-95e9fcac7efc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:42.524458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b3ace975-502a-434c-abe5-3fb54e9f4cb7 req-31661375-afa4-4002-90eb-95e9fcac7efc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:42.537390 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b3ace975-502a-434c-abe5-3fb54e9f4cb7 req-31661375-afa4-4002-90eb-95e9fcac7efc service nova] Creating event network-vif-deleted:8ea72f21-6b70-4023-9265-0e2ee19e3cdb for instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf on n-h2-851337-5 Aug 04 05:16:42.543215 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b3ace975-502a-434c-abe5-3fb54e9f4cb7 req-31661375-afa4-4002-90eb-95e9fcac7efc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116486 Aug 04 05:16:42.544561 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3309/6729] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:43.163964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:43.164592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: 95efca2e-b3c9-4e91-9acd-098cf13d96cf] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:43.171701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:43.172167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:43.173444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:43.173896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:43.187253 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] HTTP exception thrown: Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf could not be found. Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Request method failure captured: Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf HTTP/1.1 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61XYCCocmCIinwVleypOk0oD0tNMU5oyPIiXYYD9Kj7REQCBgfp6jD00NRZXwa9SwtrbcYjCFsoSSZbfOsrgnp4qbJjgB7YBQd8NfbqfAvn7_gep5sWvk8jQey8QoE5RyQrzA4YJpfemXOjKgA11Xuy7GVuB89vJVi9LeKUHkYHwyeY Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 8bd84b6f135c48c9a5cb176961d338cf Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bd84b6f135c48c9a5cb176961d338cf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 8bd84b6f135c48c9a5cb176961d338cf Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerDiskConfigTestJSON-131982459-project Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 9217ed9ac8f94594928283c2b93840a5 Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerDiskConfigTestJSON-131982459-project Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf could not be found. Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '95efca2e-b3c9-4e91-9acd-098cf13d96cf'} Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf could not be found. Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf could not be found. Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:16:43.189597 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf could not be found. Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Returning 404 to user: Instance 95efca2e-b3c9-4e91-9acd-098cf13d96cf could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7dec8814-831a-4e3f-bcc6-25e876cc7034 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf" status: 404 len: 111 microversion: 2.1 time: 0.031066 Aug 04 05:16:43.195363 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3421/6730] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:43 2022] GET /compute/v2.1/servers/95efca2e-b3c9-4e91-9acd-098cf13d96cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:16:43.200537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38a4c50f-b4e8-463c-a170-a5e37f2e33fe tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '.version_select at 0x7f191b594280>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:43.220010 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38a4c50f-b4e8-463c-a170-a5e37f2e33fe tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870060171" status: 202 len: 0 microversion: 2.1 time: 0.023655 Aug 04 05:16:43.220613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3310/6731] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Aug 4 05:16:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870060171 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:16:43.826971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:43.827579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:43.834263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:43.834738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:43.835552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:43.836014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:43.850130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] HTTP exception thrown: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Request method failure captured: Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 HTTP/1.1 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61XYCCocmCIinwVleypOk0oD0tNMU5oyPIiXYYD9Kj7REQCBgfp6jD00NRZXwa9SwtrbcYjCFsoSSZbfOsrgnp4qbJjgB7YBQd8NfbqfAvn7_gep5sWvk8jQey8QoE5RyQrzA4YJpfemXOjKgA11Xuy7GVuB89vJVi9LeKUHkYHwyeY Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 8bd84b6f135c48c9a5cb176961d338cf Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bd84b6f135c48c9a5cb176961d338cf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 8bd84b6f135c48c9a5cb176961d338cf Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerDiskConfigTestJSON-131982459-project Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 9217ed9ac8f94594928283c2b93840a5 Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerDiskConfigTestJSON-131982459-project Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'a349a271-a93f-4d36-bc35-2f735219a9b2'} Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:16:43.852043 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Returning 404 to user: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2145267b-8a4a-45ab-903f-4d74bdb87825 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 404 len: 111 microversion: 2.1 time: 0.030509 Aug 04 05:16:43.857478 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3422/6732] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:16:43 2022] DELETE /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:16:43.863748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:43.864518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] [instance: a349a271-a93f-4d36-bc35-2f735219a9b2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:43.871481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:43.871941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:43.872747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:43.873196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:43.887924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] HTTP exception thrown: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Request method failure captured: Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 HTTP/1.1 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61XYCCocmCIinwVleypOk0oD0tNMU5oyPIiXYYD9Kj7REQCBgfp6jD00NRZXwa9SwtrbcYjCFsoSSZbfOsrgnp4qbJjgB7YBQd8NfbqfAvn7_gep5sWvk8jQey8QoE5RyQrzA4YJpfemXOjKgA11Xuy7GVuB89vJVi9LeKUHkYHwyeY Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 8bd84b6f135c48c9a5cb176961d338cf Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd84b6f135c48c9a5cb176961d338cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bd84b6f135c48c9a5cb176961d338cf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 8bd84b6f135c48c9a5cb176961d338cf Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-131982459 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerDiskConfigTestJSON-131982459-project Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 9217ed9ac8f94594928283c2b93840a5 Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerDiskConfigTestJSON-131982459-project Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a349a271-a93f-4d36-bc35-2f735219a9b2'} Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:16:43.889638 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] Returning 404 to user: Instance a349a271-a93f-4d36-bc35-2f735219a9b2 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d876e79-08bd-4072-b6dc-c0183d7c1480 tempest-ServerDiskConfigTestJSON-131982459 tempest-ServerDiskConfigTestJSON-131982459-project] 10.222.0.69 "GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2" status: 404 len: 111 microversion: 2.1 time: 0.032898 Aug 04 05:16:43.894849 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3311/6733] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:43 2022] GET /compute/v2.1/servers/a349a271-a93f-4d36-bc35-2f735219a9b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:16:52.675224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ecab39f2-fb32-4cf4-8f38-0c3c4dd416a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'create', calling method: .version_select at 0x7f19197be5e0>, body: {"keypair": {"name": "tempest-keypair-1161455763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMfqY9fbye3er/tjTE4kQ5AfAs1TVvqnCRouOxGjgWOEPKlrCD8IzdKl1wMVIng+awJSqYrHfucXkEkPAEKh6z2obRmDFB274xi2Yt2NJboQ6jrlS+qjxCL4IO6rTwTRg=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:52.691290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ecab39f2-fb32-4cf4-8f38-0c3c4dd416a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:16:52.696738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ecab39f2-fb32-4cf4-8f38-0c3c4dd416a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for user c77abdb95c994fbca1991af85976243b and project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:16:52.725820 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ecab39f2-fb32-4cf4-8f38-0c3c4dd416a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.208098 Aug 04 05:16:52.726438 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3423/6734] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:16:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:54.081396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1191202806", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ead41bfa-ae51-4953-b215-e2bdda5d121d"}], "security_groups": [{"name": "tempest-securitygroup--803039292"}], "key_name": "tempest-keypair-1161455763", "user_data": "}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:54.090767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:54.091615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:54.196317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] validate_networks() for [('ead41bfa-ae51-4953-b215-e2bdda5d121d', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:16:54.628255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:16:54.628793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:16:54.629347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:16:54.629938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:16:54.630613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:16:54.646074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:54.646621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:54.647552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:54.648043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:54.666668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:16:54.672157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for user c77abdb95c994fbca1991af85976243b and project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:16:54.685239 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:16:54.687593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:16:54.736998 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-039d1124-a5b7-4a44-b3a6-8b770a64f41b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.659690 Aug 04 05:16:54.738132 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3312/6735] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:16:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:16:54.748849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44f8d049-c08b-4bf1-94ad-216e751f00ba tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:54.749488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44f8d049-c08b-4bf1-94ad-216e751f00ba tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:54.753076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:54.753954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:54.815621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-44f8d049-c08b-4bf1-94ad-216e751f00ba tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:54.824157 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44f8d049-c08b-4bf1-94ad-216e751f00ba tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1239 microversion: 2.1 time: 0.079159 Aug 04 05:16:54.824739 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3424/6736] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:54 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:55.847641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:55.849221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:55.857371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:55.858187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:55.859188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:55.859884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:55.942997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:55.952099 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-166f8b24-9c1c-4eff-ade3-ee8bc97fe7e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1299 microversion: 2.1 time: 0.110745 Aug 04 05:16:55.952823 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3313/6737] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:55 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:56.973249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:56.973886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:56.981122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:56.981590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:56.982388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:56.982839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:57.125503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:57.133437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c33c9177-8574-4c8e-98dc-0dec7c5472e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.164682 Aug 04 05:16:57.134014 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3425/6738] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:56 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:57.366290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ad483d4c-f29e-4240-a12f-081a59d09050 req-19fae7d4-dfd4-48f4-a76c-17c1b1a98e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23832231-db91-43cb-811e-431c67f97143", "tag": "139b9120-38fa-4eff-b2ed-2abd02f0f830"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:57.376667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ad483d4c-f29e-4240-a12f-081a59d09050 req-19fae7d4-dfd4-48f4-a76c-17c1b1a98e53 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:57.377125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ad483d4c-f29e-4240-a12f-081a59d09050 req-19fae7d4-dfd4-48f4-a76c-17c1b1a98e53 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:57.391194 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ad483d4c-f29e-4240-a12f-081a59d09050 req-19fae7d4-dfd4-48f4-a76c-17c1b1a98e53 service nova] Creating event network-changed:139b9120-38fa-4eff-b2ed-2abd02f0f830 for instance 23832231-db91-43cb-811e-431c67f97143 on n-h1-851337-5 Aug 04 05:16:57.396716 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ad483d4c-f29e-4240-a12f-081a59d09050 req-19fae7d4-dfd4-48f4-a76c-17c1b1a98e53 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117339 Aug 04 05:16:57.397319 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3314/6739] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:58.154030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:58.154672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:58.161715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:58.162184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:58.162995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:58.163460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:58.295297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:58.303477 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee1fced0-d0ec-42d6-b9bd-c47cd539a129 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.153343 Aug 04 05:16:58.304063 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3426/6740] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:58 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:59.326123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:59.326850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:59.333845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:59.334304 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:59.335121 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:59.335573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:59.468152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:59.476071 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-383ebd48-b004-4a76-964a-06b6dee0b1eb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.155013 Aug 04 05:16:59.476666 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3315/6741] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:59 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:00.497503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:00.498052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:00.505414 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:00.505890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:00.506720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:00.507218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:00.651805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:00.659627 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-26a5b3d3-136b-4c64-bf99-7d33a24a2438 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.166212 Aug 04 05:17:00.660211 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3427/6742] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:00 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:01.681042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:01.681667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:01.688272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.688733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.689556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.690007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.830349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:01.838966 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6259f0ce-5c4b-44ac-8cd3-4c578ec11b3f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.161891 Aug 04 05:17:01.839898 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3316/6743] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:01 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:02.860487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:02.861198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:02.868916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:02.869382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:02.870251 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:02.870642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:02.999494 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:03.007090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4f02c427-8b0c-4ddf-80b4-f84f4d7847f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.150618 Aug 04 05:17:03.007669 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3428/6744] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:02 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:03.862873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-80fbf4dc-6419-48f6-9798-70b009eeda34 req-48327cf1-ff2e-4589-8044-a927f005857b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23832231-db91-43cb-811e-431c67f97143", "name": "network-vif-plugged", "status": "completed", "tag": "139b9120-38fa-4eff-b2ed-2abd02f0f830"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:03.872684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-80fbf4dc-6419-48f6-9798-70b009eeda34 req-48327cf1-ff2e-4589-8044-a927f005857b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:03.873093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-80fbf4dc-6419-48f6-9798-70b009eeda34 req-48327cf1-ff2e-4589-8044-a927f005857b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:03.885737 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-80fbf4dc-6419-48f6-9798-70b009eeda34 req-48327cf1-ff2e-4589-8044-a927f005857b service nova] Creating event network-vif-plugged:139b9120-38fa-4eff-b2ed-2abd02f0f830 for instance 23832231-db91-43cb-811e-431c67f97143 on n-h1-851337-5 Aug 04 05:17:03.890808 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-80fbf4dc-6419-48f6-9798-70b009eeda34 req-48327cf1-ff2e-4589-8044-a927f005857b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097334 Aug 04 05:17:03.891386 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3317/6745] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:04.028120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:04.028758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:04.035892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:04.036355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:04.037175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:04.037636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:04.171735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:04.179845 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-15222f91-9a20-416c-8468-92542f775dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.155711 Aug 04 05:17:04.180428 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3429/6746] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:04 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:05.198728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:05.199539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:05.204869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:05.205581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:05.213330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:05.213784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:05.214560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:05.215024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:05.359896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:05.367329 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42476598-2b95-4a8c-978e-ca78980695a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1364 microversion: 2.1 time: 0.169564 Aug 04 05:17:05.367907 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3318/6747] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:05 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:06.389006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:06.389558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:06.391618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:06.398389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:06.398862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:06.399689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:06.400148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:06.532834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:06.541146 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5403cdb1-7800-4dd6-8d71-81790341043a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1552 microversion: 2.1 time: 0.156466 Aug 04 05:17:06.541716 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3430/6748] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:06 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:06.562097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c7dda158-ce10-43a2-82da-80b8bf7b3352 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:06.562687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c7dda158-ce10-43a2-82da-80b8bf7b3352 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:06.569859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7dda158-ce10-43a2-82da-80b8bf7b3352 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:06.570319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7dda158-ce10-43a2-82da-80b8bf7b3352 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:06.571153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7dda158-ce10-43a2-82da-80b8bf7b3352 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:06.571588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c7dda158-ce10-43a2-82da-80b8bf7b3352 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:06.653180 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c7dda158-ce10-43a2-82da-80b8bf7b3352 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095666 Aug 04 05:17:06.653773 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3319/6749] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 05:17:06 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:07.633475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a52101d8-af1b-47d7-a49e-c1c1a1a7778d req-bbe5d408-ead9-4925-a566-4334b025fd85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23832231-db91-43cb-811e-431c67f97143", "tag": "139b9120-38fa-4eff-b2ed-2abd02f0f830"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:07.649631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a52101d8-af1b-47d7-a49e-c1c1a1a7778d req-bbe5d408-ead9-4925-a566-4334b025fd85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:07.650124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a52101d8-af1b-47d7-a49e-c1c1a1a7778d req-bbe5d408-ead9-4925-a566-4334b025fd85 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:07.662701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a52101d8-af1b-47d7-a49e-c1c1a1a7778d req-bbe5d408-ead9-4925-a566-4334b025fd85 service nova] Creating event network-changed:139b9120-38fa-4eff-b2ed-2abd02f0f830 for instance 23832231-db91-43cb-811e-431c67f97143 on n-h1-851337-5 Aug 04 05:17:07.668063 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a52101d8-af1b-47d7-a49e-c1c1a1a7778d req-bbe5d408-ead9-4925-a566-4334b025fd85 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038419 Aug 04 05:17:07.668749 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3431/6750] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:12.025857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:12.026617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=34 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:12.031432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:12.032054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:12.039909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.040450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.041147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.041622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.526131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:12.533868 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a260021-7fb9-44ce-a977-23859b8c7a0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1670 microversion: 2.1 time: 0.510555 Aug 04 05:18:12.534447 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3320/6751] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:12 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1670 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:12.555012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=17 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:12.555989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=38 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:12.560681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:12.561402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:12.568590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.569219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.570245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.570713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.709371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:12.717437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a0de753d-7519-458f-a204-82bcbb23a342 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1670 microversion: 2.1 time: 0.166675 Aug 04 05:18:12.718011 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3432/6752] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:12 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:12.738254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:12.738870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:12.745092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.745546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.746318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.746787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.880874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:12.889940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-322d0d72-3427-406a-96a1-9d1279166e56 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1670 microversion: 2.1 time: 0.155654 Aug 04 05:18:12.890517 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3321/6753] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:12 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:12.910694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:12.913040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:12.919355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.919827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.920614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:12.921070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:12.948989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:12.954803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Old instance type m1.heat2, new instance type m1.heat {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:18:12.961699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:18:12.962142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:18:12.962633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:18:12.963097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:18:12.963532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:18:13.029171 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00657ce0-dd21-49f7-8e8c-15855f42554c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143/action" status: 202 len: 0 microversion: 2.1 time: 0.122400 Aug 04 05:18:13.029790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3433/6754] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:18:12 2022] POST /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:18:13.038009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:13.038630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:13.045678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:13.046162 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:13.046931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:13.047807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:13.184208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:13.192746 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b0c75991-691e-4646-97a0-8b5319806a59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1679 microversion: 2.1 time: 0.158681 Aug 04 05:18:13.193338 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3322/6755] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:13 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:14.215124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:14.215761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:14.222192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:14.222665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:14.223496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:14.223963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:14.361433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:14.369118 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2243b636-b511-46c7-8976-dc2b5d86cf5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1679 microversion: 2.1 time: 0.159303 Aug 04 05:18:14.369705 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3434/6756] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:14 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:15.394309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:15.394973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:15.406502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:15.406981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:15.407779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:15.408248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:15.544777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:15.552651 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3e9df91c-2bb8-4fae-bfe8-8a3edf33f707 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.165986 Aug 04 05:18:15.553735 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3323/6757] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:15 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:16.580847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:16.581400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:16.588533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:16.589003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:16.589797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:16.590257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:16.721399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:16.729679 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0bee172-f13d-4bc3-a5d8-37b7278c9491 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.153123 Aug 04 05:18:16.730263 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3435/6758] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:16 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:17.751407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:17.752019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:17.759590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:17.760043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:17.760804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:17.761242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:17.894604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:17.902310 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d33aa9e3-06cf-44fb-92bf-293c026fb2fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.154778 Aug 04 05:18:17.902913 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3324/6759] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:17 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:18.923730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:18.924279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:18.931392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:18.931864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:18.932661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:18.933119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:19.062390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:19.070529 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a72fc13-371e-4f31-b3c8-4fa486293a52 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.150427 Aug 04 05:18:19.071140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3436/6760] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:18 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:20.091818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:20.092355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:20.099260 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:20.099711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:20.100474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:20.100912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:20.233378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:20.241043 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5712c659-b118-4302-845b-a8d384634960 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.153215 Aug 04 05:18:20.242119 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3325/6761] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:20 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:21.263761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:21.264402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:21.270975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:21.271436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:21.272207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:21.272655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:21.408031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:21.417136 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5bd63120-dd8f-456c-a6e3-5193b9151416 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.157629 Aug 04 05:18:21.417734 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3437/6762] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:21 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:22.439038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:22.439668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:22.447284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:22.447725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:22.448503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:22.448947 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:22.584851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:22.593136 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b946a4e-c98a-449a-aad0-741eeb9bf3a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.158130 Aug 04 05:18:22.593717 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3326/6763] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:22 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:23.613837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:23.614476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:23.622192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:23.622665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:23.623485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:23.623946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:23.761298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:23.770402 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0cba98d4-822d-4e50-a3b5-5e65902fb58c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.160317 Aug 04 05:18:23.770878 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3438/6764] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:23 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:24.792587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:24.792587 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:24.800258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.801092 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.802080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.802532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.947324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:24.955276 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ec9c557-6d01-4670-b261-d5635d5f0cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.167323 Aug 04 05:18:24.955877 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3327/6765] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:24 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:25.978614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:25.979317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:25.986211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:25.986697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:25.987496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:25.987950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:26.151852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:26.159431 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a99f2282-3b0e-4d07-aabb-82392a3893f9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1684 microversion: 2.1 time: 0.185532 Aug 04 05:18:26.160017 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3439/6766] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:25 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:27.180809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:27.181504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:27.188072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:27.188526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:27.189301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:27.189740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:27.411158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-93520f65-58f2-40a5-b006-4e9c950fe108 req-affbf414-61a3-447c-9bf6-675e881e5dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23832231-db91-43cb-811e-431c67f97143", "name": "network-vif-unplugged", "status": "completed", "tag": "139b9120-38fa-4eff-b2ed-2abd02f0f830"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:27.422133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:27.429215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-93520f65-58f2-40a5-b006-4e9c950fe108 req-affbf414-61a3-447c-9bf6-675e881e5dd6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:27.429679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-93520f65-58f2-40a5-b006-4e9c950fe108 req-affbf414-61a3-447c-9bf6-675e881e5dd6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:27.437957 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b9cbc62-228c-4c56-83eb-c3bc417d1867 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1683 microversion: 2.1 time: 0.261264 Aug 04 05:18:27.439280 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3328/6767] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:27 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1683 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:27.442917 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-93520f65-58f2-40a5-b006-4e9c950fe108 req-affbf414-61a3-447c-9bf6-675e881e5dd6 service nova] Creating event network-vif-unplugged:139b9120-38fa-4eff-b2ed-2abd02f0f830 for instance 23832231-db91-43cb-811e-431c67f97143 on n-h2-851337-5 Aug 04 05:18:27.449293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-93520f65-58f2-40a5-b006-4e9c950fe108 req-affbf414-61a3-447c-9bf6-675e881e5dd6 service nova] Instance 23832231-db91-43cb-811e-431c67f97143 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:18:27.461551 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-93520f65-58f2-40a5-b006-4e9c950fe108 req-affbf414-61a3-447c-9bf6-675e881e5dd6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054290 Aug 04 05:18:27.462173 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3440/6768] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:18:28.460701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:28.461330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:28.468339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:28.468883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:28.469575 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:28.470022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:28.661817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:28.670148 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6bdf3e99-9e49-471e-8285-a5f06769a11e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1681 microversion: 2.1 time: 0.213336 Aug 04 05:18:28.670755 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3329/6769] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:28 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:29.480981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7dcf8c06-ef4b-4a7d-93e7-4488e0720907 req-af2ff0bd-202f-4461-8109-c4cd8778bde9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23832231-db91-43cb-811e-431c67f97143", "tag": "139b9120-38fa-4eff-b2ed-2abd02f0f830"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:29.491296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7dcf8c06-ef4b-4a7d-93e7-4488e0720907 req-af2ff0bd-202f-4461-8109-c4cd8778bde9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:29.492287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7dcf8c06-ef4b-4a7d-93e7-4488e0720907 req-af2ff0bd-202f-4461-8109-c4cd8778bde9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:29.503994 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7dcf8c06-ef4b-4a7d-93e7-4488e0720907 req-af2ff0bd-202f-4461-8109-c4cd8778bde9 service nova] Creating event network-changed:139b9120-38fa-4eff-b2ed-2abd02f0f830 for instance 23832231-db91-43cb-811e-431c67f97143 on n-h2-851337-5 Aug 04 05:18:29.509926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-7dcf8c06-ef4b-4a7d-93e7-4488e0720907 req-af2ff0bd-202f-4461-8109-c4cd8778bde9 service nova] Instance 23832231-db91-43cb-811e-431c67f97143 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:18:29.521454 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7dcf8c06-ef4b-4a7d-93e7-4488e0720907 req-af2ff0bd-202f-4461-8109-c4cd8778bde9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044812 Aug 04 05:18:29.522212 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3441/6770] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:29.693221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:29.695723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:29.706145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:29.706614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:29.707481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:29.707884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:29.845448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:29.854460 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4648b86e-d033-4a94-80fc-09e9b2d346a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1681 microversion: 2.1 time: 0.166487 Aug 04 05:18:29.855185 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3330/6771] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:29 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:30.878641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:30.879439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:30.887661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:30.888133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:30.888932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:30.889387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.079181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:31.086712 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3030d7a0-ee16-4284-b792-bfaa556650a9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1678 microversion: 2.1 time: 0.212845 Aug 04 05:18:31.087323 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3442/6772] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:30 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:31.107060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96c4ee78-17c8-452b-a5fd-68976cca6738 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:31.107610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96c4ee78-17c8-452b-a5fd-68976cca6738 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:31.114452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96c4ee78-17c8-452b-a5fd-68976cca6738 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.114918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96c4ee78-17c8-452b-a5fd-68976cca6738 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.115762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96c4ee78-17c8-452b-a5fd-68976cca6738 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.116206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96c4ee78-17c8-452b-a5fd-68976cca6738 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.172993 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96c4ee78-17c8-452b-a5fd-68976cca6738 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143/action" status: 204 len: 0 microversion: 2.1 time: 0.069913 Aug 04 05:18:31.173641 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3331/6773] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:18:31 2022] POST /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:18:31.183576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:31.184231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:31.191004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.191849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.193044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.193906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.334219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:31.341891 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-796602b6-d8ca-4c79-bb20-1d6fb01b52a1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1678 microversion: 2.1 time: 0.163095 Aug 04 05:18:31.342471 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3443/6774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:31 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:32.365434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:32.366134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:32.375620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.376087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.376936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.377567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.526885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:32.534897 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bc69fa0-e5e7-44ca-a72a-0888a81492c7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1670 microversion: 2.1 time: 0.175049 Aug 04 05:18:32.535504 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3332/6775] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:32 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:32.555725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:32.556337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:32.563710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.564172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.564965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.565417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.697693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:32.705254 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-56e77d25-fcbd-44ab-9f7c-bdbd70765e64 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1670 microversion: 2.1 time: 0.153931 Aug 04 05:18:32.705836 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3444/6776] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:32 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:32.725738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:32.726445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:32.732535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.732983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.733751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.734211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.870413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:32.879406 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2497dbfa-aace-4baf-b767-2866ec12217f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1670 microversion: 2.1 time: 0.157468 Aug 04 05:18:32.880008 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3333/6777] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:32 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:32.906355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:32.906870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:32.913931 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.914474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.915399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.915936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.941920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:18:33.016510 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-892061bc-4b52-4521-bf29-22f699452e00 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 204 len: 0 microversion: 2.1 time: 0.113839 Aug 04 05:18:33.017365 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3445/6778] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:18:32 2022] DELETE /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:18:33.025437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:33.026060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:33.032231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:33.032686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:33.033455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:33.033897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:33.164877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:33.172393 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f1b2cd6b-42c8-4d2e-b0d1-c4a7411a5451 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1676 microversion: 2.1 time: 0.150869 Aug 04 05:18:33.172970 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3334/6779] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:33 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:34.027328 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1c538333-e064-4f0d-9c74-9dac51e71af1 req-34d26e3a-97ba-4b44-b09a-08251a942bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23832231-db91-43cb-811e-431c67f97143", "name": "network-vif-plugged", "status": "completed", "tag": "139b9120-38fa-4eff-b2ed-2abd02f0f830"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:34.045397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1c538333-e064-4f0d-9c74-9dac51e71af1 req-34d26e3a-97ba-4b44-b09a-08251a942bdb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:34.046256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1c538333-e064-4f0d-9c74-9dac51e71af1 req-34d26e3a-97ba-4b44-b09a-08251a942bdb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:34.052367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:34.060334 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1c538333-e064-4f0d-9c74-9dac51e71af1 req-34d26e3a-97ba-4b44-b09a-08251a942bdb service nova] Creating event network-vif-plugged:139b9120-38fa-4eff-b2ed-2abd02f0f830 for instance 23832231-db91-43cb-811e-431c67f97143 on n-h2-851337-5 Aug 04 05:18:34.065720 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1c538333-e064-4f0d-9c74-9dac51e71af1 req-34d26e3a-97ba-4b44-b09a-08251a942bdb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042446 Aug 04 05:18:34.066454 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3446/6780] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:34.193913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:34.195117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:34.202246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:34.202710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:34.203525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:34.203972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:34.219301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:34.403344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:34.410931 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6a424d01-6686-4b3a-8ae7-62df1d6d24e2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1676 microversion: 2.1 time: 0.221061 Aug 04 05:18:34.411584 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3335/6781] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:34 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:35.165109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8ec23de7-cfbc-4ed4-bdd6-358c2251f873 req-8001d23e-3300-4151-a661-768b0b558efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23832231-db91-43cb-811e-431c67f97143", "name": "network-vif-deleted", "tag": "139b9120-38fa-4eff-b2ed-2abd02f0f830"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:35.181855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8ec23de7-cfbc-4ed4-bdd6-358c2251f873 req-8001d23e-3300-4151-a661-768b0b558efb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.182930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8ec23de7-cfbc-4ed4-bdd6-358c2251f873 req-8001d23e-3300-4151-a661-768b0b558efb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.198402 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8ec23de7-cfbc-4ed4-bdd6-358c2251f873 req-8001d23e-3300-4151-a661-768b0b558efb service nova] Creating event network-vif-deleted:139b9120-38fa-4eff-b2ed-2abd02f0f830 for instance 23832231-db91-43cb-811e-431c67f97143 on n-h2-851337-5 Aug 04 05:18:35.204237 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8ec23de7-cfbc-4ed4-bdd6-358c2251f873 req-8001d23e-3300-4151-a661-768b0b558efb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043698 Aug 04 05:18:35.205110 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3447/6782] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:35.432809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:35.433493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:35.440641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.441102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.441901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.442349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.477343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.477793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.478263 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lazy-loading 'fault' on Instance uuid 23832231-db91-43cb-811e-431c67f97143 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:18:35.529903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:35.537789 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-479f724a-7a19-4fc2-8968-f5892383748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 200 len: 1329 microversion: 2.1 time: 0.109034 Aug 04 05:18:35.539895 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3336/6783] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:35 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 1329 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:36.560487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:36.561202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:36.568420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.568895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.570214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.570671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.583953 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 HTTP/1.1 Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '23832231-db91-43cb-811e-431c67f97143'} Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:36.586243 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84fc7881-5e13-4147-a2fe-2e5d5acc31c9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 404 len: 111 microversion: 2.1 time: 0.031513 Aug 04 05:18:36.591814 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3448/6784] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:36 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:18:36.599450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:36.600094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:36.607141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.607593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.608355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.608793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.622147 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 HTTP/1.1 Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '23832231-db91-43cb-811e-431c67f97143'} Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:36.623826 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b0745440-72f4-40aa-8b3a-247501e5c23a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 404 len: 111 microversion: 2.1 time: 0.029657 Aug 04 05:18:36.629015 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3337/6785] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:36 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:18:36.674510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-816405140", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "ead41bfa-ae51-4953-b215-e2bdda5d121d"}], "security_groups": [{"name": "tempest-securitygroup--803039292"}], "key_name": "tempest-keypair-1161455763", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:36.778070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] validate_networks() for [('ead41bfa-ae51-4953-b215-e2bdda5d121d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:18:37.214594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:18:37.215067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:18:37.215563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:18:37.215993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:18:37.216509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:18:37.225972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:37.226399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:37.227232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:37.227688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:37.245117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:18:37.250377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for user c77abdb95c994fbca1991af85976243b and project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:18:37.263679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:18:37.265971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:18:37.312193 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-606979c8-c9ab-42d1-80df-3259fac306bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.641420 Aug 04 05:18:37.313326 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3449/6786] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:18:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:18:37.323920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b2c3a19f-1eda-4138-b597-04f67a6adbec tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:37.324532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b2c3a19f-1eda-4138-b597-04f67a6adbec tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:37.383870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b2c3a19f-1eda-4138-b597-04f67a6adbec tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:37.391959 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b2c3a19f-1eda-4138-b597-04f67a6adbec tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1238 microversion: 2.1 time: 0.071994 Aug 04 05:18:37.392551 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3338/6787] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:37 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:38.413632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:38.414377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:38.422974 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:38.423482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:38.424291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:38.424751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:38.527128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:38.535638 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38fbe393-e1b2-4386-99c5-e03199260ae4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1296 microversion: 2.1 time: 0.126203 Aug 04 05:18:38.536221 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3450/6788] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:38 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:39.557301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:39.558017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:39.566562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:39.567296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:39.568095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:39.568528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:39.608164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-820bb793-612e-4a11-a2bc-4defda7e24ea req-1b962b99-7cd9-4594-b7ff-de18b97ae1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00789856-5fe9-4a57-8099-d393b73a13bc", "tag": "827b8e36-4bb7-4bc5-8490-aab26a8586f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:39.621281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-820bb793-612e-4a11-a2bc-4defda7e24ea req-1b962b99-7cd9-4594-b7ff-de18b97ae1f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:39.622026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-820bb793-612e-4a11-a2bc-4defda7e24ea req-1b962b99-7cd9-4594-b7ff-de18b97ae1f4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:39.636140 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-820bb793-612e-4a11-a2bc-4defda7e24ea req-1b962b99-7cd9-4594-b7ff-de18b97ae1f4 service nova] Creating event network-changed:827b8e36-4bb7-4bc5-8490-aab26a8586f1 for instance 00789856-5fe9-4a57-8099-d393b73a13bc on n-h2-851337-5 Aug 04 05:18:39.641420 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-820bb793-612e-4a11-a2bc-4defda7e24ea req-1b962b99-7cd9-4594-b7ff-de18b97ae1f4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037640 Aug 04 05:18:39.642780 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3451/6789] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:39.838738 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:39.846928 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d96266f2-95a7-4582-bb01-5bffb81767f4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1363 microversion: 2.1 time: 0.293927 Aug 04 05:18:39.847538 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3339/6790] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:39 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:40.869898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:40.870627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:40.879194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:40.879669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:40.880510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:40.880967 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:41.113834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:41.121681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a4cc1309-1edd-48c2-8a23-3a4f4ae5c396 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1363 microversion: 2.1 time: 0.256379 Aug 04 05:18:41.122270 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3452/6791] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:40 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:42.144149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:42.144761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:42.148212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=45 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:42.155443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:42.156134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:42.157058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:42.157573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:42.291075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:42.298762 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ff786b55-4a9e-433e-88be-0d45ef704359 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1363 microversion: 2.1 time: 0.158933 Aug 04 05:18:42.299368 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3340/6792] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:42 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:43.321160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:43.321888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:43.324758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:43.330255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:43.330723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:43.331556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:43.332023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:43.465835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:43.473342 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08f4f140-cb6b-4a8a-8815-ea161058e4ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1363 microversion: 2.1 time: 0.156792 Aug 04 05:18:43.473927 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3453/6793] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:43 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:44.495142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:44.495939 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:44.503471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:44.503932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:44.504730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:44.505207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:44.644968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:44.652451 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1dbf53be-286e-4ebc-a40f-cd301322748a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1363 microversion: 2.1 time: 0.161862 Aug 04 05:18:44.653023 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3341/6794] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:44 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:45.673458 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:45.674103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:45.681041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:45.681509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:45.682299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:45.682759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:45.813107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:45.821139 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-265f2507-3661-427e-b0dd-2109d5a252a8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1363 microversion: 2.1 time: 0.151059 Aug 04 05:18:45.821732 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3454/6795] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:45 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:46.080724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-63ee589a-2514-4860-a784-8d440ea52cff req-73da9e88-e1d7-424e-be99-be02bdff660d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00789856-5fe9-4a57-8099-d393b73a13bc", "name": "network-vif-plugged", "status": "completed", "tag": "827b8e36-4bb7-4bc5-8490-aab26a8586f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:46.091956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-63ee589a-2514-4860-a784-8d440ea52cff req-73da9e88-e1d7-424e-be99-be02bdff660d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:46.093040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-63ee589a-2514-4860-a784-8d440ea52cff req-73da9e88-e1d7-424e-be99-be02bdff660d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:46.104980 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-63ee589a-2514-4860-a784-8d440ea52cff req-73da9e88-e1d7-424e-be99-be02bdff660d service nova] Creating event network-vif-plugged:827b8e36-4bb7-4bc5-8490-aab26a8586f1 for instance 00789856-5fe9-4a57-8099-d393b73a13bc on n-h2-851337-5 Aug 04 05:18:46.110372 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-63ee589a-2514-4860-a784-8d440ea52cff req-73da9e88-e1d7-424e-be99-be02bdff660d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033246 Aug 04 05:18:46.111224 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3342/6796] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:46.842264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:46.842888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:46.849828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:46.850291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:46.851101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:46.851550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:46.985011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:46.992967 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0573d872-d42e-4100-a6f1-69f7625d1def tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1363 microversion: 2.1 time: 0.154501 Aug 04 05:18:46.993549 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3455/6797] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:46 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:48.016178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:48.016885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:48.019686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.025586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:48.026043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:48.026832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:48.027302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:48.161426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:48.170063 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b9965635-71cd-4b39-97e2-0ecdb28cc243 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1550 microversion: 2.1 time: 0.158464 Aug 04 05:18:48.170597 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3343/6798] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:48 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:48.190603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-918adfdc-be81-4808-90f0-dda1a7175c91 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:48.191170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-918adfdc-be81-4808-90f0-dda1a7175c91 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:48.193041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.193934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.201075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-918adfdc-be81-4808-90f0-dda1a7175c91 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:48.201546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-918adfdc-be81-4808-90f0-dda1a7175c91 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:48.202345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-918adfdc-be81-4808-90f0-dda1a7175c91 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:48.202798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-918adfdc-be81-4808-90f0-dda1a7175c91 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:48.283917 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-918adfdc-be81-4808-90f0-dda1a7175c91 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097242 Aug 04 05:18:48.284567 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3456/6799] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 05:18:48 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:49.222437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-e56daf0e-9ef1-430c-bb87-2e556e5ba110 req-a2bfaa70-01bf-4225-854c-0864f56f74b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00789856-5fe9-4a57-8099-d393b73a13bc", "tag": "827b8e36-4bb7-4bc5-8490-aab26a8586f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:49.233244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e56daf0e-9ef1-430c-bb87-2e556e5ba110 req-a2bfaa70-01bf-4225-854c-0864f56f74b2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:49.233692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-e56daf0e-9ef1-430c-bb87-2e556e5ba110 req-a2bfaa70-01bf-4225-854c-0864f56f74b2 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:49.245735 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-e56daf0e-9ef1-430c-bb87-2e556e5ba110 req-a2bfaa70-01bf-4225-854c-0864f56f74b2 service nova] Creating event network-changed:827b8e36-4bb7-4bc5-8490-aab26a8586f1 for instance 00789856-5fe9-4a57-8099-d393b73a13bc on n-h2-851337-5 Aug 04 05:18:49.250924 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-e56daf0e-9ef1-430c-bb87-2e556e5ba110 req-a2bfaa70-01bf-4225-854c-0864f56f74b2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Aug 04 05:18:49.251579 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3344/6800] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:22.141503 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=7 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:22.142322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=42 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:22.146664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22494825-2849-4beb-8c8b-6831bf686841 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:22.153615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22494825-2849-4beb-8c8b-6831bf686841 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:22.154083 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22494825-2849-4beb-8c8b-6831bf686841 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:22.176263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22494825-2849-4beb-8c8b-6831bf686841 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 05:19:22.217452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22494825-2849-4beb-8c8b-6831bf686841 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action" status: 202 len: 0 microversion: 2.1 time: 0.077675 Aug 04 05:19:22.218261 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3457/6801] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:19:22 2022] POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:19:22.224941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=9 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:22.225686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=41 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:22.229929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:22.230761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:22.239432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:22.239904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:22.240671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:22.241111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:22.380887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:22.388681 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b5704472-fb82-4904-83b9-1b86f0d704b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.166024 Aug 04 05:19:22.389254 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3345/6802] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:22 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:23.410510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:23.411277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:23.418981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:23.419443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:23.420238 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:23.420692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:23.550651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:23.558348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b8408e15-d137-415a-9125-63c0ca44f103 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.152189 Aug 04 05:19:23.558928 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3458/6803] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:23 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:24.580962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:24.581528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:24.588577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:24.589035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:24.589814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:24.590341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:24.724539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:24.732317 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bcb8f3f9-5e0a-49ee-b5b5-99930ee1fb5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.155403 Aug 04 05:19:24.732895 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3346/6804] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:24 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:25.755150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:25.755821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:25.763393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:25.763861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:25.764669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:25.765131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:25.904273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:25.912038 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e88e96ed-ec20-4d1d-85cc-6288b50c01a6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.160907 Aug 04 05:19:25.912618 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3459/6805] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:25 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:26.934302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:26.934859 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:26.941607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:26.942064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:26.942842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:26.943308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:27.074264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:27.082389 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ebe38d63-1eb8-44ce-93dc-a92a31912ac9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.152366 Aug 04 05:19:27.082987 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3347/6806] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:26 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:28.104161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:28.104780 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:28.112534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:28.113004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:28.113793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:28.114253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:28.245875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:28.253389 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-46c41bc4-811b-4974-8cae-bde49a169f50 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.153274 Aug 04 05:19:28.253964 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3460/6807] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:28 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:29.274805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:29.275442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:29.282453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:29.282914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:29.283790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:29.284342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:29.413345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:29.420939 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-32788c63-a562-4e0b-9e0a-6099eb55c97d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.150002 Aug 04 05:19:29.421640 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3348/6808] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:29 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:30.441713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:30.442349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:30.449434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:30.449898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:30.450698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:30.451179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:30.591602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:30.599813 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c720fa2c-a5d1-4cac-990e-f61d2cafdc19 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.162018 Aug 04 05:19:30.600410 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3461/6809] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:30 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:31.621241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:31.621871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:31.628576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:31.629037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:31.629817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:31.630264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:31.763795 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:31.771728 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4cc86081-989d-4d7e-b7f1-f20ce4c6c142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.154536 Aug 04 05:19:31.772313 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3349/6810] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:31 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:32.797442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:32.798588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:32.805693 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:32.806152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:32.806920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:32.807395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:32.937267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:32.945591 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7e30d14-509e-43dc-95dd-e97565b3dc7a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.152069 Aug 04 05:19:32.946170 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3462/6811] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:32 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:33.883864 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:19:33.884501 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:19:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:19:33.966861 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:33.967475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:33.975151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:33.975611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:33.976437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:33.976906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:34.116115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:34.123714 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3e8af907-e071-4e5f-b08f-5bd2241a43b4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.160974 Aug 04 05:19:34.124293 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3350/6812] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:33 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:34.362044 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:19:34.362550 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:19:35.146368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:35.146973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:35.154067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:35.154483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:35.155309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:35.155769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:35.293619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:35.301851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8d16f71-f3a1-47bf-9b75-e620e1fbedd0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.159477 Aug 04 05:19:35.302442 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3463/6813] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:35 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:36.323197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:36.323817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:36.331413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:36.331862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:36.332627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:36.333058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:36.467726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:36.476786 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b057749-aeba-4e9a-a386-6e8b34913e5d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.157467 Aug 04 05:19:36.477377 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3351/6814] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:36 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:37.499919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:37.501442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:37.508552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:37.509075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:37.509869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:37.510353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:37.652954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:37.666064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8312ed88-06f4-4e1b-a344-c029e32e1254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.169583 Aug 04 05:19:37.666206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3464/6815] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:37 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:38.687335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:38.687983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:38.695032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.695497 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:38.696275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.696720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:38.827981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:38.836054 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-66fa4984-8824-44eb-b732-7255b7b0383d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1655 microversion: 2.1 time: 0.152642 Aug 04 05:19:38.836565 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3352/6816] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:38 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:38.856987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:38.859547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:38.867142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.867609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:38.868433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.868884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:38.898926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:38.904883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Old instance type m1.heat2, new instance type m1.heat {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:19:38.911842 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:19:38.912269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:19:38.912763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:19:38.913198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:19:38.913626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:19:38.977278 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b7517a0-b7c1-4c7e-8bd9-f395ec4dbcc9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action" status: 202 len: 0 microversion: 2.1 time: 0.123773 Aug 04 05:19:38.977825 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3465/6817] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:19:38 2022] POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:19:38.986269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:38.986893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:38.993040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.993504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:38.994286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.994734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:39.129902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:39.138202 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9815489c-0e50-4172-ad7f-28cdb16f5a0f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.155921 Aug 04 05:19:39.138783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3353/6818] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:38 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:40.160852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:40.161486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:40.170372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:40.170833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:40.171649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:40.172101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:40.308513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:40.316066 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8e70c65-1904-4a37-b753-c7d8424e15b8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1678 microversion: 2.1 time: 0.159826 Aug 04 05:19:40.316652 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3466/6819] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:40 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:41.337060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:41.337671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:41.345023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:41.345474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:41.346235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:41.346674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:41.479930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:41.488182 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-36aafbc0-608f-4a5a-9cf5-25d60c31d142 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1683 microversion: 2.1 time: 0.155076 Aug 04 05:19:41.488763 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3354/6820] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:41 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:42.509619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:42.510276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:42.518071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:42.518536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:42.519353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:42.519812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:42.653648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:42.662062 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c58b5b72-ef84-44c1-ab58-eaa286237dad tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1683 microversion: 2.1 time: 0.156363 Aug 04 05:19:42.662637 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3467/6821] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:42 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:43.497360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ccd29188-f9cc-4935-99b6-b31df0af9db2 req-9a8b830c-488e-43c6-8e6e-a2041fb419fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00789856-5fe9-4a57-8099-d393b73a13bc", "name": "network-vif-unplugged", "status": "completed", "tag": "827b8e36-4bb7-4bc5-8490-aab26a8586f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:43.508213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ccd29188-f9cc-4935-99b6-b31df0af9db2 req-9a8b830c-488e-43c6-8e6e-a2041fb419fa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:43.508788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ccd29188-f9cc-4935-99b6-b31df0af9db2 req-9a8b830c-488e-43c6-8e6e-a2041fb419fa service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:43.521453 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ccd29188-f9cc-4935-99b6-b31df0af9db2 req-9a8b830c-488e-43c6-8e6e-a2041fb419fa service nova] Creating event network-vif-unplugged:827b8e36-4bb7-4bc5-8490-aab26a8586f1 for instance 00789856-5fe9-4a57-8099-d393b73a13bc on n-h1-851337-5 Aug 04 05:19:43.526781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-ccd29188-f9cc-4935-99b6-b31df0af9db2 req-9a8b830c-488e-43c6-8e6e-a2041fb419fa service nova] Instance 00789856-5fe9-4a57-8099-d393b73a13bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:19:43.538609 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ccd29188-f9cc-4935-99b6-b31df0af9db2 req-9a8b830c-488e-43c6-8e6e-a2041fb419fa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045005 Aug 04 05:19:43.539353 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3355/6822] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:43.683417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:43.684213 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:43.691685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:43.692154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:43.693068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:43.693526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:43.834030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:43.842904 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84355fff-2d70-4a15-9a70-76e0979173b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1682 microversion: 2.1 time: 0.163753 Aug 04 05:19:43.843532 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3468/6823] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:43 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:44.866984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:44.867750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:44.876671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:44.877149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:44.877931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:44.878369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:45.023443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:45.030920 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14664516-34ed-4bbb-800e-25bab8c88ecc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1680 microversion: 2.1 time: 0.169463 Aug 04 05:19:45.031531 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3356/6824] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:44 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:45.553260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9c098b03-6259-49fa-816b-b047f120d3b1 req-81e4fbe1-a718-489e-aa7a-5385a303ab99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00789856-5fe9-4a57-8099-d393b73a13bc", "tag": "827b8e36-4bb7-4bc5-8490-aab26a8586f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:45.563929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9c098b03-6259-49fa-816b-b047f120d3b1 req-81e4fbe1-a718-489e-aa7a-5385a303ab99 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:45.564383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9c098b03-6259-49fa-816b-b047f120d3b1 req-81e4fbe1-a718-489e-aa7a-5385a303ab99 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:45.576111 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9c098b03-6259-49fa-816b-b047f120d3b1 req-81e4fbe1-a718-489e-aa7a-5385a303ab99 service nova] Creating event network-changed:827b8e36-4bb7-4bc5-8490-aab26a8586f1 for instance 00789856-5fe9-4a57-8099-d393b73a13bc on n-h1-851337-5 Aug 04 05:19:45.582172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-9c098b03-6259-49fa-816b-b047f120d3b1 req-81e4fbe1-a718-489e-aa7a-5385a303ab99 service nova] Instance 00789856-5fe9-4a57-8099-d393b73a13bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:19:45.593041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9c098b03-6259-49fa-816b-b047f120d3b1 req-81e4fbe1-a718-489e-aa7a-5385a303ab99 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043461 Aug 04 05:19:45.593638 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3469/6825] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:46.052809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:46.053459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:46.060811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:46.061278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:46.062066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:46.062506 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:46.215877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:46.224350 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-10504ebb-3b12-4c4e-8ed3-95412c004f07 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1680 microversion: 2.1 time: 0.175611 Aug 04 05:19:46.225038 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3357/6826] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:46 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:47.248101 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:47.248744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:47.256077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:47.256558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.257361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:47.258065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.394201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:47.401894 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-06c0dec1-f97a-4f5a-ad98-ecaf0cb146f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1676 microversion: 2.1 time: 0.159526 Aug 04 05:19:47.402480 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3470/6827] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:47 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:47.424719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-281a57a5-c459-4b5e-81b4-35a4befda3c6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:47.425308 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-281a57a5-c459-4b5e-81b4-35a4befda3c6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:47.432862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281a57a5-c459-4b5e-81b4-35a4befda3c6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:47.433339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281a57a5-c459-4b5e-81b4-35a4befda3c6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.434379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281a57a5-c459-4b5e-81b4-35a4befda3c6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:47.434829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281a57a5-c459-4b5e-81b4-35a4befda3c6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.495632 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-281a57a5-c459-4b5e-81b4-35a4befda3c6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action" status: 204 len: 0 microversion: 2.1 time: 0.076561 Aug 04 05:19:47.496728 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3358/6828] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:19:47 2022] POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:19:47.504940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:47.505586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:47.512045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:47.512767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.513575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:47.514031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.534280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:47.727327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:47.735471 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ad9f930c-4671-4618-a006-b997c7b5d870 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1676 microversion: 2.1 time: 0.233846 Aug 04 05:19:47.736066 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3471/6829] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:47 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:48.757973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:48.758674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:48.767080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:48.767545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:48.768325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:48.768765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.256360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:49.264109 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-37aa4cbc-13b5-4057-b1ed-ef45e6c11aeb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1655 microversion: 2.1 time: 0.510464 Aug 04 05:19:49.264680 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3359/6830] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:48 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1655 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:49.284392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:49.285029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:49.292106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.292575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.293368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.293830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.427855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:49.435375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7bf5a9cb-e722-4791-95fd-d9c4788ab2cb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1655 microversion: 2.1 time: 0.154898 Aug 04 05:19:49.435946 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3472/6831] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:49 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:49.455764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fb6c9b1f-1c33-4285-a1a7-d92458d00c90 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:49.461840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb6c9b1f-1c33-4285-a1a7-d92458d00c90 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.462286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fb6c9b1f-1c33-4285-a1a7-d92458d00c90 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.485293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fb6c9b1f-1c33-4285-a1a7-d92458d00c90 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Going to try to start instance {{(pid=119342) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 05:19:49.489656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:49.527301 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fb6c9b1f-1c33-4285-a1a7-d92458d00c90 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action" status: 202 len: 0 microversion: 2.1 time: 0.075230 Aug 04 05:19:49.527861 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3360/6832] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:19:49 2022] POST /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:19:49.536611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:49.537335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:49.543483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.544017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.544816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.545270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.684026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:49.692005 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-344daf20-8825-4547-a198-47c5021ca255 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1664 microversion: 2.1 time: 0.159216 Aug 04 05:19:49.692593 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3473/6833] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:49 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:50.562134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-419f78ca-4918-4242-a2c4-1eb575c9936c req-621bb7dc-deb4-4849-b9f8-ea04a3ac8289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00789856-5fe9-4a57-8099-d393b73a13bc", "name": "network-vif-plugged", "status": "completed", "tag": "827b8e36-4bb7-4bc5-8490-aab26a8586f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:50.572276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-419f78ca-4918-4242-a2c4-1eb575c9936c req-621bb7dc-deb4-4849-b9f8-ea04a3ac8289 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:50.572820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-419f78ca-4918-4242-a2c4-1eb575c9936c req-621bb7dc-deb4-4849-b9f8-ea04a3ac8289 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:50.585322 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-419f78ca-4918-4242-a2c4-1eb575c9936c req-621bb7dc-deb4-4849-b9f8-ea04a3ac8289 service nova] Creating event network-vif-plugged:827b8e36-4bb7-4bc5-8490-aab26a8586f1 for instance 00789856-5fe9-4a57-8099-d393b73a13bc on n-h1-851337-5 Aug 04 05:19:50.590658 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-419f78ca-4918-4242-a2c4-1eb575c9936c req-621bb7dc-deb4-4849-b9f8-ea04a3ac8289 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033621 Aug 04 05:19:50.591568 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3361/6834] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:50.713961 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:50.714633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:50.722204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:50.722913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:50.723827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:50.724210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:50.858586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:50.866942 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d7e1aa7f-433d-4332-a007-8ae060b7847e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1668 microversion: 2.1 time: 0.157257 Aug 04 05:19:50.867557 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3474/6835] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:50 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:50.888892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:50.889477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:50.896674 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:50.897124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:50.897889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:50.898326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:50.924155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:19:51.001390 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-961f62e4-3a60-417d-80ce-ee55ef143995 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 204 len: 0 microversion: 2.1 time: 0.116477 Aug 04 05:19:51.001976 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3362/6836] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:19:50 2022] DELETE /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:19:51.010506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:51.011268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:51.018311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:51.018779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:51.019604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:51.020062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:51.149043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:51.156638 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0d88070f-6d5e-42b5-82bb-4b1abf68d6d1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1674 microversion: 2.1 time: 0.150283 Aug 04 05:19:51.157209 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3475/6837] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:51 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:52.178330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:52.179075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:52.185974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:52.186436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:52.187225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:52.187676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:52.324222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:52.332333 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96d38d6f-4017-4a6b-a1e5-c58139bd4262 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1674 microversion: 2.1 time: 0.158262 Aug 04 05:19:52.332914 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3363/6838] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:52 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:53.353888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:53.354586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:53.357521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=43 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:53.363805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:53.364285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:53.365087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:53.365546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:53.436458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3aabe832-49c7-4222-9f83-9f4b6c499c4e req-4aa460ae-66e6-442b-8152-e1127650e458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00789856-5fe9-4a57-8099-d393b73a13bc", "name": "network-vif-deleted", "tag": "827b8e36-4bb7-4bc5-8490-aab26a8586f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:53.441991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:53.442711 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:53.448977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3aabe832-49c7-4222-9f83-9f4b6c499c4e req-4aa460ae-66e6-442b-8152-e1127650e458 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:53.449513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3aabe832-49c7-4222-9f83-9f4b6c499c4e req-4aa460ae-66e6-442b-8152-e1127650e458 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:53.451983 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c146aade-6f52-47a7-9cb6-dc8161f9b522 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 200 len: 1607 microversion: 2.1 time: 0.102040 Aug 04 05:19:53.452783 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3476/6839] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:53 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 1607 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:53.479556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3aabe832-49c7-4222-9f83-9f4b6c499c4e req-4aa460ae-66e6-442b-8152-e1127650e458 service nova] Creating event network-vif-deleted:827b8e36-4bb7-4bc5-8490-aab26a8586f1 for instance 00789856-5fe9-4a57-8099-d393b73a13bc on n-h1-851337-5 Aug 04 05:19:53.487824 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3aabe832-49c7-4222-9f83-9f4b6c499c4e req-4aa460ae-66e6-442b-8152-e1127650e458 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054808 Aug 04 05:19:53.488675 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3364/6840] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:54.474653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:54.475228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:54.486310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:54.486776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:54.487612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:54.488070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:54.502701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc HTTP/1.1 Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '00789856-5fe9-4a57-8099-d393b73a13bc'} Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:19:54.504492 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd75068f-20a0-4412-9a31-8beeee733c6e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 404 len: 111 microversion: 2.1 time: 0.035535 Aug 04 05:19:54.510447 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3477/6841] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:54 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:19:54.523871 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:54.524569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:54.530821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:54.531912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:54.532609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:54.533049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:54.546232 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc HTTP/1.1 Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '00789856-5fe9-4a57-8099-d393b73a13bc'} Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:19:54.547921 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c9f0daba-a080-4d5e-909f-998f2beac7da tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 404 len: 111 microversion: 2.1 time: 0.030636 Aug 04 05:19:54.553229 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3365/6842] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:54 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:19:54.599872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1887911108", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "ead41bfa-ae51-4953-b215-e2bdda5d121d"}], "security_groups": [{"name": "tempest-securitygroup--803039292"}], "key_name": "tempest-keypair-1161455763", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:54.704324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] validate_networks() for [('ead41bfa-ae51-4953-b215-e2bdda5d121d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:19:55.070890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:19:55.071393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:19:55.071879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:19:55.072300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:19:55.072727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:19:55.082609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:55.083085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:55.083904 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:55.084348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:55.101806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:19:55.107195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for user c77abdb95c994fbca1991af85976243b and project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:19:55.120310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:19:55.122584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:19:55.169394 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6ed868c2-e5a9-4ae8-bfd7-65e6dac53c4f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.573667 Aug 04 05:19:55.170050 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3478/6843] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:19:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:19:55.180967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8afb2319-4312-45d6-b92d-1f7b1930c539 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:55.181588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8afb2319-4312-45d6-b92d-1f7b1930c539 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:55.241001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8afb2319-4312-45d6-b92d-1f7b1930c539 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:55.250046 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8afb2319-4312-45d6-b92d-1f7b1930c539 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1239 microversion: 2.1 time: 0.072913 Aug 04 05:19:55.250669 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3366/6844] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:55 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:56.273945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:56.274699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:56.281837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:56.282387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:56.283326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:56.283777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:56.361758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:56.369336 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-be1a09a9-a48a-45aa-9c46-5ddd3edd96b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1297 microversion: 2.1 time: 0.100415 Aug 04 05:19:56.369921 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3479/6845] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:56 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:57.392650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:57.393328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:57.401286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.401746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.402529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.402991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.466529 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e048c966-57c8-4a8f-8585-887eff0cc367 req-3efcd863-aa6c-4390-adf7-c8d59a40bfa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:57.477539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e048c966-57c8-4a8f-8585-887eff0cc367 req-3efcd863-aa6c-4390-adf7-c8d59a40bfa3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.478305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e048c966-57c8-4a8f-8585-887eff0cc367 req-3efcd863-aa6c-4390-adf7-c8d59a40bfa3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.490182 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e048c966-57c8-4a8f-8585-887eff0cc367 req-3efcd863-aa6c-4390-adf7-c8d59a40bfa3 service nova] Creating event network-changed:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h2-851337-5 Aug 04 05:19:57.495950 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e048c966-57c8-4a8f-8585-887eff0cc367 req-3efcd863-aa6c-4390-adf7-c8d59a40bfa3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033064 Aug 04 05:19:57.496765 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3480/6846] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:19:57.688841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:57.696422 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b94be3e-61bd-4542-9e7f-0cb6d7d49cb4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1364 microversion: 2.1 time: 0.308683 Aug 04 05:19:57.697001 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3367/6847] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:57 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:58.721012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:58.721726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:58.728147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:58.728614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:58.729410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:58.729869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:58.992261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:59.000006 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b66ae76d-f422-45ac-9ec7-55d382882724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1364 microversion: 2.1 time: 0.284601 Aug 04 05:19:59.000600 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3481/6848] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:58 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:00.022645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:00.023253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:00.030241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:00.030693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:00.031536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:00.031974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:00.167522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:00.175036 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ea3e966-4bfa-4992-9ada-84ab1efbcf01 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1364 microversion: 2.1 time: 0.156566 Aug 04 05:20:00.175608 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3368/6849] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:00 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:01.196875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:01.197548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:01.205121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:01.205597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:01.206390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:01.206845 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:01.340465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:01.349043 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c177b21-7638-40db-9bc8-c496c934616a tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1364 microversion: 2.1 time: 0.156077 Aug 04 05:20:01.349623 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3482/6850] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:01 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:02.371131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:02.371766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:02.379135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:02.379596 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:02.380383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:02.380833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:02.519537 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:02.527930 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-416da33b-312d-447b-ac49-6ecd20a36e60 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1364 microversion: 2.1 time: 0.160694 Aug 04 05:20:02.528641 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3369/6851] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:02 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:03.549437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:03.550068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:03.557163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.557629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.558409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.558897 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.690908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:03.698411 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e82ca52e-74c0-4de4-a041-e49d772d09d8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1364 microversion: 2.1 time: 0.153022 Aug 04 05:20:03.698991 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3483/6852] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:03 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:04.473643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1e542aef-525b-483e-9499-1db0ce55ad38 req-4b780536-707a-4c8d-a05a-914f9660451d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "name": "network-vif-plugged", "status": "completed", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:20:04.484974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1e542aef-525b-483e-9499-1db0ce55ad38 req-4b780536-707a-4c8d-a05a-914f9660451d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:04.485426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1e542aef-525b-483e-9499-1db0ce55ad38 req-4b780536-707a-4c8d-a05a-914f9660451d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:04.497056 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1e542aef-525b-483e-9499-1db0ce55ad38 req-4b780536-707a-4c8d-a05a-914f9660451d service nova] Creating event network-vif-plugged:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h2-851337-5 Aug 04 05:20:04.502899 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1e542aef-525b-483e-9499-1db0ce55ad38 req-4b780536-707a-4c8d-a05a-914f9660451d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Aug 04 05:20:04.503548 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3370/6853] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:20:04.720001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:04.720640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:04.727749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:04.728223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:04.729023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:04.729484 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:04.861248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:04.869359 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bca55a80-fa2f-4952-babc-eadc06c6942c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1364 microversion: 2.1 time: 0.153327 Aug 04 05:20:04.869945 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3484/6854] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:04 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:05.888269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:05.894086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:05.894806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:05.901406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.901858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.902622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.903094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:06.040000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:06.048001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-75971b44-2969-49d6-866f-895cb2a25299 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1551 microversion: 2.1 time: 0.161039 Aug 04 05:20:06.048801 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3371/6855] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:05 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:06.070670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-df851b97-5a6a-477c-a72e-c0840f3cea54 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:06.071303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-df851b97-5a6a-477c-a72e-c0840f3cea54 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:06.073188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:06.073950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:06.081913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df851b97-5a6a-477c-a72e-c0840f3cea54 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:06.082383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df851b97-5a6a-477c-a72e-c0840f3cea54 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:06.083209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df851b97-5a6a-477c-a72e-c0840f3cea54 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:06.083676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-df851b97-5a6a-477c-a72e-c0840f3cea54 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:06.170011 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-df851b97-5a6a-477c-a72e-c0840f3cea54 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103912 Aug 04 05:20:06.170641 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3485/6856] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 05:20:06 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:20:07.115240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6170d95f-29d3-424a-990c-71ca39d92140 req-f6128417-290d-48cd-baa7-41fa8cd08986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:20:07.125472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6170d95f-29d3-424a-990c-71ca39d92140 req-f6128417-290d-48cd-baa7-41fa8cd08986 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:07.125919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6170d95f-29d3-424a-990c-71ca39d92140 req-f6128417-290d-48cd-baa7-41fa8cd08986 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:07.137720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6170d95f-29d3-424a-990c-71ca39d92140 req-f6128417-290d-48cd-baa7-41fa8cd08986 service nova] Creating event network-changed:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h2-851337-5 Aug 04 05:20:07.143287 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6170d95f-29d3-424a-990c-71ca39d92140 req-f6128417-290d-48cd-baa7-41fa8cd08986 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031683 Aug 04 05:20:07.143993 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3372/6857] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:20:40.013896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:40.015000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=72 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:40.020170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:20:40.022502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:40.030015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:40.030547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:40.031378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:40.031868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:40.064263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:40.071439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Old instance type m1.heat2, new instance type m1.heat {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:20:40.078507 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:20:40.078968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:20:40.079476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:20:40.079912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:20:40.081585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:20:40.155893 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-05800732-ada8-4654-b612-6a34ed43bec5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21/action" status: 202 len: 0 microversion: 2.1 time: 0.144219 Aug 04 05:20:40.159769 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3486/6858] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:20:40 2022] POST /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:20:40.163430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=19 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:40.164406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:40.175348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:40.176070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:40.191740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:40.192210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:40.192972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:40.193454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:40.666407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:40.674257 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d0a9d5a7-e4f7-43e9-8a8a-d837e804dc81 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1678 microversion: 2.1 time: 0.512937 Aug 04 05:20:40.675029 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3373/6859] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:40 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1678 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:41.697139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:41.697771 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:41.708639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:41.709134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:41.709944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:41.710405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:41.932097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:41.940386 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7193cc0f-7622-4406-9859-d8a8726148f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1678 microversion: 2.1 time: 0.248040 Aug 04 05:20:41.940978 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3487/6860] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:41 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:42.962111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:42.962661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:42.969577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:42.970033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:42.970801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:42.971270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:43.102440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:43.110055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9bf3fdaf-4a5a-4103-9b00-45c7d504e254 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.151935 Aug 04 05:20:43.110632 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3374/6861] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:42 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:44.133044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:44.133600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:44.140955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:44.141420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:44.142217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:44.142676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:44.277505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:44.286169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e06627b7-33e1-4030-b4fc-10c591a13147 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.157350 Aug 04 05:20:44.286745 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3488/6862] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:44 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:45.307539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:45.308156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:45.315081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:45.315540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:45.316315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:45.317380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:45.448576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:45.456214 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ece5c90f-56c9-4d1a-bcc9-688d6a40cb8c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.152705 Aug 04 05:20:45.456977 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3375/6863] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:45 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:46.481591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:46.482260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:46.489482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:46.489939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:46.490721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:46.491197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:46.628026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:46.635746 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6e8e8726-a5ca-4f7d-bee9-c4b5609da78b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.158237 Aug 04 05:20:46.636329 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3489/6864] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:46 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:47.657373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:47.657990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:47.665379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:47.665874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:47.666651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:47.667170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:47.799832 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:47.808132 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8965d08b-981a-4289-999f-d9555005c462 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.154691 Aug 04 05:20:47.808714 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3376/6865] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:47 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:48.829926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:48.830569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:48.837680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:48.838154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:48.838942 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:48.839427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:48.972050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:48.980660 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0555c8f0-355c-41bf-89e4-0c58d6e37a32 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.154593 Aug 04 05:20:48.981256 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3490/6866] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:48 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:50.005450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:50.005999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:50.013297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:50.013733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:50.014668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:50.015274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:50.149282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:50.156764 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c5c89f7b-0b6c-4e69-a6c2-83a08c26b716 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.155295 Aug 04 05:20:50.157338 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3377/6867] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:50 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:51.178633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:51.179253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:51.185908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:51.186368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:51.187176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:51.187629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:51.316854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:51.324696 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b769f3fa-963d-4844-9c60-f7a85d90c31c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.150866 Aug 04 05:20:51.325291 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3491/6868] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:51 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:52.346097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:52.347089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:52.354099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:52.354554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:52.355348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:52.355789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:52.557305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:52.565650 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-18580b6b-06ed-4d12-a54e-da65a00e7471 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.223801 Aug 04 05:20:52.566442 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3378/6869] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:52 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:53.587353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:53.587979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:53.595296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:53.595803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:53.596635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:53.597096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:53.766268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:53.773836 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00500b6f-e861-42b6-a75d-d970d34c8780 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.190323 Aug 04 05:20:53.774418 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3492/6870] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:53 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:54.795245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:54.795874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:54.803610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:54.804068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:54.804845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:54.805287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:55.019481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:55.027540 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d295512-aa2f-4404-8b9f-1b2e0badb7b7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.236244 Aug 04 05:20:55.028117 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3379/6871] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:54 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:56.048681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:56.049254 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:56.056980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:56.057455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:56.058463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:56.059066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:56.282038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:56.290523 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3516844c-3831-4e0d-aa03-96eaf349da87 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.245840 Aug 04 05:20:56.291110 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3493/6872] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:56 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:57.311536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:57.312184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:57.319612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:57.320066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:57.320827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:57.321266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:57.452479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:57.460349 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7cc08f5e-8cb1-4781-a2f7-d2b07947f66f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.152694 Aug 04 05:20:57.460937 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3380/6873] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:57 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:58.481612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:58.482233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:58.489176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:58.489633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:58.490409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:58.490870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:58.624816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:58.633068 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48742a71-6174-43e0-b4b2-4f7b45e20909 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1683 microversion: 2.1 time: 0.155311 Aug 04 05:20:58.633654 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3494/6874] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:58 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:59.655556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:59.656328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:59.664769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:59.665230 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:59.666322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:59.666462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:59.805943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:59.813732 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9737bfeb-f64d-4a6e-8202-9252f0b8e7d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1682 microversion: 2.1 time: 0.162213 Aug 04 05:20:59.814322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3381/6875] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:59 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:59.866231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b66db737-36b4-4bda-b74f-b8b9ec339ca7 req-2d4a9dee-8847-4d21-81e5-08fe4ce16c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "name": "network-vif-unplugged", "status": "completed", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:20:59.877763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b66db737-36b4-4bda-b74f-b8b9ec339ca7 req-2d4a9dee-8847-4d21-81e5-08fe4ce16c10 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:59.878289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b66db737-36b4-4bda-b74f-b8b9ec339ca7 req-2d4a9dee-8847-4d21-81e5-08fe4ce16c10 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:59.891847 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b66db737-36b4-4bda-b74f-b8b9ec339ca7 req-2d4a9dee-8847-4d21-81e5-08fe4ce16c10 service nova] Creating event network-vif-unplugged:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h1-851337-5 Aug 04 05:20:59.897998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-b66db737-36b4-4bda-b74f-b8b9ec339ca7 req-2d4a9dee-8847-4d21-81e5-08fe4ce16c10 service nova] Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:20:59.909475 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b66db737-36b4-4bda-b74f-b8b9ec339ca7 req-2d4a9dee-8847-4d21-81e5-08fe4ce16c10 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047633 Aug 04 05:20:59.910099 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3495/6876] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:00.836321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:00.837059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:00.844465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:00.844934 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:00.845718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:00.846791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:00.990172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:01.006651 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-41b672eb-37c1-4185-b25e-5cc9c03e5bde tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1682 microversion: 2.1 time: 0.174819 Aug 04 05:21:01.007298 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3382/6877] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:00 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:01.949054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1c71dace-0424-43fd-9185-00877bafa36a req-3ace1cf3-fc23-4054-aca6-3c00c1d01458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:01.959297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1c71dace-0424-43fd-9185-00877bafa36a req-3ace1cf3-fc23-4054-aca6-3c00c1d01458 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:01.959758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1c71dace-0424-43fd-9185-00877bafa36a req-3ace1cf3-fc23-4054-aca6-3c00c1d01458 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:01.971264 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1c71dace-0424-43fd-9185-00877bafa36a req-3ace1cf3-fc23-4054-aca6-3c00c1d01458 service nova] Creating event network-changed:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h1-851337-5 Aug 04 05:21:01.977136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-1c71dace-0424-43fd-9185-00877bafa36a req-3ace1cf3-fc23-4054-aca6-3c00c1d01458 service nova] Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:21:01.988244 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1c71dace-0424-43fd-9185-00877bafa36a req-3ace1cf3-fc23-4054-aca6-3c00c1d01458 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044505 Aug 04 05:21:01.988841 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3496/6878] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:02.029127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:02.029842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:02.037614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:02.038166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:02.038968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:02.039416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:02.290924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:02.298592 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03e88464-e22d-4c3e-a677-b105bbbed4b1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1680 microversion: 2.1 time: 0.273352 Aug 04 05:21:02.299213 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3383/6879] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:02 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1680 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:03.321302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:03.322026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:03.329288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:03.329759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:03.330555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:03.331064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:03.471516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:03.479802 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b1b3bc9-790c-471d-b937-7cc24b628e0d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1680 microversion: 2.1 time: 0.162841 Aug 04 05:21:03.480396 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3497/6880] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:03 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:04.501517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:04.502128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:04.508762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.509217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:04.509979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.510419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:04.642846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:04.651180 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a9bc041b-84cd-4819-a72f-8fd236ab748f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1677 microversion: 2.1 time: 0.154523 Aug 04 05:21:04.651768 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3384/6881] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:04 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:04.671593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:04.672208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:04.679349 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.679808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:04.680586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.681060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:04.717820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.718287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:04.719154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.719601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:04.745046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:21:04.750382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for user c77abdb95c994fbca1991af85976243b and project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:21:04.835244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:04.853145 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1de94404-597a-4953-80fd-dec86fc3b9ee tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21/action" status: 202 len: 0 microversion: 2.1 time: 0.185223 Aug 04 05:21:04.854010 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3498/6882] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:21:04 2022] POST /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:21:04.863600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:04.864720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:04.870906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.871312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:04.872144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:04.872741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:05.019632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:05.028358 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50bed150-debe-4cc7-ba1c-248704615f83 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1676 microversion: 2.1 time: 0.170327 Aug 04 05:21:05.029171 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3385/6883] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:04 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:06.051477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:06.052114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:06.061129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:06.061636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:06.062572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:06.063071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:06.201090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:06.209329 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-eb877025-68c4-435d-a99d-277e8c5b15f7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1676 microversion: 2.1 time: 0.163280 Aug 04 05:21:06.209915 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3499/6884] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:06 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:06.998488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a36997b6-98b0-4186-873d-e7fbcbd5ecfe req-27b7dcc5-98e8-4caa-adff-a8a47c9ba57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "name": "network-vif-plugged", "status": "completed", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:07.009219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a36997b6-98b0-4186-873d-e7fbcbd5ecfe req-27b7dcc5-98e8-4caa-adff-a8a47c9ba57d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:07.009846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a36997b6-98b0-4186-873d-e7fbcbd5ecfe req-27b7dcc5-98e8-4caa-adff-a8a47c9ba57d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:07.026403 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a36997b6-98b0-4186-873d-e7fbcbd5ecfe req-27b7dcc5-98e8-4caa-adff-a8a47c9ba57d service nova] Creating event network-vif-plugged:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h1-851337-5 Aug 04 05:21:07.032191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-a36997b6-98b0-4186-873d-e7fbcbd5ecfe req-27b7dcc5-98e8-4caa-adff-a8a47c9ba57d service nova] Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:21:07.044718 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a36997b6-98b0-4186-873d-e7fbcbd5ecfe req-27b7dcc5-98e8-4caa-adff-a8a47c9ba57d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049922 Aug 04 05:21:07.046058 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3386/6885] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:07.230731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:07.231325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:07.238239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:07.238703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:07.239587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:07.240040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:07.371604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:07.379116 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3b51102e-a401-4392-9c91-d43aaa74d6f2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1676 microversion: 2.1 time: 0.152361 Aug 04 05:21:07.380220 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3500/6886] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:07 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:08.359663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-df58e3d7-5903-42d8-9952-833c058183a8 req-353da874-0a88-4dbb-9774-e3e1b28357fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "name": "network-vif-unplugged", "status": "completed", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:08.370906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-df58e3d7-5903-42d8-9952-833c058183a8 req-353da874-0a88-4dbb-9774-e3e1b28357fc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:08.371363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-df58e3d7-5903-42d8-9952-833c058183a8 req-353da874-0a88-4dbb-9774-e3e1b28357fc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:08.384189 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-df58e3d7-5903-42d8-9952-833c058183a8 req-353da874-0a88-4dbb-9774-e3e1b28357fc service nova] Creating event network-vif-unplugged:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h2-851337-5 Aug 04 05:21:08.389916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-df58e3d7-5903-42d8-9952-833c058183a8 req-353da874-0a88-4dbb-9774-e3e1b28357fc service nova] Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:21:08.401726 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-df58e3d7-5903-42d8-9952-833c058183a8 req-353da874-0a88-4dbb-9774-e3e1b28357fc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100586 Aug 04 05:21:08.402484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3387/6887] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:08.405343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:08.406114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:08.414344 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:08.414891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:08.415733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:08.416193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:08.606236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:08.615714 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92daa674-4dff-4d06-9b1f-3b5a47774d5e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1676 microversion: 2.1 time: 0.218249 Aug 04 05:21:08.616317 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3501/6888] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:08 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:09.640248 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:09.641005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:09.648364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:09.648815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:09.649590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:09.650025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:09.781725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:09.789784 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-310adae0-03ce-4c72-b21c-a8fabdcdb25f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1676 microversion: 2.1 time: 0.154164 Aug 04 05:21:09.790360 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3388/6889] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:09 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:10.424082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-f8e37161-8900-4edd-bf35-fcf39c0040ab req-05bf39eb-a9fd-4621-af2b-351ae0ec439f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:10.429959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:10.436046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f8e37161-8900-4edd-bf35-fcf39c0040ab req-05bf39eb-a9fd-4621-af2b-351ae0ec439f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:10.436510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-f8e37161-8900-4edd-bf35-fcf39c0040ab req-05bf39eb-a9fd-4621-af2b-351ae0ec439f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:10.450025 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-f8e37161-8900-4edd-bf35-fcf39c0040ab req-05bf39eb-a9fd-4621-af2b-351ae0ec439f service nova] Creating event network-changed:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h2-851337-5 Aug 04 05:21:10.455514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-f8e37161-8900-4edd-bf35-fcf39c0040ab req-05bf39eb-a9fd-4621-af2b-351ae0ec439f service nova] Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:21:10.467053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-f8e37161-8900-4edd-bf35-fcf39c0040ab req-05bf39eb-a9fd-4621-af2b-351ae0ec439f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046759 Aug 04 05:21:10.467675 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3502/6890] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:10.816322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:10.818423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:10.828103 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=33 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:10.830414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:10.831107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:10.832229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:10.832922 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:10.841591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=93 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:11.075467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:11.083691 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2166b68-0da4-4538-b2c4-92e3473b448e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1669 microversion: 2.1 time: 0.272772 Aug 04 05:21:11.084429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3389/6891] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:10 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1669 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:11.105759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:11.106495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:11.113147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.113621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.115183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.115648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.294724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:11.302916 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-94a5bd17-5004-4b6e-b587-8fe6adcc38bd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1669 microversion: 2.1 time: 0.201516 Aug 04 05:21:11.303517 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3503/6892] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:11 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1669 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:11.323170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:11.323798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:11.329946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.330408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.331221 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.331670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.466644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:11.474585 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d702449f-057d-4bc8-88fc-7b28ea62a5ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1669 microversion: 2.1 time: 0.155395 Aug 04 05:21:11.475194 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3390/6893] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:11 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:11.495265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:11.495785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:11.502704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.503212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.504011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.504497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.529865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:21:11.605522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dcdb4a97-e7b6-4537-a100-e465313ee8c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 204 len: 0 microversion: 2.1 time: 0.113820 Aug 04 05:21:11.606200 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3504/6894] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:21:11 2022] DELETE /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:21:11.615222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:11.615965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:11.621993 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.622441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.623277 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:11.623703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:11.763806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:11.771963 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-14c5a533-2837-4feb-a712-e047f825b112 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1675 microversion: 2.1 time: 0.160865 Aug 04 05:21:11.772554 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3391/6895] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:11 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:21:12.794890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:12.795660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:12.803236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:12.803711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:12.804514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:12.804969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:13.025869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:13.033775 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22202c36-5db4-4261-a2db-74e17a03c3e3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1675 microversion: 2.1 time: 0.243252 Aug 04 05:21:13.034396 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3505/6896] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:12 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:14.057920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:14.058542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:14.067719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:14.068202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:14.069293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:14.069943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:14.078896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2eb470f8-d711-44d3-a361-dc287da8eedc req-28ca430e-a234-4bcb-9e0a-c17cf3921833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21", "name": "network-vif-deleted", "tag": "59270c23-3a7e-402b-982b-619ee2f609f1"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:14.101153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2eb470f8-d711-44d3-a361-dc287da8eedc req-28ca430e-a234-4bcb-9e0a-c17cf3921833 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:14.101609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2eb470f8-d711-44d3-a361-dc287da8eedc req-28ca430e-a234-4bcb-9e0a-c17cf3921833 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:14.116372 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2eb470f8-d711-44d3-a361-dc287da8eedc req-28ca430e-a234-4bcb-9e0a-c17cf3921833 service nova] Creating event network-vif-deleted:59270c23-3a7e-402b-982b-619ee2f609f1 for instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 on n-h2-851337-5 Aug 04 05:21:14.121320 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2eb470f8-d711-44d3-a361-dc287da8eedc req-28ca430e-a234-4bcb-9e0a-c17cf3921833 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046197 Aug 04 05:21:14.126258 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3506/6897] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:14.166376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:14.174862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2a60b06c-64b7-4c40-8c08-a2893bfdc689 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 200 len: 1608 microversion: 2.1 time: 0.121777 Aug 04 05:21:14.175494 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3392/6898] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:14 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 1608 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:15.194701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:15.200147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:15.200895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:15.208605 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:15.209074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:15.209888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:15.210347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:15.225623 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 HTTP/1.1 Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21'} Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:15.227391 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-727a3dc5-f1e3-43e7-ad39-7507b62fb98d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 404 len: 111 microversion: 2.1 time: 0.035212 Aug 04 05:21:15.232916 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3507/6899] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:15 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:21:15.246241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:15.246980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:15.254285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:15.255456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:15.256333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:15.256757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:15.271609 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 HTTP/1.1 Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21'} Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:15.273318 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-117f3860-7018-457b-8fdc-7ce0a778b675 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 404 len: 111 microversion: 2.1 time: 0.032541 Aug 04 05:21:15.279029 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3393/6900] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:15 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:21:15.356809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1325195588", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "ead41bfa-ae51-4953-b215-e2bdda5d121d"}], "security_groups": [{"name": "tempest-securitygroup--803039292"}], "key_name": "tempest-keypair-1161455763", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:15.466228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] validate_networks() for [('ead41bfa-ae51-4953-b215-e2bdda5d121d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:21:15.857933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:21:15.858666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:21:15.859227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:21:15.859799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:21:15.860243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:21:15.870020 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:15.870490 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:15.871358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:15.871812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:15.892034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:21:15.898558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for user c77abdb95c994fbca1991af85976243b and project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:21:15.916339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:21:15.918549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:21:15.969726 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-efcbf3a3-0ebc-48a6-9589-0d574e6ca128 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.616740 Aug 04 05:21:15.970374 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3508/6901] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:21:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:21:15.981644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec51b3d8-fd9d-41d9-a537-77312059b238 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:15.982259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ec51b3d8-fd9d-41d9-a537-77312059b238 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:16.038426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ec51b3d8-fd9d-41d9-a537-77312059b238 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:16.048019 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec51b3d8-fd9d-41d9-a537-77312059b238 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1239 microversion: 2.1 time: 0.070158 Aug 04 05:21:16.048632 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3394/6902] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:15 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:17.072616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:17.072616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:17.081806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:17.083119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:17.084050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:17.084638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:17.148664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:17.156192 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a5c2ce51-cca5-42f2-818f-9119b2e66dc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1297 microversion: 2.1 time: 0.088661 Aug 04 05:21:17.156758 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3509/6903] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:17 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:18.178635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:18.179352 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:18.187198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:18.187659 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:18.188469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:18.188882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:18.334558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:18.344263 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15f7e45f-44d8-421a-af29-1d0ac870f4e4 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.170449 Aug 04 05:21:18.360090 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3395/6904] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:18 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:18.360200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-4b336487-1beb-41e5-b8c4-cc97f8430d88 req-5e766650-130b-4fe9-ae4d-9296688c4413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:18.370852 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4b336487-1beb-41e5-b8c4-cc97f8430d88 req-5e766650-130b-4fe9-ae4d-9296688c4413 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:18.371321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-4b336487-1beb-41e5-b8c4-cc97f8430d88 req-5e766650-130b-4fe9-ae4d-9296688c4413 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:18.383053 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-4b336487-1beb-41e5-b8c4-cc97f8430d88 req-5e766650-130b-4fe9-ae4d-9296688c4413 service nova] Creating event network-changed:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h1-851337-5 Aug 04 05:21:18.388579 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-4b336487-1beb-41e5-b8c4-cc97f8430d88 req-5e766650-130b-4fe9-ae4d-9296688c4413 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032586 Aug 04 05:21:18.389556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3510/6905] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:19.366948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:19.367580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:19.374488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:19.374937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:19.375726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:19.376164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:19.507540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:19.515357 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76a94dbc-8d4c-4851-a9b8-6cdbbddb8749 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.152854 Aug 04 05:21:19.515930 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3396/6906] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:19 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:20.537835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:20.538540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:20.544808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:20.545271 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:20.546039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:20.546485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:20.677190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:20.684723 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a34a8dd-8c96-436c-a632-c9ec96fbf00b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.152100 Aug 04 05:21:20.685294 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3511/6907] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:20 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:21.705739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:21.706376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:21.714076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:21.714532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:21.715353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:21.715799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:21.854330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:21.861940 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f5549152-49a4-4412-ae37-d6e5ea9ba6c2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.160170 Aug 04 05:21:21.862516 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3397/6908] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:21 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:22.883058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:22.883686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:22.891054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:22.891517 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:22.892297 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:22.892747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:23.025348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:23.032833 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c1b3c136-2bf0-494d-81e1-2e267751670f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.153719 Aug 04 05:21:23.033411 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3512/6909] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:22 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:24.055489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:24.056104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:24.063755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:24.064202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:24.064972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:24.065405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:24.200768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:24.208280 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-31b42cf2-f04d-463b-b902-b879abd369ab tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.157382 Aug 04 05:21:24.208850 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3398/6910] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:24 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:25.214161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-717c77dd-469d-44c2-bdc2-68df92aa4597 req-51a9f77f-f93a-4e4a-a560-1b5794d2d792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "name": "network-vif-plugged", "status": "completed", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:25.224144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-717c77dd-469d-44c2-bdc2-68df92aa4597 req-51a9f77f-f93a-4e4a-a560-1b5794d2d792 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:25.224614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-717c77dd-469d-44c2-bdc2-68df92aa4597 req-51a9f77f-f93a-4e4a-a560-1b5794d2d792 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:25.228415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:25.229035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:25.235893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:25.236309 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-717c77dd-469d-44c2-bdc2-68df92aa4597 req-51a9f77f-f93a-4e4a-a560-1b5794d2d792 service nova] Creating event network-vif-plugged:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h1-851337-5 Aug 04 05:21:25.236457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:25.237106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:25.237543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:25.242082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-717c77dd-469d-44c2-bdc2-68df92aa4597 req-51a9f77f-f93a-4e4a-a560-1b5794d2d792 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082579 Aug 04 05:21:25.242706 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3513/6911] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:25.374052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:25.386992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83c55739-3911-4719-962c-abdb495fdf7f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.161933 Aug 04 05:21:25.388072 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3399/6912] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:25 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:21:26.410610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:26.411466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:26.416592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:26.417319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:26.424631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:26.425098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:26.425953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:26.426350 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:26.564156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:26.572350 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-49d28e51-290c-4d1d-8e23-16372d3ef823 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1364 microversion: 2.1 time: 0.162732 Aug 04 05:21:26.572925 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3514/6913] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:26 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:27.593523 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:27.594148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:27.596218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:27.602754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:27.603243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:27.604025 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:27.604467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:27.739450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:27.747032 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-afd9bf7f-8b7c-4502-ac46-30d49f8331d9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1551 microversion: 2.1 time: 0.157496 Aug 04 05:21:27.747628 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3400/6914] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:27 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:27.768928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d4f04cef-3352-4274-999e-9dd7a6439105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:27.769477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d4f04cef-3352-4274-999e-9dd7a6439105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:27.776971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4f04cef-3352-4274-999e-9dd7a6439105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:27.777431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4f04cef-3352-4274-999e-9dd7a6439105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:27.778204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4f04cef-3352-4274-999e-9dd7a6439105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:27.778652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4f04cef-3352-4274-999e-9dd7a6439105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:27.854755 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d4f04cef-3352-4274-999e-9dd7a6439105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089750 Aug 04 05:21:27.855419 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3515/6915] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 05:21:27 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:28.796956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d007f7a8-e79c-4b75-bf2d-e92caa0ae631 req-65497027-463e-49cc-af4b-4663d5bb5001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:28.807420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d007f7a8-e79c-4b75-bf2d-e92caa0ae631 req-65497027-463e-49cc-af4b-4663d5bb5001 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:28.807877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d007f7a8-e79c-4b75-bf2d-e92caa0ae631 req-65497027-463e-49cc-af4b-4663d5bb5001 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:28.819561 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d007f7a8-e79c-4b75-bf2d-e92caa0ae631 req-65497027-463e-49cc-af4b-4663d5bb5001 service nova] Creating event network-changed:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h1-851337-5 Aug 04 05:21:28.824760 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d007f7a8-e79c-4b75-bf2d-e92caa0ae631 req-65497027-463e-49cc-af4b-4663d5bb5001 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031507 Aug 04 05:21:28.825421 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3401/6916] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:22:42.626098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:42.626873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:42.631278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:22:42.631906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:42.640236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:42.640641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:42.641430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:42.641934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:42.783457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:22:42.791583 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f204c4d9-b25a-4eef-a9bd-1cb3ea9f8a5f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1669 microversion: 2.1 time: 0.167957 Aug 04 05:22:42.792166 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3516/6917] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:22:42 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:22:42.813333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=27 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:42.814123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=63 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:42.819615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0240899c-c603-4031-bf56-e70ec87ec67d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee6e73d1-1b47-421d-b6bd-2047207a0fe2"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:22:42.822030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0240899c-c603-4031-bf56-e70ec87ec67d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:42.831870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0240899c-c603-4031-bf56-e70ec87ec67d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:42.832330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0240899c-c603-4031-bf56-e70ec87ec67d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:42.833107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0240899c-c603-4031-bf56-e70ec87ec67d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:42.833552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0240899c-c603-4031-bf56-e70ec87ec67d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:43.090409 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0240899c-c603-4031-bf56-e70ec87ec67d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279533 Aug 04 05:22:43.091058 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3402/6918] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:22:42 2022] POST /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:22:53.893446 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:22:53.894495 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:22:53.938465 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:22:53.938629 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:22:54.370883 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:22:54.371505 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:22:54.864637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:22:54.867000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:54.869232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:54.869965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:54.878311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:54.878779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:54.879614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:54.880068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:54.909660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:22:54.918202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Old instance type m1.heat2, new instance type m1.heat {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:22:54.924907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:22:54.925342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:22:54.925838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:22:54.926262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:22:54.926686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:22:54.988309 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b016ac32-1711-4334-bbf7-941be6591f9e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/action" status: 202 len: 0 microversion: 2.1 time: 0.127890 Aug 04 05:22:54.989107 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3517/6919] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:22:54 2022] POST /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:22:54.995741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:54.996989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:55.001621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:22:55.002226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:55.011983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:55.012425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:55.013315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:55.013823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:55.150114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:22:55.158420 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-185f0b02-c5c9-4884-a80a-db93815ee702 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1724 microversion: 2.1 time: 0.164514 Aug 04 05:22:55.159021 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3403/6920] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:22:54 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:22:56.180710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:22:56.181348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:56.189564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:56.190039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:56.190841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:56.191324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:56.338448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:22:56.346615 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8aae94c-9704-4a2a-988d-af80af48d755 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1724 microversion: 2.1 time: 0.170074 Aug 04 05:22:56.347216 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3518/6921] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:22:56 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:22:57.368361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:22:57.369800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:57.379117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:57.379583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:57.380346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:57.380785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:57.518233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:22:57.527037 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8ce765d2-6340-425f-b473-3abbbd5e145e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1724 microversion: 2.1 time: 0.163360 Aug 04 05:22:57.527613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3404/6922] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:22:57 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:22:58.548177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:22:58.548841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:58.556468 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:58.556940 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:58.557730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:58.558190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:58.692295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:22:58.700280 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-caee75da-8165-440e-b5b6-e3f66511b8b2 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.156047 Aug 04 05:22:58.700849 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3519/6923] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:22:58 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:22:59.721763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:22:59.722389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:22:59.729414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:59.729873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:59.730646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:22:59.731122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:22:59.859952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:22:59.868745 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2aa6f39b-f542-4da5-9dc6-2090b61645bb tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.150875 Aug 04 05:22:59.869336 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3405/6924] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:22:59 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:00.891044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:00.891758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:00.899816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:00.900223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:00.901017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:00.901469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:01.040174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:01.048450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f1e103d1-faf4-4601-be55-06f572e49c6c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.162043 Aug 04 05:23:01.049043 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3520/6925] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:00 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:23:02.071269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:02.071834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:02.078713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:02.079208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:02.079976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:02.080416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:02.214086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:02.222099 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7d3637e7-c78a-42a2-9e5b-0eadf3de1d33 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.155347 Aug 04 05:23:02.222670 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3406/6926] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:02 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:03.243091 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:03.243722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:03.250630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:03.251126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:03.251909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:03.252361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:03.384724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:03.393442 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ee3b374-52fd-49df-b7ad-f458c6eb5795 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.154009 Aug 04 05:23:03.393837 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3521/6927] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:03 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:04.416228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:04.416837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:04.423810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:04.424257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:04.425018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:04.425454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:04.563477 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:04.571431 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6b8aa4df-3e39-459e-a2d6-cefa42fb345c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.159525 Aug 04 05:23:04.572017 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3407/6928] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:04 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:05.592598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:05.593329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:05.600893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:05.601366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:05.602171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:05.602629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:05.747711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:05.756717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f0cb08b0-e086-4ab4-bc0f-15d721068a37 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.167887 Aug 04 05:23:05.757246 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3522/6929] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:05 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:06.778631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:06.779291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:06.786297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:06.786745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:06.787554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:06.787994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:06.922935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:06.931404 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-183902eb-c83a-4322-abdf-f48db9d4568b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.156671 Aug 04 05:23:06.931979 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3408/6930] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:06 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:07.953287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:07.953951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:07.961348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:07.961819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:07.962611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:07.963107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:08.097717 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:08.105739 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95c5db44-ae03-48b4-acbb-a7dc1774104e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.156502 Aug 04 05:23:08.106312 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3523/6931] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:07 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:09.126730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:09.127350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:09.134219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:09.134670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:09.135467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:09.135901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:09.264923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:09.273434 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1cfe8fca-78d5-49ef-8ac9-9775214b824c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.150697 Aug 04 05:23:09.274003 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3409/6932] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:09 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:10.294212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:10.294828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:10.301856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:10.302319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:10.303144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:10.304253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:10.436519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:10.444761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-927bda68-2821-4857-8de4-b4cc9ebdada9 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.154414 Aug 04 05:23:10.445339 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3524/6933] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:10 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:11.466315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:11.466945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:11.473902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:11.474368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:11.475174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:11.475640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:11.604420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:11.612447 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2c4aed48-30fe-431d-bbca-3a7f178d57b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.150111 Aug 04 05:23:11.613025 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3410/6934] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:11 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:12.634850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:12.635434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:12.642873 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:12.643384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:12.644189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:12.644653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:12.781207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:12.789434 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8aa7a19d-8412-4e4f-8624-cac04df821c5 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.159145 Aug 04 05:23:12.790019 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3525/6935] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:12 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:13.810581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:13.811225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:13.818254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:13.818708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:13.820145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:13.820582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:13.950207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:13.958127 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-87739fb0-11b6-4553-92cf-7602c88fa56f tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.151316 Aug 04 05:23:13.958706 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3411/6936] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:13 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:14.979596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:14.980234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:14.987890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:14.988367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:14.989173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:14.989631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:15.134196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:15.143109 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8a97238-2504-4a92-a38a-ebf6cc9ec335 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.167389 Aug 04 05:23:15.143924 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3526/6937] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:14 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:16.165686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:16.166363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:16.173475 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:16.173935 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:16.174715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:16.175191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:16.320990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:16.329740 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0ddbeb32-f4d0-47ea-a83f-92612e449a72 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1729 microversion: 2.1 time: 0.168648 Aug 04 05:23:16.330377 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3412/6938] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:16 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:17.102880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b0f6179b-144e-43ac-ae65-979c83f1bb2e req-15720bcc-9b3d-49c2-bebf-e63620569322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "name": "network-vif-unplugged", "status": "completed", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:17.113795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b0f6179b-144e-43ac-ae65-979c83f1bb2e req-15720bcc-9b3d-49c2-bebf-e63620569322 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:17.114766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b0f6179b-144e-43ac-ae65-979c83f1bb2e req-15720bcc-9b3d-49c2-bebf-e63620569322 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:17.127745 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b0f6179b-144e-43ac-ae65-979c83f1bb2e req-15720bcc-9b3d-49c2-bebf-e63620569322 service nova] Creating event network-vif-unplugged:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h2-851337-5 Aug 04 05:23:17.133710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-b0f6179b-144e-43ac-ae65-979c83f1bb2e req-15720bcc-9b3d-49c2-bebf-e63620569322 service nova] Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:23:17.145601 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b0f6179b-144e-43ac-ae65-979c83f1bb2e req-15720bcc-9b3d-49c2-bebf-e63620569322 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047247 Aug 04 05:23:17.146361 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3527/6939] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:17.355654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:17.356421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:17.363725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:17.364175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:17.364948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:17.365447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:17.561396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:17.569832 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c784f0d7-ecdc-4a1b-ab50-f696c69c98bf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1728 microversion: 2.1 time: 0.217875 Aug 04 05:23:17.570436 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3413/6940] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:17 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:18.593264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:18.594013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:18.600913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:18.601387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:18.602188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:18.602644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:18.738186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:18.747072 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-030f3472-8786-4a5b-b251-a25610a2a028 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.159041 Aug 04 05:23:18.747644 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3528/6941] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:18 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:19.165585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-51a30176-c5c9-4f60-92f2-7a552cc5b103 req-4bd59965-b355-4200-afd0-f201026da12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:19.176515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-51a30176-c5c9-4f60-92f2-7a552cc5b103 req-4bd59965-b355-4200-afd0-f201026da12d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:19.176972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-51a30176-c5c9-4f60-92f2-7a552cc5b103 req-4bd59965-b355-4200-afd0-f201026da12d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:19.193120 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-51a30176-c5c9-4f60-92f2-7a552cc5b103 req-4bd59965-b355-4200-afd0-f201026da12d service nova] Creating event network-changed:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h2-851337-5 Aug 04 05:23:19.201981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-51a30176-c5c9-4f60-92f2-7a552cc5b103 req-4bd59965-b355-4200-afd0-f201026da12d service nova] Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:23:19.219665 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-51a30176-c5c9-4f60-92f2-7a552cc5b103 req-4bd59965-b355-4200-afd0-f201026da12d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058352 Aug 04 05:23:19.220532 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3414/6942] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:19.768525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:19.770026 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:19.777821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:19.778690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:19.779779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:19.780464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:19.997867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:20.006192 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-59e5eccb-8163-4cdf-b9ba-ee6dcad0fa4e tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.241915 Aug 04 05:23:20.006786 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3529/6943] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:19 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:23:21.030670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:21.031526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:21.037739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:21.038198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:21.039021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:21.039452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:21.195182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:21.204399 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c92120c8-309c-47ff-814c-826defa2bd75 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.179376 Aug 04 05:23:21.205004 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3415/6944] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:21 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:22.226516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:22.227197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:22.234049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:22.234515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:22.235353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:22.235810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:22.374619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:22.383358 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a5293b6f-d9b2-4757-b82c-fbc32e40ff8b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.161424 Aug 04 05:23:22.383944 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3530/6945] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:22 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:23.404266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:23.404826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:23.414663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:23.415145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:23.415918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:23.416670 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:23.548347 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:23.556562 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ebdef3d9-b149-40b6-b2f6-a54419e67cbf tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.156318 Aug 04 05:23:23.557132 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3416/6946] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:23 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:24.577430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:24.578049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:24.584957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:24.585413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:24.586196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:24.586643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:24.724340 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:24.732945 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3c412736-2f5a-4aee-9fbc-a16e211892b3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.159421 Aug 04 05:23:24.733524 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3531/6947] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:24 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:25.755291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:25.755940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:25.759078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=29 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:25.764824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:25.765280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:25.766060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:25.766505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:25.769371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=83 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:25.917028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:25.925890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6fde42fa-421d-4377-8547-42b70a13ddc1 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.174727 Aug 04 05:23:25.926723 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3417/6948] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:25 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:26.948201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:26.948754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:26.951589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=35 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:26.956962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:26.957431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:26.958227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:26.958716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:26.962201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:27.099672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:27.108700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f3f75a7-9a07-4f50-93a4-3a70ee87afe7 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.164845 Aug 04 05:23:27.109551 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3532/6949] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:26 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:28.130813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:28.131508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:28.138458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:28.138910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:28.139959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:28.140391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:28.277396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:28.285346 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d21107d6-3259-48b6-9192-7042bc1232ea tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.158430 Aug 04 05:23:28.285924 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3418/6950] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:28 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:29.306928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:29.307584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:29.314653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:29.315162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:29.315950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:29.316405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:29.446292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:29.454343 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b0b18d2e-4ebb-4511-afa3-e4435c1e36c0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1726 microversion: 2.1 time: 0.151953 Aug 04 05:23:29.454928 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3533/6951] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:29 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:30.477002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:30.477624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:30.485717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.486188 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:30.487067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.487516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:30.625360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:30.633563 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-11825197-f251-4245-a313-fee4b76cd148 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1723 microversion: 2.1 time: 0.160952 Aug 04 05:23:30.634144 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3419/6952] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:30 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:30.654407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:30.655000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:30.663029 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.663788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:30.664660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.665145 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:30.704064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.704528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:30.705354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.705810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:30.729526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:23:30.734883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Getting quotas for user c77abdb95c994fbca1991af85976243b and project d00ba8bfdec240d0849a382300f3fd9f. Resources: {'ram', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:23:30.835951 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff72ce7d-36da-45e1-a5a7-5f6edd62bc38 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "POST /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/action" status: 202 len: 0 microversion: 2.1 time: 0.185159 Aug 04 05:23:30.836486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3534/6953] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:23:30 2022] POST /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:23:30.844760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:30.845386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:30.852185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.852648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:30.853430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:30.854152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:31.063700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:31.072087 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4a95394b-01e1-4b09-8ad3-4bb586a2c8cc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.231266 Aug 04 05:23:31.072684 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3420/6954] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:30 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:23:32.095372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:32.095989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:32.103774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:32.104236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:32.105017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:32.105496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:32.238153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:32.246983 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bd1e2542-8e0e-46f4-b53b-3b9fcd162848 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.156859 Aug 04 05:23:32.247564 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3535/6955] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:32 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:33.269826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:33.270495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:33.278003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:33.279268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:33.280055 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:33.280638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:33.306010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-72fd0209-12a3-4537-87b6-0979c2a866b7 req-e6bdb7bb-d904-4160-8b60-671d463484cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "name": "network-vif-plugged", "status": "completed", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:33.321394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-72fd0209-12a3-4537-87b6-0979c2a866b7 req-e6bdb7bb-d904-4160-8b60-671d463484cf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:33.321858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-72fd0209-12a3-4537-87b6-0979c2a866b7 req-e6bdb7bb-d904-4160-8b60-671d463484cf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:33.335058 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-72fd0209-12a3-4537-87b6-0979c2a866b7 req-e6bdb7bb-d904-4160-8b60-671d463484cf service nova] Creating event network-vif-plugged:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h2-851337-5 Aug 04 05:23:33.341856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-72fd0209-12a3-4537-87b6-0979c2a866b7 req-e6bdb7bb-d904-4160-8b60-671d463484cf service nova] Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:23:33.354733 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-72fd0209-12a3-4537-87b6-0979c2a866b7 req-e6bdb7bb-d904-4160-8b60-671d463484cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053184 Aug 04 05:23:33.355975 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3536/6956] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:23:33.440198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:33.449029 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ea93d88a-410e-41d8-ab58-afb642ce279c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.184380 Aug 04 05:23:33.449606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3421/6957] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:33 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:34.471385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:34.472141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:34.478557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:34.479056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:34.479855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:34.480311 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:34.622285 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:34.630902 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0add9230-2074-4d04-8b20-0d38bfcffb5c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.164657 Aug 04 05:23:34.632159 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3537/6958] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:34 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:35.653860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:35.654476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:35.661620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:35.662362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:35.663890 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:35.664504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:35.797444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:35.805791 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38d31f1a-bdd7-479f-b226-44d246e5a724 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.155759 Aug 04 05:23:35.806381 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3422/6959] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:35 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:36.163036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9ee38deb-d1f7-4cfd-9880-4729cfa8b706 req-71f483b4-ec04-45b7-b0df-dfc3bdb323ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "name": "network-vif-unplugged", "status": "completed", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:36.172810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9ee38deb-d1f7-4cfd-9880-4729cfa8b706 req-71f483b4-ec04-45b7-b0df-dfc3bdb323ac service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:36.173278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9ee38deb-d1f7-4cfd-9880-4729cfa8b706 req-71f483b4-ec04-45b7-b0df-dfc3bdb323ac service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:36.185592 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9ee38deb-d1f7-4cfd-9880-4729cfa8b706 req-71f483b4-ec04-45b7-b0df-dfc3bdb323ac service nova] Creating event network-vif-unplugged:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h1-851337-5 Aug 04 05:23:36.191064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-9ee38deb-d1f7-4cfd-9880-4729cfa8b706 req-71f483b4-ec04-45b7-b0df-dfc3bdb323ac service nova] Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:23:36.202621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9ee38deb-d1f7-4cfd-9880-4729cfa8b706 req-71f483b4-ec04-45b7-b0df-dfc3bdb323ac service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109667 Aug 04 05:23:36.203265 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3538/6960] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:36.827978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:36.828590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:36.835621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:36.835997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:36.836773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:36.837208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:36.988833 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:36.997330 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b462d7fe-b4f0-4b2b-86db-be6f74cae263 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.173316 Aug 04 05:23:36.997920 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3423/6961] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:36 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:38.020649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:38.021265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:38.027794 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:38.028216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:38.029034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:38.029462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:38.167182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:38.175628 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ed18abb0-3037-4d56-8fea-671e766a2044 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.160218 Aug 04 05:23:38.176313 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3539/6962] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:38 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:38.218365 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-fa3787b7-8a7e-4446-baa2-ec6c4d6ab876 req-43a50477-e0c1-46e9-854a-9c9436c6d456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:38.229500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fa3787b7-8a7e-4446-baa2-ec6c4d6ab876 req-43a50477-e0c1-46e9-854a-9c9436c6d456 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:38.229952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-fa3787b7-8a7e-4446-baa2-ec6c4d6ab876 req-43a50477-e0c1-46e9-854a-9c9436c6d456 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:38.242332 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-fa3787b7-8a7e-4446-baa2-ec6c4d6ab876 req-43a50477-e0c1-46e9-854a-9c9436c6d456 service nova] Creating event network-changed:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h1-851337-5 Aug 04 05:23:38.247725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-fa3787b7-8a7e-4446-baa2-ec6c4d6ab876 req-43a50477-e0c1-46e9-854a-9c9436c6d456 service nova] Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:23:38.259037 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-fa3787b7-8a7e-4446-baa2-ec6c4d6ab876 req-43a50477-e0c1-46e9-854a-9c9436c6d456 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044607 Aug 04 05:23:38.259526 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3424/6963] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:39.198619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:39.199307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:39.206611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:39.207143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:39.208001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:39.208386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:39.349015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:39.357775 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa347bd0-bda6-4d1c-93e7-6cee5185c495 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.163216 Aug 04 05:23:39.358372 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3540/6964] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:39 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:40.379862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:40.380471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:40.388369 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:40.388818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:40.389846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:40.390286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:40.524646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:40.532911 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b22e1216-e4d6-43c8-b74e-186c18a6dba3 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.157622 Aug 04 05:23:40.533493 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3425/6965] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:40 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:41.553976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:41.554649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:41.557675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:41.563747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:41.564243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:41.565069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:41.565532 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:41.700691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:41.710180 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-80c50d5b-85b6-454d-bbb3-81a0b2f93169 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.159989 Aug 04 05:23:41.710765 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3541/6966] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:41 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:42.731769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:42.732378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:42.739203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:42.739654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:42.741023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:42.741460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:42.883504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:42.892644 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f4f52980-1ea1-4a0b-96f9-9fc697923e27 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.164746 Aug 04 05:23:42.893246 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3426/6967] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:42 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:43.913898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:43.914304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:43.921181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:43.921583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:43.922363 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:43.922814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:44.053475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:44.061568 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9800c0fe-9a1c-4fd0-b01e-016efc7169b6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.151802 Aug 04 05:23:44.062157 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3542/6968] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:43 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:45.082805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:45.083631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:45.091842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:45.092302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:45.093084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:45.093526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:45.225236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:45.233392 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-53ce4490-28de-4dc7-88c4-bba255bbcc96 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.154504 Aug 04 05:23:45.233966 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3427/6969] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:45 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:46.255259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:46.256440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:46.263080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:46.263553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:46.264595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:46.265060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:46.397247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:46.405422 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6740b32f-c5cf-4459-9e30-020e6cb7d427 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.154254 Aug 04 05:23:46.405923 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3543/6970] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:46 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:47.425811 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:47.426470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:47.433629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:47.434089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:47.434864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:47.435336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:47.567212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:47.575268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52a09804-85a1-44bf-8cb9-6374e43683dc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.153390 Aug 04 05:23:47.575840 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3428/6971] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:47 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:48.597633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:48.598272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:48.605446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:48.605918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:48.606712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:48.607212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:48.745868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:48.753940 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-690065f7-3bb0-433f-915a-f3705ebbc8ed tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.160265 Aug 04 05:23:48.754527 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3544/6972] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:48 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:49.776358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:49.777091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:49.784353 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:49.784809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:49.785594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:49.786040 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:49.921099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:49.929303 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-333bade5-d1eb-4cbd-9a81-4189e441e4e8 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1722 microversion: 2.1 time: 0.156889 Aug 04 05:23:49.929880 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3429/6973] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:49 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:50.950629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:50.951264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:50.957979 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:50.958441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:50.959257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:50.959716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.095277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:51.104278 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b19528ed-25bb-42b8-a353-d53b67550916 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1715 microversion: 2.1 time: 0.157628 Aug 04 05:23:51.104866 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3545/6974] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:50 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:23:51.125915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:51.126567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:51.133531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.133988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.134764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.135236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.276634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:51.284981 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60be9195-87e6-4a50-9f6b-5e1f1541324c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1715 microversion: 2.1 time: 0.163440 Aug 04 05:23:51.285583 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3430/6975] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:51 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:51.306079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:51.306709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:51.312884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.313355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.314144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.314604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.329463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:51.453944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:51.462581 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f8fb419e-c8f6-4712-a0ba-769307115790 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1715 microversion: 2.1 time: 0.160491 Aug 04 05:23:51.463194 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3546/6976] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:51 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:51.483538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:51.483969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:51.490266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.490719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.491549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.492018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.517259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:23:51.596108 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-95f7f6dd-4a73-4c60-8253-7117abeac105 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 204 len: 0 microversion: 2.1 time: 0.115668 Aug 04 05:23:51.599081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3431/6977] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:23:51 2022] DELETE /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:23:51.606528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:51.607187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:51.616052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.616916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.617696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.618158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.744938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-3448e108-503d-4a62-9e9f-c53816d65d6d req-491a338b-777a-4327-ad32-a27689f54add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "name": "network-vif-plugged", "status": "completed", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:51.756271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3448e108-503d-4a62-9e9f-c53816d65d6d req-491a338b-777a-4327-ad32-a27689f54add service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:51.757099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-3448e108-503d-4a62-9e9f-c53816d65d6d req-491a338b-777a-4327-ad32-a27689f54add service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:51.772781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:51.773307 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-3448e108-503d-4a62-9e9f-c53816d65d6d req-491a338b-777a-4327-ad32-a27689f54add service nova] Creating event network-vif-plugged:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h1-851337-5 Aug 04 05:23:51.778296 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-3448e108-503d-4a62-9e9f-c53816d65d6d req-491a338b-777a-4327-ad32-a27689f54add service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039087 Aug 04 05:23:51.779563 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3432/6978] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:23:51.781947 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-77f78560-e738-432a-905e-9e80566c7027 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1721 microversion: 2.1 time: 0.179246 Aug 04 05:23:51.782535 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3547/6979] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:51 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:52.805666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:52.806269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:52.812610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:52.813063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:52.813829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:52.814262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:52.819068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:52.950422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:52.958786 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52d0d19b-056a-4d48-b5e8-e33de3004e06 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1721 microversion: 2.1 time: 0.158653 Aug 04 05:23:52.959699 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3433/6980] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:52 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:53.980813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:53.981578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:53.988829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:53.989327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:53.990178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:53.990687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:54.065730 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:54.075305 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-296fe0ee-bfe5-4464-a2ae-0eeff96fd0a0 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1654 microversion: 2.1 time: 0.098370 Aug 04 05:23:54.076197 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3548/6981] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:53 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:54.309006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1ecd2970-1610-4593-81cc-a99ca0f83c59 req-e7118ca6-eca6-472c-ad4a-05d23b044562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6873c5da-4f9a-4bf6-a66b-a62cb0f63c85", "name": "network-vif-deleted", "tag": "6c058324-9c64-448e-8ab6-d55eff2a5ac8"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:23:54.321073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1ecd2970-1610-4593-81cc-a99ca0f83c59 req-e7118ca6-eca6-472c-ad4a-05d23b044562 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:54.321529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1ecd2970-1610-4593-81cc-a99ca0f83c59 req-e7118ca6-eca6-472c-ad4a-05d23b044562 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:54.335998 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1ecd2970-1610-4593-81cc-a99ca0f83c59 req-e7118ca6-eca6-472c-ad4a-05d23b044562 service nova] Creating event network-vif-deleted:6c058324-9c64-448e-8ab6-d55eff2a5ac8 for instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 on n-h1-851337-5 Aug 04 05:23:54.342268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1ecd2970-1610-4593-81cc-a99ca0f83c59 req-e7118ca6-eca6-472c-ad4a-05d23b044562 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037004 Aug 04 05:23:54.342836 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3434/6982] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:55.097958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:55.098764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:55.106901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:55.107546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:55.108435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:55.108993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:55.181562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:55.192062 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d177688f-a85b-4f77-9897-20cceb98e9fd tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1370 microversion: 2.1 time: 0.097944 Aug 04 05:23:55.193329 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3549/6983] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:55 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:56.214275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:56.215083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:56.217692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:56.223458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:56.223919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:56.225183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:56.225625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:56.290201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:56.298620 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4955b3f8-cae1-4c2a-a0e4-6d50ce8e4f59 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1370 microversion: 2.1 time: 0.088736 Aug 04 05:23:56.299247 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3435/6984] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:56 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:57.321004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:57.321644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:57.324920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:57.331394 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:57.331918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:57.332726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:57.333186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:57.397325 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:57.405827 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0cb8ef52-0365-481c-92bc-59a03762fc7d tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1370 microversion: 2.1 time: 0.089297 Aug 04 05:23:57.406633 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3550/6985] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:57 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:58.428582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:58.429141 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:58.435599 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:58.436048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:58.436821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:58.437256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:58.500843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77abdb95c994fbca1991af85976243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ba8bfdec240d0849a382300f3fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:23:58.509487 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3501fe11-9c19-481c-add5-5c76453d8e58 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 200 len: 1370 microversion: 2.1 time: 0.086297 Aug 04 05:23:58.510071 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3436/6986] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:58 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:59.531392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:59.532038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:59.539755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:59.540218 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:59.540992 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:59.541439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:59.554533 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 HTTP/1.1 Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6873c5da-4f9a-4bf6-a66b-a62cb0f63c85'} Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:23:59.556204 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9e327d4-de13-42ea-8620-859506675934 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 404 len: 111 microversion: 2.1 time: 0.030223 Aug 04 05:23:59.562111 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3551/6987] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:23:59 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:23:59.617003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:59.619228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:23:59.626137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:59.626590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:59.627402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:59.627866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:59.640984 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/os-volume_attachments HTTP/1.1 Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'server_id': '6873c5da-4f9a-4bf6-a66b-a62cb0f63c85'} Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:23:59.642753 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b26bb9a2-1532-4475-89e5-ea10c6125d9c tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031880 Aug 04 05:23:59.648630 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3437/6988] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:23:59 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:02.962070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:02.962592 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:02.972365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:02.972922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:02.973772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:02.974268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:02.988432 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 HTTP/1.1 Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '6873c5da-4f9a-4bf6-a66b-a62cb0f63c85'} Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:02.990053 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dbb277e6-cd4a-4b3e-8525-065c36c3de3b tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 404 len: 111 microversion: 2.1 time: 0.033954 Aug 04 05:24:02.994800 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3552/6989] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:24:02 2022] DELETE /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:03.000509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.001129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:03.009485 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.009932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.010836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.011390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.026991 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 HTTP/1.1 Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '6873c5da-4f9a-4bf6-a66b-a62cb0f63c85'} Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.028556 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-26af47eb-838f-4b8c-848d-6f4ffd089854 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85" status: 404 len: 111 microversion: 2.1 time: 0.033618 Aug 04 05:24:03.035366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3438/6990] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:02 2022] GET /compute/v2.1/servers/6873c5da-4f9a-4bf6-a66b-a62cb0f63c85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:24:03.041737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.042264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:03.048828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.049308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.050086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.050550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.068269 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 HTTP/1.1 Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21'} Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:03.069869 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-981cacb3-1655-4436-a6a9-648973384049 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 404 len: 111 microversion: 2.1 time: 0.033586 Aug 04 05:24:03.074838 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3553/6991] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:24:03 2022] DELETE /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:03.082081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.082693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:03.089443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.089891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.090652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.091112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.104520 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 HTTP/1.1 Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21'} Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.106069 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-045ce024-316f-4289-b91d-1ba5f6129cf6 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21" status: 404 len: 111 microversion: 2.1 time: 0.029277 Aug 04 05:24:03.111283 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3439/6992] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:03 2022] GET /compute/v2.1/servers/84ec3e2d-b8a9-4753-a7a9-66f43ac9cd21 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:03.117284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.117955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:03.124286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.124835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.125702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.126236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.141009 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc HTTP/1.1 Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '00789856-5fe9-4a57-8099-d393b73a13bc'} Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:03.142671 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a6af1067-22f9-4271-8aa7-5a427c3cf012 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 404 len: 111 microversion: 2.1 time: 0.032687 Aug 04 05:24:03.147880 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3554/6993] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:24:03 2022] DELETE /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:03.155434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.156075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 00789856-5fe9-4a57-8099-d393b73a13bc] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:03.162389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.162838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.163624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.164057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.178375 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc HTTP/1.1 Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '00789856-5fe9-4a57-8099-d393b73a13bc'} Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.179927 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 00789856-5fe9-4a57-8099-d393b73a13bc could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-656e205d-2950-4a69-bb34-8806654b6bac tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc" status: 404 len: 111 microversion: 2.1 time: 0.029749 Aug 04 05:24:03.185653 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3440/6994] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:03 2022] GET /compute/v2.1/servers/00789856-5fe9-4a57-8099-d393b73a13bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:03.191004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.191554 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:03.198361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.198921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.200024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.200351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.214629 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 HTTP/1.1 Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '23832231-db91-43cb-811e-431c67f97143'} Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:03.216348 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:03.221630 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-497174ec-ade2-4ff8-8c53-c43a3e9c3810 tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 404 len: 111 microversion: 2.1 time: 0.032312 Aug 04 05:24:03.223406 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3555/6995] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:24:03 2022] DELETE /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:03.229181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.229813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] [instance: 23832231-db91-43cb-811e-431c67f97143] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:03.236045 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.236494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.237259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:03.237694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:03.255969 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] HTTP exception thrown: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Request method failure captured: Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 HTTP/1.1 Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61ZEI3Y36rj6U9dyv9K2TB-INQfGj1YNgESZI9BgpC2ym1zu-_-dvqy-nCXk3lRTHZoD8ztyg2vX3GzbgiNr0gW7Nk8HYemas2R-steisLL-iseigQEMQEDdcdbzGlncck3lkzXj4JIKYMnbH1JsQoYQgdnLOzd21r32awIVrYXuJlc Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d00ba8bfdec240d0849a382300f3fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d00ba8bfdec240d0849a382300f3fd9f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: d00ba8bfdec240d0849a382300f3fd9f Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServerActionsTestJSON-137558950 Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: c77abdb95c994fbca1991af85976243b Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServerActionsTestJSON-137558950-project Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '23832231-db91-43cb-811e-431c67f97143'} Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:03.257501 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Returning 404 to user: Instance 23832231-db91-43cb-811e-431c67f97143 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0d5f6cd-cfb4-4052-9678-160a170043fc tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143" status: 404 len: 111 microversion: 2.1 time: 0.033629 Aug 04 05:24:03.262409 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3441/6996] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:03 2022] GET /compute/v2.1/servers/23832231-db91-43cb-811e-431c67f97143 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:24:03.268522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c267e9f7-09a0-452e-854d-cbe88a1f4ffa tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] Calling method '.version_select at 0x7f1919adf670>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:03.292460 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c267e9f7-09a0-452e-854d-cbe88a1f4ffa tempest-ServerActionsTestJSON-137558950 tempest-ServerActionsTestJSON-137558950-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161455763" status: 202 len: 0 microversion: 2.1 time: 0.027964 Aug 04 05:24:03.293062 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3556/6997] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Aug 4 05:24:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161455763 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:24:12.872410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1459452870", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "3c2ec7db-645f-4c86-b7df-eb41f1d820bc"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:12.932283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] validate_networks() for [('3c2ec7db-645f-4c86-b7df-eb41f1d820bc', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:24:13.244720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=29 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:13.403691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:24:13.404125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:24:13.404632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:24:13.405046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:24:13.405680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:24:13.421784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:13.422232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:13.423070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:13.423511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:13.442583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Getting quotas for project 33ae8d5f27d64d48b670871145c37ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:24:13.447886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Getting quotas for user f67c706e8b214cafb80d44288f42b453 and project 33ae8d5f27d64d48b670871145c37ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:24:13.460770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:24:13.463080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:24:13.509106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f49884cb-0279-4e72-b0a4-c9fd04919b78 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770024 Aug 04 05:24:13.510081 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3442/6998] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:24:13.519067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=37 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:13.519796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:13.528697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66b024c7-f381-48c1-8a33-eec9508c9646 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:13.529335 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-66b024c7-f381-48c1-8a33-eec9508c9646 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:13.588096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-66b024c7-f381-48c1-8a33-eec9508c9646 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:13.597279 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-66b024c7-f381-48c1-8a33-eec9508c9646 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1217 microversion: 2.1 time: 0.080027 Aug 04 05:24:13.598036 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3557/6999] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:13 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:14.619860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-848ca31c-4456-4e08-a7a3-54fc8cfb30a2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:14.620656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-848ca31c-4456-4e08-a7a3-54fc8cfb30a2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:14.712486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-848ca31c-4456-4e08-a7a3-54fc8cfb30a2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:14.722210 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-848ca31c-4456-4e08-a7a3-54fc8cfb30a2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1217 microversion: 2.1 time: 0.108186 Aug 04 05:24:14.738900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3443/7000] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:14 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:15.747347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:15.748534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:15.756481 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:15.756954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:15.757930 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:15.758382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:15.846539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:15.856636 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bbe3dbad-5f4b-4b9b-8b6f-50a3f4eca190 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1269 microversion: 2.1 time: 0.113439 Aug 04 05:24:15.857248 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3558/7001] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:15 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:16.883579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:16.884212 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:16.892768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:16.893145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:16.894069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:16.894507 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:17.045034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:17.053720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-01c3e1dc-b7e1-4266-8387-41faa666c22c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.178479 Aug 04 05:24:17.054335 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3444/7002] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:16 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:17.330124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-67e24d5c-d21b-4980-809c-9087cd5aa1b7 req-5b5c4f6b-6f9b-415e-a79d-3c8cf8d3d9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea0cf4e-00bd-4836-8382-3f00e2ea2871", "tag": "d0ff58ef-d737-46ae-b05b-77315d7b321d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:17.344343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-67e24d5c-d21b-4980-809c-9087cd5aa1b7 req-5b5c4f6b-6f9b-415e-a79d-3c8cf8d3d9da service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:17.344980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-67e24d5c-d21b-4980-809c-9087cd5aa1b7 req-5b5c4f6b-6f9b-415e-a79d-3c8cf8d3d9da service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:17.362445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-67e24d5c-d21b-4980-809c-9087cd5aa1b7 req-5b5c4f6b-6f9b-415e-a79d-3c8cf8d3d9da service nova] Creating event network-changed:d0ff58ef-d737-46ae-b05b-77315d7b321d for instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 on n-h1-851337-5 Aug 04 05:24:17.371605 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-67e24d5c-d21b-4980-809c-9087cd5aa1b7 req-5b5c4f6b-6f9b-415e-a79d-3c8cf8d3d9da service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055749 Aug 04 05:24:17.372424 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3559/7003] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:24:18.074733 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:18.075283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:18.082279 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:18.082731 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:18.084039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:18.084480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:18.215191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:18.223263 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f603de58-dd20-432d-bd97-680af0cfd7b7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.152519 Aug 04 05:24:18.223837 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3445/7004] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:18 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:19.245234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:19.245959 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:19.253282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:19.253759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:19.254549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:19.255033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:19.386488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:19.394869 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cecba369-c13b-40e5-885b-730c754cf33d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.153919 Aug 04 05:24:19.395486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3560/7005] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:19 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:20.418143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:20.419012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:20.426235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:20.426690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:20.428139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:20.428584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:20.568957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:20.576617 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6813bcb-ef45-4ac7-932d-308d6f193725 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.162771 Aug 04 05:24:20.577206 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3446/7006] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:20 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:21.597203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:21.597834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:21.604463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:21.604920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:21.605690 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:21.606137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:21.744679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:21.753618 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-de8766e7-ac2f-45e6-87b7-032895f8edb3 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.160340 Aug 04 05:24:21.754381 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3561/7007] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:21 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:22.776525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:22.777151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:22.784462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:22.784915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:22.785696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:22.786136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:22.926500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:22.933912 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c1dfd80a-3cb7-4a04-b4f4-62e99540ac8b tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.161903 Aug 04 05:24:22.934472 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3447/7008] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:22 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:23.901980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-cac31dac-b19a-4c99-9a36-e4f3fa2ebce9 req-a7b706d1-f9a4-43ef-9edc-ff8a9a56cb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea0cf4e-00bd-4836-8382-3f00e2ea2871", "name": "network-vif-plugged", "status": "completed", "tag": "d0ff58ef-d737-46ae-b05b-77315d7b321d"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:23.908031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:23.918279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cac31dac-b19a-4c99-9a36-e4f3fa2ebce9 req-a7b706d1-f9a4-43ef-9edc-ff8a9a56cb4a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:23.919098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-cac31dac-b19a-4c99-9a36-e4f3fa2ebce9 req-a7b706d1-f9a4-43ef-9edc-ff8a9a56cb4a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:23.931289 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-cac31dac-b19a-4c99-9a36-e4f3fa2ebce9 req-a7b706d1-f9a4-43ef-9edc-ff8a9a56cb4a service nova] Creating event network-vif-plugged:d0ff58ef-d737-46ae-b05b-77315d7b321d for instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 on n-h1-851337-5 Aug 04 05:24:23.936601 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-cac31dac-b19a-4c99-9a36-e4f3fa2ebce9 req-a7b706d1-f9a4-43ef-9edc-ff8a9a56cb4a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038426 Aug 04 05:24:23.937388 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3562/7009] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:24:23.959289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:23.960496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:23.963775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:23.975988 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:23.976830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:23.978453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:23.979097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:24.127923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:24.136011 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f78a4018-c522-45a5-b843-2b2fd9680849 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.184981 Aug 04 05:24:24.136611 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3448/7010] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:23 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:25.158119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:25.158843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:25.166587 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:25.167093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:25.167923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:25.168387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:25.306600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:25.314190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19b879cd-d9d2-45e1-ac49-11fa2a41e44c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1317 microversion: 2.1 time: 0.160392 Aug 04 05:24:25.314770 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3563/7011] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:25 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:26.335020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:26.335568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:26.337589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:26.338797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:26.344716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:26.345149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:26.345919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:26.346474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:26.488097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:26.496190 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1aef4ae4-9d25-4389-ab98-8a1f5a52a5d5 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1507 microversion: 2.1 time: 0.165268 Aug 04 05:24:26.496762 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3449/7012] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:26 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:26.562761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1341258207", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "3c2ec7db-645f-4c86-b7df-eb41f1d820bc"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:26.617137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] validate_networks() for [('3c2ec7db-645f-4c86-b7df-eb41f1d820bc', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:24:27.079470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:24:27.079907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:24:27.080398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:24:27.080818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:24:27.081241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:24:27.091308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:27.091308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:27.092124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:27.092572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:27.110013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Getting quotas for project 33ae8d5f27d64d48b670871145c37ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:24:27.115203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Getting quotas for user f67c706e8b214cafb80d44288f42b453 and project 33ae8d5f27d64d48b670871145c37ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:24:27.127649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:24:27.130436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:24:27.177019 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1aaec2aa-a6ce-49cd-a6e4-029d91f6a295 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618206 Aug 04 05:24:27.177887 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3564/7013] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:24:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:24:27.188604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ef590ad-b873-40dc-858a-260208958fcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:27.189227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ef590ad-b873-40dc-858a-260208958fcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:27.242545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ef590ad-b873-40dc-858a-260208958fcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:27.249312 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ef590ad-b873-40dc-858a-260208958fcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1217 microversion: 2.1 time: 0.064762 Aug 04 05:24:27.249895 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3450/7014] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:27 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:28.271488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:28.272134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:28.280226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:28.280697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:28.281502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:28.281964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:28.355357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:28.363065 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aa4e1abe-61c1-4dfa-abde-76411a9f5891 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1275 microversion: 2.1 time: 0.096498 Aug 04 05:24:28.363651 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3565/7015] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:28 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:29.386439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:29.387208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:29.394593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:29.395077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:29.395866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:29.396407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:29.417052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7040b1db-394d-42e5-876b-26906b8e9277 req-c903506a-517e-4142-81af-83cae00ba632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1d4fa6-5a02-4997-8116-667ac4b0a7e2", "tag": "a6aa6a16-79da-4eb9-887d-4f9d0147d1e3"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:29.436187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7040b1db-394d-42e5-876b-26906b8e9277 req-c903506a-517e-4142-81af-83cae00ba632 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:29.436867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7040b1db-394d-42e5-876b-26906b8e9277 req-c903506a-517e-4142-81af-83cae00ba632 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:29.450104 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7040b1db-394d-42e5-876b-26906b8e9277 req-c903506a-517e-4142-81af-83cae00ba632 service nova] Creating event network-changed:a6aa6a16-79da-4eb9-887d-4f9d0147d1e3 for instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 on n-h2-851337-5 Aug 04 05:24:29.455275 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7040b1db-394d-42e5-876b-26906b8e9277 req-c903506a-517e-4142-81af-83cae00ba632 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044818 Aug 04 05:24:29.456264 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3566/7016] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:24:29.635544 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:29.643645 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8928238c-725c-442f-97af-8f79c7acddf8 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1317 microversion: 2.1 time: 0.262117 Aug 04 05:24:29.649737 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3451/7017] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:29 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:30.664709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:30.665430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:30.672919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:30.673385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:30.674184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:30.674641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:30.875105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:30.883868 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b3f47ca-d571-4872-8c4c-5088705f8663 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1317 microversion: 2.1 time: 0.223301 Aug 04 05:24:30.884471 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3567/7018] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:30 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:31.905364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:31.905984 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:31.912759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:31.913215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:31.913990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:31.914428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:32.046100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:32.054055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6822e72-e5ad-4f97-ad57-05a671e671e2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1317 microversion: 2.1 time: 0.152613 Aug 04 05:24:32.054623 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3452/7019] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:31 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:33.073791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:33.074429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:33.081513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:33.081985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:33.082778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:33.083748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:33.212401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:33.220113 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6919a2da-e7e8-46c7-8156-ee1275836beb tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1317 microversion: 2.1 time: 0.150298 Aug 04 05:24:33.220689 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3568/7020] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:33 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:34.241814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:34.242430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:34.249525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:34.249974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:34.250749 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:34.251219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:34.384876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:34.393375 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b24647e-db8e-471a-b1ee-fb9d5cc06f02 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1317 microversion: 2.1 time: 0.156083 Aug 04 05:24:34.393955 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3453/7021] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:34 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:35.414647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:35.415301 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:35.422329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:35.422792 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:35.423606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:35.424062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:35.563811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:35.571494 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-076931ae-9c13-44a3-9444-82985d0543fc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1317 microversion: 2.1 time: 0.161335 Aug 04 05:24:35.572072 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3569/7022] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:35 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:35.639391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1c99dff1-8837-4259-bd57-412c8b8212d8 req-45840aa6-ac4a-4754-a7d6-40e3577c9f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1d4fa6-5a02-4997-8116-667ac4b0a7e2", "name": "network-vif-plugged", "status": "completed", "tag": "a6aa6a16-79da-4eb9-887d-4f9d0147d1e3"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:35.653897 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1c99dff1-8837-4259-bd57-412c8b8212d8 req-45840aa6-ac4a-4754-a7d6-40e3577c9f70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:35.655789 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1c99dff1-8837-4259-bd57-412c8b8212d8 req-45840aa6-ac4a-4754-a7d6-40e3577c9f70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:35.672606 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1c99dff1-8837-4259-bd57-412c8b8212d8 req-45840aa6-ac4a-4754-a7d6-40e3577c9f70 service nova] Creating event network-vif-plugged:a6aa6a16-79da-4eb9-887d-4f9d0147d1e3 for instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 on n-h2-851337-5 Aug 04 05:24:35.678851 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1c99dff1-8837-4259-bd57-412c8b8212d8 req-45840aa6-ac4a-4754-a7d6-40e3577c9f70 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043178 Aug 04 05:24:35.679535 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3454/7023] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:24:36.593950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:36.594972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:36.602362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:36.602851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:36.603665 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:36.604120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:36.741039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:36.748659 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7601f525-2a63-48d6-b5c9-6e3298fdd69e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1317 microversion: 2.1 time: 0.159425 Aug 04 05:24:36.749240 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3570/7024] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:36 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:37.768156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:37.773228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:37.773959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:37.780561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:37.781019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:37.781781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:37.782216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:37.915696 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:37.923338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-89c35ad6-b4b0-4bab-9e49-f7d7ebf7fb8c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1506 microversion: 2.1 time: 0.156971 Aug 04 05:24:37.923925 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3455/7025] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:37 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:37.943582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:37.944093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:37.946068 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:37.946760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:37.953892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:37.954362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:37.955182 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:37.955640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:37.981169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:24:38.057122 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9547e1fe-3f6f-4a99-8c3d-1212a2149468 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 204 len: 0 microversion: 2.1 time: 0.117520 Aug 04 05:24:38.057621 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3571/7026] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:24:37 2022] DELETE /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:24:38.066071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:38.066688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:38.073394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:38.073812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:38.074568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:38.075052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:38.228171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:38.235757 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-513dbe05-a210-48e8-815f-b3e7211b38f9 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1512 microversion: 2.1 time: 0.173548 Aug 04 05:24:38.236325 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3456/7027] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:38 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:24:39.258316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:39.259092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:39.266235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:39.266704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:39.267595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:39.268134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:39.448241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:39.456873 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1d40e58-c635-4980-a8d2-75072100c680 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 200 len: 1512 microversion: 2.1 time: 0.203268 Aug 04 05:24:39.457486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3572/7028] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:39 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:39.877776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-0262a8d4-c683-4d1e-8ea3-e4200e5c6e91 req-1322ed08-32ac-423b-b06c-73fe741b5af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1d4fa6-5a02-4997-8116-667ac4b0a7e2", "name": "network-vif-deleted", "tag": "a6aa6a16-79da-4eb9-887d-4f9d0147d1e3"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:39.896396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0262a8d4-c683-4d1e-8ea3-e4200e5c6e91 req-1322ed08-32ac-423b-b06c-73fe741b5af9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:39.897066 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-0262a8d4-c683-4d1e-8ea3-e4200e5c6e91 req-1322ed08-32ac-423b-b06c-73fe741b5af9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:39.910162 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-0262a8d4-c683-4d1e-8ea3-e4200e5c6e91 req-1322ed08-32ac-423b-b06c-73fe741b5af9 service nova] Creating event network-vif-deleted:a6aa6a16-79da-4eb9-887d-4f9d0147d1e3 for instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 on n-h2-851337-5 Aug 04 05:24:39.916290 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-0262a8d4-c683-4d1e-8ea3-e4200e5c6e91 req-1322ed08-32ac-423b-b06c-73fe741b5af9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042041 Aug 04 05:24:39.920012 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3457/7029] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:24:40.478277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:40.478917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:40.485971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.486443 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:40.487268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.487731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:40.501766 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] HTTP exception thrown: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Request method failure captured: Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 HTTP/1.1 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61f8L4nipsGbXC52ElINl9GaPHSJHOMg_eo31hsHMdHpj970xLVViw-IXVYy75rYcyUSoDSb00JcMMMMGUoTvfgpERbu2ipl9tqeOZJnJhUu3TneHWhEp-j4jULmz2OgdWyK_KAmsg0FLtIIWNJ3oS6CDu67ycMSmHK6XPZ86xurpx8 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_33ae8d5f27d64d48b670871145c37ca2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f67c706e8b214cafb80d44288f42b453 Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5c1d4fa6-5a02-4997-8116-667ac4b0a7e2'} Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:40.503512 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Returning 404 to user: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb504cff-336f-4625-af34-ce5f9489f098 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 404 len: 111 microversion: 2.1 time: 0.031237 Aug 04 05:24:40.506687 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3573/7030] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:40 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:40.514623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:40.515600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:40.522310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.522761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:40.523548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.523983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:40.658562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:40.666309 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e5d783a4-6b8e-4a35-9e94-1e77a0f59389 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1507 microversion: 2.1 time: 0.155858 Aug 04 05:24:40.666901 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3458/7031] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:40 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:40.686609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37213774-f5ae-4ea6-b4df-fdb03066e461 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:40.688976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-37213774-f5ae-4ea6-b4df-fdb03066e461 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 1e6ae762-acc9-40f4-aa56-2582796405f6] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:40.695045 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-37213774-f5ae-4ea6-b4df-fdb03066e461 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] HTTP exception thrown: Instance 1e6ae762-acc9-40f4-aa56-2582796405f6 could not be found. Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37213774-f5ae-4ea6-b4df-fdb03066e461 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Request method failure captured: Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/1e6ae762-acc9-40f4-aa56-2582796405f6/action HTTP/1.1 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 32 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61f8L4nipsGbXC52ElINl9GaPHSJHOMg_eo31hsHMdHpj970xLVViw-IXVYy75rYcyUSoDSb00JcMMMMGUoTvfgpERbu2ipl9tqeOZJnJhUu3TneHWhEp-j4jULmz2OgdWyK_KAmsg0FLtIIWNJ3oS6CDu67ycMSmHK6XPZ86xurpx8 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_33ae8d5f27d64d48b670871145c37ca2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f67c706e8b214cafb80d44288f42b453 Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: {"resize": {"flavorRef": "452"}} Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 1e6ae762-acc9-40f4-aa56-2582796405f6 could not be found. Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '1e6ae762-acc9-40f4-aa56-2582796405f6', 'body': {'resize': {'flavorRef': '452'}}} Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6ae762-acc9-40f4-aa56-2582796405f6 could not be found. Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:40.696617 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6ae762-acc9-40f4-aa56-2582796405f6 could not be found. Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6ae762-acc9-40f4-aa56-2582796405f6 could not be found. Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-37213774-f5ae-4ea6-b4df-fdb03066e461 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Returning 404 to user: Instance 1e6ae762-acc9-40f4-aa56-2582796405f6 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-37213774-f5ae-4ea6-b4df-fdb03066e461 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "POST /compute/v2.1/servers/1e6ae762-acc9-40f4-aa56-2582796405f6/action" status: 404 len: 111 microversion: 2.1 time: 0.015452 Aug 04 05:24:40.700042 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3574/7032] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:24:40 2022] POST /compute/v2.1/servers/1e6ae762-acc9-40f4-aa56-2582796405f6/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:40.706740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:40.707404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:40.714192 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.714590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:40.715380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.715820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:40.849556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:40.856862 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-84033b2d-2ceb-4bbc-a610-807ac5fa7414 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1507 microversion: 2.1 time: 0.153965 Aug 04 05:24:40.857464 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3459/7033] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:40 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:40.877998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:40.878633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:40.886686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.887193 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:40.887985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:40.888442 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.018758 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:41.026330 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-15ebd8b5-cf6e-47f5-a2bf-49b0451ee409 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1507 microversion: 2.1 time: 0.152289 Aug 04 05:24:41.026894 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3575/7034] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:40 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:41.047153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "266387a6-2433-4ae1-98ca-140377be8aa6"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:41.049406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.056970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.057428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.058202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.058649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.099463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:41.105107 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] HTTP exception thrown: Flavor 266387a6-2433-4ae1-98ca-140377be8aa6 could not be found. Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Request method failure captured: Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: request: POST /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871/action HTTP/1.1 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 65 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61f8L4nipsGbXC52ElINl9GaPHSJHOMg_eo31hsHMdHpj970xLVViw-IXVYy75rYcyUSoDSb00JcMMMMGUoTvfgpERbu2ipl9tqeOZJnJhUu3TneHWhEp-j4jULmz2OgdWyK_KAmsg0FLtIIWNJ3oS6CDu67ycMSmHK6XPZ86xurpx8 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_33ae8d5f27d64d48b670871145c37ca2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f67c706e8b214cafb80d44288f42b453 Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: {"resize": {"flavorRef": "266387a6-2433-4ae1-98ca-140377be8aa6"}} Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: exception: Flavor 266387a6-2433-4ae1-98ca-140377be8aa6 could not be found. Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '2ea0cf4e-00bd-4836-8382-3f00e2ea2871', 'body': {'resize': {'flavorRef': '266387a6-2433-4ae1-98ca-140377be8aa6'}}} Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 05:24:41.116268 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 266387a6-2433-4ae1-98ca-140377be8aa6 could not be found. Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 266387a6-2433-4ae1-98ca-140377be8aa6 could not be found. Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 266387a6-2433-4ae1-98ca-140377be8aa6 could not be found. Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Returning 400 to user: Flavor 266387a6-2433-4ae1-98ca-140377be8aa6 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c665b6b3-5758-463f-af96-8663b315819c tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "POST /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871/action" status: 400 len: 107 microversion: 2.1 time: 0.074795 Aug 04 05:24:41.119374 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3460/7035] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:24:41 2022] POST /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871/action => generated 107 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:24:41.126617 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:41.127281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.134141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.134606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.135416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.135865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.266726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:41.274355 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6e9d3d7f-47e1-47fe-8c79-37f4fe9a3077 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1507 microversion: 2.1 time: 0.151581 Aug 04 05:24:41.274934 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3576/7036] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:41 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:41.295428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:41.296048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.302619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.303133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.303908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.304338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.438080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:41.446067 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e85eed5-3f99-4a27-b133-1883997c34a7 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1507 microversion: 2.1 time: 0.154499 Aug 04 05:24:41.446632 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3461/7037] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:41 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:41.466726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67162f16-a82d-4974-94d2-daf4608f7cbc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67162f16-a82d-4974-94d2-daf4608f7cbc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Request method failure captured: Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: request: POST /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871/action HTTP/1.1 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 29 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61f8L4nipsGbXC52ElINl9GaPHSJHOMg_eo31hsHMdHpj970xLVViw-IXVYy75rYcyUSoDSb00JcMMMMGUoTvfgpERbu2ipl9tqeOZJnJhUu3TneHWhEp-j4jULmz2OgdWyK_KAmsg0FLtIIWNJ3oS6CDu67ycMSmHK6XPZ86xurpx8 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_33ae8d5f27d64d48b670871145c37ca2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f67c706e8b214cafb80d44288f42b453 Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: {"resize": {"flavorRef": ""}} Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '2ea0cf4e-00bd-4836-8382-3f00e2ea2871', 'body': {'resize': {'flavorRef': ''}}} Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise error Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi '' Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.470371 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67162f16-a82d-4974-94d2-daf4608f7cbc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67162f16-a82d-4974-94d2-daf4608f7cbc tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "POST /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871/action" status: 400 len: 113 microversion: 2.1 time: 0.009097 Aug 04 05:24:41.474434 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3577/7038] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:24:41 2022] POST /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:24:41.481912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:41.482518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.488626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.489208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.489964 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.490399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.622265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:41.625828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=100 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:41.630699 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d3401482-5cf2-434c-b57b-3df69502fa8d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1507 microversion: 2.1 time: 0.152560 Aug 04 05:24:41.631310 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3462/7039] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:41 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:41.655331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:41.655849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.663705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.664174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.664975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.665424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.669764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:41.683503 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] HTTP exception thrown: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Request method failure captured: Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 HTTP/1.1 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61f8L4nipsGbXC52ElINl9GaPHSJHOMg_eo31hsHMdHpj970xLVViw-IXVYy75rYcyUSoDSb00JcMMMMGUoTvfgpERbu2ipl9tqeOZJnJhUu3TneHWhEp-j4jULmz2OgdWyK_KAmsg0FLtIIWNJ3oS6CDu67ycMSmHK6XPZ86xurpx8 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_33ae8d5f27d64d48b670871145c37ca2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: f67c706e8b214cafb80d44288f42b453 Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '5c1d4fa6-5a02-4997-8116-667ac4b0a7e2'} Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:41.685058 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Returning 404 to user: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8822044d-98ea-48da-93eb-ac980653d09e tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 404 len: 111 microversion: 2.1 time: 0.035878 Aug 04 05:24:41.688763 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3578/7040] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:24:41 2022] DELETE /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:41.695342 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:41.695958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.701999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.702451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.703240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.703683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.717615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] HTTP exception thrown: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Request method failure captured: Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 HTTP/1.1 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61f8L4nipsGbXC52ElINl9GaPHSJHOMg_eo31hsHMdHpj970xLVViw-IXVYy75rYcyUSoDSb00JcMMMMGUoTvfgpERbu2ipl9tqeOZJnJhUu3TneHWhEp-j4jULmz2OgdWyK_KAmsg0FLtIIWNJ3oS6CDu67ycMSmHK6XPZ86xurpx8 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_33ae8d5f27d64d48b670871145c37ca2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f67c706e8b214cafb80d44288f42b453 Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '5c1d4fa6-5a02-4997-8116-667ac4b0a7e2'} Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:41.719189 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Returning 404 to user: Instance 5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fba3d5e9-35ab-46df-8743-dec6ca8abfdf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2" status: 404 len: 111 microversion: 2.1 time: 0.029421 Aug 04 05:24:41.722701 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3463/7041] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:41 2022] GET /compute/v2.1/servers/5c1d4fa6-5a02-4997-8116-667ac4b0a7e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:24:41.730166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:41.730688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.738149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.738615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.739426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.739951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.766773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:24:41.851027 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7aeb2087-1843-4578-a26f-47b82ab4b0f1 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 204 len: 0 microversion: 2.1 time: 0.124616 Aug 04 05:24:41.851569 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3579/7042] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:24:41 2022] DELETE /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:24:41.862298 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:41.862921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:41.870874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.871578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:41.872827 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:41.873414 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:42.009976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:42.017760 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-69162c22-87a4-4530-9ffe-4b0b19dd7345 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1513 microversion: 2.1 time: 0.161548 Aug 04 05:24:42.018335 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3464/7043] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:41 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:24:43.041403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:43.042161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:43.049144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:43.049613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:43.050403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:43.050857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:43.181643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:43.189369 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-224b5543-dd2b-40e2-94c9-fe4d6cdecbe2 tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1513 microversion: 2.1 time: 0.153153 Aug 04 05:24:43.189954 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3580/7044] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:43 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:43.931904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1437554c-0fb0-4942-9e12-05f1e07c8424 req-3c3a4172-1297-4273-b580-150c88dd5603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea0cf4e-00bd-4836-8382-3f00e2ea2871", "name": "network-vif-deleted", "tag": "d0ff58ef-d737-46ae-b05b-77315d7b321d"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:24:43.945034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1437554c-0fb0-4942-9e12-05f1e07c8424 req-3c3a4172-1297-4273-b580-150c88dd5603 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:43.945480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1437554c-0fb0-4942-9e12-05f1e07c8424 req-3c3a4172-1297-4273-b580-150c88dd5603 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:43.957393 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1437554c-0fb0-4942-9e12-05f1e07c8424 req-3c3a4172-1297-4273-b580-150c88dd5603 service nova] Creating event network-vif-deleted:d0ff58ef-d737-46ae-b05b-77315d7b321d for instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 on n-h1-851337-5 Aug 04 05:24:43.963593 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1437554c-0fb0-4942-9e12-05f1e07c8424 req-3c3a4172-1297-4273-b580-150c88dd5603 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035356 Aug 04 05:24:43.964428 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3465/7045] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:24:44.209661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:44.210298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:44.213161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:44.219266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:44.219741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:44.220536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:44.220994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:44.253146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:44.253652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:44.254138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lazy-loading 'fault' on Instance uuid 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:24:44.295581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c706e8b214cafb80d44288f42b453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae8d5f27d64d48b670871145c37ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:24:44.303693 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-09711555-e60d-4a97-a675-5f637008087d tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 200 len: 1307 microversion: 2.1 time: 0.097925 Aug 04 05:24:44.304538 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3581/7046] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:44 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:24:45.326402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:24:45.327133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] [instance: 2ea0cf4e-00bd-4836-8382-3f00e2ea2871] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:24:45.334023 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:45.334478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:45.335282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:45.335726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:45.349114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] HTTP exception thrown: Instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 could not be found. Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Request method failure captured: Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 HTTP/1.1 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61f8L4nipsGbXC52ElINl9GaPHSJHOMg_eo31hsHMdHpj970xLVViw-IXVYy75rYcyUSoDSb00JcMMMMGUoTvfgpERbu2ipl9tqeOZJnJhUu3TneHWhEp-j4jULmz2OgdWyK_KAmsg0FLtIIWNJ3oS6CDu67ycMSmHK6XPZ86xurpx8 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/33ae8d5f27d64d48b670871145c37ca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_33ae8d5f27d64d48b670871145c37ca2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 33ae8d5f27d64d48b670871145c37ca2 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657477866 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: f67c706e8b214cafb80d44288f42b453 Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-ServersNegativeTestJSON-1657477866-project Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 could not be found. Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '2ea0cf4e-00bd-4836-8382-3f00e2ea2871'} Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 could not be found. Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 could not be found. Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:24:45.350874 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 could not be found. Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] Returning 404 to user: Instance 2ea0cf4e-00bd-4836-8382-3f00e2ea2871 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8cea610-4367-40a1-9d2b-e3101cb1fdcf tempest-ServersNegativeTestJSON-1657477866 tempest-ServersNegativeTestJSON-1657477866-project] 10.222.0.69 "GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871" status: 404 len: 111 microversion: 2.1 time: 0.031189 Aug 04 05:24:45.354382 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3466/7047] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:24:45 2022] GET /compute/v2.1/servers/2ea0cf4e-00bd-4836-8382-3f00e2ea2871 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:19.090499 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:19.091912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:19.275440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae48a412-eecf-4f06-8f00-31bd27f4d1da tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: .version_select at 0x7f191a33e3a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1058392482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4svwY8QLcwUg8wuccaMIoew+ZGPEpl6zR+sZHTASGPnFBV+oxHte1MRiL9nVJ1xvKLAhlBB6/oUv+pf9PRo2Q/RLLQzfWWvH92jrcSQjwfzRo9ximZMIfhstckaHd70g=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:19.292270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ae48a412-eecf-4f06-8f00-31bd27f4d1da tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:19.297774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-ae48a412-eecf-4f06-8f00-31bd27f4d1da tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for user 7d7da6981dc74f87a9489d116c135f97 and project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:19.325176 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae48a412-eecf-4f06-8f00-31bd27f4d1da tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.239946 Aug 04 05:25:19.325798 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3582/7048] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:25:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:19.379476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-942212864", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1058392482", "networks": [{"uuid": "e61ec360-957a-4a4f-bdd3-948db242c8b2"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:19.388466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=39 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:19.389117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:19.443744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] validate_networks() for [('e61ec360-957a-4a4f-bdd3-948db242c8b2', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:25:19.828415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:25:19.828840 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:25:19.829319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:25:19.829727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:25:19.830165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:25:19.839394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:19.839858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:19.840668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:19.841086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:19.859614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:19.865538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for user 7d7da6981dc74f87a9489d116c135f97 and project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:19.878016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:25:19.880920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:25:19.927883 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d0e2762-d2cc-4cea-a7a0-2a0fdc828455 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552283 Aug 04 05:25:19.929157 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3467/7049] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:25:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:25:19.940243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-08e6ed1c-9242-4f05-bc2e-a22bd280ef60 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:19.940984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-08e6ed1c-9242-4f05-bc2e-a22bd280ef60 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:19.995431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-08e6ed1c-9242-4f05-bc2e-a22bd280ef60 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:20.002117 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-08e6ed1c-9242-4f05-bc2e-a22bd280ef60 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1262 microversion: 2.1 time: 0.065752 Aug 04 05:25:20.002697 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3583/7050] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:19 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1262 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:21.027209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:21.030569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:21.045283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.046470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:21.047931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.048716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:21.130995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:21.141652 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2de481fa-107d-45b1-8f45-39272ff930f7 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1322 microversion: 2.1 time: 0.120545 Aug 04 05:25:21.147208 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3468/7051] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:21 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1322 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:22.170877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:22.171599 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:22.180107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:22.180572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.181574 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:22.182192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.372917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:22.383459 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-100f94c8-bd91-4952-982b-2b858b4e2cd5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1362 microversion: 2.1 time: 0.218031 Aug 04 05:25:22.384507 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3584/7052] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:22 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:22.429183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-bdab4495-15cd-446c-98ce-7f79f87dfca9 req-621a2d6f-b78a-4861-a1be-0276d267c281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de155cb-4d01-42b5-9d2b-35b4092fd5d3", "tag": "4148f621-50fc-438f-95de-b25891642b52"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:22.440322 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bdab4495-15cd-446c-98ce-7f79f87dfca9 req-621a2d6f-b78a-4861-a1be-0276d267c281 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:22.441150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bdab4495-15cd-446c-98ce-7f79f87dfca9 req-621a2d6f-b78a-4861-a1be-0276d267c281 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.453944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-bdab4495-15cd-446c-98ce-7f79f87dfca9 req-621a2d6f-b78a-4861-a1be-0276d267c281 service nova] Creating event network-changed:4148f621-50fc-438f-95de-b25891642b52 for instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 on n-h1-851337-5 Aug 04 05:25:22.459211 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-bdab4495-15cd-446c-98ce-7f79f87dfca9 req-621a2d6f-b78a-4861-a1be-0276d267c281 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 Aug 04 05:25:22.460455 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3469/7053] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:23.404699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.405333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:23.412896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.413362 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.414156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.414611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.544677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:23.552539 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-28bfeaed-f3b6-4302-860b-599b77bb5688 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1362 microversion: 2.1 time: 0.151876 Aug 04 05:25:23.553124 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3585/7054] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:24.575362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.576018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:24.584961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.585571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.587858 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.588551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.735035 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:24.743329 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-511cd65f-9626-4c23-a521-c7132b0ef10e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1362 microversion: 2.1 time: 0.173129 Aug 04 05:25:24.743971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3470/7055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:24 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:25.764789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:25.765682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:25.773891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.774356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:25.775242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.775714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:25.923657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:25.931982 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1a98cbd-c48a-4afc-8163-f2d0ad436e9b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1362 microversion: 2.1 time: 0.171025 Aug 04 05:25:25.932569 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3586/7056] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:25 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:26.953937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:26.954556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:26.961574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:26.962027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:26.962807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:26.963274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:27.092269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:27.100412 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-42ee9f16-9053-44fd-a93d-5c753200e06b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1362 microversion: 2.1 time: 0.150628 Aug 04 05:25:27.100990 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3471/7057] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:26 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:28.121085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:28.121727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:28.129642 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:28.130114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:28.130917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:28.131972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:28.240078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-02370773-aaff-4c5e-b81e-4140d72fc1ab req-40989d0c-b189-45da-a40e-20d15cd9b63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de155cb-4d01-42b5-9d2b-35b4092fd5d3", "name": "network-vif-plugged", "status": "completed", "tag": "4148f621-50fc-438f-95de-b25891642b52"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:28.252064 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-02370773-aaff-4c5e-b81e-4140d72fc1ab req-40989d0c-b189-45da-a40e-20d15cd9b63f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:28.252550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-02370773-aaff-4c5e-b81e-4140d72fc1ab req-40989d0c-b189-45da-a40e-20d15cd9b63f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:28.265304 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-02370773-aaff-4c5e-b81e-4140d72fc1ab req-40989d0c-b189-45da-a40e-20d15cd9b63f service nova] Creating event network-vif-plugged:4148f621-50fc-438f-95de-b25891642b52 for instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 on n-h1-851337-5 Aug 04 05:25:28.270540 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-02370773-aaff-4c5e-b81e-4140d72fc1ab req-40989d0c-b189-45da-a40e-20d15cd9b63f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035443 Aug 04 05:25:28.271248 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3472/7058] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:28.277863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:28.287474 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6bf93fe5-6a0d-4135-835a-873a5daeaad0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1362 microversion: 2.1 time: 0.170155 Aug 04 05:25:28.288062 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3587/7059] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:28 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:29.310841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:29.311797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:29.318682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:29.319176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:29.319948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:29.320391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:29.455880 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:29.463259 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73c447ef-bea0-4512-b616-f0b84a47a267 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1362 microversion: 2.1 time: 0.157609 Aug 04 05:25:29.463842 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3473/7060] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:29 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:30.485446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:30.486092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:30.489516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:30.495382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.495851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:30.496643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.497099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:30.630482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:30.638018 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c607edd1-cf0d-4cb6-a918-4e24011df920 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1553 microversion: 2.1 time: 0.156574 Aug 04 05:25:30.638593 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3588/7061] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:30 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:30.658515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:30.659155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:30.661254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:30.662129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:30.669209 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.669662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:30.670443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.670883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:30.798881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:30.806926 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a031ac39-add5-4205-9ea9-7b0efaac64ef tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1553 microversion: 2.1 time: 0.152316 Aug 04 05:25:30.807534 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3474/7062] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:30 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:32.412692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d3aea8ec-462b-4a99-b52b-93ecc06bd742 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "581e2ec7-b4e9-456a-b157-63c741c8e681"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:32.415210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d3aea8ec-462b-4a99-b52b-93ecc06bd742 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:32.422420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3aea8ec-462b-4a99-b52b-93ecc06bd742 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:32.422916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3aea8ec-462b-4a99-b52b-93ecc06bd742 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:32.423938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3aea8ec-462b-4a99-b52b-93ecc06bd742 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:32.424526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d3aea8ec-462b-4a99-b52b-93ecc06bd742 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:32.688525 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d3aea8ec-462b-4a99-b52b-93ecc06bd742 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280139 Aug 04 05:25:32.689146 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3589/7063] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:25:32 2022] POST /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:43.381647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:43.382196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:43.384915 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:43.385685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=36 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:43.392168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.392617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:43.393392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.393823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:43.473829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lazy-loading 'services' on Instance uuid 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:25:43.545759 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8b05eda6-4a36-49fd-9dfe-76295a97a190 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments/581e2ec7-b4e9-456a-b157-63c741c8e681" status: 202 len: 0 microversion: 2.1 time: 0.167663 Aug 04 05:25:43.546367 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3475/7064] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:25:43 2022] DELETE /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments/581e2ec7-b4e9-456a-b157-63c741c8e681 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:25:43.553223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:43.554136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:43.558986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22f56681-e9c8-471e-b5d2-ca634673eb6c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:43.561426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22f56681-e9c8-471e-b5d2-ca634673eb6c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:43.569984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f56681-e9c8-471e-b5d2-ca634673eb6c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.570480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f56681-e9c8-471e-b5d2-ca634673eb6c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:43.571278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f56681-e9c8-471e-b5d2-ca634673eb6c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.571731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22f56681-e9c8-471e-b5d2-ca634673eb6c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:43.604695 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22f56681-e9c8-471e-b5d2-ca634673eb6c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053529 Aug 04 05:25:43.605338 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3590/7065] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:25:43 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:44.621960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82ece478-6745-48d3-871b-099abf19b376 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:44.624371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82ece478-6745-48d3-871b-099abf19b376 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:44.631812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ece478-6745-48d3-871b-099abf19b376 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:44.632269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ece478-6745-48d3-871b-099abf19b376 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:44.633057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ece478-6745-48d3-871b-099abf19b376 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:44.633495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82ece478-6745-48d3-871b-099abf19b376 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:44.666443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82ece478-6745-48d3-871b-099abf19b376 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048588 Aug 04 05:25:44.666777 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3476/7066] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:25:44 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:45.678650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-99a99038-84bd-4a67-b994-5c0566b013ea tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:45.680962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-99a99038-84bd-4a67-b994-5c0566b013ea tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:45.688220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a99038-84bd-4a67-b994-5c0566b013ea tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.688683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a99038-84bd-4a67-b994-5c0566b013ea tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.689482 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a99038-84bd-4a67-b994-5c0566b013ea tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.689933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99a99038-84bd-4a67-b994-5c0566b013ea tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.722064 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-99a99038-84bd-4a67-b994-5c0566b013ea tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047705 Aug 04 05:25:45.722790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3591/7067] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:25:45 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:46.734609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-455cfa22-9b35-4fd4-bc31-4a85b22d6cae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:46.736881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-455cfa22-9b35-4fd4-bc31-4a85b22d6cae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:46.743904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-455cfa22-9b35-4fd4-bc31-4a85b22d6cae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.744309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-455cfa22-9b35-4fd4-bc31-4a85b22d6cae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.745089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-455cfa22-9b35-4fd4-bc31-4a85b22d6cae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.745533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-455cfa22-9b35-4fd4-bc31-4a85b22d6cae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.776653 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-455cfa22-9b35-4fd4-bc31-4a85b22d6cae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Aug 04 05:25:46.776849 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3477/7068] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:25:46 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:47.789289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-505903c1-d3df-46fa-ae84-eb1f2435272a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:47.791520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-505903c1-d3df-46fa-ae84-eb1f2435272a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:47.798429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-505903c1-d3df-46fa-ae84-eb1f2435272a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:47.798893 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-505903c1-d3df-46fa-ae84-eb1f2435272a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:47.799703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-505903c1-d3df-46fa-ae84-eb1f2435272a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:47.800151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-505903c1-d3df-46fa-ae84-eb1f2435272a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:47.829767 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-505903c1-d3df-46fa-ae84-eb1f2435272a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044984 Aug 04 05:25:47.830341 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3592/7069] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:25:47 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:48.843671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7ebd5a33-b70b-4139-9e6c-0b8f97d80dcc tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:48.845852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7ebd5a33-b70b-4139-9e6c-0b8f97d80dcc tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:48.852787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ebd5a33-b70b-4139-9e6c-0b8f97d80dcc tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:48.853245 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ebd5a33-b70b-4139-9e6c-0b8f97d80dcc tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:48.854037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ebd5a33-b70b-4139-9e6c-0b8f97d80dcc tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:48.854464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7ebd5a33-b70b-4139-9e6c-0b8f97d80dcc tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:48.884123 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7ebd5a33-b70b-4139-9e6c-0b8f97d80dcc tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044987 Aug 04 05:25:48.884708 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3478/7070] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:25:48 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 05:25:48.896525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:48.897090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:48.904229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:48.904714 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:48.905485 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:48.905937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:48.984729 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] HTTP exception thrown: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 is not attached to volume 581e2ec7-b4e9-456a-b157-63c741c8e681 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Request method failure captured: Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments/581e2ec7-b4e9-456a-b157-63c741c8e681 HTTP/1.1 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61g5gM52R1_ZzuNNe5eOAjob4ouiSbARZNIrzoEb-quwsORDza124_oCSyfrbmTISRm7scAJDUEKMvSl_VSHOxZsGndD9Ht-LjFoZu_fL3_LQP8TT_JHnZGaVvLDWt3DmgGDZKhOk6vJEy8cWZ4zojIBglmUjbgXREshS5A1Z_VaU3I Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b95aed0ee5f540a6bf9093f4fa763213", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7d7da6981dc74f87a9489d116c135f97 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 is not attached to volume 581e2ec7-b4e9-456a-b157-63c741c8e681 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': '0de155cb-4d01-42b5-9d2b-35b4092fd5d3', 'id': '581e2ec7-b4e9-456a-b157-63c741c8e681'} Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 581e2ec7-b4e9-456a-b157-63c741c8e681. Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 is not attached to volume 581e2ec7-b4e9-456a-b157-63c741c8e681 Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:48.988330 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:48.992210 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:25:48.992210 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:25:48.992210 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 is not attached to volume 581e2ec7-b4e9-456a-b157-63c741c8e681 Aug 04 05:25:48.992210 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:48.992210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Returning 404 to user: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 is not attached to volume 581e2ec7-b4e9-456a-b157-63c741c8e681 {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:25:48.992210 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-823da68c-05ae-4434-89eb-84d3925ba578 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments/581e2ec7-b4e9-456a-b157-63c741c8e681" status: 404 len: 154 microversion: 2.1 time: 0.098047 Aug 04 05:25:48.992210 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3593/7071] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:25:48 2022] DELETE /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3/os-volume_attachments/581e2ec7-b4e9-456a-b157-63c741c8e681 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:52.328602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:52.329129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:52.336464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:52.336917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.337676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:52.338108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.368170 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:25:52.453397 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-57bc8bc5-e02f-433b-995e-8d45e11100a0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 204 len: 0 microversion: 2.1 time: 0.128300 Aug 04 05:25:52.454053 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3479/7072] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:25:52 2022] DELETE /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:25:52.463392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:52.464074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:52.471675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:52.472143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.472939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:52.473397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.612426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:52.620284 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d69be18b-4442-4d9c-abae-70653eeb3168 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1559 microversion: 2.1 time: 0.161094 Aug 04 05:25:52.620864 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3594/7073] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:52 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:53.642994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:53.643723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:53.650862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.651333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.652111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.652552 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.791101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:53.798677 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-138672c8-e04a-4ec9-a13c-1464240e8601 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1559 microversion: 2.1 time: 0.160331 Aug 04 05:25:53.799288 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3480/7074] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:53 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:54.820434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:54.820973 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:54.828177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.828650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.829452 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.829906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.902777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:54.911000 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d0659d1-5adc-4fc1-b33d-c91c377839a6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 200 len: 1517 microversion: 2.1 time: 0.094821 Aug 04 05:25:54.911621 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3595/7075] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:54 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 1517 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:54.984232 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-4c632179-bf09-4009-b3e8-039fde54f436 req-93bd11fb-bd58-458c-b2c0-d43f848fad29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de155cb-4d01-42b5-9d2b-35b4092fd5d3", "name": "network-vif-deleted", "tag": "4148f621-50fc-438f-95de-b25891642b52"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:54.995136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4c632179-bf09-4009-b3e8-039fde54f436 req-93bd11fb-bd58-458c-b2c0-d43f848fad29 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.995610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-4c632179-bf09-4009-b3e8-039fde54f436 req-93bd11fb-bd58-458c-b2c0-d43f848fad29 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.012267 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-4c632179-bf09-4009-b3e8-039fde54f436 req-93bd11fb-bd58-458c-b2c0-d43f848fad29 service nova] Creating event network-vif-deleted:4148f621-50fc-438f-95de-b25891642b52 for instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 on n-h1-851337-5 Aug 04 05:25:55.018667 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-4c632179-bf09-4009-b3e8-039fde54f436 req-93bd11fb-bd58-458c-b2c0-d43f848fad29 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038058 Aug 04 05:25:55.019635 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3481/7076] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:55.938466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:55.939041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: 0de155cb-4d01-42b5-9d2b-35b4092fd5d3] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:55.946683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.947194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.947995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.948453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.961980 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] HTTP exception thrown: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 could not be found. Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Request method failure captured: Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 HTTP/1.1 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61g5gM52R1_ZzuNNe5eOAjob4ouiSbARZNIrzoEb-quwsORDza124_oCSyfrbmTISRm7scAJDUEKMvSl_VSHOxZsGndD9Ht-LjFoZu_fL3_LQP8TT_JHnZGaVvLDWt3DmgGDZKhOk6vJEy8cWZ4zojIBglmUjbgXREshS5A1Z_VaU3I Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b95aed0ee5f540a6bf9093f4fa763213", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7d7da6981dc74f87a9489d116c135f97 Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 could not be found. Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '0de155cb-4d01-42b5-9d2b-35b4092fd5d3'} Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 could not be found. Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 could not be found. Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:55.963575 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 could not be found. Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Returning 404 to user: Instance 0de155cb-4d01-42b5-9d2b-35b4092fd5d3 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-416e4eea-91de-405b-8294-1b9a354b9ede tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3" status: 404 len: 111 microversion: 2.1 time: 0.030575 Aug 04 05:25:55.967583 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3596/7077] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:55 2022] GET /compute/v2.1/servers/0de155cb-4d01-42b5-9d2b-35b4092fd5d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:55.974444 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21e3dfb6-4f25-41be-8df3-46b919ba3808 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '.version_select at 0x7f1918fb2820>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:55.981997 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21e3dfb6-4f25-41be-8df3-46b919ba3808 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [1b3553b0-2080-4552-b69c-cd78772dd193] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:25:56.989699 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [None req-21e3dfb6-4f25-41be-8df3-46b919ba3808 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [1b3553b0-2080-4552-b69c-cd78772dd193] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 60374. Aug 04 05:25:57.012212 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21e3dfb6-4f25-41be-8df3-46b919ba3808 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1058392482" status: 202 len: 0 microversion: 2.1 time: 1.042064 Aug 04 05:25:57.012814 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3482/7078] 10.222.0.69 () {58 vars in 1278 bytes} [Thu Aug 4 05:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1058392482 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:25:57.030768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-24f30cf2-2141-4c53-b046-986519c65435 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: .version_select at 0x7f1919a4d0d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-568488915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8xp51YRVdmtsLg4UKnz8Viwf4AInF33GNwsz171Z4Qim84aVPCJc90NFDXpBufasxyVjfYExX+oPVkLjbXf1u6BC3G3qDlL8QQpBJNfDy2vgyBUi2NtbEMvHNZEcZ43A=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:57.048715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-24f30cf2-2141-4c53-b046-986519c65435 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:57.054720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-24f30cf2-2141-4c53-b046-986519c65435 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for user 7d7da6981dc74f87a9489d116c135f97 and project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:57.078310 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-24f30cf2-2141-4c53-b046-986519c65435 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051390 Aug 04 05:25:57.078928 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3597/7079] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:25:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:57.128549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1577022746", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-568488915", "networks": [{"uuid": "e61ec360-957a-4a4f-bdd3-948db242c8b2"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:57.352959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] validate_networks() for [('e61ec360-957a-4a4f-bdd3-948db242c8b2', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:25:57.726173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:25:57.726594 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:25:57.727129 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:25:57.727540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:25:57.727956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:25:57.736957 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:57.737399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:57.738186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:57.738618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:57.756589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:57.761800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for user 7d7da6981dc74f87a9489d116c135f97 and project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:57.774106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:25:57.776466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:25:57.821274 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad710ed5-b213-42ba-bf4f-90056cb5645e tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696627 Aug 04 05:25:57.821855 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3483/7080] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:25:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:25:57.832615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55f8a772-ec2a-4585-ae72-399b3c81569c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:57.833160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55f8a772-ec2a-4585-ae72-399b3c81569c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:57.988768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-55f8a772-ec2a-4585-ae72-399b3c81569c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:57.996322 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55f8a772-ec2a-4585-ae72-399b3c81569c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1262 microversion: 2.1 time: 0.167730 Aug 04 05:25:57.996903 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3598/7081] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:57 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:59.018433 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:59.019128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:59.027317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.027779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.028586 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.029009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.095536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:59.103802 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-afc1402c-e9b5-4905-bd48-2bfa5f0fa411 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1320 microversion: 2.1 time: 0.090748 Aug 04 05:25:59.104389 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3484/7082] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:59 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1320 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:00.125819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:00.126457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:00.133546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.134015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.134835 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.135302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.202660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-25ef4548-26c8-4298-8937-6d8c4e4a63fc req-ac1208f6-640d-4fb1-967c-82ff1e165357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3975e6e-1027-4e8d-8fc0-002f67cfa44f", "tag": "c4fd42d5-e2f7-4d24-aa10-282673348d05"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:00.218651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-25ef4548-26c8-4298-8937-6d8c4e4a63fc req-ac1208f6-640d-4fb1-967c-82ff1e165357 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.219300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-25ef4548-26c8-4298-8937-6d8c4e4a63fc req-ac1208f6-640d-4fb1-967c-82ff1e165357 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.233258 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-25ef4548-26c8-4298-8937-6d8c4e4a63fc req-ac1208f6-640d-4fb1-967c-82ff1e165357 service nova] Creating event network-changed:c4fd42d5-e2f7-4d24-aa10-282673348d05 for instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f on n-h1-851337-5 Aug 04 05:26:00.241265 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-25ef4548-26c8-4298-8937-6d8c4e4a63fc req-ac1208f6-640d-4fb1-967c-82ff1e165357 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043372 Aug 04 05:26:00.242815 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3485/7083] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:26:00.510094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:00.518081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11324cad-e7c0-42ce-ade3-e7fa97dec00f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1362 microversion: 2.1 time: 0.396555 Aug 04 05:26:00.518671 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3599/7084] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:00 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:01.541813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:01.542580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:01.548884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:01.549336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:01.550106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:01.550545 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:01.684646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:01.692459 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0f11dfc5-51e4-4581-a9c6-0f61aafed7d2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1362 microversion: 2.1 time: 0.156247 Aug 04 05:26:01.693097 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3486/7085] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:01 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:02.713383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:02.714043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:02.721045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:02.721513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:02.722298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:02.722752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:02.856953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:02.864545 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5b46e741-46f5-40d5-aed4-39dd19f26faa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1362 microversion: 2.1 time: 0.155077 Aug 04 05:26:02.865621 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3600/7086] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:02 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:03.885718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:03.886329 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:03.893671 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:03.894123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:03.894889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:03.896588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.027459 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:04.035362 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a3a4e9e-61e8-459a-baca-5005b4a8066b tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1362 microversion: 2.1 time: 0.153418 Aug 04 05:26:04.035933 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3487/7087] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:03 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:05.056270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:05.056829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:05.063946 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:05.064423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:05.065209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:05.065668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:05.200229 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:05.207781 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-198375a3-e500-4529-8b52-170da0396bf6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1362 microversion: 2.1 time: 0.155612 Aug 04 05:26:05.208872 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3601/7088] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:05 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:06.229998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:06.230622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:06.237543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:06.238000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:06.238771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:06.239242 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:06.373877 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:06.382062 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ca9b096b-b77d-44dc-a1cd-6483b1b46ba3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1362 microversion: 2.1 time: 0.156269 Aug 04 05:26:06.382668 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3488/7089] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:06 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:06.421061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-90b93c53-6384-4c72-b37e-39fa38582907 req-9b75a29d-cb0d-460d-863f-6f3fc66db4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3975e6e-1027-4e8d-8fc0-002f67cfa44f", "name": "network-vif-plugged", "status": "completed", "tag": "c4fd42d5-e2f7-4d24-aa10-282673348d05"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:06.432227 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90b93c53-6384-4c72-b37e-39fa38582907 req-9b75a29d-cb0d-460d-863f-6f3fc66db4bd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:06.432696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-90b93c53-6384-4c72-b37e-39fa38582907 req-9b75a29d-cb0d-460d-863f-6f3fc66db4bd service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:06.444325 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-90b93c53-6384-4c72-b37e-39fa38582907 req-9b75a29d-cb0d-460d-863f-6f3fc66db4bd service nova] Creating event network-vif-plugged:c4fd42d5-e2f7-4d24-aa10-282673348d05 for instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f on n-h1-851337-5 Aug 04 05:26:06.449403 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-90b93c53-6384-4c72-b37e-39fa38582907 req-9b75a29d-cb0d-460d-863f-6f3fc66db4bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032110 Aug 04 05:26:06.450013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3602/7090] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:07.403267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:07.403878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:07.410828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:07.411339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:07.412174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:07.412613 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:07.550286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:07.558590 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7101d538-fd79-4fd5-b109-0718668d3457 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1362 microversion: 2.1 time: 0.159216 Aug 04 05:26:07.559184 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3489/7091] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:07 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:08.578296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:08.582404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:08.583187 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:08.590410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:08.590876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:08.591686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:08.592143 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:08.723277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:08.730982 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c7b07da4-527c-4867-92f8-2d034fdde629 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1553 microversion: 2.1 time: 0.154580 Aug 04 05:26:08.731556 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3603/7092] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:08 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:08.751512 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:08.752130 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:08.754077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:08.754739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:08.762073 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:08.762524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:08.763318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:08.763758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:08.894745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:08.902454 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-55c6c555-3aa1-47f0-a41c-fd7b23f20755 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1553 microversion: 2.1 time: 0.154902 Aug 04 05:26:08.903392 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3490/7093] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:08 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:10.398520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b99d97ab-ae00-46f0-bafb-dbb9135aaaca tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "038e0b97-75f2-47ec-a246-58d0e2faa47d"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:10.400927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b99d97ab-ae00-46f0-bafb-dbb9135aaaca tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:10.407855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b99d97ab-ae00-46f0-bafb-dbb9135aaaca tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:10.408322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b99d97ab-ae00-46f0-bafb-dbb9135aaaca tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:10.409102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b99d97ab-ae00-46f0-bafb-dbb9135aaaca tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:10.409548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b99d97ab-ae00-46f0-bafb-dbb9135aaaca tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:10.681744 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b99d97ab-ae00-46f0-bafb-dbb9135aaaca tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287041 Aug 04 05:26:10.682651 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3604/7094] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:26:10 2022] POST /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:21.390225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:21.391042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:21.393842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:21.394639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:21.400838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.401292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:21.402058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.402504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:21.486456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lazy-loading 'services' on Instance uuid f3975e6e-1027-4e8d-8fc0-002f67cfa44f {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:26:21.557936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-71dd62ce-1d6c-4673-8c7a-5a680050af1c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments/038e0b97-75f2-47ec-a246-58d0e2faa47d" status: 202 len: 0 microversion: 2.1 time: 0.171343 Aug 04 05:26:21.558533 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3491/7095] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:26:21 2022] DELETE /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments/038e0b97-75f2-47ec-a246-58d0e2faa47d => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:26:21.565010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:21.565909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:21.570643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-42928831-598b-4f5d-904d-549dc24a47ff tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:21.573133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-42928831-598b-4f5d-904d-549dc24a47ff tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:21.581779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42928831-598b-4f5d-904d-549dc24a47ff tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.582239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42928831-598b-4f5d-904d-549dc24a47ff tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:21.583540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42928831-598b-4f5d-904d-549dc24a47ff tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.583986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42928831-598b-4f5d-904d-549dc24a47ff tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:21.616106 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-42928831-598b-4f5d-904d-549dc24a47ff tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052978 Aug 04 05:26:21.616599 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3605/7096] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:21 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:22.630321 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d29c23f1-9613-410e-951e-a760fc89703f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:22.632770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d29c23f1-9613-410e-951e-a760fc89703f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:22.639224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d29c23f1-9613-410e-951e-a760fc89703f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:22.639735 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d29c23f1-9613-410e-951e-a760fc89703f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:22.640778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d29c23f1-9613-410e-951e-a760fc89703f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:22.641222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d29c23f1-9613-410e-951e-a760fc89703f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:22.675096 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d29c23f1-9613-410e-951e-a760fc89703f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050256 Aug 04 05:26:22.675686 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3492/7097] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:22 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:23.687699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83a73dfe-c718-4596-bb4f-c3623f90cd2f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:23.690033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-83a73dfe-c718-4596-bb4f-c3623f90cd2f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:23.697621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a73dfe-c718-4596-bb4f-c3623f90cd2f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:23.698092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a73dfe-c718-4596-bb4f-c3623f90cd2f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:23.698901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a73dfe-c718-4596-bb4f-c3623f90cd2f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:23.699385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83a73dfe-c718-4596-bb4f-c3623f90cd2f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:23.732558 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83a73dfe-c718-4596-bb4f-c3623f90cd2f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048823 Aug 04 05:26:23.733166 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3606/7098] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:23 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:24.746284 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f5a89dd-121b-4558-9797-225b90dfb709 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:24.748622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f5a89dd-121b-4558-9797-225b90dfb709 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:24.756668 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5a89dd-121b-4558-9797-225b90dfb709 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:24.757044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5a89dd-121b-4558-9797-225b90dfb709 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:24.757822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5a89dd-121b-4558-9797-225b90dfb709 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:24.758254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f5a89dd-121b-4558-9797-225b90dfb709 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:24.792785 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f5a89dd-121b-4558-9797-225b90dfb709 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050983 Aug 04 05:26:24.793397 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3493/7099] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:24 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:25.806236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb288069-055c-4fe6-8403-2787986146f9 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:25.808525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cb288069-055c-4fe6-8403-2787986146f9 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:25.816186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb288069-055c-4fe6-8403-2787986146f9 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:25.816641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb288069-055c-4fe6-8403-2787986146f9 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:25.817949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb288069-055c-4fe6-8403-2787986146f9 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:25.818407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cb288069-055c-4fe6-8403-2787986146f9 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:25.855452 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb288069-055c-4fe6-8403-2787986146f9 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053125 Aug 04 05:26:25.856053 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3607/7100] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:25 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:26.867650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1a8e9b35-de85-467c-b4ac-9178a975cbc3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:26.869807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1a8e9b35-de85-467c-b4ac-9178a975cbc3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:26.876692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8e9b35-de85-467c-b4ac-9178a975cbc3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.877150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8e9b35-de85-467c-b4ac-9178a975cbc3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:26.877928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8e9b35-de85-467c-b4ac-9178a975cbc3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.878373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1a8e9b35-de85-467c-b4ac-9178a975cbc3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:26.908732 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1a8e9b35-de85-467c-b4ac-9178a975cbc3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045343 Aug 04 05:26:26.909298 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3494/7101] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:26 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:26:26.920590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:26.921107 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:26.928096 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.928545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:26.929326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.929776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:27.007909 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] HTTP exception thrown: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f is not attached to volume 038e0b97-75f2-47ec-a246-58d0e2faa47d Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Request method failure captured: Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments/038e0b97-75f2-47ec-a246-58d0e2faa47d HTTP/1.1 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61g5gM52R1_ZzuNNe5eOAjob4ouiSbARZNIrzoEb-quwsORDza124_oCSyfrbmTISRm7scAJDUEKMvSl_VSHOxZsGndD9Ht-LjFoZu_fL3_LQP8TT_JHnZGaVvLDWt3DmgGDZKhOk6vJEy8cWZ4zojIBglmUjbgXREshS5A1Z_VaU3I Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b95aed0ee5f540a6bf9093f4fa763213", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7d7da6981dc74f87a9489d116c135f97 Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f is not attached to volume 038e0b97-75f2-47ec-a246-58d0e2faa47d Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': 'f3975e6e-1027-4e8d-8fc0-002f67cfa44f', 'id': '038e0b97-75f2-47ec-a246-58d0e2faa47d'} Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 038e0b97-75f2-47ec-a246-58d0e2faa47d. Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f is not attached to volume 038e0b97-75f2-47ec-a246-58d0e2faa47d Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:27.009583 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:27.013761 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:26:27.013761 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:26:27.013761 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f is not attached to volume 038e0b97-75f2-47ec-a246-58d0e2faa47d Aug 04 05:26:27.013761 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:27.013761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Returning 404 to user: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f is not attached to volume 038e0b97-75f2-47ec-a246-58d0e2faa47d {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:26:27.013761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-69a47035-b5f4-4f2a-bf31-9b60eb2c0784 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments/038e0b97-75f2-47ec-a246-58d0e2faa47d" status: 404 len: 154 microversion: 2.1 time: 0.094555 Aug 04 05:26:27.013761 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3608/7102] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:26:26 2022] DELETE /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f/os-volume_attachments/038e0b97-75f2-47ec-a246-58d0e2faa47d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:26:30.355568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:30.356182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:30.363608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.364591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:30.365367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.365803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:30.392838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:26:30.474778 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-91b7bdc2-036b-41ae-8542-fb3adde2d8e6 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 204 len: 0 microversion: 2.1 time: 0.122227 Aug 04 05:26:30.475772 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3495/7103] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:26:30 2022] DELETE /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:26:30.483857 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:30.484437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:30.492118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.492590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:30.493382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.493838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:30.637809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:30.646581 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62898993-0187-4bf2-9ebe-d3f8fcc186e0 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1559 microversion: 2.1 time: 0.166475 Aug 04 05:26:30.647459 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3609/7104] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:30 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:31.668439 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:31.669142 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:31.675710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:31.676159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:31.677567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:31.677996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:31.811986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:31.820045 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d2d8c04e-99c5-4e06-b86d-3007e2858b5a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1559 microversion: 2.1 time: 0.156023 Aug 04 05:26:31.820627 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3496/7105] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:31 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:32.682598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8ed6111b-8ac1-40aa-bbb4-65aceaa89373 req-4e7e2d08-9fb4-4342-b18c-8659b5ee4c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3975e6e-1027-4e8d-8fc0-002f67cfa44f", "name": "network-vif-deleted", "tag": "c4fd42d5-e2f7-4d24-aa10-282673348d05"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:32.696683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8ed6111b-8ac1-40aa-bbb4-65aceaa89373 req-4e7e2d08-9fb4-4342-b18c-8659b5ee4c81 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.697148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8ed6111b-8ac1-40aa-bbb4-65aceaa89373 req-4e7e2d08-9fb4-4342-b18c-8659b5ee4c81 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.709797 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8ed6111b-8ac1-40aa-bbb4-65aceaa89373 req-4e7e2d08-9fb4-4342-b18c-8659b5ee4c81 service nova] Creating event network-vif-deleted:c4fd42d5-e2f7-4d24-aa10-282673348d05 for instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f on n-h1-851337-5 Aug 04 05:26:32.715779 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8ed6111b-8ac1-40aa-bbb4-65aceaa89373 req-4e7e2d08-9fb4-4342-b18c-8659b5ee4c81 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037257 Aug 04 05:26:32.716382 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3610/7106] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:32.842645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:32.843372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:32.851244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.851780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.852626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.853069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.885417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.885777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.886240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lazy-loading 'fault' on Instance uuid f3975e6e-1027-4e8d-8fc0-002f67cfa44f {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:26:32.932658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:32.940421 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4da9ba02-091e-4901-af73-0fab5f59433a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 200 len: 1352 microversion: 2.1 time: 0.101655 Aug 04 05:26:32.941003 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3497/7107] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:32 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:33.962341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:33.963038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: f3975e6e-1027-4e8d-8fc0-002f67cfa44f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:33.970207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:33.970672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:33.971496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:33.971951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:33.985709 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] HTTP exception thrown: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f could not be found. Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Request method failure captured: Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f HTTP/1.1 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61g5gM52R1_ZzuNNe5eOAjob4ouiSbARZNIrzoEb-quwsORDza124_oCSyfrbmTISRm7scAJDUEKMvSl_VSHOxZsGndD9Ht-LjFoZu_fL3_LQP8TT_JHnZGaVvLDWt3DmgGDZKhOk6vJEy8cWZ4zojIBglmUjbgXREshS5A1Z_VaU3I Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b95aed0ee5f540a6bf9093f4fa763213", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7d7da6981dc74f87a9489d116c135f97 Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f could not be found. Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'f3975e6e-1027-4e8d-8fc0-002f67cfa44f'} Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f could not be found. Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f could not be found. Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:33.987460 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f could not be found. Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Returning 404 to user: Instance f3975e6e-1027-4e8d-8fc0-002f67cfa44f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3d8e0949-5ce3-4cd8-ba1b-30eb02b15ed1 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f" status: 404 len: 111 microversion: 2.1 time: 0.030939 Aug 04 05:26:33.992207 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3611/7108] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:33 2022] GET /compute/v2.1/servers/f3975e6e-1027-4e8d-8fc0-002f67cfa44f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:26:33.998282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3058bccb-0228-47b6-a423-a0b26e5fea96 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '.version_select at 0x7f191a3fde50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:34.018101 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3058bccb-0228-47b6-a423-a0b26e5fea96 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-568488915" status: 202 len: 0 microversion: 2.1 time: 0.023594 Aug 04 05:26:34.018675 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3498/7109] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Aug 4 05:26:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-568488915 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:26:34.036202 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cfbf7c41-b8a9-4017-8867-0d76b26388fa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: .version_select at 0x7f191a6a0ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1823217606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCVGFZ6FOeSEhtUwExipqyWyhYp7wltfQMrCLw1wtLXwRv9Q4aBBIuVacn3FaQN9B50u0uJ3dMYx8k/5kiU/N2Cg2lAu29USol5AZbdORWPL8lUrxKf9ppRhERzOh4jYQ=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:34.052425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cfbf7c41-b8a9-4017-8867-0d76b26388fa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:26:34.058402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cfbf7c41-b8a9-4017-8867-0d76b26388fa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for user 7d7da6981dc74f87a9489d116c135f97 and project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:26:34.081649 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cfbf7c41-b8a9-4017-8867-0d76b26388fa tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049742 Aug 04 05:26:34.085911 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3612/7110] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:26:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:26:34.134104 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-275613351", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1823217606", "networks": [{"uuid": "e61ec360-957a-4a4f-bdd3-948db242c8b2"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:34.187472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] validate_networks() for [('e61ec360-957a-4a4f-bdd3-948db242c8b2', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:26:34.565002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:26:34.565440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:26:34.565958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:26:34.566375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:26:34.567326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:26:34.576173 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:34.576624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:34.577429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:34.577867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:34.594941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:26:34.600206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Getting quotas for user 7d7da6981dc74f87a9489d116c135f97 and project b95aed0ee5f540a6bf9093f4fa763213. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:26:34.612442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:26:34.614713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:26:34.665278 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fde4c13d-e108-4140-85e3-1120e57a7f1d tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534986 Aug 04 05:26:34.665994 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3499/7111] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:26:34.677934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e1f57ca4-0269-4f0b-a92c-34ea12444a0a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:34.678444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e1f57ca4-0269-4f0b-a92c-34ea12444a0a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:34.733535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e1f57ca4-0269-4f0b-a92c-34ea12444a0a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:34.740632 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e1f57ca4-0269-4f0b-a92c-34ea12444a0a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1262 microversion: 2.1 time: 0.066954 Aug 04 05:26:34.741221 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3613/7112] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:34 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:35.763578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:35.764199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:35.771108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:35.771662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:35.772530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:35.773075 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:35.838457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:35.846250 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7614e91a-a182-4c90-a2d5-0602951a6f31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1320 microversion: 2.1 time: 0.088379 Aug 04 05:26:35.846835 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3500/7113] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:35 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1320 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:36.868176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:36.868868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:36.876296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:36.876763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:36.877569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:36.878053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:36.951924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1cd33802-8aa2-4f22-ad0e-3765f3221063 req-5c602e41-4ed8-41c2-bdc9-aea6240ee5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c0ae38-489d-4b00-aca1-23b886ad5bee", "tag": "0c1e4f95-bbb1-4de7-b5c4-640dd82cdd90"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:36.965241 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1cd33802-8aa2-4f22-ad0e-3765f3221063 req-5c602e41-4ed8-41c2-bdc9-aea6240ee5d8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:36.965933 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1cd33802-8aa2-4f22-ad0e-3765f3221063 req-5c602e41-4ed8-41c2-bdc9-aea6240ee5d8 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:36.980371 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1cd33802-8aa2-4f22-ad0e-3765f3221063 req-5c602e41-4ed8-41c2-bdc9-aea6240ee5d8 service nova] Creating event network-changed:0c1e4f95-bbb1-4de7-b5c4-640dd82cdd90 for instance b2c0ae38-489d-4b00-aca1-23b886ad5bee on n-h1-851337-5 Aug 04 05:26:36.985272 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1cd33802-8aa2-4f22-ad0e-3765f3221063 req-5c602e41-4ed8-41c2-bdc9-aea6240ee5d8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037414 Aug 04 05:26:36.986036 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3501/7114] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:37.028715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:37.037998 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9be8894-ee80-4feb-874a-c27961889417 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1362 microversion: 2.1 time: 0.174343 Aug 04 05:26:37.039127 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3614/7115] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:36 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:38.063100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:38.063726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:38.070763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:38.071254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:38.072021 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:38.072462 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:38.206574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:38.214789 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d4e6738a-b4e0-44db-9c3d-d7790718ec27 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1362 microversion: 2.1 time: 0.157117 Aug 04 05:26:38.215403 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3502/7116] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:38 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:39.236279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:39.236962 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:39.244918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:39.245387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:39.246184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:39.246647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:39.380267 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:39.388997 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-58ae793f-f83d-4a0f-b9c8-947af02f49ec tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1362 microversion: 2.1 time: 0.156261 Aug 04 05:26:39.390172 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3615/7117] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:39 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:40.415345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:40.415974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:40.422875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:40.423356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:40.424133 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:40.424569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:40.559297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:40.568047 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5b1a9fc0-8e65-4493-acc6-33571703ffa2 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1362 microversion: 2.1 time: 0.156538 Aug 04 05:26:40.569366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3503/7118] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:40 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:41.591346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:41.591987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:41.599253 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:41.599721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:41.600512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:41.600966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:41.750005 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:41.758271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01945ae7-312e-4978-b61f-b8a4ac4cec55 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1362 microversion: 2.1 time: 0.170841 Aug 04 05:26:41.758853 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3616/7119] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:41 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:42.736233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5eea4990-4434-4423-905a-1ac87dbbf39a req-0fb2a206-9095-41c6-893f-2f60e73649f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c0ae38-489d-4b00-aca1-23b886ad5bee", "name": "network-vif-plugged", "status": "completed", "tag": "0c1e4f95-bbb1-4de7-b5c4-640dd82cdd90"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:42.746215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5eea4990-4434-4423-905a-1ac87dbbf39a req-0fb2a206-9095-41c6-893f-2f60e73649f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:42.746647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5eea4990-4434-4423-905a-1ac87dbbf39a req-0fb2a206-9095-41c6-893f-2f60e73649f5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:42.758369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5eea4990-4434-4423-905a-1ac87dbbf39a req-0fb2a206-9095-41c6-893f-2f60e73649f5 service nova] Creating event network-vif-plugged:0c1e4f95-bbb1-4de7-b5c4-640dd82cdd90 for instance b2c0ae38-489d-4b00-aca1-23b886ad5bee on n-h1-851337-5 Aug 04 05:26:42.763161 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5eea4990-4434-4423-905a-1ac87dbbf39a req-0fb2a206-9095-41c6-893f-2f60e73649f5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094710 Aug 04 05:26:42.763768 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3504/7120] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:42.779294 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:42.779988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:42.787370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:42.787798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:42.788586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:42.789035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:42.932887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:42.941245 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17f7d9fe-f2d1-48e7-8930-25bcba6b2b18 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1362 microversion: 2.1 time: 0.165297 Aug 04 05:26:42.941853 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3617/7121] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:42 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:43.963864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:43.964493 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:43.970780 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:43.971264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:43.972039 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:43.972480 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:44.104338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:44.112093 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48e27f32-2024-49f3-8293-bf212b67c62a tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1362 microversion: 2.1 time: 0.154049 Aug 04 05:26:44.112713 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3505/7122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:43 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:45.138045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:45.138677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:45.141864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:45.147980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.148440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:45.149223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.149672 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:45.279823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:45.287406 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b1a28934-ee47-42cb-b185-60662546a1f3 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1553 microversion: 2.1 time: 0.153321 Aug 04 05:26:45.287981 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3618/7123] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:45 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:45.307340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:45.307891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:45.309870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:45.310530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:45.317316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.317765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:45.319099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.319543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:45.457991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:45.465453 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bd49e182-922b-4d6f-a9c7-dbddd10b8650 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1553 microversion: 2.1 time: 0.162064 Aug 04 05:26:45.466059 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3506/7124] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:45 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:46.958283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-880c0b41-a213-4767-a063-5a1ab621e4dd tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "865ce6c4-d431-444b-91ea-0f740e4ab2e3"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:46.961119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-880c0b41-a213-4767-a063-5a1ab621e4dd tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:46.967295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-880c0b41-a213-4767-a063-5a1ab621e4dd tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:46.967761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-880c0b41-a213-4767-a063-5a1ab621e4dd tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:46.968549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-880c0b41-a213-4767-a063-5a1ab621e4dd tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:46.969008 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-880c0b41-a213-4767-a063-5a1ab621e4dd tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:47.218913 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-880c0b41-a213-4767-a063-5a1ab621e4dd tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "POST /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265176 Aug 04 05:26:47.219564 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3619/7125] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:26:46 2022] POST /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:57.921105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:57.921645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:57.923912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:57.924719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:57.931358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:57.931813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:57.932638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:57.933061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:58.015203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lazy-loading 'services' on Instance uuid b2c0ae38-489d-4b00-aca1-23b886ad5bee {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:26:58.087236 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-31075691-069b-4fc4-8e38-46c2c5701c31 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments/865ce6c4-d431-444b-91ea-0f740e4ab2e3" status: 202 len: 0 microversion: 2.1 time: 0.172329 Aug 04 05:26:58.087989 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3507/7126] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:26:57 2022] DELETE /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments/865ce6c4-d431-444b-91ea-0f740e4ab2e3 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:26:58.094217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:58.095039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:58.099378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6232e336-b1e2-4565-99eb-6d5468293320 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:58.101778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6232e336-b1e2-4565-99eb-6d5468293320 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:58.115487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6232e336-b1e2-4565-99eb-6d5468293320 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:58.115943 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6232e336-b1e2-4565-99eb-6d5468293320 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:58.116744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6232e336-b1e2-4565-99eb-6d5468293320 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:58.117198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6232e336-b1e2-4565-99eb-6d5468293320 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:58.152727 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6232e336-b1e2-4565-99eb-6d5468293320 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060091 Aug 04 05:26:58.153381 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3620/7127] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:58 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:59.167090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-037ec66e-2c2b-45be-b56b-22a4aa7a7f36 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:59.169623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-037ec66e-2c2b-45be-b56b-22a4aa7a7f36 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:59.176225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-037ec66e-2c2b-45be-b56b-22a4aa7a7f36 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:59.176682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-037ec66e-2c2b-45be-b56b-22a4aa7a7f36 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:59.178072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-037ec66e-2c2b-45be-b56b-22a4aa7a7f36 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:59.178515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-037ec66e-2c2b-45be-b56b-22a4aa7a7f36 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:59.208567 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-037ec66e-2c2b-45be-b56b-22a4aa7a7f36 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046722 Aug 04 05:26:59.209405 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3508/7128] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:59 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:00.221077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6b6d371d-f576-408a-b518-4303170c3eee tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:00.223399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6b6d371d-f576-408a-b518-4303170c3eee tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:00.230810 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b6d371d-f576-408a-b518-4303170c3eee tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:00.231409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b6d371d-f576-408a-b518-4303170c3eee tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:00.232215 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b6d371d-f576-408a-b518-4303170c3eee tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:00.232670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6b6d371d-f576-408a-b518-4303170c3eee tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:00.268404 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6b6d371d-f576-408a-b518-4303170c3eee tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051322 Aug 04 05:27:00.269022 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3621/7129] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:27:00 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:01.281311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-546bf01e-b5a5-4a01-a775-aa9e7cd65f13 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:01.283585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-546bf01e-b5a5-4a01-a775-aa9e7cd65f13 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:01.290207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-546bf01e-b5a5-4a01-a775-aa9e7cd65f13 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:01.290662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-546bf01e-b5a5-4a01-a775-aa9e7cd65f13 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:01.291469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-546bf01e-b5a5-4a01-a775-aa9e7cd65f13 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:01.291913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-546bf01e-b5a5-4a01-a775-aa9e7cd65f13 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:01.322647 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-546bf01e-b5a5-4a01-a775-aa9e7cd65f13 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Aug 04 05:27:01.323174 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3509/7130] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:27:01 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:02.335400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a3956fa9-53bb-48ba-a675-e6b339d9e3c5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:02.337588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a3956fa9-53bb-48ba-a675-e6b339d9e3c5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:02.344950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3956fa9-53bb-48ba-a675-e6b339d9e3c5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:02.345427 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3956fa9-53bb-48ba-a675-e6b339d9e3c5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:02.346219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3956fa9-53bb-48ba-a675-e6b339d9e3c5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:02.346677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3956fa9-53bb-48ba-a675-e6b339d9e3c5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:02.376093 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a3956fa9-53bb-48ba-a675-e6b339d9e3c5 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Aug 04 05:27:02.376672 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3622/7131] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:27:02 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:03.389067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cfdf3688-7af7-41db-8ce0-683ff22ae4eb tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:03.391715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cfdf3688-7af7-41db-8ce0-683ff22ae4eb tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:03.398601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfdf3688-7af7-41db-8ce0-683ff22ae4eb tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:03.399099 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfdf3688-7af7-41db-8ce0-683ff22ae4eb tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:03.399872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfdf3688-7af7-41db-8ce0-683ff22ae4eb tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:03.400317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cfdf3688-7af7-41db-8ce0-683ff22ae4eb tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:03.435645 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cfdf3688-7af7-41db-8ce0-683ff22ae4eb tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050587 Aug 04 05:27:03.436247 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3510/7132] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:27:03 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:27:03.449103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:03.449941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:03.457399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:03.457863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:03.458680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:03.459163 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:03.539782 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] HTTP exception thrown: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee is not attached to volume 865ce6c4-d431-444b-91ea-0f740e4ab2e3 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Request method failure captured: Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments/865ce6c4-d431-444b-91ea-0f740e4ab2e3 HTTP/1.1 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61g5gM52R1_ZzuNNe5eOAjob4ouiSbARZNIrzoEb-quwsORDza124_oCSyfrbmTISRm7scAJDUEKMvSl_VSHOxZsGndD9Ht-LjFoZu_fL3_LQP8TT_JHnZGaVvLDWt3DmgGDZKhOk6vJEy8cWZ4zojIBglmUjbgXREshS5A1Z_VaU3I Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b95aed0ee5f540a6bf9093f4fa763213", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7d7da6981dc74f87a9489d116c135f97 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee is not attached to volume 865ce6c4-d431-444b-91ea-0f740e4ab2e3 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': 'b2c0ae38-489d-4b00-aca1-23b886ad5bee', 'id': '865ce6c4-d431-444b-91ea-0f740e4ab2e3'} Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 865ce6c4-d431-444b-91ea-0f740e4ab2e3. Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee is not attached to volume 865ce6c4-d431-444b-91ea-0f740e4ab2e3 Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:03.541585 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:03.545647 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:27:03.545647 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:27:03.545647 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee is not attached to volume 865ce6c4-d431-444b-91ea-0f740e4ab2e3 Aug 04 05:27:03.545647 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:03.545647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Returning 404 to user: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee is not attached to volume 865ce6c4-d431-444b-91ea-0f740e4ab2e3 {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:27:03.545647 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-26ceef17-abf9-4a8f-be0e-01decadf2912 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments/865ce6c4-d431-444b-91ea-0f740e4ab2e3" status: 404 len: 154 microversion: 2.1 time: 0.099324 Aug 04 05:27:03.545647 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3623/7133] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:27:03 2022] DELETE /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee/os-volume_attachments/865ce6c4-d431-444b-91ea-0f740e4ab2e3 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:27:06.886487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:06.887043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:06.894609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:06.895110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:06.896381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:06.896814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:06.925258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:27:07.005765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5a51ddaf-1e29-49cd-9c98-96a4ffd76866 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 204 len: 0 microversion: 2.1 time: 0.122982 Aug 04 05:27:07.006364 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3511/7134] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:27:06 2022] DELETE /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:27:07.015540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:07.016759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:07.025280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:07.025837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:07.026727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:07.027276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:07.163268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:07.171646 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fcba14a0-7d58-43c1-8fac-a50317509c57 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1559 microversion: 2.1 time: 0.160704 Aug 04 05:27:07.172439 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3624/7135] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:07 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:08.194401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:08.195198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:08.202218 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:08.202673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:08.203484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:08.203921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:08.343301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:08.351886 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4bef6f44-575e-4925-8a64-dfce6e2e885c tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1559 microversion: 2.1 time: 0.161719 Aug 04 05:27:08.352476 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3512/7136] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:08 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:09.177793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-9577411f-e75c-44e5-800b-80aff16ae321 req-79825e0a-6a0e-461b-97bf-9b4c4ab4a709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c0ae38-489d-4b00-aca1-23b886ad5bee", "name": "network-vif-deleted", "tag": "0c1e4f95-bbb1-4de7-b5c4-640dd82cdd90"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:09.195480 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9577411f-e75c-44e5-800b-80aff16ae321 req-79825e0a-6a0e-461b-97bf-9b4c4ab4a709 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:09.196641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-9577411f-e75c-44e5-800b-80aff16ae321 req-79825e0a-6a0e-461b-97bf-9b4c4ab4a709 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:09.211514 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-9577411f-e75c-44e5-800b-80aff16ae321 req-79825e0a-6a0e-461b-97bf-9b4c4ab4a709 service nova] Creating event network-vif-deleted:0c1e4f95-bbb1-4de7-b5c4-640dd82cdd90 for instance b2c0ae38-489d-4b00-aca1-23b886ad5bee on n-h1-851337-5 Aug 04 05:27:09.218123 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-9577411f-e75c-44e5-800b-80aff16ae321 req-79825e0a-6a0e-461b-97bf-9b4c4ab4a709 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044955 Aug 04 05:27:09.219095 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3625/7137] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:09.373449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:09.373969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:09.381559 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:09.382011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:09.382784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:09.383265 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:09.415257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:09.415719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:09.416180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lazy-loading 'fault' on Instance uuid b2c0ae38-489d-4b00-aca1-23b886ad5bee {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:27:09.457555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7da6981dc74f87a9489d116c135f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95aed0ee5f540a6bf9093f4fa763213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:09.465592 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c4d3e2cc-f47c-4225-9c43-b1eadfa7618f tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 200 len: 1352 microversion: 2.1 time: 0.096100 Aug 04 05:27:09.465959 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3513/7138] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:09 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:10.486841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:10.487596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] [instance: b2c0ae38-489d-4b00-aca1-23b886ad5bee] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:10.494769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:10.495259 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:10.496044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:10.496497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:10.510090 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] HTTP exception thrown: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee could not be found. Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Request method failure captured: Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee HTTP/1.1 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61g5gM52R1_ZzuNNe5eOAjob4ouiSbARZNIrzoEb-quwsORDza124_oCSyfrbmTISRm7scAJDUEKMvSl_VSHOxZsGndD9Ht-LjFoZu_fL3_LQP8TT_JHnZGaVvLDWt3DmgGDZKhOk6vJEy8cWZ4zojIBglmUjbgXREshS5A1Z_VaU3I Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b95aed0ee5f540a6bf9093f4fa763213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b95aed0ee5f540a6bf9093f4fa763213", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b95aed0ee5f540a6bf9093f4fa763213 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-433676994 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 7d7da6981dc74f87a9489d116c135f97 Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestEncryptedCinderVolumes-433676994-project Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee could not be found. Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'b2c0ae38-489d-4b00-aca1-23b886ad5bee'} Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee could not be found. Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee could not be found. Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:10.511731 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee could not be found. Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Returning 404 to user: Instance b2c0ae38-489d-4b00-aca1-23b886ad5bee could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0536339-7f2c-45a9-b6a5-c3c0a2849dae tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee" status: 404 len: 111 microversion: 2.1 time: 0.030619 Aug 04 05:27:10.516102 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3626/7139] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:10 2022] GET /compute/v2.1/servers/b2c0ae38-489d-4b00-aca1-23b886ad5bee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:27:10.522652 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b8964e4b-f938-46cf-ba6f-4776ff034909 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] Calling method '.version_select at 0x7f1918c42af0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:10.542532 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b8964e4b-f938-46cf-ba6f-4776ff034909 tempest-TestEncryptedCinderVolumes-433676994 tempest-TestEncryptedCinderVolumes-433676994-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1823217606" status: 202 len: 0 microversion: 2.1 time: 0.024272 Aug 04 05:27:10.543157 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3514/7140] 10.222.0.69 () {58 vars in 1278 bytes} [Thu Aug 4 05:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1823217606 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:27:38.185854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-fe1d54ac-44bb-4859-baf9-b4529d2afe2f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'create', calling method: .version_select at 0x7f191a1873a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz4RsNXIHGfJuNmCzhj4M0mYXYZl4F7L+fcFhlbZX0GQim9P5OLpb1kX8kuLMN6N4/t3QU5cGIMboSbrtr6ZQmz/QDCRn6hlBP0iG1NFNwFXzWDEALQSEcssGcqu6IMEA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:38.192263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:38.192928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=34 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:38.204342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-fe1d54ac-44bb-4859-baf9-b4529d2afe2f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for project b898fb6967104b21940a66008b7a150a. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:38.210080 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-fe1d54ac-44bb-4859-baf9-b4529d2afe2f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for user 80b8b646e8e64a078d45b2803d6c780b and project b898fb6967104b21940a66008b7a150a. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:38.232955 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-fe1d54ac-44bb-4859-baf9-b4529d2afe2f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.050973 Aug 04 05:27:38.233551 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3627/7141] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:27:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:38.285948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:38.286704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:38.291144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1546807570", "imageRef": "bc6f27fd-89f9-431b-91d5-2bcaf26ecc41", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1373", "networks": [{"uuid": "4bef3201-7c27-4585-98dc-83de593cd520"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:38.344960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] validate_networks() for [('4bef3201-7c27-4585-98dc-83de593cd520', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:27:38.727374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:27:38.727817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:27:38.728274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:27:38.728710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:27:38.729152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:27:38.738116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.739196 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.739990 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.740423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.756807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for project b898fb6967104b21940a66008b7a150a. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:38.761981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for user 80b8b646e8e64a078d45b2803d6c780b and project b898fb6967104b21940a66008b7a150a. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:38.774316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:27:38.776515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc6f27fd-89f9-431b-91d5-2bcaf26ecc41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:27:38.820760 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bfc19400-c37c-47ab-924d-96019e449808 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536939 Aug 04 05:27:38.821415 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3515/7142] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:27:38.832597 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-23adfab7-d2cd-4324-a627-20232db47ef4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:38.833469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-23adfab7-d2cd-4324-a627-20232db47ef4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:38.891698 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-23adfab7-d2cd-4324-a627-20232db47ef4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:38.898666 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-23adfab7-d2cd-4324-a627-20232db47ef4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1253 microversion: 2.1 time: 0.070318 Aug 04 05:27:38.899297 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3628/7143] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:38 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1253 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:39.924773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:39.925398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:39.932979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.933430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:39.934226 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.934656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:40.039388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:40.048419 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1387ab31-cb4b-4a20-8708-46d7305319d1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1323 microversion: 2.1 time: 0.128281 Aug 04 05:27:40.049548 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3516/7144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:39 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1323 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:41.072953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:41.073509 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:41.081844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.082553 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.083417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.084183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.236680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:41.245562 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-be6d9255-ba98-4ce7-a258-31f68087a033 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.176252 Aug 04 05:27:41.246261 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3629/7145] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:41 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:42.268359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:42.268970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:42.275511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.275886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.276655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.277089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.429718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:42.444720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-20563025-ad49-4da3-9aff-eb190f137750 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.180599 Aug 04 05:27:42.446614 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3517/7146] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:42 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:43.466413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:43.467038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:43.474868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.475356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.476323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.476848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.623926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:43.631927 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-edfaa996-b376-425f-9977-13f6e2df0eab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.169419 Aug 04 05:27:43.632621 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3630/7147] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:43 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:44.654181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:44.654896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:44.662872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.663384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:44.664135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.664602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:44.815216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:44.820360 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e11194a1-4137-48ec-90c8-dbdc57399614 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.170172 Aug 04 05:27:44.828173 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3518/7148] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:44 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:45.844803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:45.845438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:45.854149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:45.854613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:45.855438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:45.855921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:46.007821 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:46.026974 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d59f8a39-59b9-4677-8d87-09afb1a1d4b1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.174339 Aug 04 05:27:46.026974 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3631/7149] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:45 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:47.043122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:47.044453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:47.054286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:47.054746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:47.055582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:47.056026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:47.200013 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:47.208279 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-675ef5f7-2012-459b-8e96-71cb48aa9e46 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.171471 Aug 04 05:27:47.209108 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3519/7150] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:47 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:48.228819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:48.229444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:48.236643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:48.237106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:48.237876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:48.238818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:48.380907 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:48.388621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-510a8ce6-3148-42fa-af1a-078362178f66 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.163636 Aug 04 05:27:48.389206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3632/7151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:48 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:48.980965 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:48.981801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:49.108206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-516ad084-afbc-4984-8303-85f1ce5a434f req-8d8ab3fb-ae1a-480b-81dc-d3d078c5c7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe58ee8c-8c54-414f-8282-a19f36ced54f", "tag": "7ea5d749-b630-4787-9685-0912ac136f94"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:49.118527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-516ad084-afbc-4984-8303-85f1ce5a434f req-8d8ab3fb-ae1a-480b-81dc-d3d078c5c7e5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:49.119107 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-516ad084-afbc-4984-8303-85f1ce5a434f req-8d8ab3fb-ae1a-480b-81dc-d3d078c5c7e5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:49.133801 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-516ad084-afbc-4984-8303-85f1ce5a434f req-8d8ab3fb-ae1a-480b-81dc-d3d078c5c7e5 service nova] Creating event network-changed:7ea5d749-b630-4787-9685-0912ac136f94 for instance fe58ee8c-8c54-414f-8282-a19f36ced54f on n-h2-851337-5 Aug 04 05:27:49.138779 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-516ad084-afbc-4984-8303-85f1ce5a434f req-8d8ab3fb-ae1a-480b-81dc-d3d078c5c7e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163639 Aug 04 05:27:49.139438 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3520/7152] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:49.406769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:49.414408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:49.415066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:49.421844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:49.422382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:49.423226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:49.423988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:49.559725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:49.568008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-340afdb7-086f-4641-9e81-28a057912378 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.162142 Aug 04 05:27:49.568594 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3633/7153] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:49 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:50.593746 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:50.594435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:50.601200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:50.601650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:50.602412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:50.602843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:50.762028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:50.770582 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ae7b91e-0a78-4c7e-b504-6e40d6bb7e03 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.181916 Aug 04 05:27:50.771192 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3521/7154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:50 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:51.793995 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:51.794827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:51.802866 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:51.803373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:51.804562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:51.805390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:51.948136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:51.955685 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-adac8c30-1453-4e64-9b37-037a769f10e2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.167288 Aug 04 05:27:51.956265 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3634/7155] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:51 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:52.977491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:52.978115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:52.985251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:52.985714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:52.986489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:52.986927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:53.125952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:53.134183 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aba073ff-c69d-40cd-852c-d6c5a407ca05 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.160456 Aug 04 05:27:53.134771 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3522/7156] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:52 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:54.155475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:54.156048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:54.162917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:54.163410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:54.164185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:54.164632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:54.293403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:54.301685 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8f08dfd-78ca-4c3f-8990-651cb06216b6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.150201 Aug 04 05:27:54.302275 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3635/7157] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:54 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:54.653403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-27533924-1ff7-44c2-b2f5-620b0f606675 req-25f66ec5-9938-443a-8d36-a310493d8200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe58ee8c-8c54-414f-8282-a19f36ced54f", "name": "network-vif-plugged", "status": "completed", "tag": "7ea5d749-b630-4787-9685-0912ac136f94"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:54.663969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-27533924-1ff7-44c2-b2f5-620b0f606675 req-25f66ec5-9938-443a-8d36-a310493d8200 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:54.664385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-27533924-1ff7-44c2-b2f5-620b0f606675 req-25f66ec5-9938-443a-8d36-a310493d8200 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:54.676578 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-27533924-1ff7-44c2-b2f5-620b0f606675 req-25f66ec5-9938-443a-8d36-a310493d8200 service nova] Creating event network-vif-plugged:7ea5d749-b630-4787-9685-0912ac136f94 for instance fe58ee8c-8c54-414f-8282-a19f36ced54f on n-h2-851337-5 Aug 04 05:27:54.681475 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-27533924-1ff7-44c2-b2f5-620b0f606675 req-25f66ec5-9938-443a-8d36-a310493d8200 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035474 Aug 04 05:27:54.682290 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3523/7158] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:55.322972 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:55.323624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:55.330558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:55.331054 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:55.331919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:55.332375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:55.465607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:55.473678 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e51e1a4b-01a0-446f-a0b4-a9ff062291c2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1353 microversion: 2.1 time: 0.154630 Aug 04 05:27:55.474257 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3636/7159] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:55 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:56.496319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:56.497022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:56.503319 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.504470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.505258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.505701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.641334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:56.649346 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-421d74b3-4246-45ea-9b06-22f30470f59b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1543 microversion: 2.1 time: 0.158256 Aug 04 05:27:56.649937 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3524/7160] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:56 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1543 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:56.670078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:56.670716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:56.679997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.680674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.681769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.682569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.818602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:56.826182 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f629f481-7503-49ea-8b35-19b1a04836f6 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1543 microversion: 2.1 time: 0.159976 Aug 04 05:27:56.826775 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3637/7161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:56 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1543 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:56.845645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:56.850660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:56.851456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Searching by: {'deleted': False, 'project_id': 'b898fb6967104b21940a66008b7a150a'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 05:27:56.856829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.857275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.858060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.858488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.882736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 05:27:56.911186 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bec78324-c279-436c-b0c0-5a71d0a8bbb5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069199 Aug 04 05:27:56.911766 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3525/7162] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 05:27:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:56.922939 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:56.923602 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:56.930385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.930855 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.931668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.932131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:57.061420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:57.068984 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-849224ac-192e-4772-8cb5-e3b253ade95f tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1543 microversion: 2.1 time: 0.149958 Aug 04 05:27:57.069569 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3638/7163] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:56 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1543 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:58.599568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-73bf1839-92d0-4fbc-943b-14601ccf31c5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "483a4ad4-b5c7-47c9-becd-15ffa69edf4b"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:58.601960 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-73bf1839-92d0-4fbc-943b-14601ccf31c5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:58.609510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73bf1839-92d0-4fbc-943b-14601ccf31c5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:58.609968 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73bf1839-92d0-4fbc-943b-14601ccf31c5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:58.610750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73bf1839-92d0-4fbc-943b-14601ccf31c5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:58.611238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-73bf1839-92d0-4fbc-943b-14601ccf31c5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:58.848889 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-73bf1839-92d0-4fbc-943b-14601ccf31c5 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253754 Aug 04 05:27:58.849655 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3526/7164] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:27:58 2022] POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:11.885887 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:11.886523 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:11.889536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:11.890224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=60 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:11.896822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:11.897293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:11.898094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:11.898551 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:12.032685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:12.041424 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11d880aa-57b3-4648-a43a-53db55ed799a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1589 microversion: 2.1 time: 0.159443 Aug 04 05:28:12.042005 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3639/7165] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:11 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1589 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:28:13.979941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:13.980716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:13.985725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:13.996254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-ec5c890f-9114-4f07-b779-85f24539b1cd req-64fe91fa-1ec2-4c8d-a025-80ee70959e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe58ee8c-8c54-414f-8282-a19f36ced54f", "tag": "7ea5d749-b630-4787-9685-0912ac136f94"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:14.010060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ec5c890f-9114-4f07-b779-85f24539b1cd req-64fe91fa-1ec2-4c8d-a025-80ee70959e27 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:14.010514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-ec5c890f-9114-4f07-b779-85f24539b1cd req-64fe91fa-1ec2-4c8d-a025-80ee70959e27 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:14.024286 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-ec5c890f-9114-4f07-b779-85f24539b1cd req-64fe91fa-1ec2-4c8d-a025-80ee70959e27 service nova] Creating event network-changed:7ea5d749-b630-4787-9685-0912ac136f94 for instance fe58ee8c-8c54-414f-8282-a19f36ced54f on n-h2-851337-5 Aug 04 05:28:14.030140 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-ec5c890f-9114-4f07-b779-85f24539b1cd req-64fe91fa-1ec2-4c8d-a025-80ee70959e27 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051957 Aug 04 05:28:14.031235 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3527/7166] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:15.040077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1604932447"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:15.040645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:15.048282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:15.048751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:15.049563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:15.050265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:15.202261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Adding security group dd5ad296-2a94-45cb-bfff-51ebea31e6c0 to port 7ea5d749-b630-4787-9685-0912ac136f94 Aug 04 05:28:15.541977 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4ff4f66f-b168-4580-be56-ea0e5ca3722b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/action" status: 202 len: 0 microversion: 2.1 time: 0.506065 Aug 04 05:28:15.543298 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3640/7167] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:28:15 2022] POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:28:15.554691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:15.555694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:15.574633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:15.575267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:15.576457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:15.576831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:15.758034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:15.772316 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8fd4ee3d-14e4-4990-8308-93d8d48dfac4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1755 microversion: 2.1 time: 0.222347 Aug 04 05:28:15.773745 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3528/7168] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:15 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:16.044623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7226c476-90de-4368-8717-9b24633fa7e4 req-6de621a2-57fb-4587-8270-a503e3740c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe58ee8c-8c54-414f-8282-a19f36ced54f", "tag": "7ea5d749-b630-4787-9685-0912ac136f94"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:16.055813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7226c476-90de-4368-8717-9b24633fa7e4 req-6de621a2-57fb-4587-8270-a503e3740c59 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:16.056376 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7226c476-90de-4368-8717-9b24633fa7e4 req-6de621a2-57fb-4587-8270-a503e3740c59 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:16.068667 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7226c476-90de-4368-8717-9b24633fa7e4 req-6de621a2-57fb-4587-8270-a503e3740c59 service nova] Creating event network-changed:7ea5d749-b630-4787-9685-0912ac136f94 for instance fe58ee8c-8c54-414f-8282-a19f36ced54f on n-h2-851337-5 Aug 04 05:28:16.073949 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7226c476-90de-4368-8717-9b24633fa7e4 req-6de621a2-57fb-4587-8270-a503e3740c59 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032969 Aug 04 05:28:16.074767 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3641/7169] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:34.449137 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:29:34.450299 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:29:53.394736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:53.395531 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:53.400080 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d152aa85-075c-4baa-bbc3-9f250701d99e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:53.402337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d152aa85-075c-4baa-bbc3-9f250701d99e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:53.409655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d152aa85-075c-4baa-bbc3-9f250701d99e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:53.410131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d152aa85-075c-4baa-bbc3-9f250701d99e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:53.410909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d152aa85-075c-4baa-bbc3-9f250701d99e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:53.411379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d152aa85-075c-4baa-bbc3-9f250701d99e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:53.484944 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d152aa85-075c-4baa-bbc3-9f250701d99e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/action" status: 202 len: 0 microversion: 2.1 time: 0.092085 Aug 04 05:29:53.485585 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3529/7170] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:29:53 2022] POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:29:53.493244 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:29:53.493856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:53.494603 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:53.499116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:53.499836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:53.508827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:53.509287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:53.510663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:53.511332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:53.759722 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:53.768554 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a9a88bd-2714-4efc-9e32-64e4510be7a2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1757 microversion: 2.1 time: 0.277818 Aug 04 05:29:53.769139 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3642/7171] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:53 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:54.790825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:54.791561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:54.798820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:54.799384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:54.800676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:54.801110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:54.946621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:54.954640 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4366e7f7-9741-4651-a844-8f35772134ba tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1755 microversion: 2.1 time: 0.168162 Aug 04 05:29:54.955232 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3530/7172] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:54 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:07.675619 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:31:07.677827 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:07.678646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:07.683871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1604932447"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:07.684425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:07.692638 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 32852. Aug 04 05:31:07.699257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.699731 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:07.700530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.700987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:07.888119 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Removing security group dd5ad296-2a94-45cb-bfff-51ebea31e6c0 from port 7ea5d749-b630-4787-9685-0912ac136f94 Aug 04 05:31:08.193894 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5474f2ed-01cc-4ebe-8937-cbb40af83f00 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/action" status: 202 len: 0 microversion: 2.1 time: 0.519878 Aug 04 05:31:08.195359 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3643/7173] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:31:07 2022] POST /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:31:08.201788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:08.202567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:08.206524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-1cecb611-ac96-43ac-a509-579f8bb052bb req-c1ea1552-9785-46a8-8181-65c3c43c6fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe58ee8c-8c54-414f-8282-a19f36ced54f", "tag": "7ea5d749-b630-4787-9685-0912ac136f94"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:08.227962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1cecb611-ac96-43ac-a509-579f8bb052bb req-c1ea1552-9785-46a8-8181-65c3c43c6fa6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:08.228403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-1cecb611-ac96-43ac-a509-579f8bb052bb req-c1ea1552-9785-46a8-8181-65c3c43c6fa6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:08.253815 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-1cecb611-ac96-43ac-a509-579f8bb052bb req-c1ea1552-9785-46a8-8181-65c3c43c6fa6 service nova] Creating event network-changed:7ea5d749-b630-4787-9685-0912ac136f94 for instance fe58ee8c-8c54-414f-8282-a19f36ced54f on n-h2-851337-5 Aug 04 05:31:08.259768 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-1cecb611-ac96-43ac-a509-579f8bb052bb req-c1ea1552-9785-46a8-8181-65c3c43c6fa6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059819 Aug 04 05:31:08.260937 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3531/7174] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:09.682896 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 32874. Aug 04 05:31:09.720326 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:09.720920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:09.727420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.727882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.728665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.729111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.744528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-3e0caada-a53c-4e65-8b96-51de5b56a213 req-cf6c2f38-72cc-452c-92bf-ccb8ee9bc50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe58ee8c-8c54-414f-8282-a19f36ced54f", "tag": "7ea5d749-b630-4787-9685-0912ac136f94"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:09.754333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3e0caada-a53c-4e65-8b96-51de5b56a213 req-cf6c2f38-72cc-452c-92bf-ccb8ee9bc50d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.754922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-3e0caada-a53c-4e65-8b96-51de5b56a213 req-cf6c2f38-72cc-452c-92bf-ccb8ee9bc50d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.770508 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-3e0caada-a53c-4e65-8b96-51de5b56a213 req-cf6c2f38-72cc-452c-92bf-ccb8ee9bc50d service nova] Creating event network-changed:7ea5d749-b630-4787-9685-0912ac136f94 for instance fe58ee8c-8c54-414f-8282-a19f36ced54f on n-h2-851337-5 Aug 04 05:31:09.776081 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-3e0caada-a53c-4e65-8b96-51de5b56a213 req-cf6c2f38-72cc-452c-92bf-ccb8ee9bc50d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107516 Aug 04 05:31:09.777007 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3644/7175] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:09.970678 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lazy-loading 'services' on Instance uuid fe58ee8c-8c54-414f-8282-a19f36ced54f {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:31:10.049974 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39d15c4b-bb76-4758-81aa-9a0b29fc4e0c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments/483a4ad4-b5c7-47c9-becd-15ffa69edf4b" status: 202 len: 0 microversion: 2.1 time: 0.334498 Aug 04 05:31:10.050893 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3532/7176] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:31:09 2022] DELETE /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments/483a4ad4-b5c7-47c9-becd-15ffa69edf4b => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:31:10.060031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-388b8294-0137-405e-ab8b-907821556317 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:10.062658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-388b8294-0137-405e-ab8b-907821556317 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:10.069626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-388b8294-0137-405e-ab8b-907821556317 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.071108 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-388b8294-0137-405e-ab8b-907821556317 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.071925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-388b8294-0137-405e-ab8b-907821556317 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.072388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-388b8294-0137-405e-ab8b-907821556317 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.106364 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-388b8294-0137-405e-ab8b-907821556317 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050614 Aug 04 05:31:10.107193 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3645/7177] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:31:10 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:11.121382 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1752bcdf-6073-494e-b693-38eb5bd803ad tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:11.123741 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1752bcdf-6073-494e-b693-38eb5bd803ad tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:11.130349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1752bcdf-6073-494e-b693-38eb5bd803ad tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.130794 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1752bcdf-6073-494e-b693-38eb5bd803ad tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.131589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1752bcdf-6073-494e-b693-38eb5bd803ad tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.132024 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1752bcdf-6073-494e-b693-38eb5bd803ad tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.161374 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1752bcdf-6073-494e-b693-38eb5bd803ad tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046015 Aug 04 05:31:11.161936 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3533/7178] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:31:11 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:12.174787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8ee6ec0c-22b8-4d26-98ec-491b393d7bda tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:12.177150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8ee6ec0c-22b8-4d26-98ec-491b393d7bda tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:12.187039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec0c-22b8-4d26-98ec-491b393d7bda tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.187521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec0c-22b8-4d26-98ec-491b393d7bda tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:12.188329 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec0c-22b8-4d26-98ec-491b393d7bda tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.188788 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec0c-22b8-4d26-98ec-491b393d7bda tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:12.231100 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8ee6ec0c-22b8-4d26-98ec-491b393d7bda tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060239 Aug 04 05:31:12.231670 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3646/7179] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:31:12 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:13.243767 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-38ff073e-b7d8-4383-99f0-78b0a96b9a8c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:13.245882 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-38ff073e-b7d8-4383-99f0-78b0a96b9a8c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:13.252815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ff073e-b7d8-4383-99f0-78b0a96b9a8c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:13.253256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ff073e-b7d8-4383-99f0-78b0a96b9a8c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:13.254019 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ff073e-b7d8-4383-99f0-78b0a96b9a8c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:13.254449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-38ff073e-b7d8-4383-99f0-78b0a96b9a8c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:13.283569 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-38ff073e-b7d8-4383-99f0-78b0a96b9a8c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Aug 04 05:31:13.284136 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3534/7180] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:31:13 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:14.295906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f6e77c5e-6d2d-4731-b660-eb60130d9481 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:14.298125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f6e77c5e-6d2d-4731-b660-eb60130d9481 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:14.305776 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e77c5e-6d2d-4731-b660-eb60130d9481 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.306243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e77c5e-6d2d-4731-b660-eb60130d9481 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.307166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e77c5e-6d2d-4731-b660-eb60130d9481 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.307629 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f6e77c5e-6d2d-4731-b660-eb60130d9481 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.336727 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f6e77c5e-6d2d-4731-b660-eb60130d9481 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Aug 04 05:31:14.337490 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3647/7181] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:31:14 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:15.349306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29170fb0-38f3-4f49-9ca8-770278941792 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:15.352076 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29170fb0-38f3-4f49-9ca8-770278941792 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:15.359005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29170fb0-38f3-4f49-9ca8-770278941792 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.359472 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29170fb0-38f3-4f49-9ca8-770278941792 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.360249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29170fb0-38f3-4f49-9ca8-770278941792 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.360692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29170fb0-38f3-4f49-9ca8-770278941792 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.389788 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29170fb0-38f3-4f49-9ca8-770278941792 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044469 Aug 04 05:31:15.390365 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3535/7182] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:31:15 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:31:15.401710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:15.402219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:15.409245 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.409696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.410488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.410941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.489880 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] HTTP exception thrown: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f is not attached to volume 483a4ad4-b5c7-47c9-becd-15ffa69edf4b Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Request method failure captured: Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments/483a4ad4-b5c7-47c9-becd-15ffa69edf4b HTTP/1.1 Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61i7r0VrXwl8EFmDZlX3pEYh2WpiJnoC9OT7fj_tMFoawhGnHBhk2lx5XcKG5G9E5JMZqlfUZbkmzScdG348UJjjVnsSxgNpJpQVMRA1ODW4LwWG77_Mw-1UwOvQXhZF7jwgEP7guPm_6X8_JdgmITT-ToNWFi0cEOjpGLAEMcOkYuI Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b898fb6967104b21940a66008b7a150a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b898fb6967104b21940a66008b7a150a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 80b8b646e8e64a078d45b2803d6c780b Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f is not attached to volume 483a4ad4-b5c7-47c9-becd-15ffa69edf4b Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': 'fe58ee8c-8c54-414f-8282-a19f36ced54f', 'id': '483a4ad4-b5c7-47c9-becd-15ffa69edf4b'} Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 483a4ad4-b5c7-47c9-becd-15ffa69edf4b. Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f is not attached to volume 483a4ad4-b5c7-47c9-becd-15ffa69edf4b Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:31:15.491678 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:31:15.496374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:31:15.496374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:31:15.496374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f is not attached to volume 483a4ad4-b5c7-47c9-becd-15ffa69edf4b Aug 04 05:31:15.496374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:15.496374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Returning 404 to user: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f is not attached to volume 483a4ad4-b5c7-47c9-becd-15ffa69edf4b {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:31:15.496374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-123302dd-9191-452c-9328-26362abcb220 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments/483a4ad4-b5c7-47c9-becd-15ffa69edf4b" status: 404 len: 154 microversion: 2.1 time: 0.096587 Aug 04 05:31:15.496374 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3648/7183] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:31:15 2022] DELETE /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f/os-volume_attachments/483a4ad4-b5c7-47c9-becd-15ffa69edf4b => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:31:18.755566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:18.756051 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:18.762987 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:18.763437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:18.764200 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:18.764924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:18.791240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:31:18.873701 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29fad94f-92f0-4c50-8668-e5143660db45 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 204 len: 0 microversion: 2.1 time: 0.121698 Aug 04 05:31:18.874549 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3536/7184] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:31:18 2022] DELETE /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:31:18.885790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:18.887090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:18.895613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:18.896112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:18.896917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:18.897375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:19.036339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:19.044700 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cf48acb4-7173-473b-8c44-300189d9a8cc tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1549 microversion: 2.1 time: 0.163097 Aug 04 05:31:19.045276 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3649/7185] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:18 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:20.067410 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:20.068101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:20.075698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:20.076146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:20.076907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:20.077341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:20.205562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:20.213182 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a6033a6f-7f33-4901-9ffc-c204dc98909e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1549 microversion: 2.1 time: 0.150121 Aug 04 05:31:20.213880 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3537/7186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:20 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:21.054521 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0cdb7a28-41a5-4936-89ea-a0abce47473b req-b4cf9235-4a64-4b5d-85f0-95951fbe9e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe58ee8c-8c54-414f-8282-a19f36ced54f", "name": "network-vif-deleted", "tag": "7ea5d749-b630-4787-9685-0912ac136f94"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:21.068370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0cdb7a28-41a5-4936-89ea-a0abce47473b req-b4cf9235-4a64-4b5d-85f0-95951fbe9e12 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:21.069100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0cdb7a28-41a5-4936-89ea-a0abce47473b req-b4cf9235-4a64-4b5d-85f0-95951fbe9e12 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:21.083674 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0cdb7a28-41a5-4936-89ea-a0abce47473b req-b4cf9235-4a64-4b5d-85f0-95951fbe9e12 service nova] Creating event network-vif-deleted:7ea5d749-b630-4787-9685-0912ac136f94 for instance fe58ee8c-8c54-414f-8282-a19f36ced54f on n-h2-851337-5 Aug 04 05:31:21.089624 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0cdb7a28-41a5-4936-89ea-a0abce47473b req-b4cf9235-4a64-4b5d-85f0-95951fbe9e12 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038624 Aug 04 05:31:21.090224 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3650/7187] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:21.233905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:21.234437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:21.241761 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:21.242214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:21.243518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:21.243952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:21.275479 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:21.275847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:21.276299 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lazy-loading 'fault' on Instance uuid fe58ee8c-8c54-414f-8282-a19f36ced54f {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:31:21.317220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:21.325564 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c8c13d6d-9ff8-4563-bf1e-73550d7d5665 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 200 len: 1343 microversion: 2.1 time: 0.095613 Aug 04 05:31:21.326155 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3538/7188] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:21 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 1343 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:22.347345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:22.348058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: fe58ee8c-8c54-414f-8282-a19f36ced54f] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:22.355230 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:22.355695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:22.356471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:22.356918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:22.370020 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] HTTP exception thrown: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f could not be found. Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Request method failure captured: Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f HTTP/1.1 Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61i7r0VrXwl8EFmDZlX3pEYh2WpiJnoC9OT7fj_tMFoawhGnHBhk2lx5XcKG5G9E5JMZqlfUZbkmzScdG348UJjjVnsSxgNpJpQVMRA1ODW4LwWG77_Mw-1UwOvQXhZF7jwgEP7guPm_6X8_JdgmITT-ToNWFi0cEOjpGLAEMcOkYuI Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b898fb6967104b21940a66008b7a150a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b898fb6967104b21940a66008b7a150a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 80b8b646e8e64a078d45b2803d6c780b Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f could not be found. Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'fe58ee8c-8c54-414f-8282-a19f36ced54f'} Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f could not be found. Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f could not be found. Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:31:22.371702 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f could not be found. Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Returning 404 to user: Instance fe58ee8c-8c54-414f-8282-a19f36ced54f could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f695e0f8-3813-40b9-92c6-bad4faebc663 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f" status: 404 len: 111 microversion: 2.1 time: 0.030074 Aug 04 05:31:22.375854 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3651/7189] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:22 2022] GET /compute/v2.1/servers/fe58ee8c-8c54-414f-8282-a19f36ced54f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:31:22.382001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-159bb4f3-74a9-401f-9fa1-7d8e2a7fa456 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '.version_select at 0x7f19188fc040>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:22.404527 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-159bb4f3-74a9-401f-9fa1-7d8e2a7fa456 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1373" status: 202 len: 0 microversion: 2.1 time: 0.026331 Aug 04 05:31:22.405120 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3539/7190] 10.222.0.69 () {58 vars in 1254 bytes} [Thu Aug 4 05:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1373 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:31:31.301609 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd1b07cb-e8a2-4228-8b0c-a8d40fc97593 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'create', calling method: .version_select at 0x7f192399ff70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1746803288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHESl5d9FhTRI8H0FCXa8pffEzfWqEeKGBGk19Aj2cUMkDL9DNwsCHghiuZ4AITP02C2WBJlKJPJKaT/gRB73PMqLSIABTGPbo/yAiPKR4wMPjITZd5cf02GfI5qeZzoag=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:31.318695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cd1b07cb-e8a2-4228-8b0c-a8d40fc97593 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for project b898fb6967104b21940a66008b7a150a. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:31:31.324727 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cd1b07cb-e8a2-4228-8b0c-a8d40fc97593 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for user 80b8b646e8e64a078d45b2803d6c780b and project b898fb6967104b21940a66008b7a150a. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:31:31.348530 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd1b07cb-e8a2-4228-8b0c-a8d40fc97593 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051214 Aug 04 05:31:31.349130 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3652/7191] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:31:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:31.403936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1831278388", "imageRef": "c8842ee9-67d0-40e9-8748-91652b70c0d0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1746803288", "networks": [{"uuid": "4bef3201-7c27-4585-98dc-83de593cd520"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:31.417495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:31.459517 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] validate_networks() for [('4bef3201-7c27-4585-98dc-83de593cd520', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:31:31.920420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:31:31.920825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:31:31.921296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:31:31.921701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:31:31.922110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:31:31.931467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:31.931910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:31.932700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:31.933165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:31.949948 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for project b898fb6967104b21940a66008b7a150a. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:31:31.955146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Getting quotas for user 80b8b646e8e64a078d45b2803d6c780b and project b898fb6967104b21940a66008b7a150a. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:31:31.967108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:31:31.969275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8842ee9-67d0-40e9-8748-91652b70c0d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:31:32.013293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a959ab5-d08f-4d7a-af01-afec306027f3 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613928 Aug 04 05:31:32.013975 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3540/7192] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:31:32.025194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ba7f1e8c-1b0e-4bf8-a70c-08eaef78b009 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:32.025832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ba7f1e8c-1b0e-4bf8-a70c-08eaef78b009 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:32.085976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ba7f1e8c-1b0e-4bf8-a70c-08eaef78b009 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:32.094186 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ba7f1e8c-1b0e-4bf8-a70c-08eaef78b009 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1259 microversion: 2.1 time: 0.072794 Aug 04 05:31:32.094790 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3653/7193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:32 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:33.118416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:33.119676 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:33.128426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:33.128989 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:33.130008 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:33.130443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:33.198306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:33.206304 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-153d225f-b69c-453d-b678-510e174ce3c4 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1329 microversion: 2.1 time: 0.093621 Aug 04 05:31:33.206926 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3541/7194] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:33 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1329 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:34.227649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:34.228303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:34.231392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=40 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:34.239312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:34.239783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:34.240595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:34.241058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:34.396947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:34.405014 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6ccab4af-170e-43ab-8b34-6426b8a759dd tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.181344 Aug 04 05:31:34.405604 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3654/7195] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:34 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:35.427755 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:35.428417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:35.436078 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:35.436540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:35.437354 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:35.437797 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:35.576615 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:35.585067 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3e2d53ae-2aa0-44c0-8fbe-f76ee08ee670 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.161508 Aug 04 05:31:35.586029 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3542/7196] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:35 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:36.605814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:36.607085 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:36.615009 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:36.615453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:36.616266 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:36.616718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:36.793134 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:36.803904 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9be981f-8aa7-4162-8ca3-355c0a83fd3d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.201916 Aug 04 05:31:36.811004 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3655/7197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:36 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:37.824834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:37.826442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:37.834403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:37.834937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:37.836991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:37.837516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:37.980672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:37.989623 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-009aa18e-6005-4713-9504-8434421fd157 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.168592 Aug 04 05:31:37.990528 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3543/7198] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:37 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:39.010874 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:39.011506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:39.014265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:39.020526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:39.021006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:39.021790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:39.022336 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:39.168051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:39.177372 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-66fc576a-4963-4f22-a457-83bf43f36fca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.170289 Aug 04 05:31:39.178238 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3656/7199] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:39 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:40.197664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:40.198269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:40.200983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:40.206577 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:40.207067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:40.207855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:40.208296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:40.353695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:40.361349 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3ec3d836-9911-4c01-99ce-65cc989c2565 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.167532 Aug 04 05:31:40.361925 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3544/7200] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:40 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:41.382398 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:41.383064 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:41.389925 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:41.390392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:41.391211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:41.391667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:41.520883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:41.529335 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a65ad9c-89c0-4cce-b7c3-a0c8e8e37a56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.150819 Aug 04 05:31:41.529914 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3657/7201] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:41 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:42.551151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:42.551766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:42.555033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:42.555691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:42.561666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:42.562119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:42.562888 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:42.563349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:42.702884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:42.710420 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-489dd5f8-f1dd-4f91-bd78-f8c1ead78051 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.163240 Aug 04 05:31:42.711014 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3545/7202] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:42 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:43.731260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:43.731882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:43.733742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:43.740176 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:43.740634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:43.741410 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:43.742348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:43.879070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:43.887582 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8f2ae4af-57c1-4a2c-b2ab-4b88da6a8446 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.159904 Aug 04 05:31:43.888153 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3658/7203] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:43 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:44.908846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:44.909540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:44.916740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:44.917116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:44.917895 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:44.918513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:45.053030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:45.060621 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d117f79f-d345-4eb0-b146-05a63a626e56 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.155713 Aug 04 05:31:45.061223 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3546/7204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:44 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:45.309011 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b8129a89-f614-4941-b5c0-c638292f3466 req-60e1069c-0668-4497-b93c-68903b9aae5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d4f270-0abb-436d-8617-108139a48ab4", "tag": "4fa87aa7-92da-4efc-8ed6-e79bffb999b0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:45.321260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b8129a89-f614-4941-b5c0-c638292f3466 req-60e1069c-0668-4497-b93c-68903b9aae5b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:45.321733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b8129a89-f614-4941-b5c0-c638292f3466 req-60e1069c-0668-4497-b93c-68903b9aae5b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:45.333281 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b8129a89-f614-4941-b5c0-c638292f3466 req-60e1069c-0668-4497-b93c-68903b9aae5b service nova] Creating event network-changed:4fa87aa7-92da-4efc-8ed6-e79bffb999b0 for instance c8d4f270-0abb-436d-8617-108139a48ab4 on n-h1-851337-5 Aug 04 05:31:45.338319 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b8129a89-f614-4941-b5c0-c638292f3466 req-60e1069c-0668-4497-b93c-68903b9aae5b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033649 Aug 04 05:31:45.339394 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3659/7205] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:46.083180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:46.083771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:46.091404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:46.091853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:46.092623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:46.093065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:46.231776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:46.239377 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9b880b4d-cf1e-4a89-9fe0-708c818878df tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.160189 Aug 04 05:31:46.239991 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3547/7206] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:46 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:47.261983 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:47.262689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:47.269303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:47.269763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:47.270531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:47.271003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:47.400656 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:47.408080 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-272c02e0-6bae-446f-82f5-2199627191bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.151268 Aug 04 05:31:47.408648 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3660/7207] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:47 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:48.429351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:48.430536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:48.437604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:48.438061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:48.438835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:48.439313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:48.580017 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:48.587498 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e5b2f2be-ea59-4ffa-b50e-ab9f905aaeb2 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.162105 Aug 04 05:31:48.588069 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3548/7208] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:48 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:49.608167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:49.608798 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:49.615869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:49.616361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:49.617140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:49.618081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:49.749219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:49.756701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dca0a334-732f-47a0-8022-bb3e60791bb0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.152433 Aug 04 05:31:49.757276 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3661/7209] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:49 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:50.778870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:50.779426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:50.786268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:50.786717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:50.787503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:50.787936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:50.924252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:50.933565 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e3d8d5cb-2070-482e-a095-8ce7ffa0f34a tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.159245 Aug 04 05:31:50.934161 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3549/7210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:50 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:51.955164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:51.955697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:51.963249 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:51.963708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:51.964483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:51.964935 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:52.096366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:52.105370 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b100d112-6b55-4cff-b186-9ec71509bd9d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.154069 Aug 04 05:31:52.106230 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3662/7211] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:51 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:52.429516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-46fb190c-2ba3-47a9-8347-02abfd75c54a req-bedb008e-53f6-442f-b009-bdd14a08ca1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d4f270-0abb-436d-8617-108139a48ab4", "name": "network-vif-plugged", "status": "completed", "tag": "4fa87aa7-92da-4efc-8ed6-e79bffb999b0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:52.440504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-46fb190c-2ba3-47a9-8347-02abfd75c54a req-bedb008e-53f6-442f-b009-bdd14a08ca1e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:52.440969 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-46fb190c-2ba3-47a9-8347-02abfd75c54a req-bedb008e-53f6-442f-b009-bdd14a08ca1e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:52.452498 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-46fb190c-2ba3-47a9-8347-02abfd75c54a req-bedb008e-53f6-442f-b009-bdd14a08ca1e service nova] Creating event network-vif-plugged:4fa87aa7-92da-4efc-8ed6-e79bffb999b0 for instance c8d4f270-0abb-436d-8617-108139a48ab4 on n-h1-851337-5 Aug 04 05:31:52.458097 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-46fb190c-2ba3-47a9-8347-02abfd75c54a req-bedb008e-53f6-442f-b009-bdd14a08ca1e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090228 Aug 04 05:31:52.458717 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3550/7212] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:53.132775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:53.133318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:53.140791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:53.141250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:53.142282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:53.142746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:53.273397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:53.281491 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3cd49c83-a871-458e-abba-47205502d7e0 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1359 microversion: 2.1 time: 0.152754 Aug 04 05:31:53.282077 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3663/7213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:53 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:54.302793 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:54.303508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:54.310823 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.311574 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.312360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.313407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.454525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:54.462806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2e221c2f-178e-47f4-8b0c-a942a280ad25 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1548 microversion: 2.1 time: 0.164207 Aug 04 05:31:54.463419 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3551/7214] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:54 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:54.484228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:54.484891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:54.492058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.492528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.493330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.493784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.627198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:54.635350 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4fad294f-9934-4d5f-8b58-baf25733953d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1548 microversion: 2.1 time: 0.155089 Aug 04 05:31:54.635938 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3664/7215] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:54 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:54.656057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:54.660757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:54.661530 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Searching by: {'deleted': False, 'project_id': 'b898fb6967104b21940a66008b7a150a'} {{(pid=119342) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 05:31:54.667026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.667481 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.668287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.668727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.692114 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.multi_cell_list [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119342) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 05:31:54.720319 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-51ab7331-1b2e-4584-916a-de80eac9a8fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068093 Aug 04 05:31:54.720903 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3552/7216] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Aug 4 05:31:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:54.732437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:54.733073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:54.739330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.739797 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.740586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:54.741038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:54.869734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:54.878001 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9ea97b24-a577-4e0c-9ef2-ef547bf2f69e tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1548 microversion: 2.1 time: 0.149339 Aug 04 05:31:54.878591 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3665/7217] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:54 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:56.382739 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82b1f4ab-019d-45c6-994a-8bb97ef0e46c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eed4bc9f-c14e-4ae7-931c-924873cb1e51"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:56.385785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82b1f4ab-019d-45c6-994a-8bb97ef0e46c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:56.392994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b1f4ab-019d-45c6-994a-8bb97ef0e46c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:56.393441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b1f4ab-019d-45c6-994a-8bb97ef0e46c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:56.394214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b1f4ab-019d-45c6-994a-8bb97ef0e46c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:56.394653 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82b1f4ab-019d-45c6-994a-8bb97ef0e46c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:56.658404 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82b1f4ab-019d-45c6-994a-8bb97ef0e46c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279528 Aug 04 05:31:56.666613 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3553/7218] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Aug 4 05:31:56 2022] POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:07.422660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:07.423333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:07.426318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=19 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:07.427223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=68 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:07.433579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:07.434044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:07.434832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:07.435323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:07.573954 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:07.582044 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-284e4374-9a24-4b36-953e-c7dbeec55c38 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1594 microversion: 2.1 time: 0.163452 Aug 04 05:32:07.582628 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3666/7219] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:07 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:09.635375 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:09.636229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=19 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:09.636959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:09.642673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d91b7c42-1cbc-4fad-a387-7723fbf3fdab req-285b0536-fd9b-4066-8b65-9b7f40b3a18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d4f270-0abb-436d-8617-108139a48ab4", "tag": "4fa87aa7-92da-4efc-8ed6-e79bffb999b0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:09.657274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d91b7c42-1cbc-4fad-a387-7723fbf3fdab req-285b0536-fd9b-4066-8b65-9b7f40b3a18e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:09.658397 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d91b7c42-1cbc-4fad-a387-7723fbf3fdab req-285b0536-fd9b-4066-8b65-9b7f40b3a18e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:09.674982 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d91b7c42-1cbc-4fad-a387-7723fbf3fdab req-285b0536-fd9b-4066-8b65-9b7f40b3a18e service nova] Creating event network-changed:4fa87aa7-92da-4efc-8ed6-e79bffb999b0 for instance c8d4f270-0abb-436d-8617-108139a48ab4 on n-h1-851337-5 Aug 04 05:32:09.681627 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d91b7c42-1cbc-4fad-a387-7723fbf3fdab req-285b0536-fd9b-4066-8b65-9b7f40b3a18e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048214 Aug 04 05:32:09.683234 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3554/7220] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:10.926560 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1889906613"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:10.927158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:10.933426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.933891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:10.934683 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.935171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:11.061814 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Adding security group da9a8cf9-64c2-4ee6-93af-ba383a4574d4 to port 4fa87aa7-92da-4efc-8ed6-e79bffb999b0 Aug 04 05:32:11.383448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e3ec5ac3-8cc2-4b6a-9aa1-91b365d2eef1 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/action" status: 202 len: 0 microversion: 2.1 time: 0.460791 Aug 04 05:32:11.384128 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3667/7221] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:32:10 2022] POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:32:11.393624 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:11.394195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-975fe1bf-d650-46bc-bef1-21a727538b0b req-31b10415-e174-4ba9-8e6b-2c0a11f300a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d4f270-0abb-436d-8617-108139a48ab4", "tag": "4fa87aa7-92da-4efc-8ed6-e79bffb999b0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:11.394688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:11.404474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-975fe1bf-d650-46bc-bef1-21a727538b0b req-31b10415-e174-4ba9-8e6b-2c0a11f300a9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:11.405198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-975fe1bf-d650-46bc-bef1-21a727538b0b req-31b10415-e174-4ba9-8e6b-2c0a11f300a9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:11.405417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:11.407460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:11.408471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:11.409083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:11.423903 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-975fe1bf-d650-46bc-bef1-21a727538b0b req-31b10415-e174-4ba9-8e6b-2c0a11f300a9 service nova] Creating event network-changed:4fa87aa7-92da-4efc-8ed6-e79bffb999b0 for instance c8d4f270-0abb-436d-8617-108139a48ab4 on n-h1-851337-5 Aug 04 05:32:11.435370 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-975fe1bf-d650-46bc-bef1-21a727538b0b req-31b10415-e174-4ba9-8e6b-2c0a11f300a9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044922 Aug 04 05:32:11.437168 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3668/7222] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:11.580052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:11.590211 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-301b4482-3693-4f51-8199-d36bb6a43b72 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1760 microversion: 2.1 time: 0.201357 Aug 04 05:32:11.591058 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3555/7223] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:11 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1760 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:54.458243 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:32:54.458841 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:32:59.655828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:59.656604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:59.708030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d8e17c60-bf10-429a-8c87-680e7bdcc559 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:59.710384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d8e17c60-bf10-429a-8c87-680e7bdcc559 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:59.717184 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e17c60-bf10-429a-8c87-680e7bdcc559 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:59.717643 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e17c60-bf10-429a-8c87-680e7bdcc559 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:59.718422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e17c60-bf10-429a-8c87-680e7bdcc559 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:59.718876 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d8e17c60-bf10-429a-8c87-680e7bdcc559 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:59.791449 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d8e17c60-bf10-429a-8c87-680e7bdcc559 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/action" status: 202 len: 0 microversion: 2.1 time: 0.137491 Aug 04 05:32:59.792979 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3669/7224] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:32:59 2022] POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:32:59.800894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:59.801697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:59.804224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:59.804918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=8 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:59.811891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:59.812291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:59.813071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:59.813526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:59.968106 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:59.977111 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-80b27a08-ff92-4c57-a0df-350d67b6773d tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1752 microversion: 2.1 time: 0.180103 Aug 04 05:32:59.977788 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3556/7225] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:59 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:01.000191 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:01.000700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:01.007885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:01.008353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:01.009141 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:01.009606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:01.159675 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:01.167803 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-84b5e64f-b398-436e-a8bb-cad7ead60408 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.172290 Aug 04 05:33:01.168388 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3670/7226] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:00 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:02.189500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:02.190108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:02.196849 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:02.197301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:02.198214 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:02.199213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:02.346390 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:02.354942 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4179d824-16d7-4141-800f-428ebabd0c80 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.168840 Aug 04 05:33:02.355555 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3557/7227] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:02 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:03.376067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:03.376734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:03.383721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:03.384174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:03.384945 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:03.385456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:03.530225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:03.538246 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-55b60cbf-844c-427d-bd4e-82182c997068 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.166047 Aug 04 05:33:03.538822 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3671/7228] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:03 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:04.560920 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:04.561525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:04.568554 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:04.569000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:04.569759 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:04.570193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:04.719705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:04.727700 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-464ff600-78fb-4801-b27a-c9b92713e737 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.171403 Aug 04 05:33:04.728272 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3558/7229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:04 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:05.749582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:05.750217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:05.757262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:05.757729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:05.758516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:05.759028 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:05.902735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:05.910876 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ee05bdf6-2ef5-4797-a68b-159f8d78ed65 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.165292 Aug 04 05:33:05.911480 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3672/7230] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:05 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:06.933616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:06.934237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:06.941357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:06.941812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:06.942582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:06.943070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:07.095894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:07.105608 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b636477b-a5ef-400a-a443-9385739d151c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.176881 Aug 04 05:33:07.106252 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3559/7231] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:06 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:08.127505 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:08.128140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:08.135049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:08.135519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:08.136309 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:08.136762 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:08.282736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:08.290862 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67f0974e-2b9b-4f9d-a305-b8b1bd6cc22b tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.167337 Aug 04 05:33:08.291533 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3673/7232] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:08 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:09.313077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:09.313605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:09.320503 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:09.320958 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:09.321750 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:09.322210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:09.466470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:09.475254 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-28f20708-92aa-4f76-99ef-fe064f76bf51 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.165932 Aug 04 05:33:09.475935 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3560/7233] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:09 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:33:10.496848 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:10.497472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:10.504159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:10.504613 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:10.505384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:10.505830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:10.656766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:10.665568 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c31201c6-948f-4c55-aa57-543628bc9427 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1757 microversion: 2.1 time: 0.172345 Aug 04 05:33:10.665902 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3674/7234] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:10 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:11.686000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:11.686611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:11.693650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:11.694089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:11.694848 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:11.695305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:11.836763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:11.845347 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35b62918-ef17-4e0c-9203-95d5bcebaaaf tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1760 microversion: 2.1 time: 0.163361 Aug 04 05:33:11.845919 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3561/7235] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:11 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:00.907502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1889906613"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:00.908732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:00.911116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:00.911955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:00.917700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:00.918109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:00.918899 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:00.919377 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.050466 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.network.security_group_api [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Removing security group da9a8cf9-64c2-4ee6-93af-ba383a4574d4 from port 4fa87aa7-92da-4efc-8ed6-e79bffb999b0 Aug 04 05:34:01.353696 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-aba7a391-5111-4c5e-9b5c-2ffc9ddcb570 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/action" status: 202 len: 0 microversion: 2.1 time: 0.450058 Aug 04 05:34:01.354323 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3675/7236] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:34:00 2022] POST /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:34:01.365620 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:01.366522 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=36 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:01.463857 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-cc416fb9-bd6a-4521-ba00-11b46351a8c3 req-a500a0d1-a0ca-4f94-aa36-760fc04cff36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d4f270-0abb-436d-8617-108139a48ab4", "tag": "4fa87aa7-92da-4efc-8ed6-e79bffb999b0"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:01.473641 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cc416fb9-bd6a-4521-ba00-11b46351a8c3 req-a500a0d1-a0ca-4f94-aa36-760fc04cff36 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:01.474088 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cc416fb9-bd6a-4521-ba00-11b46351a8c3 req-a500a0d1-a0ca-4f94-aa36-760fc04cff36 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.487249 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-cc416fb9-bd6a-4521-ba00-11b46351a8c3 req-a500a0d1-a0ca-4f94-aa36-760fc04cff36 service nova] Creating event network-changed:4fa87aa7-92da-4efc-8ed6-e79bffb999b0 for instance c8d4f270-0abb-436d-8617-108139a48ab4 on n-h1-851337-5 Aug 04 05:34:01.494033 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-cc416fb9-bd6a-4521-ba00-11b46351a8c3 req-a500a0d1-a0ca-4f94-aa36-760fc04cff36 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133890 Aug 04 05:34:01.494998 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3562/7237] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:02.755666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:02.756181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:02.762298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.762766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.763585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.764055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.845718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lazy-loading 'services' on Instance uuid c8d4f270-0abb-436d-8617-108139a48ab4 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:34:02.926940 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-92afd567-0522-4963-8aef-a7befbac12fe tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments/eed4bc9f-c14e-4ae7-931c-924873cb1e51" status: 202 len: 0 microversion: 2.1 time: 0.176151 Aug 04 05:34:02.927583 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3676/7238] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:34:02 2022] DELETE /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments/eed4bc9f-c14e-4ae7-931c-924873cb1e51 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:34:02.941842 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2359feef-daf2-467f-8004-dcd2b8706b75 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:02.947257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2359feef-daf2-467f-8004-dcd2b8706b75 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:02.960870 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2359feef-daf2-467f-8004-dcd2b8706b75 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.961334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2359feef-daf2-467f-8004-dcd2b8706b75 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.962134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2359feef-daf2-467f-8004-dcd2b8706b75 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.962576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2359feef-daf2-467f-8004-dcd2b8706b75 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.995569 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2359feef-daf2-467f-8004-dcd2b8706b75 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063144 Aug 04 05:34:02.996176 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3563/7239] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:34:02 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:03.510194 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-78e3e51f-7f70-4d40-a7e1-f12ca474d2d3 req-819066dd-c999-47da-8651-6579ea4c4d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d4f270-0abb-436d-8617-108139a48ab4", "tag": "4fa87aa7-92da-4efc-8ed6-e79bffb999b0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:03.521142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-78e3e51f-7f70-4d40-a7e1-f12ca474d2d3 req-819066dd-c999-47da-8651-6579ea4c4d0c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:03.521614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-78e3e51f-7f70-4d40-a7e1-f12ca474d2d3 req-819066dd-c999-47da-8651-6579ea4c4d0c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:03.533516 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-78e3e51f-7f70-4d40-a7e1-f12ca474d2d3 req-819066dd-c999-47da-8651-6579ea4c4d0c service nova] Creating event network-changed:4fa87aa7-92da-4efc-8ed6-e79bffb999b0 for instance c8d4f270-0abb-436d-8617-108139a48ab4 on n-h1-851337-5 Aug 04 05:34:03.538501 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-78e3e51f-7f70-4d40-a7e1-f12ca474d2d3 req-819066dd-c999-47da-8651-6579ea4c4d0c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032454 Aug 04 05:34:03.539123 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3677/7240] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:04.008336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b5d5d6f7-4ffe-4791-8ac1-06a025d3474c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:04.010604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b5d5d6f7-4ffe-4791-8ac1-06a025d3474c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:04.017875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5d5d6f7-4ffe-4791-8ac1-06a025d3474c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:04.018553 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5d5d6f7-4ffe-4791-8ac1-06a025d3474c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:04.019373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5d5d6f7-4ffe-4791-8ac1-06a025d3474c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:04.019818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b5d5d6f7-4ffe-4791-8ac1-06a025d3474c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:04.051106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b5d5d6f7-4ffe-4791-8ac1-06a025d3474c tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046658 Aug 04 05:34:04.051692 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3564/7241] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:34:04 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:05.065037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a55bb813-b61c-4107-8868-0e9a0d0834ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:05.067421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a55bb813-b61c-4107-8868-0e9a0d0834ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:05.074132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a55bb813-b61c-4107-8868-0e9a0d0834ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:05.074598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a55bb813-b61c-4107-8868-0e9a0d0834ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:05.075444 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a55bb813-b61c-4107-8868-0e9a0d0834ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:05.075895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a55bb813-b61c-4107-8868-0e9a0d0834ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:05.110183 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a55bb813-b61c-4107-8868-0e9a0d0834ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050297 Aug 04 05:34:05.110832 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3678/7242] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:34:05 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:06.122054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d771272a-e5cd-4795-96af-6ba3bbb855bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:06.124313 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d771272a-e5cd-4795-96af-6ba3bbb855bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:06.131971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d771272a-e5cd-4795-96af-6ba3bbb855bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:06.132371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d771272a-e5cd-4795-96af-6ba3bbb855bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:06.133148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d771272a-e5cd-4795-96af-6ba3bbb855bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:06.133591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d771272a-e5cd-4795-96af-6ba3bbb855bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:06.168856 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d771272a-e5cd-4795-96af-6ba3bbb855bb tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050868 Aug 04 05:34:06.169448 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3565/7243] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:34:06 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:07.180984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8609313e-40b3-4457-8924-b28afc2613ab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:07.183289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8609313e-40b3-4457-8924-b28afc2613ab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:07.190804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8609313e-40b3-4457-8924-b28afc2613ab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:07.191293 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8609313e-40b3-4457-8924-b28afc2613ab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:07.192081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8609313e-40b3-4457-8924-b28afc2613ab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:07.192535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8609313e-40b3-4457-8924-b28afc2613ab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:07.223560 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8609313e-40b3-4457-8924-b28afc2613ab tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Aug 04 05:34:07.227913 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3679/7244] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:34:07 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:08.235822 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2f502e6b-babd-41b1-bc4a-e2ebe645d9ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:08.237962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2f502e6b-babd-41b1-bc4a-e2ebe645d9ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:08.245131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f502e6b-babd-41b1-bc4a-e2ebe645d9ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:08.245573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f502e6b-babd-41b1-bc4a-e2ebe645d9ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:08.246331 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f502e6b-babd-41b1-bc4a-e2ebe645d9ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:08.246760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2f502e6b-babd-41b1-bc4a-e2ebe645d9ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:08.284770 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2f502e6b-babd-41b1-bc4a-e2ebe645d9ca tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052857 Aug 04 05:34:08.285343 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3566/7245] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Aug 4 05:34:08 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:34:08.295886 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:08.296400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:08.303017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:08.303486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:08.304275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:08.304725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:08.378561 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] HTTP exception thrown: Instance c8d4f270-0abb-436d-8617-108139a48ab4 is not attached to volume eed4bc9f-c14e-4ae7-931c-924873cb1e51 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Request method failure captured: Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: request: DELETE /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments/eed4bc9f-c14e-4ae7-931c-924873cb1e51 HTTP/1.1 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61i7r0VrXwl8EFmDZlX3pEYh2WpiJnoC9OT7fj_tMFoawhGnHBhk2lx5XcKG5G9E5JMZqlfUZbkmzScdG348UJjjVnsSxgNpJpQVMRA1ODW4LwWG77_Mw-1UwOvQXhZF7jwgEP7guPm_6X8_JdgmITT-ToNWFi0cEOjpGLAEMcOkYuI Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b898fb6967104b21940a66008b7a150a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b898fb6967104b21940a66008b7a150a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 80b8b646e8e64a078d45b2803d6c780b Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance c8d4f270-0abb-436d-8617-108139a48ab4 is not attached to volume eed4bc9f-c14e-4ae7-931c-924873cb1e51 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'server_id': 'c8d4f270-0abb-436d-8617-108139a48ab4', 'id': 'eed4bc9f-c14e-4ae7-931c-924873cb1e51'} Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eed4bc9f-c14e-4ae7-931c-924873cb1e51. Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d4f270-0abb-436d-8617-108139a48ab4 is not attached to volume eed4bc9f-c14e-4ae7-931c-924873cb1e51 Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:08.380233 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:08.384851 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:34:08.384851 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:34:08.384851 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d4f270-0abb-436d-8617-108139a48ab4 is not attached to volume eed4bc9f-c14e-4ae7-931c-924873cb1e51 Aug 04 05:34:08.384851 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:08.384851 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Returning 404 to user: Instance c8d4f270-0abb-436d-8617-108139a48ab4 is not attached to volume eed4bc9f-c14e-4ae7-931c-924873cb1e51 {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:34:08.384851 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-19c5f346-d7c7-463d-aecf-ccb7d12f6c96 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments/eed4bc9f-c14e-4ae7-931c-924873cb1e51" status: 404 len: 154 microversion: 2.1 time: 0.090195 Aug 04 05:34:08.384851 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3680/7246] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Aug 4 05:34:08 2022] DELETE /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4/os-volume_attachments/eed4bc9f-c14e-4ae7-931c-924873cb1e51 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:34:11.634835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:11.635411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:11.642916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:11.643401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:11.644193 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:11.644633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:11.675558 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:34:11.758178 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cc12be6-3769-49da-a33c-869e9661aa83 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 204 len: 0 microversion: 2.1 time: 0.126909 Aug 04 05:34:11.762107 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3567/7247] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:34:11 2022] DELETE /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:34:11.767407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:11.769441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:11.775709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:11.776169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:11.776951 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:11.777399 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:11.919281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:11.927331 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9b6852d9-ee13-412d-97c0-4efc0646d1be tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1554 microversion: 2.1 time: 0.163930 Aug 04 05:34:11.928070 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3681/7248] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:11 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:12.950223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:12.950982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:12.958763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:12.959256 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:12.960031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:12.960468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:13.089127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:13.097443 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-12f5d74b-832d-4245-9603-e34fea71d5af tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1554 microversion: 2.1 time: 0.151538 Aug 04 05:34:13.098022 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3568/7249] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:12 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:14.093803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-97cf16ad-5762-4a2b-920f-37dfca13d250 req-8a4cbba7-04a3-4c59-967a-4fc7fec0ea5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d4f270-0abb-436d-8617-108139a48ab4", "name": "network-vif-deleted", "tag": "4fa87aa7-92da-4efc-8ed6-e79bffb999b0"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:14.111685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-97cf16ad-5762-4a2b-920f-37dfca13d250 req-8a4cbba7-04a3-4c59-967a-4fc7fec0ea5a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:14.113471 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-97cf16ad-5762-4a2b-920f-37dfca13d250 req-8a4cbba7-04a3-4c59-967a-4fc7fec0ea5a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:14.118775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:14.119820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:14.125978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-97cf16ad-5762-4a2b-920f-37dfca13d250 req-8a4cbba7-04a3-4c59-967a-4fc7fec0ea5a service nova] Creating event network-vif-deleted:4fa87aa7-92da-4efc-8ed6-e79bffb999b0 for instance c8d4f270-0abb-436d-8617-108139a48ab4 on n-h1-851337-5 Aug 04 05:34:14.128048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:14.128573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:14.129423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:14.130007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:14.132100 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-97cf16ad-5762-4a2b-920f-37dfca13d250 req-8a4cbba7-04a3-4c59-967a-4fc7fec0ea5a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042108 Aug 04 05:34:14.132710 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3682/7250] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:14.195105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b8b646e8e64a078d45b2803d6c780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b898fb6967104b21940a66008b7a150a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:14.202699 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6737ed55-5bd2-4b42-bd36-edfe5dc21329 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 200 len: 1344 microversion: 2.1 time: 0.087980 Aug 04 05:34:14.203305 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3569/7251] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:14 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 1344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:15.224436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:15.225086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [instance: c8d4f270-0abb-436d-8617-108139a48ab4] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:15.232772 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:15.233242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:15.234051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:15.234506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:15.248785 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] HTTP exception thrown: Instance c8d4f270-0abb-436d-8617-108139a48ab4 could not be found. Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Request method failure captured: Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 HTTP/1.1 Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61i7r0VrXwl8EFmDZlX3pEYh2WpiJnoC9OT7fj_tMFoawhGnHBhk2lx5XcKG5G9E5JMZqlfUZbkmzScdG348UJjjVnsSxgNpJpQVMRA1ODW4LwWG77_Mw-1UwOvQXhZF7jwgEP7guPm_6X8_JdgmITT-ToNWFi0cEOjpGLAEMcOkYuI Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b898fb6967104b21940a66008b7a150a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b898fb6967104b21940a66008b7a150a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b898fb6967104b21940a66008b7a150a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: b898fb6967104b21940a66008b7a150a Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1580866731 Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 80b8b646e8e64a078d45b2803d6c780b Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestMinimumBasicScenario-1580866731-project Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance c8d4f270-0abb-436d-8617-108139a48ab4 could not be found. Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'c8d4f270-0abb-436d-8617-108139a48ab4'} Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d4f270-0abb-436d-8617-108139a48ab4 could not be found. Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d4f270-0abb-436d-8617-108139a48ab4 could not be found. Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:15.250475 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d4f270-0abb-436d-8617-108139a48ab4 could not be found. Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Returning 404 to user: Instance c8d4f270-0abb-436d-8617-108139a48ab4 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4e4bcc3d-f247-44ce-8d65-b5fe37d74327 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4" status: 404 len: 111 microversion: 2.1 time: 0.032502 Aug 04 05:34:15.254933 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3683/7252] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:15 2022] GET /compute/v2.1/servers/c8d4f270-0abb-436d-8617-108139a48ab4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:34:15.262050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f197cce6-def3-4fed-9bfe-7210bd4b0d77 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] Calling method '.version_select at 0x7f1918feee50>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:15.266524 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f197cce6-def3-4fed-9bfe-7210bd4b0d77 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [1b3553b0-2080-4552-b69c-cd78772dd193] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:34:16.275479 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [None req-f197cce6-def3-4fed-9bfe-7210bd4b0d77 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] [1b3553b0-2080-4552-b69c-cd78772dd193] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 33328. Aug 04 05:34:16.296001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f197cce6-def3-4fed-9bfe-7210bd4b0d77 tempest-TestMinimumBasicScenario-1580866731 tempest-TestMinimumBasicScenario-1580866731-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1746803288" status: 202 len: 0 microversion: 2.1 time: 1.037755 Aug 04 05:34:16.296662 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3570/7253] 10.222.0.69 () {58 vars in 1272 bytes} [Thu Aug 4 05:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1746803288 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:34:25.506043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=18 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:25.506804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:25.696282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-10d69ca8-77ba-4fb2-be67-1d014c60091a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: .version_select at 0x7f191946c4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1400229351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWbx4ilCQ60JWWC2XhnfSgjghu1p8hq7KuOa8WGJfblk1al0QCKVS9Hj+7vakqz4IYtyMt1PEYk1Jkqe5OQXBT6pRtmqUCCsGNvWORwc/52elj8VIDhVgCisAh4ttli7w=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:25.712646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-10d69ca8-77ba-4fb2-be67-1d014c60091a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:34:25.717869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-10d69ca8-77ba-4fb2-be67-1d014c60091a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:34:25.731627 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10d69ca8-77ba-4fb2-be67-1d014c60091a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [c0e9b15a-e87d-4d1b-8697-d53fad7d1ae7] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:34:26.740901 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [None req-10d69ca8-77ba-4fb2-be67-1d014c60091a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [c0e9b15a-e87d-4d1b-8697-d53fad7d1ae7] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 33456. Aug 04 05:34:26.758681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-10d69ca8-77ba-4fb2-be67-1d014c60091a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.258834 Aug 04 05:34:26.759347 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3684/7254] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:34:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:32.691576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:32.692499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:32.696628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-363300325", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "6f774dcc-7c2c-48ee-8d53-5e34321df2e3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1400229351", "security_groups": [{"name": "tempest-secgroup-smoke-41099180"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:32.815328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] validate_networks() for [('6f774dcc-7c2c-48ee-8d53-5e34321df2e3', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:34:33.258198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:34:33.258632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:34:33.259145 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:34:33.259602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:34:33.260062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:34:33.270371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:33.270828 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:33.271715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:33.272157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:33.289557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:34:33.295138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:34:33.307775 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:34:33.310210 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:34:33.355393 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [9387cb11-8f2c-4f9f-963f-04e61f5ad7e8] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:34:34.362837 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [9387cb11-8f2c-4f9f-963f-04e61f5ad7e8] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 33502. Aug 04 05:34:34.373063 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c2f167d4-5e03-42a3-a556-d09045e85f7a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.683512 Aug 04 05:34:34.374193 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3571/7255] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:34:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:34:34.388441 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-00bd2559-2341-407f-8151-c6034130c9b1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:34.389826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-00bd2559-2341-407f-8151-c6034130c9b1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:34.457206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-00bd2559-2341-407f-8151-c6034130c9b1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:34.464785 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-00bd2559-2341-407f-8151-c6034130c9b1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1266 microversion: 2.1 time: 0.083167 Aug 04 05:34:34.466555 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3685/7256] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:34 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:35.490117 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:35.491785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:35.498333 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:35.498790 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:35.499598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:35.500042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:35.578136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:35.587380 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6e7abfb-c3fb-481c-b9e3-6d19de1323a9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1318 microversion: 2.1 time: 0.103548 Aug 04 05:34:35.597990 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3572/7257] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:35 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:36.613292 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:36.614637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:36.622409 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:36.623174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:36.623989 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:36.624448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:36.833137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:36.841804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c9cfe0be-8ec6-4aef-bcdb-af344c9f5514 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1390 microversion: 2.1 time: 0.234587 Aug 04 05:34:36.842407 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3686/7258] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:36 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:37.106708 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d2f6143a-9da0-496a-9142-92c79a3a558b req-2eb56033-8b34-4819-8b5a-08b89c849777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539242ee-8035-49be-887a-4b3db6ad1f7a", "tag": "52f69a22-5866-4f7e-8ebe-5b3aac87da6c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:37.120999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d2f6143a-9da0-496a-9142-92c79a3a558b req-2eb56033-8b34-4819-8b5a-08b89c849777 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:37.121713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d2f6143a-9da0-496a-9142-92c79a3a558b req-2eb56033-8b34-4819-8b5a-08b89c849777 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:37.134067 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d2f6143a-9da0-496a-9142-92c79a3a558b req-2eb56033-8b34-4819-8b5a-08b89c849777 service nova] Creating event network-changed:52f69a22-5866-4f7e-8ebe-5b3aac87da6c for instance 539242ee-8035-49be-887a-4b3db6ad1f7a on n-h2-851337-5 Aug 04 05:34:37.139586 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d2f6143a-9da0-496a-9142-92c79a3a558b req-2eb56033-8b34-4819-8b5a-08b89c849777 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037008 Aug 04 05:34:37.140302 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3573/7259] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:34:37.862544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:37.863210 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:37.870090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:37.870565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:37.871402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:37.871862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:38.003404 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:38.011334 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-917c1469-348c-427d-9c83-05251e87e5b5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1390 microversion: 2.1 time: 0.152545 Aug 04 05:34:38.011955 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3687/7260] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:37 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:39.034865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:39.035608 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:39.042972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:39.043563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:39.044370 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:39.044815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:39.195171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:39.203236 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bce9134-f25c-4c5f-a4f9-ee7272051ba8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1390 microversion: 2.1 time: 0.173083 Aug 04 05:34:39.204503 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3574/7261] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:39 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:40.227262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:40.227898 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:40.234663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:40.235168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:40.236615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:40.237074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:40.370391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:40.378660 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8082f8c6-2636-476a-afc0-1893c5c431df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1390 microversion: 2.1 time: 0.155293 Aug 04 05:34:40.379483 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3688/7262] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:40 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:41.400250 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:41.400872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:41.408344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:41.408802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:41.409571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:41.410011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:41.558713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:41.566382 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a776db0b-9c8d-421e-a25d-c8359e2f6add tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1390 microversion: 2.1 time: 0.170033 Aug 04 05:34:41.566973 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3575/7263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:41 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:34:42.441736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0978017b-ed34-4e8f-8d16-5c50e3c004b9 req-45e4e622-ed03-4f90-b622-4f035b3ba082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539242ee-8035-49be-887a-4b3db6ad1f7a", "name": "network-vif-plugged", "status": "completed", "tag": "52f69a22-5866-4f7e-8ebe-5b3aac87da6c"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:42.452910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0978017b-ed34-4e8f-8d16-5c50e3c004b9 req-45e4e622-ed03-4f90-b622-4f035b3ba082 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:42.453463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0978017b-ed34-4e8f-8d16-5c50e3c004b9 req-45e4e622-ed03-4f90-b622-4f035b3ba082 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:42.465824 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0978017b-ed34-4e8f-8d16-5c50e3c004b9 req-45e4e622-ed03-4f90-b622-4f035b3ba082 service nova] Creating event network-vif-plugged:52f69a22-5866-4f7e-8ebe-5b3aac87da6c for instance 539242ee-8035-49be-887a-4b3db6ad1f7a on n-h2-851337-5 Aug 04 05:34:42.472348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0978017b-ed34-4e8f-8d16-5c50e3c004b9 req-45e4e622-ed03-4f90-b622-4f035b3ba082 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034635 Aug 04 05:34:42.472348 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3689/7264] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:42.588436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:42.589046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:42.596338 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:42.596781 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:42.597729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:42.598018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:42.736724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:42.744220 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48ee3e95-ccb3-40e0-a880-7c213e419e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1390 microversion: 2.1 time: 0.160455 Aug 04 05:34:42.744810 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3576/7265] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:42 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:34:43.767514 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:43.768483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:43.774739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:43.775231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:43.776007 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:43.776456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:43.912197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:43.920030 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-351a2ab5-140a-4a98-8cfc-e9face2ecbed tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1561 microversion: 2.1 time: 0.158152 Aug 04 05:34:43.920532 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3690/7266] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:43 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:43.940611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:43.941225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:43.943203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:43.943866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:43.950532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:43.951007 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:43.951776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:43.952220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:44.081000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:44.088437 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b12a76ea-0492-4c6d-a681-00eff063829b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1561 microversion: 2.1 time: 0.152229 Aug 04 05:34:44.089024 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3577/7267] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:43 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:45.703131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:45.703763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:45.706548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-43aa7ffb-97f4-4b95-bc18-b96dbbb80d22 req-2a7e770f-4a6f-4c65-a58b-7c5c2e6e3b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539242ee-8035-49be-887a-4b3db6ad1f7a", "tag": "52f69a22-5866-4f7e-8ebe-5b3aac87da6c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:45.707109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:45.713079 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:45.713782 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:45.714743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:45.715383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:45.718974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-43aa7ffb-97f4-4b95-bc18-b96dbbb80d22 req-2a7e770f-4a6f-4c65-a58b-7c5c2e6e3b12 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:45.719509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-43aa7ffb-97f4-4b95-bc18-b96dbbb80d22 req-2a7e770f-4a6f-4c65-a58b-7c5c2e6e3b12 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:45.731359 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-43aa7ffb-97f4-4b95-bc18-b96dbbb80d22 req-2a7e770f-4a6f-4c65-a58b-7c5c2e6e3b12 service nova] Creating event network-changed:52f69a22-5866-4f7e-8ebe-5b3aac87da6c for instance 539242ee-8035-49be-887a-4b3db6ad1f7a on n-h2-851337-5 Aug 04 05:34:45.736978 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-43aa7ffb-97f4-4b95-bc18-b96dbbb80d22 req-2a7e770f-4a6f-4c65-a58b-7c5c2e6e3b12 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034474 Aug 04 05:34:45.737919 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3578/7268] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:45.944791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:45.952911 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-62f7a9f3-9466-45a3-bdc9-423afecf2763 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1561 microversion: 2.1 time: 0.254189 Aug 04 05:34:45.953492 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3691/7269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:45 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:09.196220 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:09.196970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=36 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:09.201682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-39c47f1a-be49-4961-b1b8-16404f6aadae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:09.204607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-39c47f1a-be49-4961-b1b8-16404f6aadae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:09.212177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39c47f1a-be49-4961-b1b8-16404f6aadae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:09.212634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39c47f1a-be49-4961-b1b8-16404f6aadae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:09.213405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39c47f1a-be49-4961-b1b8-16404f6aadae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:09.213847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-39c47f1a-be49-4961-b1b8-16404f6aadae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:09.266720 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-39c47f1a-be49-4961-b1b8-16404f6aadae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action" status: 200 len: 24572 microversion: 2.1 time: 0.071697 Aug 04 05:35:09.267392 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3579/7270] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:35:09 2022] POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action => generated 24572 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:35:15.647832 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7cf2353a-1426-4da6-8432-4257ffdb26d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:15.648572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7cf2353a-1426-4da6-8432-4257ffdb26d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:15.650355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:15.651150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=32 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:15.657750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cf2353a-1426-4da6-8432-4257ffdb26d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:15.658252 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cf2353a-1426-4da6-8432-4257ffdb26d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:15.659205 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cf2353a-1426-4da6-8432-4257ffdb26d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:15.659661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7cf2353a-1426-4da6-8432-4257ffdb26d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:15.732886 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7cf2353a-1426-4da6-8432-4257ffdb26d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.089825 Aug 04 05:35:15.733470 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3692/7271] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:35:15 2022] POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:35:15.743123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:15.743825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:15.752153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:15.752729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:15.753667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:15.754240 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:15.900665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:15.909035 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eec8afaf-fd87-40ee-b6cb-846807ecc0a1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1685 microversion: 2.1 time: 0.170452 Aug 04 05:35:15.909675 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3580/7272] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:15 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:16.932504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:16.933226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:16.940526 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:16.941086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:16.942049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:16.942594 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:17.077183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:17.084976 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0aa35e08-076e-4cc4-8231-df0715fac608 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1665 microversion: 2.1 time: 0.157787 Aug 04 05:35:17.085602 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3693/7273] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:16 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:18.181476 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cd27f69e-d9b1-43b8-944d-96543001dab8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:18.183657 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cd27f69e-d9b1-43b8-944d-96543001dab8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:18.191856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd27f69e-d9b1-43b8-944d-96543001dab8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.192317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd27f69e-d9b1-43b8-944d-96543001dab8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.193089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd27f69e-d9b1-43b8-944d-96543001dab8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.193540 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-cd27f69e-d9b1-43b8-944d-96543001dab8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.242105 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cd27f69e-d9b1-43b8-944d-96543001dab8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action" status: 200 len: 32651 microversion: 2.1 time: 0.064386 Aug 04 05:35:18.242758 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3581/7274] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:35:18 2022] POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action => generated 32651 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:35:18.255066 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e04ad44-da7b-4ef8-ab87-1f8203f71791 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:18.255628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2e04ad44-da7b-4ef8-ab87-1f8203f71791 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:18.262620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e04ad44-da7b-4ef8-ab87-1f8203f71791 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.263140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e04ad44-da7b-4ef8-ab87-1f8203f71791 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.263936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e04ad44-da7b-4ef8-ab87-1f8203f71791 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.264388 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e04ad44-da7b-4ef8-ab87-1f8203f71791 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.331348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2e04ad44-da7b-4ef8-ab87-1f8203f71791 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.080453 Aug 04 05:35:18.331997 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3694/7275] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:35:18 2022] POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:35:18.342448 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:18.343413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:18.353037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.353573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.354400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.354885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.499904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:18.508377 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c3a04ec4-6d4d-4ace-841e-3a38f2cf543e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1672 microversion: 2.1 time: 0.170865 Aug 04 05:35:18.508955 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3582/7276] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:18 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:19.531864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:19.533167 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:19.540522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:19.540993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:19.541787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:19.542247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:19.675670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:19.683362 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b3c3fad8-58ab-46b3-9a38-48be560e1d5e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1680 microversion: 2.1 time: 0.155970 Aug 04 05:35:19.683940 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3695/7277] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:19 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:19.780467 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-09e67940-c5a3-4c0e-a7bf-04a1dfd6f747 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:19.782695 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-09e67940-c5a3-4c0e-a7bf-04a1dfd6f747 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:19.790601 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09e67940-c5a3-4c0e-a7bf-04a1dfd6f747 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:19.791131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09e67940-c5a3-4c0e-a7bf-04a1dfd6f747 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:19.791904 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09e67940-c5a3-4c0e-a7bf-04a1dfd6f747 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:19.792349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-09e67940-c5a3-4c0e-a7bf-04a1dfd6f747 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:19.839962 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-09e67940-c5a3-4c0e-a7bf-04a1dfd6f747 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action" status: 200 len: 35462 microversion: 2.1 time: 0.063237 Aug 04 05:35:19.840635 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3583/7278] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:35:19 2022] POST /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a/action => generated 35462 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:35:20.843228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:20.843732 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:20.846754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b27d3aca-1c50-42d6-aa54-0a15c2857cd4 req-c1656e35-946c-488c-89b8-4c5bdd225858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539242ee-8035-49be-887a-4b3db6ad1f7a", "tag": "52f69a22-5866-4f7e-8ebe-5b3aac87da6c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:20.852188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:20.852755 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:20.853626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:20.854158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:20.858538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b27d3aca-1c50-42d6-aa54-0a15c2857cd4 req-c1656e35-946c-488c-89b8-4c5bdd225858 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:20.859016 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b27d3aca-1c50-42d6-aa54-0a15c2857cd4 req-c1656e35-946c-488c-89b8-4c5bdd225858 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:20.870418 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b27d3aca-1c50-42d6-aa54-0a15c2857cd4 req-c1656e35-946c-488c-89b8-4c5bdd225858 service nova] Creating event network-changed:52f69a22-5866-4f7e-8ebe-5b3aac87da6c for instance 539242ee-8035-49be-887a-4b3db6ad1f7a on n-h2-851337-5 Aug 04 05:35:20.875896 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b27d3aca-1c50-42d6-aa54-0a15c2857cd4 req-c1656e35-946c-488c-89b8-4c5bdd225858 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033728 Aug 04 05:35:20.876830 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3584/7279] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:20.883291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:35:20.972283 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffb027a3-fe48-4071-990e-a59607a08578 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 204 len: 0 microversion: 2.1 time: 0.132615 Aug 04 05:35:20.973218 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3696/7280] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:35:20 2022] DELETE /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:35:20.982401 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:20.983034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:20.990451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:20.991201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:20.993101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:20.993745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:21.156837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:21.164789 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-52a273f7-c318-420f-9002-f3be3f320474 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1686 microversion: 2.1 time: 0.187152 Aug 04 05:35:21.165569 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3585/7281] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:20 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:35:22.188299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:22.189025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:22.196046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:22.196516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:22.197305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:22.197764 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:22.366234 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:22.379702 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f58bf50a-1602-40e7-80a9-b0077620e62b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1686 microversion: 2.1 time: 0.195269 Aug 04 05:35:22.380746 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3697/7282] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:22 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:23.099578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-2411cb7f-6b8e-430e-992c-c792fcd2779d req-f4641d13-abb7-4abd-b144-89c39996f467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539242ee-8035-49be-887a-4b3db6ad1f7a", "name": "network-vif-deleted", "tag": "52f69a22-5866-4f7e-8ebe-5b3aac87da6c"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:23.111360 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2411cb7f-6b8e-430e-992c-c792fcd2779d req-f4641d13-abb7-4abd-b144-89c39996f467 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:23.111800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-2411cb7f-6b8e-430e-992c-c792fcd2779d req-f4641d13-abb7-4abd-b144-89c39996f467 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:23.127267 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-2411cb7f-6b8e-430e-992c-c792fcd2779d req-f4641d13-abb7-4abd-b144-89c39996f467 service nova] Creating event network-vif-deleted:52f69a22-5866-4f7e-8ebe-5b3aac87da6c for instance 539242ee-8035-49be-887a-4b3db6ad1f7a on n-h2-851337-5 Aug 04 05:35:23.132089 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-2411cb7f-6b8e-430e-992c-c792fcd2779d req-f4641d13-abb7-4abd-b144-89c39996f467 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036251 Aug 04 05:35:23.132900 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3586/7283] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:23.409559 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:23.410192 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:23.416793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:23.417464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:23.418055 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:23.418515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:23.458039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:23.458527 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:23.459103 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lazy-loading 'fault' on Instance uuid 539242ee-8035-49be-887a-4b3db6ad1f7a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:35:23.508125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:23.520960 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3b87a2b1-a7a3-44da-9440-5e0f6fb278e6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 200 len: 1356 microversion: 2.1 time: 0.117050 Aug 04 05:35:23.521853 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3698/7284] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:23 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 1356 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:24.553074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:24.553772 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 539242ee-8035-49be-887a-4b3db6ad1f7a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:24.560105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:24.560563 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:24.561330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:24.561768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:24.575480 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] HTTP exception thrown: Instance 539242ee-8035-49be-887a-4b3db6ad1f7a could not be found. Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Request method failure captured: Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a HTTP/1.1 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61pgk4eLdfJ9UEccN2kVQFTK9OsBvcXapI8H7sZ9Cl0FIdhT7Y-t4iblXzZkNpmud1oH_6UEnKdriff06EaFtvySOTzFDga0YLA4ljfOO6pc9ZPK73Yz2aDlFai0uBNFrz9BPP5KLqk_qgDSnLxEso-QcbDquFLI0Jq2XV0uDJfpOjs Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e7eae59a921c40ee9ed58b1b12cdcbbe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4c284c697d1a4c0fa858d2966d8915f1 Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 539242ee-8035-49be-887a-4b3db6ad1f7a could not be found. Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '539242ee-8035-49be-887a-4b3db6ad1f7a'} Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539242ee-8035-49be-887a-4b3db6ad1f7a could not be found. Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539242ee-8035-49be-887a-4b3db6ad1f7a could not be found. Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:35:24.577102 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539242ee-8035-49be-887a-4b3db6ad1f7a could not be found. Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Returning 404 to user: Instance 539242ee-8035-49be-887a-4b3db6ad1f7a could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4ec420d0-1f4c-4e9b-a1e3-c635387f71f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a" status: 404 len: 111 microversion: 2.1 time: 0.031374 Aug 04 05:35:24.581435 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3587/7285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:24 2022] GET /compute/v2.1/servers/539242ee-8035-49be-887a-4b3db6ad1f7a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:35:27.986928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8b62df24-c74b-4c1d-b749-46a145607b93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '.version_select at 0x7f191945daf0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:28.012040 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8b62df24-c74b-4c1d-b749-46a145607b93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1400229351" status: 202 len: 0 microversion: 2.1 time: 0.029395 Aug 04 05:35:28.012834 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3699/7286] 10.222.0.69 () {58 vars in 1284 bytes} [Thu Aug 4 05:35:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1400229351 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:35:28.045327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ec067c6f-d839-415e-b5e1-498312f5b98c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: .version_select at 0x7f1923967790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1141679496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnMON13lqLhVaKofSlvjaPJPQ+v/BKsEy+6a0XpgzDp2VtdGirEmohBcsHx0xEeTDn4cGp41axyGCX6F73m5uxOzBByjO4lxp8bXLNVS9FM3cPMKnQP9IX3dE9Ml8bkyQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:28.062893 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ec067c6f-d839-415e-b5e1-498312f5b98c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:35:28.068398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ec067c6f-d839-415e-b5e1-498312f5b98c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:35:28.095882 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ec067c6f-d839-415e-b5e1-498312f5b98c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055424 Aug 04 05:35:28.096487 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3588/7287] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:35:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:33.649396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:33.654535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-202091447", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "1e84a3c0-88c5-48ad-9b82-05cd6272810d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1141679496", "security_groups": [{"name": "tempest-secgroup-smoke-1653295857"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:33.779568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] validate_networks() for [('1e84a3c0-88c5-48ad-9b82-05cd6272810d', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:35:34.306416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:35:34.306860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:35:34.307384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:35:34.307814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:35:34.308256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:35:34.319146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:34.319616 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:34.320446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:34.321003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:34.340283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:35:34.348110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:35:34.362658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:35:34.365056 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:35:34.417361 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bfa84fb9-8708-4d35-95ea-93dcfe5c2128 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769650 Aug 04 05:35:34.418583 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3700/7288] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:35:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:35:34.431578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7a424824-8feb-4289-9a3a-02a05953029d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:34.432930 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7a424824-8feb-4289-9a3a-02a05953029d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:34.520134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7a424824-8feb-4289-9a3a-02a05953029d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:34.528074 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7a424824-8feb-4289-9a3a-02a05953029d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1266 microversion: 2.1 time: 0.102552 Aug 04 05:35:34.529280 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3589/7289] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:34 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:35.554568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:35.555175 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:35.564260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:35.565039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:35.566431 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:35.567137 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:35.655318 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:35.674083 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-471301bd-95ef-4406-94db-f1e63cb0dc2a tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1326 microversion: 2.1 time: 0.128397 Aug 04 05:35:35.675068 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3701/7290] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:35 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:36.696324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:36.696977 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:36.698727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=36 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:36.705631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:36.706094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:36.706854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:36.707312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:36.849189 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:36.856936 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b4aa30a5-b135-4b23-b94c-77fd0841390f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.164606 Aug 04 05:35:36.857505 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3590/7291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:36 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:36.998863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-e4502de5-4865-4801-bcea-8addecfd60f8 req-6f2df71b-3182-42fd-8e00-1f9c4c75c81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77753b3f-52f8-47be-bf42-2458c5650910", "tag": "d674bd4b-6de5-453b-a378-31c552f12b94"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:37.017356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e4502de5-4865-4801-bcea-8addecfd60f8 req-6f2df71b-3182-42fd-8e00-1f9c4c75c81b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:37.018123 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-e4502de5-4865-4801-bcea-8addecfd60f8 req-6f2df71b-3182-42fd-8e00-1f9c4c75c81b service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:37.044008 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-e4502de5-4865-4801-bcea-8addecfd60f8 req-6f2df71b-3182-42fd-8e00-1f9c4c75c81b service nova] Creating event network-changed:d674bd4b-6de5-453b-a378-31c552f12b94 for instance 77753b3f-52f8-47be-bf42-2458c5650910 on n-h1-851337-5 Aug 04 05:35:37.050522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-e4502de5-4865-4801-bcea-8addecfd60f8 req-6f2df71b-3182-42fd-8e00-1f9c4c75c81b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056760 Aug 04 05:35:37.051662 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3702/7292] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:37.879692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:37.880311 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:37.887383 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:37.887843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:37.888618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:37.889062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:38.024961 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:38.032606 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d8bfbcdc-264c-45dc-9d1a-e5c4c9cc854e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.157401 Aug 04 05:35:38.033171 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3591/7293] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:37 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:39.054197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:39.054933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:39.066082 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:39.066709 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:39.067586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:39.068044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:39.206013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:39.213584 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-abf3732c-5f87-4ec3-8d86-59593e712189 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.163669 Aug 04 05:35:39.214159 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3703/7294] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:39 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:40.233900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:40.234450 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:40.237760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:40.243206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:40.243662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:40.244430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:40.244867 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:40.375660 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:40.383039 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3d762af9-9c87-4c9d-8bd6-3c7684a41395 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.153140 Aug 04 05:35:40.383606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3592/7295] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:40 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:41.404738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:41.405510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:41.412583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:41.413127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:41.413923 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:41.414380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:41.553283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:41.560899 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-01e88af9-22da-415b-bd8b-d14c941b4568 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.160186 Aug 04 05:35:41.561894 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3704/7296] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:41 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:42.582280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:42.582898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:42.589866 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:42.590324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:42.591165 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:42.591609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:42.727847 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:42.735891 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d80c78d4-b0f0-48ab-b9d8-cc079fa3de13 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.157525 Aug 04 05:35:42.736466 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3593/7297] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:42 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:43.491153 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1bd6c3b0-df15-4df7-86b7-79ee4d266cd8 req-a2601a00-460b-43fe-ac89-0ad5046c69db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77753b3f-52f8-47be-bf42-2458c5650910", "name": "network-vif-plugged", "status": "completed", "tag": "d674bd4b-6de5-453b-a378-31c552f12b94"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:43.502463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1bd6c3b0-df15-4df7-86b7-79ee4d266cd8 req-a2601a00-460b-43fe-ac89-0ad5046c69db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:43.503563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1bd6c3b0-df15-4df7-86b7-79ee4d266cd8 req-a2601a00-460b-43fe-ac89-0ad5046c69db service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:43.515408 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1bd6c3b0-df15-4df7-86b7-79ee4d266cd8 req-a2601a00-460b-43fe-ac89-0ad5046c69db service nova] Creating event network-vif-plugged:d674bd4b-6de5-453b-a378-31c552f12b94 for instance 77753b3f-52f8-47be-bf42-2458c5650910 on n-h1-851337-5 Aug 04 05:35:43.521507 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1bd6c3b0-df15-4df7-86b7-79ee4d266cd8 req-a2601a00-460b-43fe-ac89-0ad5046c69db service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034133 Aug 04 05:35:43.522464 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3705/7298] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:43.757154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:43.757782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:43.764627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:43.765072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:43.765831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:43.766267 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:43.910046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:43.917984 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a456b8cb-5d4a-46d9-803d-7182ccbca792 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.164664 Aug 04 05:35:43.919615 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3594/7299] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:43 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:44.940836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:44.941552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:44.943699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:44.944385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:44.952286 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:44.952784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:44.953548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:44.954001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:45.103208 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:45.111236 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-90a570e0-30c7-488b-9eff-30c7ac52655f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1392 microversion: 2.1 time: 0.174604 Aug 04 05:35:45.111844 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3706/7300] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:44 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:46.132125 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:46.132745 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:46.135835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:46.140886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:46.141359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:46.142137 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:46.142581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:46.277399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:46.285500 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1c1a6aa5-cbd2-4e43-b680-093210bc2f3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1564 microversion: 2.1 time: 0.157361 Aug 04 05:35:46.286078 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3595/7301] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:46 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:46.305760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:46.306391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:46.309094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:46.314539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:46.315031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:46.315822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:46.316278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:46.454100 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:46.462261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-debaa113-d7ad-4cc6-8573-16b92b59cb8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1564 microversion: 2.1 time: 0.160332 Aug 04 05:35:46.462839 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3707/7302] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:46 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:48.334932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:48.335589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:48.340211 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a54d7eb8-0fd4-4d01-bf06-8d02557ff8cf req-8aad6938-6ca1-4943-b100-f20f8ca9af23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77753b3f-52f8-47be-bf42-2458c5650910", "tag": "d674bd4b-6de5-453b-a378-31c552f12b94"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:48.343026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:48.343762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:48.344625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:48.345229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:48.350652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a54d7eb8-0fd4-4d01-bf06-8d02557ff8cf req-8aad6938-6ca1-4943-b100-f20f8ca9af23 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:48.351142 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a54d7eb8-0fd4-4d01-bf06-8d02557ff8cf req-8aad6938-6ca1-4943-b100-f20f8ca9af23 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:48.363739 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a54d7eb8-0fd4-4d01-bf06-8d02557ff8cf req-8aad6938-6ca1-4943-b100-f20f8ca9af23 service nova] Creating event network-changed:d674bd4b-6de5-453b-a378-31c552f12b94 for instance 77753b3f-52f8-47be-bf42-2458c5650910 on n-h1-851337-5 Aug 04 05:35:48.369119 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a54d7eb8-0fd4-4d01-bf06-8d02557ff8cf req-8aad6938-6ca1-4943-b100-f20f8ca9af23 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041294 Aug 04 05:35:48.369964 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3708/7303] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:48.486629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:48.495779 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-68379610-5e6d-4d82-8ca7-5fbc3ab101d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1564 microversion: 2.1 time: 0.169636 Aug 04 05:35:48.496960 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3596/7304] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:48 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:19.776583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-151bcc62-9bfa-4e83-ac24-feba184c52a4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:36:19.778928 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-151bcc62-9bfa-4e83-ac24-feba184c52a4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:19.781160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:19.781836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=38 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:19.788158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-151bcc62-9bfa-4e83-ac24-feba184c52a4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.788634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-151bcc62-9bfa-4e83-ac24-feba184c52a4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.789423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-151bcc62-9bfa-4e83-ac24-feba184c52a4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.789883 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-151bcc62-9bfa-4e83-ac24-feba184c52a4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.851397 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-151bcc62-9bfa-4e83-ac24-feba184c52a4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910/action" status: 200 len: 24568 microversion: 2.1 time: 0.079145 Aug 04 05:36:19.852052 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3709/7305] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:36:19 2022] POST /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910/action => generated 24568 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:36:50.309962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=9 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:50.310872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=42 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:50.315773 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ad68fc60-d809-4188-a5b5-09ef6ddca320 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:36:50.318255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ad68fc60-d809-4188-a5b5-09ef6ddca320 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:50.325155 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad68fc60-d809-4188-a5b5-09ef6ddca320 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:50.325602 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad68fc60-d809-4188-a5b5-09ef6ddca320 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:50.326371 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad68fc60-d809-4188-a5b5-09ef6ddca320 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:50.326808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ad68fc60-d809-4188-a5b5-09ef6ddca320 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:50.405877 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ad68fc60-d809-4188-a5b5-09ef6ddca320 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910/action" status: 202 len: 0 microversion: 2.1 time: 0.097518 Aug 04 05:36:50.406523 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3597/7306] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:36:50 2022] POST /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:36:50.415353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:50.416070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:50.418777 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:50.419596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:50.427536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:50.428397 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:50.429299 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:50.429760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:50.656170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:50.664889 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-67f88778-98f0-42e2-87e7-840b44137c48 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1675 microversion: 2.1 time: 0.253741 Aug 04 05:36:50.666032 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3710/7307] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:50 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:51.690128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:51.690836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:51.697108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:51.697557 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:51.698327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:51.698763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:51.891283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:51.901660 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-85bedc0f-2cf3-49af-9997-12b8fc4e7b04 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.217074 Aug 04 05:36:51.902251 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3598/7308] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:51 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:52.924384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:52.925071 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:52.933754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:52.934220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:52.935059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:52.935558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:53.070006 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:53.077848 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8370f8ff-bd2d-46fd-b0a7-3474be63e898 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.157933 Aug 04 05:36:53.078425 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3711/7309] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:52 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:54.101607 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:54.102151 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:54.109095 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:54.109555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:54.110974 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:54.111432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:54.245925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:54.253665 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d943974d-e386-4c53-aea9-c6be9e824024 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.156341 Aug 04 05:36:54.254261 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3599/7310] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:54 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:55.274998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:55.275634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:55.283455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:55.283926 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:55.284773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:55.285174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:55.415834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:55.423477 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-63111726-19d2-46b6-a3b2-48b3dc6bf9e1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.152411 Aug 04 05:36:55.424061 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3712/7311] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:55 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:56.444800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:56.445318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:56.452139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:56.452595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:56.453361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:56.453802 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:56.584541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:56.591985 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fbebc0c0-b067-4697-9262-d86cd210096c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.151191 Aug 04 05:36:56.592566 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3600/7312] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:56 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:57.614495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:57.615331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:57.622273 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:57.622740 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:57.623565 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:57.624075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:57.770036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:57.777566 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1a6194dd-0e65-4dc8-bbd2-2464d0193b59 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.167662 Aug 04 05:36:57.778145 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3713/7313] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:57 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:58.798261 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:58.798874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:58.805846 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:58.806301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:58.807123 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:58.807561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:58.942253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:58.950304 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e3bead3-6565-4fbf-82da-9b3544c72067 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.155945 Aug 04 05:36:58.950898 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3601/7314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:58 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:59.972697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:59.973658 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:59.981060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:59.981837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:59.983276 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:59.984095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:00.143461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:00.151033 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7ef7f12f-9332-4172-a25d-92cbac3cddce tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.182980 Aug 04 05:37:00.151603 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3714/7315] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:36:59 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:01.172297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:01.173542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:01.180144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:01.180600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:01.181359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:01.181798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:01.314400 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:01.321852 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-87fd1dd1-1c19-43f5-9f79-34cace02b265 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1680 microversion: 2.1 time: 0.153605 Aug 04 05:37:01.322459 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3602/7316] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:01 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:02.343968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:02.345161 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:02.352334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:02.352796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:02.353581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:02.354037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:02.488337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:02.495855 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f60d5d58-cb07-4184-a868-4fc2be18c25f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1683 microversion: 2.1 time: 0.155837 Aug 04 05:37:02.496433 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3715/7317] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:02 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:34.721216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fd4b42f2-a039-4d2b-be7e-afdded52fe3d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:37:34.723478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fd4b42f2-a039-4d2b-be7e-afdded52fe3d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:34.725665 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:34.726387 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:34.732205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4b42f2-a039-4d2b-be7e-afdded52fe3d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:34.732667 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4b42f2-a039-4d2b-be7e-afdded52fe3d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:34.733451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4b42f2-a039-4d2b-be7e-afdded52fe3d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:34.733898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fd4b42f2-a039-4d2b-be7e-afdded52fe3d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:34.808683 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fd4b42f2-a039-4d2b-be7e-afdded52fe3d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910/action" status: 200 len: 69054 microversion: 2.1 time: 0.092005 Aug 04 05:37:34.809345 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3603/7318] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:37:34 2022] POST /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910/action => generated 69054 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:37:54.474130 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:37:54.474725 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:37:58.341633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:58.342225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:58.344697 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:58.344835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-7239d571-c194-4ed8-b254-54ea5ff97037 req-796304a6-681e-43c9-9a14-c79939bfc33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77753b3f-52f8-47be-bf42-2458c5650910", "tag": "d674bd4b-6de5-453b-a378-31c552f12b94"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:37:58.346519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=36 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:58.352933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:58.353407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:58.354217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:58.354680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:58.356309 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:58.357202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:58.360150 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7239d571-c194-4ed8-b254-54ea5ff97037 req-796304a6-681e-43c9-9a14-c79939bfc33e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:58.360907 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7239d571-c194-4ed8-b254-54ea5ff97037 req-796304a6-681e-43c9-9a14-c79939bfc33e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:58.375141 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-7239d571-c194-4ed8-b254-54ea5ff97037 req-796304a6-681e-43c9-9a14-c79939bfc33e service nova] Creating event network-changed:d674bd4b-6de5-453b-a378-31c552f12b94 for instance 77753b3f-52f8-47be-bf42-2458c5650910 on n-h1-851337-5 Aug 04 05:37:58.380376 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-7239d571-c194-4ed8-b254-54ea5ff97037 req-796304a6-681e-43c9-9a14-c79939bfc33e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040208 Aug 04 05:37:58.381198 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3604/7319] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:37:58.382031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:37:58.472393 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-814ebef6-a943-4004-b91b-d3b63c65f700 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 204 len: 0 microversion: 2.1 time: 0.134248 Aug 04 05:37:58.473823 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3716/7320] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:37:58 2022] DELETE /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:37:58.482896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:58.483631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:58.490430 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:58.490889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:58.491693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:58.492774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:58.632219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:58.640465 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f9494e96-a09a-4345-9f03-be29df6c2e27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1689 microversion: 2.1 time: 0.161758 Aug 04 05:37:58.649634 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3605/7321] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:58 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:59.666112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:59.666870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:59.674077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:59.674550 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:59.675368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:59.675828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:59.824334 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:59.837450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bdfc0783-39d3-4535-af0f-c68b2bf18090 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1689 microversion: 2.1 time: 0.176248 Aug 04 05:37:59.838427 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3717/7322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:59 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:00.834582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-bcd0536d-b08d-4b7a-a1af-b1a520a0e268 req-a9f473e2-b76e-405f-8acf-41e2029c2dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77753b3f-52f8-47be-bf42-2458c5650910", "name": "network-vif-deleted", "tag": "d674bd4b-6de5-453b-a378-31c552f12b94"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:00.845438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bcd0536d-b08d-4b7a-a1af-b1a520a0e268 req-a9f473e2-b76e-405f-8acf-41e2029c2dac service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:00.846000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bcd0536d-b08d-4b7a-a1af-b1a520a0e268 req-a9f473e2-b76e-405f-8acf-41e2029c2dac service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:00.858306 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-bcd0536d-b08d-4b7a-a1af-b1a520a0e268 req-a9f473e2-b76e-405f-8acf-41e2029c2dac service nova] Creating event network-vif-deleted:d674bd4b-6de5-453b-a378-31c552f12b94 for instance 77753b3f-52f8-47be-bf42-2458c5650910 on n-h1-851337-5 Aug 04 05:38:00.862791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:00.863406 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-bcd0536d-b08d-4b7a-a1af-b1a520a0e268 req-a9f473e2-b76e-405f-8acf-41e2029c2dac service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099473 Aug 04 05:38:00.863506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:00.864002 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3606/7323] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:00.870635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:00.871174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:00.871978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:00.872460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:00.907486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:00.907952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:00.908445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lazy-loading 'fault' on Instance uuid 77753b3f-52f8-47be-bf42-2458c5650910 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:38:00.949506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:00.957475 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d82a64a5-8acb-4105-8e13-ce9a551872f7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 200 len: 1356 microversion: 2.1 time: 0.098578 Aug 04 05:38:00.958061 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3718/7324] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:00 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:38:01.979609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:01.980312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 77753b3f-52f8-47be-bf42-2458c5650910] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:01.987425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:01.987911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:01.988681 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:01.989126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:02.002262 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] HTTP exception thrown: Instance 77753b3f-52f8-47be-bf42-2458c5650910 could not be found. Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Request method failure captured: Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 HTTP/1.1 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61pgk4eLdfJ9UEccN2kVQFTK9OsBvcXapI8H7sZ9Cl0FIdhT7Y-t4iblXzZkNpmud1oH_6UEnKdriff06EaFtvySOTzFDga0YLA4ljfOO6pc9ZPK73Yz2aDlFai0uBNFrz9BPP5KLqk_qgDSnLxEso-QcbDquFLI0Jq2XV0uDJfpOjs Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e7eae59a921c40ee9ed58b1b12cdcbbe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4c284c697d1a4c0fa858d2966d8915f1 Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 77753b3f-52f8-47be-bf42-2458c5650910 could not be found. Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '77753b3f-52f8-47be-bf42-2458c5650910'} Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77753b3f-52f8-47be-bf42-2458c5650910 could not be found. Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77753b3f-52f8-47be-bf42-2458c5650910 could not be found. Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:38:02.003910 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77753b3f-52f8-47be-bf42-2458c5650910 could not be found. Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Returning 404 to user: Instance 77753b3f-52f8-47be-bf42-2458c5650910 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8651b484-6ae3-4e2e-9a03-49e7f167c5f6 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910" status: 404 len: 111 microversion: 2.1 time: 0.030663 Aug 04 05:38:02.008317 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3607/7325] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:01 2022] GET /compute/v2.1/servers/77753b3f-52f8-47be-bf42-2458c5650910 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:38:05.363646 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-760b2dd9-b394-486b-98ee-e064519a2bda tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '.version_select at 0x7f19193a7f70>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:05.385423 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-760b2dd9-b394-486b-98ee-e064519a2bda tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1141679496" status: 202 len: 0 microversion: 2.1 time: 0.025489 Aug 04 05:38:05.386019 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3719/7326] 10.222.0.69 () {58 vars in 1284 bytes} [Thu Aug 4 05:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1141679496 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:38:05.416926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9713fadc-6595-44de-9cfc-cacc14f77054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: .version_select at 0x7f191897e5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-56481104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQMdIcNWxNGSOb4iC4tn0mrPbRR5vURgW9YgSl8ulLCG2vOl25M0lq5BBN/n5Hqdr+rYaY0VRm4uaZx9gQE+TD9yQv45F/41/C+i7LJxb/ryToxLaZg7XFgLdMjK7qY2A=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:05.435752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9713fadc-6595-44de-9cfc-cacc14f77054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:38:05.441423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9713fadc-6595-44de-9cfc-cacc14f77054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:38:05.475091 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9713fadc-6595-44de-9cfc-cacc14f77054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.062678 Aug 04 05:38:05.475703 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3608/7327] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:38:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:11.035219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-569397324", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "6a3f739e-56e0-4656-940d-2eed395983cc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-56481104", "security_groups": [{"name": "tempest-secgroup-smoke-1965331885"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:11.063355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:11.193312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] validate_networks() for [('6a3f739e-56e0-4656-940d-2eed395983cc', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:38:11.648988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:38:11.649556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:38:11.650172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:38:11.650703 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:38:11.651305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:38:11.671077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:11.671555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:11.672387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:11.674046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:11.704638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:38:11.711875 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:38:11.725708 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:38:11.728659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:38:11.776489 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6a6b5b99-90cb-44c5-87f9-57c98921915d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745240 Aug 04 05:38:11.777622 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3720/7328] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:38:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:38:11.788110 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-cacfd501-a8e9-4cd1-9c92-97b5aadae84e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:11.790614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-cacfd501-a8e9-4cd1-9c92-97b5aadae84e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:11.867932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-cacfd501-a8e9-4cd1-9c92-97b5aadae84e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:11.881614 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-cacfd501-a8e9-4cd1-9c92-97b5aadae84e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1264 microversion: 2.1 time: 0.097210 Aug 04 05:38:11.883420 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3609/7329] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:11 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1264 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:38:12.904906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:12.906250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:12.914867 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:12.915775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:12.916856 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:12.917543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:12.991557 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:12.999135 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-da06b692-511b-4bf4-b809-ab7833abfaba tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1334 microversion: 2.1 time: 0.098926 Aug 04 05:38:12.999720 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3721/7330] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:12 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:14.020707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:14.021336 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:14.024808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:14.034564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:14.035054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:14.035850 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:14.036289 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:14.201247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:14.209372 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-21888139-c58d-4b92-ad2e-2e9ec93a84f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1390 microversion: 2.1 time: 0.192789 Aug 04 05:38:14.210032 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3610/7331] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:14 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:14.401031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-c4384e2e-a943-45e9-a1e4-7927d065eaa9 req-e39c2e10-6d89-4ef0-8ee9-7b957ead906c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:14.414039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c4384e2e-a943-45e9-a1e4-7927d065eaa9 req-e39c2e10-6d89-4ef0-8ee9-7b957ead906c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:14.414936 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-c4384e2e-a943-45e9-a1e4-7927d065eaa9 req-e39c2e10-6d89-4ef0-8ee9-7b957ead906c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:14.427725 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-c4384e2e-a943-45e9-a1e4-7927d065eaa9 req-e39c2e10-6d89-4ef0-8ee9-7b957ead906c service nova] Creating event network-changed:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h1-851337-5 Aug 04 05:38:14.433716 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-c4384e2e-a943-45e9-a1e4-7927d065eaa9 req-e39c2e10-6d89-4ef0-8ee9-7b957ead906c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038202 Aug 04 05:38:14.434525 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3722/7332] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:38:15.232215 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:15.233533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:15.241367 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:15.241834 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:15.242647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:15.243310 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:15.389941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:15.399990 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-96f24ead-45ac-42e3-a5bd-933a19dde132 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1390 microversion: 2.1 time: 0.171777 Aug 04 05:38:15.400888 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3611/7333] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:15 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:16.422726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:16.423472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:16.431395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:16.431864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:16.432666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:16.433116 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:16.565206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:16.573752 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-83f1f92d-4bb3-4661-aba5-1a3f80bdca71 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1390 microversion: 2.1 time: 0.155103 Aug 04 05:38:16.574335 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3723/7334] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:16 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:17.595091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:17.595701 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:17.603233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:17.603687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:17.604454 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:17.604913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:17.738585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:17.746866 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e310d174-fd48-495c-91d2-f9ea2d2a9054 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1390 microversion: 2.1 time: 0.155754 Aug 04 05:38:17.747576 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3612/7335] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:17 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:18.767829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:18.768843 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:18.777364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:18.777834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:18.778639 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:18.779155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:18.920831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:18.928511 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4a7ee34b-fc9e-44a7-9393-73b47fa68439 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1390 microversion: 2.1 time: 0.164651 Aug 04 05:38:18.929097 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3724/7336] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:18 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:19.950014 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:19.950627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:19.957744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:19.958198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:19.959001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:19.959447 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:20.091584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:20.099618 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4b4fac44-4c0a-4c51-b82d-b5307a743d1e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1390 microversion: 2.1 time: 0.153599 Aug 04 05:38:20.100189 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3613/7337] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:19 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:20.204525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-083e978d-5daa-439c-876e-8c0d2699d28d req-9a5d7939-12c6-4bdf-8e7c-c0a8b9a89f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "name": "network-vif-plugged", "status": "completed", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:20.215648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-083e978d-5daa-439c-876e-8c0d2699d28d req-9a5d7939-12c6-4bdf-8e7c-c0a8b9a89f21 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:20.216117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-083e978d-5daa-439c-876e-8c0d2699d28d req-9a5d7939-12c6-4bdf-8e7c-c0a8b9a89f21 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:20.227577 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-083e978d-5daa-439c-876e-8c0d2699d28d req-9a5d7939-12c6-4bdf-8e7c-c0a8b9a89f21 service nova] Creating event network-vif-plugged:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h1-851337-5 Aug 04 05:38:20.232884 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-083e978d-5daa-439c-876e-8c0d2699d28d req-9a5d7939-12c6-4bdf-8e7c-c0a8b9a89f21 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087673 Aug 04 05:38:20.233567 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3725/7338] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:21.122122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:21.122734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:21.129692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.130144 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.130899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.131356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.265425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:21.273159 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-35e294d8-b41d-4132-b75f-c8dfcbe50466 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1390 microversion: 2.1 time: 0.154880 Aug 04 05:38:21.273796 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3614/7339] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:21 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:22.299095 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:22.299822 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:22.302657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:22.303367 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:22.310037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:22.310504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:22.311323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:22.311791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:22.443544 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:22.451761 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b083b356-8476-4388-b192-09ef5004469c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1562 microversion: 2.1 time: 0.161664 Aug 04 05:38:22.452346 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3726/7340] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:22 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:22.472937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:22.473560 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:22.475524 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:22.481716 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:22.482174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:22.482945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:22.483407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:22.611979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:22.620039 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-75c3b2f4-9267-43e3-8cb5-0e337f2fcdf3 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1562 microversion: 2.1 time: 0.151038 Aug 04 05:38:22.620633 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3615/7341] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:22 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:24.516635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:24.517295 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:24.518041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-67fcd59b-44f0-4b75-9b33-b17acc876ecc req-15d93520-6ca6-44c7-a9c9-176fdea6a4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:24.525264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:24.525985 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:24.526878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:24.527365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:24.529824 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-67fcd59b-44f0-4b75-9b33-b17acc876ecc req-15d93520-6ca6-44c7-a9c9-176fdea6a4b3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:24.530335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-67fcd59b-44f0-4b75-9b33-b17acc876ecc req-15d93520-6ca6-44c7-a9c9-176fdea6a4b3 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:24.545344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-67fcd59b-44f0-4b75-9b33-b17acc876ecc req-15d93520-6ca6-44c7-a9c9-176fdea6a4b3 service nova] Creating event network-changed:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h1-851337-5 Aug 04 05:38:24.550904 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-67fcd59b-44f0-4b75-9b33-b17acc876ecc req-15d93520-6ca6-44c7-a9c9-176fdea6a4b3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037612 Aug 04 05:38:24.551558 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3616/7342] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:38:24.689304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:24.697954 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd26e505-9caa-4261-ac8c-d240ebcb3d6e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1562 microversion: 2.1 time: 0.187196 Aug 04 05:38:24.698718 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3727/7343] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:24 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:58.003026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:58.003703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=38 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:58.008048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-68bc0ff4-0acb-4001-8f22-a56a03b25c07 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:58.010266 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-68bc0ff4-0acb-4001-8f22-a56a03b25c07 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:58.018038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68bc0ff4-0acb-4001-8f22-a56a03b25c07 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:58.018491 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68bc0ff4-0acb-4001-8f22-a56a03b25c07 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:58.019349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68bc0ff4-0acb-4001-8f22-a56a03b25c07 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:58.020034 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-68bc0ff4-0acb-4001-8f22-a56a03b25c07 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:58.079556 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-68bc0ff4-0acb-4001-8f22-a56a03b25c07 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action" status: 200 len: 24566 microversion: 2.1 time: 0.078478 Aug 04 05:38:58.080424 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3617/7344] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:38:57 2022] POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action => generated 24566 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:39:28.489531 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:28.490298 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=36 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:28.541944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:28.544351 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:28.550808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:28.551312 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:28.552094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:28.552546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:28.610826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:28.619596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119343) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 05:39:28.628982 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:39:28.629572 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:39:28.630061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:39:28.630487 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:39:28.630913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:39:28.704441 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2327e07f-83e3-49c4-a74a-a9b6a71ae0c1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action" status: 202 len: 0 microversion: 2.1 time: 0.216824 Aug 04 05:39:28.705069 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3728/7345] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:39:28 2022] POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:39:28.714018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:28.714905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:28.717458 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:28.718031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:28.725164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:28.725626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:28.726515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:28.726929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:28.865605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:28.874056 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63216ece-c82f-4509-8721-d8078e223bbb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1689 microversion: 2.1 time: 0.164328 Aug 04 05:39:28.874648 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3618/7346] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:28 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:29.898806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:29.899575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:29.907370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:29.907917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:29.908711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:29.909155 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:30.060341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:30.067985 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-49258333-65fe-4477-b914-3032e9d86f50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1689 microversion: 2.1 time: 0.176045 Aug 04 05:39:30.068560 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3729/7347] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:29 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:39:31.090941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:31.091580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:31.098422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:31.098875 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:31.099672 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:31.100111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:31.234391 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:31.241992 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a5a52d8-3b32-4b2b-be72-70558e4491de tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.154965 Aug 04 05:39:31.242575 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3619/7348] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:31 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:32.264746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:32.265403 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:32.272653 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:32.273118 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:32.273902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:32.274354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:32.404320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:32.411804 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bb53ce8e-a211-4f32-8a56-ca13c07657c0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.151549 Aug 04 05:39:32.412409 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3730/7349] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:32 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:33.433466 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:33.434083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:33.440979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:33.441429 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:33.442197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:33.442638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:33.580091 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:33.587650 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc80d32d-fd14-46c0-92f1-2d0d0b06f980 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.158131 Aug 04 05:39:33.588231 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3620/7350] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:33 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:34.379122 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:39:34.379390 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:39:34.609624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:34.610257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:34.620406 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:34.620920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:34.621721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:34.623032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:34.758433 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:34.765932 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6c35e8be-cb16-464c-8160-c655928d7dbf tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.160264 Aug 04 05:39:34.766505 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3731/7351] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:34 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:35.788068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:35.788686 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:35.796168 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:35.796622 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:35.797395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:35.797837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:35.939816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:35.947577 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-706fb35e-94e6-424e-bf2f-8eafaa1e99fb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.163465 Aug 04 05:39:35.948170 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3621/7352] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:35 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:36.972751 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:36.973392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:36.980323 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:36.980786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:36.981567 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:36.982017 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:37.114432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:37.123355 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-710fba22-6b83-4f33-8457-6d36d0112912 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.154466 Aug 04 05:39:37.123934 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3732/7353] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:36 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:38.145004 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:38.145535 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:38.153453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:38.153924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:38.154680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:38.155159 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:38.286236 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:38.293806 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-59fb77a9-0099-4735-a28e-914460186b97 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.152758 Aug 04 05:39:38.294374 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3622/7354] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:38 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:39.314933 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:39.315589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:39.322563 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:39.323062 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:39.324348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:39.324804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:39.465206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:39.472797 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7f9746f-1518-4a90-87d2-1a8454c2c582 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.161783 Aug 04 05:39:39.473365 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3733/7355] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:39 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:40.495197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:40.496440 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:40.503538 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:40.503995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:40.504764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:40.505206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:40.644020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:40.652156 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0123957c-6d7a-49cd-8e4a-f8913fae79ac tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.160914 Aug 04 05:39:40.652733 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3623/7356] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:40 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:41.673787 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:41.674422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:41.681179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:41.681647 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:41.682436 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:41.682892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:41.820518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:41.828920 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e231d4c0-e555-4474-a12d-79c31d8fc0c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1694 microversion: 2.1 time: 0.159135 Aug 04 05:39:41.829540 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3734/7357] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:41 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:42.851059 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:42.851792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:42.859684 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:42.860134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:42.860945 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:42.861379 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:43.000762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:43.009247 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0b0189f1-c009-49fe-b09e-7f5e71c51288 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1693 microversion: 2.1 time: 0.162073 Aug 04 05:39:43.009835 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3624/7358] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:42 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:43.357914 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ccd62bec-4e80-46cd-9f41-e412f45645ee req-b7a740ab-dda7-4fab-9755-d20aa9dda7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "name": "network-vif-unplugged", "status": "completed", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:43.368513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ccd62bec-4e80-46cd-9f41-e412f45645ee req-b7a740ab-dda7-4fab-9755-d20aa9dda7dc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:43.368953 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ccd62bec-4e80-46cd-9f41-e412f45645ee req-b7a740ab-dda7-4fab-9755-d20aa9dda7dc service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:43.381111 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ccd62bec-4e80-46cd-9f41-e412f45645ee req-b7a740ab-dda7-4fab-9755-d20aa9dda7dc service nova] Creating event network-vif-unplugged:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h2-851337-5 Aug 04 05:39:43.387135 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [req-ccd62bec-4e80-46cd-9f41-e412f45645ee req-b7a740ab-dda7-4fab-9755-d20aa9dda7dc service nova] Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:39:43.398427 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ccd62bec-4e80-46cd-9f41-e412f45645ee req-b7a740ab-dda7-4fab-9755-d20aa9dda7dc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044412 Aug 04 05:39:43.399141 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3735/7359] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:44.031547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:44.032247 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:44.039612 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:44.040071 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:44.040869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:44.041316 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:44.184820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:44.192957 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0a32911a-d0a4-4030-8a04-f8e495c4d37c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1693 microversion: 2.1 time: 0.165395 Aug 04 05:39:44.193561 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3625/7360] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:44 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:45.215463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:45.216177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:45.222516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:45.223030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:45.223805 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:45.224263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:45.364368 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:45.371978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-13104feb-0432-45bc-aa11-822a14a3b222 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1691 microversion: 2.1 time: 0.162173 Aug 04 05:39:45.372558 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3736/7361] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:45 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:45.443112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9749369b-1976-4154-b105-b7cbbe5d1a50 req-e8d692b4-2364-4150-9b8a-f9dc9ac6c200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:45.454202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9749369b-1976-4154-b105-b7cbbe5d1a50 req-e8d692b4-2364-4150-9b8a-f9dc9ac6c200 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:45.454648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9749369b-1976-4154-b105-b7cbbe5d1a50 req-e8d692b4-2364-4150-9b8a-f9dc9ac6c200 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:45.466825 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9749369b-1976-4154-b105-b7cbbe5d1a50 req-e8d692b4-2364-4150-9b8a-f9dc9ac6c200 service nova] Creating event network-changed:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h2-851337-5 Aug 04 05:39:45.472202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [req-9749369b-1976-4154-b105-b7cbbe5d1a50 req-e8d692b4-2364-4150-9b8a-f9dc9ac6c200 service nova] Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-5', 'n-h2-851337-5'} {{(pid=119342) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 05:39:45.483113 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9749369b-1976-4154-b105-b7cbbe5d1a50 req-e8d692b4-2364-4150-9b8a-f9dc9ac6c200 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043722 Aug 04 05:39:45.483709 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3626/7362] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:46.393547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:46.394802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:46.402706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.403242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.404374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.404841 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.538626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:46.546857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-032e2e22-b0db-48f3-bfa0-f2c02862c3d1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1688 microversion: 2.1 time: 0.157209 Aug 04 05:39:46.547463 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3737/7363] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:46 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:46.568806 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d90d435e-b3e8-4b8d-8e4a-aa9c48e6fe93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:46.569425 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d90d435e-b3e8-4b8d-8e4a-aa9c48e6fe93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:46.575698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d90d435e-b3e8-4b8d-8e4a-aa9c48e6fe93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.576152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d90d435e-b3e8-4b8d-8e4a-aa9c48e6fe93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.576921 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d90d435e-b3e8-4b8d-8e4a-aa9c48e6fe93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.577362 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d90d435e-b3e8-4b8d-8e4a-aa9c48e6fe93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.634522 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d90d435e-b3e8-4b8d-8e4a-aa9c48e6fe93 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action" status: 204 len: 0 microversion: 2.1 time: 0.070635 Aug 04 05:39:46.635194 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3627/7364] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:39:46 2022] POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:39:46.646836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:46.647513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:46.654761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.655648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.657106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.667769 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.817094 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:46.825271 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bf06a361-99ca-460d-aa80-8db2420d8658 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1688 microversion: 2.1 time: 0.183774 Aug 04 05:39:46.825870 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3738/7365] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:46 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:46.846661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:46.847301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:46.853504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.853956 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.854777 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.855246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.994396 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:47.003236 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ea06820c-cc2a-4264-a248-f1d0e28b7ed4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1688 microversion: 2.1 time: 0.160770 Aug 04 05:39:47.003930 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3628/7366] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:46 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:47.876941 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2b79cbe5-7017-4004-a993-1e8b6255ff7b req-f5206d0d-d980-421d-94aa-bee4ad0b4862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "name": "network-vif-plugged", "status": "completed", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:47.889815 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2b79cbe5-7017-4004-a993-1e8b6255ff7b req-f5206d0d-d980-421d-94aa-bee4ad0b4862 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:47.890469 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2b79cbe5-7017-4004-a993-1e8b6255ff7b req-f5206d0d-d980-421d-94aa-bee4ad0b4862 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:47.902867 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2b79cbe5-7017-4004-a993-1e8b6255ff7b req-f5206d0d-d980-421d-94aa-bee4ad0b4862 service nova] Creating event network-vif-plugged:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h2-851337-5 Aug 04 05:39:47.908324 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2b79cbe5-7017-4004-a993-1e8b6255ff7b req-f5206d0d-d980-421d-94aa-bee4ad0b4862 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035425 Aug 04 05:39:47.909557 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3739/7367] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:48.025913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:48.027656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:48.035176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:48.035628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:48.036839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:48.037276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:48.175041 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:48.182692 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4c910d52-0d52-4d0f-9d54-56c42e773a75 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1680 microversion: 2.1 time: 0.160673 Aug 04 05:39:48.183783 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3629/7368] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:48 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:40:10.374222 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44ca3741-bd52-433c-b6f3-4a0cd6863d50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:10.376540 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44ca3741-bd52-433c-b6f3-4a0cd6863d50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:10.378918 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=28 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:10.379635 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:10.385711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ca3741-bd52-433c-b6f3-4a0cd6863d50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:10.386177 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ca3741-bd52-433c-b6f3-4a0cd6863d50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:10.386993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ca3741-bd52-433c-b6f3-4a0cd6863d50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:10.387455 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44ca3741-bd52-433c-b6f3-4a0cd6863d50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:10.439348 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44ca3741-bd52-433c-b6f3-4a0cd6863d50 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action" status: 200 len: 24576 microversion: 2.1 time: 0.070121 Aug 04 05:40:10.440228 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3740/7369] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:40:10 2022] POST /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9/action => generated 24576 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:40:17.450837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:17.451404 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:17.452680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ef7ddbe4-856d-4852-99ba-d0d89b1e8469 req-93e951df-9774-472c-8739-6f9e3ded020e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:17.454812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=24 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:17.455835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:17.460995 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:17.461455 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:17.462804 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:17.462923 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:17.465393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ef7ddbe4-856d-4852-99ba-d0d89b1e8469 req-93e951df-9774-472c-8739-6f9e3ded020e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:17.466148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ef7ddbe4-856d-4852-99ba-d0d89b1e8469 req-93e951df-9774-472c-8739-6f9e3ded020e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:17.481445 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ef7ddbe4-856d-4852-99ba-d0d89b1e8469 req-93e951df-9774-472c-8739-6f9e3ded020e service nova] Creating event network-changed:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h2-851337-5 Aug 04 05:40:17.488147 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ef7ddbe4-856d-4852-99ba-d0d89b1e8469 req-93e951df-9774-472c-8739-6f9e3ded020e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040086 Aug 04 05:40:17.489188 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3741/7370] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:40:17.493837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:40:17.605072 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c25b9c24-58ed-45f6-8bb6-e3c0775da183 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 204 len: 0 microversion: 2.1 time: 0.158776 Aug 04 05:40:17.605855 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3630/7371] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:40:17 2022] DELETE /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:40:17.615214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:17.615966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:17.623439 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:17.623920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:17.624715 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:17.625181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:17.782632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:17.790404 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4bfb97c0-4f03-4d67-a410-256e4550979b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1686 microversion: 2.1 time: 0.179981 Aug 04 05:40:17.791520 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3742/7372] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:17 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:18.813697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:18.814510 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:18.821616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:18.822067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:18.822982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:18.823970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:19.051010 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:19.059392 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-281192d9-a863-492b-820b-ed69b7ba0dc9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 200 len: 1686 microversion: 2.1 time: 0.249830 Aug 04 05:40:19.060106 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3631/7373] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:18 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 1686 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:19.465412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-8e491c40-4571-459b-8710-54857142f01b req-030bef39-b699-46f4-a5fa-4368f42bc5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94088397-6bfd-4f39-9119-bc79bb00d3a9", "name": "network-vif-deleted", "tag": "e03cc951-2010-4891-8dfc-3b9372f4a84e"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:19.476114 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8e491c40-4571-459b-8710-54857142f01b req-030bef39-b699-46f4-a5fa-4368f42bc5d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:19.476576 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-8e491c40-4571-459b-8710-54857142f01b req-030bef39-b699-46f4-a5fa-4368f42bc5d5 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:19.491018 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-8e491c40-4571-459b-8710-54857142f01b req-030bef39-b699-46f4-a5fa-4368f42bc5d5 service nova] Creating event network-vif-deleted:e03cc951-2010-4891-8dfc-3b9372f4a84e for instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 on n-h2-851337-5 Aug 04 05:40:19.497661 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-8e491c40-4571-459b-8710-54857142f01b req-030bef39-b699-46f4-a5fa-4368f42bc5d5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096719 Aug 04 05:40:19.498287 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3743/7374] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:40:20.081101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:20.081638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 94088397-6bfd-4f39-9119-bc79bb00d3a9] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:20.088442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:20.088903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:20.089704 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:20.090149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:20.103543 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] HTTP exception thrown: Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 could not be found. Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Request method failure captured: Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 HTTP/1.1 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61pgk4eLdfJ9UEccN2kVQFTK9OsBvcXapI8H7sZ9Cl0FIdhT7Y-t4iblXzZkNpmud1oH_6UEnKdriff06EaFtvySOTzFDga0YLA4ljfOO6pc9ZPK73Yz2aDlFai0uBNFrz9BPP5KLqk_qgDSnLxEso-QcbDquFLI0Jq2XV0uDJfpOjs Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e7eae59a921c40ee9ed58b1b12cdcbbe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 4c284c697d1a4c0fa858d2966d8915f1 Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 could not be found. Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': '94088397-6bfd-4f39-9119-bc79bb00d3a9'} Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 could not be found. Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 could not be found. Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:40:20.105164 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 could not be found. Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Returning 404 to user: Instance 94088397-6bfd-4f39-9119-bc79bb00d3a9 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-27fcfcaf-1bc1-48a7-b420-bcd89bb18e31 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9" status: 404 len: 111 microversion: 2.1 time: 0.030067 Aug 04 05:40:20.110005 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3632/7375] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:20 2022] GET /compute/v2.1/servers/94088397-6bfd-4f39-9119-bc79bb00d3a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:40:23.523831 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f103cc5-988b-4f98-b944-5f6fd0ae5240 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '.version_select at 0x7f19193ba790>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:23.545557 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f103cc5-988b-4f98-b944-5f6fd0ae5240 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-56481104" status: 202 len: 0 microversion: 2.1 time: 0.027137 Aug 04 05:40:23.546624 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3744/7376] 10.222.0.69 () {58 vars in 1278 bytes} [Thu Aug 4 05:40:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-56481104 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:40:23.575363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9ba20f3e-7d3f-49d4-8db7-0516a14fe007 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: .version_select at 0x7f1918a7e700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-840146450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfCGpg4p5W74lqqTj6mMT0RM1T8gI/15mymGPY3yOEBSp+BXCdr/jpTw8QRHmuXPjJnRNAMVUWns8yqB9T4dMcLr1aoBVDu0knQ/5MceNG8jGr6kqLMyFv9UvMpW2acUw=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:23.592618 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9ba20f3e-7d3f-49d4-8db7-0516a14fe007 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:40:23.599294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-9ba20f3e-7d3f-49d4-8db7-0516a14fe007 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:40:23.615092 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ba20f3e-7d3f-49d4-8db7-0516a14fe007 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [1b3553b0-2080-4552-b69c-cd78772dd193] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:40:24.620581 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ba20f3e-7d3f-49d4-8db7-0516a14fe007 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [1b3553b0-2080-4552-b69c-cd78772dd193] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 34102. Aug 04 05:40:24.636399 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9ba20f3e-7d3f-49d4-8db7-0516a14fe007 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.065744 Aug 04 05:40:24.637005 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3633/7377] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:40:23 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:40:30.506919 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1694330111", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "faca249d-3264-449c-9b00-885fbfb66172"}], "key_name": "tempest-TestNetworkAdvancedServerOps-840146450", "security_groups": [{"name": "tempest-secgroup-smoke-1934067774"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:30.520224 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=14 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:30.656290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] validate_networks() for [('faca249d-3264-449c-9b00-885fbfb66172', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:40:31.143033 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:40:31.143662 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:40:31.144164 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:40:31.144648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:40:31.145032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:40:31.155836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:31.156516 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:31.157818 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:31.158583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:31.180749 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:40:31.192093 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:40:31.217578 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:40:31.220122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:40:31.293052 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-30f276c0-833c-4fa6-b116-4d9adeb8238e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790172 Aug 04 05:40:31.295013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3745/7378] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:40:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:40:31.304982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc8423a7-91db-4031-9e35-c11be52eeb3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:31.305605 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-bc8423a7-91db-4031-9e35-c11be52eeb3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:31.317619 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:31.401721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-bc8423a7-91db-4031-9e35-c11be52eeb3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:31.410313 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc8423a7-91db-4031-9e35-c11be52eeb3b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1266 microversion: 2.1 time: 0.109088 Aug 04 05:40:31.411455 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3634/7379] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:31 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:32.430785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:32.432158 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:32.440366 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:32.440890 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:32.441804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:32.442620 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:32.519070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:32.528642 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9d6d2c1b-c0be-41cf-bf52-a634bdbbe177 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1326 microversion: 2.1 time: 0.101691 Aug 04 05:40:32.529644 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3746/7380] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:32 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:33.552885 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:33.553420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:33.564303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:33.566116 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:33.567865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:33.568632 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:33.760788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:33.769001 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f2cab883-1201-401f-a264-7ecbe388b686 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.221697 Aug 04 05:40:33.770059 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3635/7381] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:33 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:34.117198 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a91bfa6c-d40a-4e8c-802b-7ee56e024eef req-1cc6b667-7450-486f-8d5e-3cb516d0d8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e398c2b-bd72-4d33-bd4c-4c03462301c0", "tag": "d3f4a014-cd9c-4c49-aba3-040c93fa08ea"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:34.132811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a91bfa6c-d40a-4e8c-802b-7ee56e024eef req-1cc6b667-7450-486f-8d5e-3cb516d0d8eb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:34.133504 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a91bfa6c-d40a-4e8c-802b-7ee56e024eef req-1cc6b667-7450-486f-8d5e-3cb516d0d8eb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:34.153225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a91bfa6c-d40a-4e8c-802b-7ee56e024eef req-1cc6b667-7450-486f-8d5e-3cb516d0d8eb service nova] Creating event network-changed:d3f4a014-cd9c-4c49-aba3-040c93fa08ea for instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 on n-h1-851337-5 Aug 04 05:40:34.159948 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a91bfa6c-d40a-4e8c-802b-7ee56e024eef req-1cc6b667-7450-486f-8d5e-3cb516d0d8eb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052120 Aug 04 05:40:34.160750 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3747/7382] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:40:34.791255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:34.791874 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:34.799399 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:34.799855 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:34.800628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:34.801068 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:34.938191 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:34.945615 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd6d1c6f-544f-492c-ac67-d1fa297920b4 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.158313 Aug 04 05:40:34.946180 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3636/7383] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:34 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:35.970117 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:35.971047 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:35.978185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:35.978571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:35.979400 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:35.979879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:36.115575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:36.123869 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7c452da5-011a-46c3-bd83-69f41f52388c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.161741 Aug 04 05:40:36.124504 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3748/7384] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:35 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:37.145337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:37.145962 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:37.154356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:37.154817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:37.155640 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:37.156084 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:37.303616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:37.311365 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bb5c4a4-732d-4b5c-871d-e48d82b229df tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.169892 Aug 04 05:40:37.311967 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3637/7385] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:37 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:38.332950 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:38.333604 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:38.341203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:38.341601 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:38.342390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:38.342837 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:38.476515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:38.484539 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-048c3331-5a58-4520-904f-8492eb9fde0c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.155569 Aug 04 05:40:38.485095 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3749/7386] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:38 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:39.504944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:39.505583 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:39.512486 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:39.512937 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:39.513734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:39.514180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:39.650656 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:39.659625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-66d86a52-fb45-4d25-a0f9-8f76a1c4bb64 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.158614 Aug 04 05:40:39.660207 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3638/7387] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:39 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:40.682001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:40.683737 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:40.689412 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:40.689883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-7ff10c15-cdcc-4a10-986f-44d57f6ee46a req-5e5f7e04-7134-47d2-9cff-1341c12a80e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e398c2b-bd72-4d33-bd4c-4c03462301c0", "name": "network-vif-plugged", "status": "completed", "tag": "d3f4a014-cd9c-4c49-aba3-040c93fa08ea"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:40.698220 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:40.698733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:40.700154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:40.700501 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7ff10c15-cdcc-4a10-986f-44d57f6ee46a req-5e5f7e04-7134-47d2-9cff-1341c12a80e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:40.700654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:40.700942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-7ff10c15-cdcc-4a10-986f-44d57f6ee46a req-5e5f7e04-7134-47d2-9cff-1341c12a80e1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:40.714032 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-7ff10c15-cdcc-4a10-986f-44d57f6ee46a req-5e5f7e04-7134-47d2-9cff-1341c12a80e1 service nova] Creating event network-vif-plugged:d3f4a014-cd9c-4c49-aba3-040c93fa08ea for instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 on n-h1-851337-5 Aug 04 05:40:40.719534 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-7ff10c15-cdcc-4a10-986f-44d57f6ee46a req-5e5f7e04-7134-47d2-9cff-1341c12a80e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037002 Aug 04 05:40:40.721010 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3639/7388] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:40:40.857110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:40.864702 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-893e2a3e-966b-4ab5-80e7-f85f74d41ad8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.186978 Aug 04 05:40:40.865293 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3750/7389] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:40 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:41.884187 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:41.890432 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:41.891270 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:41.898302 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:41.898747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:41.899549 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:41.899980 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:42.044030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:42.051651 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dd035b56-3cd6-4a1b-93a5-b13e0cc37ac2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1392 microversion: 2.1 time: 0.168542 Aug 04 05:40:42.052224 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3640/7390] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:41 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:43.072652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:43.073283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:43.075206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:43.076031 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:43.083257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:43.083725 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:43.084520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:43.084978 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:43.217834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:43.225599 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76e6dadf-1530-4a93-80d8-82260de87bcb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1564 microversion: 2.1 time: 0.156850 Aug 04 05:40:43.226177 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3751/7391] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:43 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:43.247295 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:43.247918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:43.254796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:43.255288 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:43.256058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:43.256542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:43.391952 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:43.399662 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2e2b54d8-e14a-47b0-9332-348f394763c2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1564 microversion: 2.1 time: 0.156940 Aug 04 05:40:43.400229 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3641/7392] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:43 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:45.265023 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:45.265759 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:45.270908 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-bd7dbda5-bed9-4428-86b1-3342ab4abaa3 req-35010364-f3c2-4f5d-abec-97561c13579e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e398c2b-bd72-4d33-bd4c-4c03462301c0", "tag": "d3f4a014-cd9c-4c49-aba3-040c93fa08ea"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:45.273415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:45.273960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:45.274839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:45.275402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:45.285036 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bd7dbda5-bed9-4428-86b1-3342ab4abaa3 req-35010364-f3c2-4f5d-abec-97561c13579e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:45.285478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bd7dbda5-bed9-4428-86b1-3342ab4abaa3 req-35010364-f3c2-4f5d-abec-97561c13579e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:45.297366 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-bd7dbda5-bed9-4428-86b1-3342ab4abaa3 req-35010364-f3c2-4f5d-abec-97561c13579e service nova] Creating event network-changed:d3f4a014-cd9c-4c49-aba3-040c93fa08ea for instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 on n-h1-851337-5 Aug 04 05:40:45.303008 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-bd7dbda5-bed9-4428-86b1-3342ab4abaa3 req-35010364-f3c2-4f5d-abec-97561c13579e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037114 Aug 04 05:40:45.303825 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3642/7393] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:40:45.425265 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:45.434615 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7a6d3d57-9c15-49bb-be1b-25605f56a642 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1564 microversion: 2.1 time: 0.174154 Aug 04 05:40:45.435324 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3752/7394] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:45 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:18.725756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-eed96a3c-7585-4b11-a502-f709890de816 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:41:18.728048 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-eed96a3c-7585-4b11-a502-f709890de816 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:18.731050 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:18.731715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=40 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:18.738303 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eed96a3c-7585-4b11-a502-f709890de816 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:18.738763 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eed96a3c-7585-4b11-a502-f709890de816 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:18.739600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eed96a3c-7585-4b11-a502-f709890de816 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:18.740047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-eed96a3c-7585-4b11-a502-f709890de816 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:18.805338 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-eed96a3c-7585-4b11-a502-f709890de816 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action" status: 200 len: 24563 microversion: 2.1 time: 0.083764 Aug 04 05:41:18.806018 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3643/7395] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:41:18 2022] POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action => generated 24563 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:41:49.210506 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=5 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:49.211303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=40 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:49.215255 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1eddaeed-2e24-432d-b5a1-5a56c70b421f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:41:49.222065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1eddaeed-2e24-432d-b5a1-5a56c70b421f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:49.222530 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1eddaeed-2e24-432d-b5a1-5a56c70b421f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:49.244630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1eddaeed-2e24-432d-b5a1-5a56c70b421f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Going to try to stop instance {{(pid=119343) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 05:41:49.289311 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1eddaeed-2e24-432d-b5a1-5a56c70b421f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action" status: 202 len: 0 microversion: 2.1 time: 0.080458 Aug 04 05:41:49.289906 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3753/7396] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:41:49 2022] POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:41:49.299521 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:49.300346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:49.302986 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:49.303744 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:49.310900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:49.311385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:49.312184 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:49.312625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:49.450807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:49.458515 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-726be39a-7be3-401f-87b5-052ce3dd5914 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.163414 Aug 04 05:41:49.459111 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3644/7397] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:49 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:50.484241 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:50.484984 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:50.491341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:50.491811 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:50.492596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:50.493051 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:50.701272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:50.708872 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-17e49908-41d0-4631-a852-527ddc30c371 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.230733 Aug 04 05:41:50.709450 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3754/7398] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:50 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:51.729971 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:51.730584 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:51.737725 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:51.738181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:51.738978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:51.739416 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:51.931815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:51.939773 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c0fd8d08-4d6c-4459-afbc-f7f161710d2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.213724 Aug 04 05:41:51.940333 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3645/7399] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:51 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:52.961785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:52.962320 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:52.970034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:52.970510 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:52.971345 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:52.971803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:53.108024 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:53.115621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-76b506ae-dd37-4727-9450-2b702a612d3f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.157872 Aug 04 05:41:53.116208 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3755/7400] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:52 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:54.136970 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:54.137572 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:54.144663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:54.145119 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:54.145898 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:54.146368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:54.282488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:54.290170 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6f7af5ca-8558-4de7-9e1c-3f4e85cee595 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.157197 Aug 04 05:41:54.290749 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3646/7401] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:54 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:55.312090 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:55.312726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:55.319692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:55.320171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:55.320963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:55.321422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:55.454065 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:55.461691 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ff6d8058-3a45-41c6-9a49-fb7a6ccb0ce7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.154341 Aug 04 05:41:55.462274 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3756/7402] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:55 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:56.484011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:56.484661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:56.491415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:56.491869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:56.492639 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:56.493079 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:56.633642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:56.641356 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-085f40e5-f555-4c74-bb18-9694ed702b2c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.161733 Aug 04 05:41:56.641937 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3647/7403] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:56 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:57.662825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:57.663493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:57.670729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:57.671235 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:57.672036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:57.672491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:57.811497 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:57.818548 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7038998-94f9-4cda-820e-b76f581397ee tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.159642 Aug 04 05:41:57.819153 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3757/7404] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:57 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:58.841082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:58.841730 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:58.848783 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:58.849237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:58.850011 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:58.850453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:58.988490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:58.996196 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-48e77956-0ef2-4da9-9502-80376162bf27 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.159625 Aug 04 05:41:58.996758 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3648/7405] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:58 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:00.017814 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:00.018347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:00.025689 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:00.026152 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:00.026937 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:00.027422 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:00.182695 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:00.191369 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c7ed70ef-7c83-4710-86c8-de56d7b266ec tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.177367 Aug 04 05:42:00.192005 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3758/7406] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:00 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:01.215153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:01.216000 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:01.226690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:01.227845 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:01.228633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:01.229072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:01.363610 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:01.371323 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-475e8d78-a12d-49cc-942b-95602d680311 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.161249 Aug 04 05:42:01.371883 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3649/7407] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:01 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:02.398654 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:02.399314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:02.406121 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:02.406588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:02.407418 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:02.407879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:02.559088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:02.567736 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-718a82ff-2d5e-4695-9229-12c46b703be5 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.177933 Aug 04 05:42:02.568328 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3759/7408] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:02 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:03.589081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:03.589642 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:03.596568 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:03.597020 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:03.597785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:03.598224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:03.733147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:03.740663 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b0ebee71-b5ca-4512-8304-bdf6ba70c0a2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1693 microversion: 2.1 time: 0.155606 Aug 04 05:42:03.741266 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3650/7409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:03 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:04.761824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:04.762474 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:04.770043 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:04.770502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:04.771315 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:04.771760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:04.909619 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:04.917261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-952438dd-d8c4-4765-8126-48b5648ba4dc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1670 microversion: 2.1 time: 0.159299 Aug 04 05:42:04.917773 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3760/7410] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:04 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:06.012412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7036bd0f-df97-48b2-a1ce-531a168f2a6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:42:06.014478 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7036bd0f-df97-48b2-a1ce-531a168f2a6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:06.021488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7036bd0f-df97-48b2-a1ce-531a168f2a6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:06.021929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7036bd0f-df97-48b2-a1ce-531a168f2a6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:06.022703 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7036bd0f-df97-48b2-a1ce-531a168f2a6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:06.023198 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7036bd0f-df97-48b2-a1ce-531a168f2a6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:06.079401 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7036bd0f-df97-48b2-a1ce-531a168f2a6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action" status: 200 len: 35542 microversion: 2.1 time: 0.070749 Aug 04 05:42:06.080062 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3651/7411] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:42:06 2022] POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action => generated 35542 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:42:06.092524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-36f1f48f-e247-4c05-9cae-1ac872ea84c7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:42:06.099588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36f1f48f-e247-4c05-9cae-1ac872ea84c7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:06.100048 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-36f1f48f-e247-4c05-9cae-1ac872ea84c7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:06.122649 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-36f1f48f-e247-4c05-9cae-1ac872ea84c7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Going to try to start instance {{(pid=119343) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 05:42:06.168191 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-36f1f48f-e247-4c05-9cae-1ac872ea84c7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action" status: 202 len: 0 microversion: 2.1 time: 0.080066 Aug 04 05:42:06.168827 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3761/7412] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:42:06 2022] POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:42:06.178525 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:06.179335 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:06.186721 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:06.187317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:06.188178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:06.188617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:06.334778 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:06.343105 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-50d1c64f-fd4f-4065-a0b2-5bac9a13dc6c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1679 microversion: 2.1 time: 0.168720 Aug 04 05:42:06.343687 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3652/7413] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:06 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:07.366284 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:07.367149 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:07.374752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:07.375300 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:07.376173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:07.376636 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:07.517678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:07.525527 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c8aef6b8-c69e-42f2-8d38-457df3724a41 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1679 microversion: 2.1 time: 0.163473 Aug 04 05:42:07.526105 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3762/7414] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:07 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:08.547597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:42:08.548243 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:08.555505 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:08.555889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:08.556666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:08.557105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:08.704258 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:42:08.711999 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a6287d69-c426-42dc-98d1-859be34e0d79 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1683 microversion: 2.1 time: 0.168907 Aug 04 05:42:08.712572 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3653/7415] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:42:08 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:42:40.945326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-6df8120d-064b-4a0d-b1ad-bc7c52bc3a1f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:42:40.947581 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-6df8120d-064b-4a0d-b1ad-bc7c52bc3a1f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:42:40.950648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=20 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:42:40.950648 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:42:40.956655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df8120d-064b-4a0d-b1ad-bc7c52bc3a1f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:40.956965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df8120d-064b-4a0d-b1ad-bc7c52bc3a1f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:40.957760 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df8120d-064b-4a0d-b1ad-bc7c52bc3a1f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:42:40.958214 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-6df8120d-064b-4a0d-b1ad-bc7c52bc3a1f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:42:41.030196 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-6df8120d-064b-4a0d-b1ad-bc7c52bc3a1f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action" status: 200 len: 60106 microversion: 2.1 time: 0.088873 Aug 04 05:42:41.030877 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3763/7416] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:42:40 2022] POST /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0/action => generated 60106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:42:54.387843 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:42:54.388409 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:42:54.397649 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:42:54.398055 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:42:54.484905 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:42:54.485116 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:43:04.600396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-b8b234ae-76a1-43a0-9e13-1409e0370d1d req-d53d40fd-3182-403f-b8d2-ab335ee58b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e398c2b-bd72-4d33-bd4c-4c03462301c0", "tag": "d3f4a014-cd9c-4c49-aba3-040c93fa08ea"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:43:04.603856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:04.610282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:04.610774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:04.611154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=4 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:04.613682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=20 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:04.614343 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=58 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:04.619728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b8b234ae-76a1-43a0-9e13-1409e0370d1d req-d53d40fd-3182-403f-b8d2-ab335ee58b78 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:04.619925 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:04.620279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-b8b234ae-76a1-43a0-9e13-1409e0370d1d req-d53d40fd-3182-403f-b8d2-ab335ee58b78 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:04.620413 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:04.621134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:04.621569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:04.632621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-b8b234ae-76a1-43a0-9e13-1409e0370d1d req-d53d40fd-3182-403f-b8d2-ab335ee58b78 service nova] Creating event network-changed:d3f4a014-cd9c-4c49-aba3-040c93fa08ea for instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 on n-h1-851337-5 Aug 04 05:43:04.637996 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-b8b234ae-76a1-43a0-9e13-1409e0370d1d req-d53d40fd-3182-403f-b8d2-ab335ee58b78 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041661 Aug 04 05:43:04.638942 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3764/7417] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:43:04.651516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:43:04.739735 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f6b1439a-67c9-4ba5-b2a9-ce7fac27d1c8 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 204 len: 0 microversion: 2.1 time: 0.146934 Aug 04 05:43:04.741842 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3654/7418] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:43:04 2022] DELETE /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:43:04.751678 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:04.752392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:04.759075 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:04.759694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:04.760586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:04.761036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:04.902824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:04.911082 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-90e02c7b-e3db-4d03-aa96-940ac01c693e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1689 microversion: 2.1 time: 0.164230 Aug 04 05:43:04.911662 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3765/7419] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:04 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:43:05.933417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:05.934122 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:05.941330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:05.941782 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:05.942561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:05.943022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:06.076359 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:06.084161 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60c9cdb1-9b3b-4692-91b2-14a98f2be663 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1689 microversion: 2.1 time: 0.155071 Aug 04 05:43:06.084827 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3655/7420] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:05 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:07.076877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-22dde87b-4f23-4ff0-9a80-fbf19add98e9 req-fb85ed8e-cb66-449f-bd19-b16476fa005f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e398c2b-bd72-4d33-bd4c-4c03462301c0", "name": "network-vif-deleted", "tag": "d3f4a014-cd9c-4c49-aba3-040c93fa08ea"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:43:07.086415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22dde87b-4f23-4ff0-9a80-fbf19add98e9 req-fb85ed8e-cb66-449f-bd19-b16476fa005f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:07.086881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-22dde87b-4f23-4ff0-9a80-fbf19add98e9 req-fb85ed8e-cb66-449f-bd19-b16476fa005f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:07.097859 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-22dde87b-4f23-4ff0-9a80-fbf19add98e9 req-fb85ed8e-cb66-449f-bd19-b16476fa005f service nova] Creating event network-vif-deleted:d3f4a014-cd9c-4c49-aba3-040c93fa08ea for instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 on n-h1-851337-5 Aug 04 05:43:07.103689 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-22dde87b-4f23-4ff0-9a80-fbf19add98e9 req-fb85ed8e-cb66-449f-bd19-b16476fa005f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081043 Aug 04 05:43:07.104365 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3766/7421] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:43:07.106883 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:07.107496 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:07.114720 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:07.115246 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:07.115973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:07.116403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:07.151406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:07.151854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:07.152305 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lazy-loading 'fault' on Instance uuid 3e398c2b-bd72-4d33-bd4c-4c03462301c0 {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:43:07.193997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:07.201528 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fa82d943-2efe-470a-90ad-885789961376 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 200 len: 1356 microversion: 2.1 time: 0.099711 Aug 04 05:43:07.202086 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3656/7422] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:07 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:43:08.224861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:08.225486 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: 3e398c2b-bd72-4d33-bd4c-4c03462301c0] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:08.231896 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:08.232361 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:08.233147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:08.233598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:08.246717 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] HTTP exception thrown: Instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 could not be found. Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Request method failure captured: Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 HTTP/1.1 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61pgk4eLdfJ9UEccN2kVQFTK9OsBvcXapI8H7sZ9Cl0FIdhT7Y-t4iblXzZkNpmud1oH_6UEnKdriff06EaFtvySOTzFDga0YLA4ljfOO6pc9ZPK73Yz2aDlFai0uBNFrz9BPP5KLqk_qgDSnLxEso-QcbDquFLI0Jq2XV0uDJfpOjs Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e7eae59a921c40ee9ed58b1b12cdcbbe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4c284c697d1a4c0fa858d2966d8915f1 Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 could not be found. Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '3e398c2b-bd72-4d33-bd4c-4c03462301c0'} Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 could not be found. Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 could not be found. Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:43:08.248374 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 could not be found. Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Returning 404 to user: Instance 3e398c2b-bd72-4d33-bd4c-4c03462301c0 could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-70997a91-7652-4834-803e-f33d4062eec7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0" status: 404 len: 111 microversion: 2.1 time: 0.030168 Aug 04 05:43:08.253586 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3767/7423] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:08 2022] GET /compute/v2.1/servers/3e398c2b-bd72-4d33-bd4c-4c03462301c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:43:11.566330 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aa583e6c-e0ff-459e-acf5-879cf82b72fd tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '.version_select at 0x7f19188688b0>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:11.595769 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aa583e6c-e0ff-459e-acf5-879cf82b72fd tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-840146450" status: 202 len: 0 microversion: 2.1 time: 0.035019 Aug 04 05:43:11.597093 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3657/7424] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 05:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-840146450 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:43:11.629402 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cb4eb12e-8c06-4422-89cd-ba7622a4cfad tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: .version_select at 0x7f191947b790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-672629241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOI63T7MD1qf1C0voA24RK4OgxdYriFT8y/2o65AvwDtVD9DH169YIeK50Wxt563lIQAd7AfUV6Qy0bWgXG6u3yfdcRcl2ua5r3affX2J4WQGwUneZNAWxi1H6tbrePAA=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:43:11.646809 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cb4eb12e-8c06-4422-89cd-ba7622a4cfad tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:43:11.652369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cb4eb12e-8c06-4422-89cd-ba7622a4cfad tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:43:11.682249 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cb4eb12e-8c06-4422-89cd-ba7622a4cfad tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057327 Aug 04 05:43:11.682919 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3768/7425] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:43:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:43:17.418132 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-522877228", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "networks": [{"uuid": "1eb52a3b-4bbe-4ceb-92d4-c06ae7287e72"}], "key_name": "tempest-TestNetworkAdvancedServerOps-672629241", "security_groups": [{"name": "tempest-secgroup-smoke-839943092"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:43:17.428983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:17.552927 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] validate_networks() for [('1eb52a3b-4bbe-4ceb-92d4-c06ae7287e72', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:43:18.061929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:43:18.062896 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:43:18.063463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:43:18.063911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:43:18.064355 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:43:18.073764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:18.074364 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:18.075202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:18.075650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:18.093199 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:43:18.098411 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Getting quotas for user 4c284c697d1a4c0fa858d2966d8915f1 and project e7eae59a921c40ee9ed58b1b12cdcbbe. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:43:18.111786 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:43:18.114225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:43:18.163513 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-834463e4-af6f-4ae3-9281-c5ae09ae53f2 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748958 Aug 04 05:43:18.164347 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3658/7426] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:43:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:43:18.178058 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2327258b-262b-4906-93e7-d6dfcde1340e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:18.178704 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2327258b-262b-4906-93e7-d6dfcde1340e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:18.238280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=12 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:18.249040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2327258b-262b-4906-93e7-d6dfcde1340e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:18.256651 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2327258b-262b-4906-93e7-d6dfcde1340e tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1265 microversion: 2.1 time: 0.085188 Aug 04 05:43:18.257236 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3769/7427] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:18 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:19.278389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:19.279058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:19.287285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:19.287906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:19.288756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:19.289348 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:19.367646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:19.376501 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-82aaccfb-b6e9-4268-ae0f-f1792240b59f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1335 microversion: 2.1 time: 0.103689 Aug 04 05:43:19.377077 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3659/7428] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:19 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:20.397584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:20.398881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:20.408600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:20.411247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:20.412110 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:20.412568 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:20.563346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:20.571338 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-48b78bcb-9dcc-4fdd-94f3-5ff0b2749c16 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.177603 Aug 04 05:43:20.572239 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3770/7429] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:20 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:20.789713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-cd821aef-cb87-4631-b24e-2076ea9e3fe0 req-16e855a0-44f0-4f3a-9fdd-0a297c1501cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce770ddb-f43a-4af6-8b4b-d643071dba9a", "tag": "9cd9bebb-c0f5-43d0-9bc6-fc645702e78f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:43:20.802541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cd821aef-cb87-4631-b24e-2076ea9e3fe0 req-16e855a0-44f0-4f3a-9fdd-0a297c1501cf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:20.803012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-cd821aef-cb87-4631-b24e-2076ea9e3fe0 req-16e855a0-44f0-4f3a-9fdd-0a297c1501cf service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:20.815117 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-cd821aef-cb87-4631-b24e-2076ea9e3fe0 req-16e855a0-44f0-4f3a-9fdd-0a297c1501cf service nova] Creating event network-changed:9cd9bebb-c0f5-43d0-9bc6-fc645702e78f for instance ce770ddb-f43a-4af6-8b4b-d643071dba9a on n-h1-851337-5 Aug 04 05:43:20.820343 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-cd821aef-cb87-4631-b24e-2076ea9e3fe0 req-16e855a0-44f0-4f3a-9fdd-0a297c1501cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Aug 04 05:43:20.821093 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3660/7430] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:43:21.594528 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:21.595201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:21.602209 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:21.602674 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:21.603495 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:21.603949 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:21.737944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:21.745590 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-876bd279-3c2b-4674-af0d-5cccf1158acb tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.155535 Aug 04 05:43:21.746176 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3771/7431] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:21 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:22.767222 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:22.767839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:22.774138 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:22.774592 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:22.775423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:22.775869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:22.917779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:22.925894 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7600485-4eba-4e8f-be60-8ac32fc93fa9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.163908 Aug 04 05:43:22.926484 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3661/7432] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:22 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:23.947004 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:23.947644 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:23.955416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:23.955885 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:23.956681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:23.957138 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:24.091305 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:24.098818 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d92aaec4-d613-4922-ae50-0276a7750c02 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.155788 Aug 04 05:43:24.099497 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3772/7433] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:23 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:25.120751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:25.121376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:25.128800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:25.129291 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:25.130089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:25.130650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:25.268743 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:25.281858 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-56657ac7-fad4-452f-be9a-c8073a994410 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.162270 Aug 04 05:43:25.294987 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3662/7434] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:25 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:26.305761 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:26.306337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:26.313375 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:26.313901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:26.314696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:26.315181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:26.452673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:26.460996 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-326672c8-e0c3-40e2-a894-af8fad7b1f9d tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.160350 Aug 04 05:43:26.461577 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3773/7435] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:26 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:27.430175 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-bbe8bd39-7f7a-4c8b-af24-318a7d5a9702 req-32206230-5215-4c61-8d63-39030788fcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce770ddb-f43a-4af6-8b4b-d643071dba9a", "name": "network-vif-plugged", "status": "completed", "tag": "9cd9bebb-c0f5-43d0-9bc6-fc645702e78f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:43:27.441614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bbe8bd39-7f7a-4c8b-af24-318a7d5a9702 req-32206230-5215-4c61-8d63-39030788fcf4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:27.442058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-bbe8bd39-7f7a-4c8b-af24-318a7d5a9702 req-32206230-5215-4c61-8d63-39030788fcf4 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:27.453262 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-bbe8bd39-7f7a-4c8b-af24-318a7d5a9702 req-32206230-5215-4c61-8d63-39030788fcf4 service nova] Creating event network-vif-plugged:9cd9bebb-c0f5-43d0-9bc6-fc645702e78f for instance ce770ddb-f43a-4af6-8b4b-d643071dba9a on n-h1-851337-5 Aug 04 05:43:27.458263 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-bbe8bd39-7f7a-4c8b-af24-318a7d5a9702 req-32206230-5215-4c61-8d63-39030788fcf4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086351 Aug 04 05:43:27.458847 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3663/7436] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:43:27.484076 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:27.484733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:27.492316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:27.492779 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:27.493571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:27.494025 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:27.637671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:27.648046 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a699e42b-9dfb-4978-88d0-da971f079e8c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.167731 Aug 04 05:43:27.648658 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3774/7437] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:27 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:28.670714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:28.671456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:28.673905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:28.674571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:28.681598 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:28.682054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:28.682826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:28.683293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:28.821623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:28.829301 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d51c362-5982-4db8-9649-dafd3dc3c303 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1390 microversion: 2.1 time: 0.162845 Aug 04 05:43:28.829926 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3664/7438] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:28 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:29.850232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:29.850781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:29.852747 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:43:29.858865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:29.859354 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:29.860129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:29.860584 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:29.994861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:30.003041 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f98cd561-b7c8-44ec-8ad1-683f08440950 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1563 microversion: 2.1 time: 0.156767 Aug 04 05:43:30.003625 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3775/7439] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:29 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:30.023529 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:30.024147 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:30.031452 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:30.031911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:30.032715 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:30.033154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:30.167760 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:30.175931 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-43fa6fa5-3bc6-4221-bc3d-96bf74d5ec24 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1563 microversion: 2.1 time: 0.156213 Aug 04 05:43:30.176520 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3665/7440] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:30 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:43:32.081269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:43:32.081906 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:43:32.089160 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:32.089650 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:32.090456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:32.090565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-78e99422-3682-4c72-a332-f1542798734f req-9b5be61f-f27e-4a7b-b69f-2552aad86b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce770ddb-f43a-4af6-8b4b-d643071dba9a", "tag": "9cd9bebb-c0f5-43d0-9bc6-fc645702e78f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:43:32.090994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:32.100729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-78e99422-3682-4c72-a332-f1542798734f req-9b5be61f-f27e-4a7b-b69f-2552aad86b54 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:43:32.101178 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-78e99422-3682-4c72-a332-f1542798734f req-9b5be61f-f27e-4a7b-b69f-2552aad86b54 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:43:32.113221 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-78e99422-3682-4c72-a332-f1542798734f req-9b5be61f-f27e-4a7b-b69f-2552aad86b54 service nova] Creating event network-changed:9cd9bebb-c0f5-43d0-9bc6-fc645702e78f for instance ce770ddb-f43a-4af6-8b4b-d643071dba9a on n-h1-851337-5 Aug 04 05:43:32.118741 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-78e99422-3682-4c72-a332-f1542798734f req-9b5be61f-f27e-4a7b-b69f-2552aad86b54 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031889 Aug 04 05:43:32.119449 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3666/7441] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:43:32.240902 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:43:32.248427 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-840b2b9c-e464-48be-af62-e9c0a14cd440 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1563 microversion: 2.1 time: 0.171195 Aug 04 05:43:32.249017 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3776/7442] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:43:32 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:03.529083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:44:03.529765 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=38 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:44:03.535057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-37497170-36b3-4e84-a221-fe9ee9a71c14 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:44:03.537287 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-37497170-36b3-4e84-a221-fe9ee9a71c14 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:03.544809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37497170-36b3-4e84-a221-fe9ee9a71c14 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:03.545176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37497170-36b3-4e84-a221-fe9ee9a71c14 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:03.545944 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37497170-36b3-4e84-a221-fe9ee9a71c14 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:03.546381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-37497170-36b3-4e84-a221-fe9ee9a71c14 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:03.610015 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-37497170-36b3-4e84-a221-fe9ee9a71c14 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action" status: 200 len: 24563 microversion: 2.1 time: 0.083529 Aug 04 05:44:03.610665 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3667/7443] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:44:03 2022] POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action => generated 24563 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:44:33.993373 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:44:33.994059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=42 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:44:34.223289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:44:34.223994 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:34.234190 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:34.234655 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:34.235470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:34.235922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:34.269524 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lazy-loading 'flavor' on Instance uuid ce770ddb-f43a-4af6-8b4b-d643071dba9a {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:44:34.590296 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-85a230f6-0e14-49b2-ae9f-a65e92fd0b09 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action" status: 202 len: 0 microversion: 2.1 time: 0.598538 Aug 04 05:44:34.590833 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3777/7444] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:44:33 2022] POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:44:34.600037 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:34.600891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:34.604315 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:44:34.604519 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:44:34.610418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:34.610924 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:34.611683 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:34.612127 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:34.750758 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:34.758917 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-daefc184-baab-4a13-bbd9-59c7ad979f6b tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1689 microversion: 2.1 time: 0.163260 Aug 04 05:44:34.759584 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3668/7445] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:34 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:44:35.785012 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:35.785768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:35.792081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:35.792541 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:35.793310 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:35.793754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:35.925677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:35.933661 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-586ced7e-0939-41cd-bead-76f5f53839ae tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1689 microversion: 2.1 time: 0.153907 Aug 04 05:44:35.934242 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3778/7446] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:35 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:36.961268 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:36.961812 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:36.969101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:36.969556 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:36.970334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:36.970770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:37.122815 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:37.131156 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f7aa168a-15c9-45a7-acd7-54539d5d1825 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1689 microversion: 2.1 time: 0.174405 Aug 04 05:44:37.131787 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3669/7447] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:36 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:38.153786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:38.154331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:38.161593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:38.162060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:38.162844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:38.163322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:38.295561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:38.303663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-11666325-583a-4102-bba3-932a171b9a1c tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1672 microversion: 2.1 time: 0.154103 Aug 04 05:44:38.304233 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3779/7448] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:38 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:39.395237 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a0bfb20e-2047-4d15-a903-e3430f37a4e9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:44:39.397426 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a0bfb20e-2047-4d15-a903-e3430f37a4e9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:39.404555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0bfb20e-2047-4d15-a903-e3430f37a4e9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:39.404998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0bfb20e-2047-4d15-a903-e3430f37a4e9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:39.405752 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0bfb20e-2047-4d15-a903-e3430f37a4e9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:39.406183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a0bfb20e-2047-4d15-a903-e3430f37a4e9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:39.462244 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a0bfb20e-2047-4d15-a903-e3430f37a4e9 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action" status: 200 len: 36280 microversion: 2.1 time: 0.070821 Aug 04 05:44:39.462879 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3670/7449] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:44:39 2022] POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action => generated 36280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:44:39.475165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-5ff77acd-0190-45dd-8b7b-efbb1637d19f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:44:39.475834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-5ff77acd-0190-45dd-8b7b-efbb1637d19f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:39.482858 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff77acd-0190-45dd-8b7b-efbb1637d19f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:39.483364 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff77acd-0190-45dd-8b7b-efbb1637d19f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:39.484157 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff77acd-0190-45dd-8b7b-efbb1637d19f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:39.484637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-5ff77acd-0190-45dd-8b7b-efbb1637d19f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:39.550576 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-5ff77acd-0190-45dd-8b7b-efbb1637d19f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action" status: 202 len: 0 microversion: 2.1 time: 0.079616 Aug 04 05:44:39.551207 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3780/7450] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:44:39 2022] POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:44:39.560565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:39.561323 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:39.569899 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:39.570358 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:39.571470 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:39.571914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:39.732650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:39.740512 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0469cb7f-9bf4-40c5-a1d1-deababa923fc tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1678 microversion: 2.1 time: 0.184133 Aug 04 05:44:39.743819 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3671/7451] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:39 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:40.762610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:40.763356 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:40.770280 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:40.770752 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:40.771583 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:40.772037 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:40.910380 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:40.918536 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-845c6699-2b70-4536-87e5-c7022fcabb9f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1678 microversion: 2.1 time: 0.160185 Aug 04 05:44:40.919071 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3781/7452] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:40 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:41.940109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:41.940644 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:41.948002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:41.948460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:41.949272 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:41.949707 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:42.353865 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:42.361451 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-76484180-e84a-4d84-b4ad-01d1c6624019 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1681 microversion: 2.1 time: 0.425301 Aug 04 05:44:42.362076 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3672/7453] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:41 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:42.462264 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0cf84d73-9b5d-454a-bc20-f2a06ed8d6e7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:44:42.464699 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0cf84d73-9b5d-454a-bc20-f2a06ed8d6e7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:42.472955 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cf84d73-9b5d-454a-bc20-f2a06ed8d6e7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:42.473478 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cf84d73-9b5d-454a-bc20-f2a06ed8d6e7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:42.474282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cf84d73-9b5d-454a-bc20-f2a06ed8d6e7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:42.474743 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0cf84d73-9b5d-454a-bc20-f2a06ed8d6e7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:42.540144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0cf84d73-9b5d-454a-bc20-f2a06ed8d6e7 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action" status: 200 len: 36280 microversion: 2.1 time: 0.082252 Aug 04 05:44:42.540789 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3782/7454] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:44:42 2022] POST /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a/action => generated 36280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:44:43.610097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:43.611172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:43.611314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2be664c9-bb3a-4be5-b34a-62d1a8bdc537 req-82778b3e-42be-42a7-956f-6385791c71be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce770ddb-f43a-4af6-8b4b-d643071dba9a", "tag": "9cd9bebb-c0f5-43d0-9bc6-fc645702e78f"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:44:43.623054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:43.623518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2be664c9-bb3a-4be5-b34a-62d1a8bdc537 req-82778b3e-42be-42a7-956f-6385791c71be service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:43.623655 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:43.624067 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2be664c9-bb3a-4be5-b34a-62d1a8bdc537 req-82778b3e-42be-42a7-956f-6385791c71be service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:43.624376 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:43.624829 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:43.636448 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2be664c9-bb3a-4be5-b34a-62d1a8bdc537 req-82778b3e-42be-42a7-956f-6385791c71be service nova] Creating event network-changed:9cd9bebb-c0f5-43d0-9bc6-fc645702e78f for instance ce770ddb-f43a-4af6-8b4b-d643071dba9a on n-h1-851337-5 Aug 04 05:44:43.647367 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2be664c9-bb3a-4be5-b34a-62d1a8bdc537 req-82778b3e-42be-42a7-956f-6385791c71be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040208 Aug 04 05:44:43.648315 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3783/7455] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:44:43.653403 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:44:43.741517 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a813d1b5-8ae3-4ae9-b17e-be46a92f1a35 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 204 len: 0 microversion: 2.1 time: 0.137033 Aug 04 05:44:43.742202 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3673/7456] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:44:43 2022] DELETE /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:44:43.753346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:43.754200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:43.760900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:43.761447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:43.762321 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:43.762838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:43.899607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:43.907890 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a5f8bc4c-c40b-41e3-a471-838e3fb95462 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1687 microversion: 2.1 time: 0.160625 Aug 04 05:44:43.908465 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3784/7457] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:43 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:44:44.931031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:44.931771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:44.938810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:44.939300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:44.940082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:44.940526 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:45.087060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:45.094899 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d0d36297-dc8f-4cf6-940c-3d474d6fa6d0 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1687 microversion: 2.1 time: 0.168686 Aug 04 05:44:45.095489 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3674/7458] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:44 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:46.118032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:46.118863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:46.126415 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:46.126884 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:46.127711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:46.128165 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:46.265742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c284c697d1a4c0fa858d2966d8915f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eae59a921c40ee9ed58b1b12cdcbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:44:46.273466 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b605ad19-dbb1-43db-ba68-1e4ef9bd15f1 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 200 len: 1569 microversion: 2.1 time: 0.160054 Aug 04 05:44:46.274051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3785/7459] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:46 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:44:46.391518 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-b67a9380-51b1-4dd0-8220-347e5847e4f0 req-d00c38cc-6b8e-4ac0-be9c-9de44bed57d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce770ddb-f43a-4af6-8b4b-d643071dba9a", "name": "network-vif-deleted", "tag": "9cd9bebb-c0f5-43d0-9bc6-fc645702e78f"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:44:46.401972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b67a9380-51b1-4dd0-8220-347e5847e4f0 req-d00c38cc-6b8e-4ac0-be9c-9de44bed57d0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:46.402420 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-b67a9380-51b1-4dd0-8220-347e5847e4f0 req-d00c38cc-6b8e-4ac0-be9c-9de44bed57d0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:46.414369 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-b67a9380-51b1-4dd0-8220-347e5847e4f0 req-d00c38cc-6b8e-4ac0-be9c-9de44bed57d0 service nova] Creating event network-vif-deleted:9cd9bebb-c0f5-43d0-9bc6-fc645702e78f for instance ce770ddb-f43a-4af6-8b4b-d643071dba9a on n-h1-851337-5 Aug 04 05:44:46.419282 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-b67a9380-51b1-4dd0-8220-347e5847e4f0 req-d00c38cc-6b8e-4ac0-be9c-9de44bed57d0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Aug 04 05:44:46.419884 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3675/7460] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:44:47.294664 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:47.295342 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] [instance: ce770ddb-f43a-4af6-8b4b-d643071dba9a] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:44:47.302882 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:47.303382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:47.304179 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:44:47.304640 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:44:47.319130 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] HTTP exception thrown: Instance ce770ddb-f43a-4af6-8b4b-d643071dba9a could not be found. Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Request method failure captured: Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a HTTP/1.1 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi61pgk4eLdfJ9UEccN2kVQFTK9OsBvcXapI8H7sZ9Cl0FIdhT7Y-t4iblXzZkNpmud1oH_6UEnKdriff06EaFtvySOTzFDga0YLA4ljfOO6pc9ZPK73Yz2aDlFai0uBNFrz9BPP5KLqk_qgDSnLxEso-QcbDquFLI0Jq2XV0uDJfpOjs Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e7eae59a921c40ee9ed58b1b12cdcbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e7eae59a921c40ee9ed58b1b12cdcbbe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: e7eae59a921c40ee9ed58b1b12cdcbbe Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621306940 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 4c284c697d1a4c0fa858d2966d8915f1 Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621306940-project Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance ce770ddb-f43a-4af6-8b4b-d643071dba9a could not be found. Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': 'ce770ddb-f43a-4af6-8b4b-d643071dba9a'} Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce770ddb-f43a-4af6-8b4b-d643071dba9a could not be found. Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce770ddb-f43a-4af6-8b4b-d643071dba9a could not be found. Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:44:47.320819 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce770ddb-f43a-4af6-8b4b-d643071dba9a could not be found. Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Returning 404 to user: Instance ce770ddb-f43a-4af6-8b4b-d643071dba9a could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f05e3840-5711-43fb-ac30-7d86f8c4e58f tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a" status: 404 len: 111 microversion: 2.1 time: 0.031741 Aug 04 05:44:47.325691 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3786/7461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:44:47 2022] GET /compute/v2.1/servers/ce770ddb-f43a-4af6-8b4b-d643071dba9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:44:50.656651 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6fcda8a8-577d-4516-a5c9-c9995f43ad57 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] Calling method '.version_select at 0x7f19189e4310>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:44:50.682249 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6fcda8a8-577d-4516-a5c9-c9995f43ad57 tempest-TestNetworkAdvancedServerOps-1621306940 tempest-TestNetworkAdvancedServerOps-1621306940-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-672629241" status: 202 len: 0 microversion: 2.1 time: 0.030987 Aug 04 05:44:50.683366 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3676/7462] 10.222.0.69 () {58 vars in 1281 bytes} [Thu Aug 4 05:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-672629241 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:45:02.164147 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=20 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:45:02.165981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:45:02.343677 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-367889e2-2e78-40c4-96fe-2a7ec52accf5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'create', calling method: .version_select at 0x7f1918364790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1310343466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3HZFNIq3Czxe4eKzsnGF9IbvzMxk0oAjCtMXbcg/s9V0XzFyc8VsAHaU5A7kMVW/y9iH477GVHh0oWiyGgB4WkcjQBU1niZAq/fLv8bpERgRzwTKZF3b5kWrIJeZZsIg=="}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:45:02.361272 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-367889e2-2e78-40c4-96fe-2a7ec52accf5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:45:02.366651 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-367889e2-2e78-40c4-96fe-2a7ec52accf5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for user 164db8279c4f49dea8a12242934c0921 and project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'key_pairs'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:45:02.393319 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-367889e2-2e78-40c4-96fe-2a7ec52accf5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235404 Aug 04 05:45:02.394245 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3787/7463] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:45:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:45:03.409278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:45:03.410456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:45:03.416186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1384700403", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1310343466", "security_groups": [{"name": "tempest-secgroup-smoke-61716158"}], "networks": [{"uuid": "584adcb6-9b0e-4f5b-ba02-cb057f559ee3"}]}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:45:03.537219 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.network.neutron [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] validate_networks() for [('584adcb6-9b0e-4f5b-ba02-cb057f559ee3', None, None, None, None, None)] {{(pid=119342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:45:03.932428 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Flavor limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:45:03.932869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Image limits 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:45:03.934077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Flavor pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:45:03.934077 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Image pref 0:0:0 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:45:03.934372 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.virt.hardware [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:45:03.943951 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:03.944407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:03.945216 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:03.945658 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:03.963633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:45:03.969140 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for user 164db8279c4f49dea8a12242934c0921 and project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'ram', 'instances', 'cores'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:45:03.982884 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Going to run 1 instances... {{(pid=119342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:45:03.985314 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:45:04.032514 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ef4edc4f-918d-4993-8a13-ff9548f260b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.625018 Aug 04 05:45:04.033385 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3677/7464] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:45:03 2022] POST /compute/v2.1/servers => generated 404 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:45:04.045700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3e6d6c5f-4e27-460c-870f-2bf829501db8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:04.046338 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3e6d6c5f-4e27-460c-870f-2bf829501db8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:04.107971 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3e6d6c5f-4e27-460c-870f-2bf829501db8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:04.117775 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3e6d6c5f-4e27-460c-870f-2bf829501db8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1247 microversion: 2.1 time: 0.076756 Aug 04 05:45:04.118371 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3788/7465] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:04 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:05.142803 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:05.143546 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:05.151555 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:05.152086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:05.153286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:05.153736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:05.223074 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:05.231357 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04911948-6f41-4e76-bfc8-4a623377d814 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1251 microversion: 2.1 time: 0.095741 Aug 04 05:45:05.231974 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3678/7466] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:05 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1251 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:45:06.252790 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:06.254099 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:06.262260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:06.262713 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:06.263546 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:06.263993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:06.343434 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:06.352144 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-461cf90a-d468-413d-b5b5-7b5ac7719cf2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1305 microversion: 2.1 time: 0.103194 Aug 04 05:45:06.352740 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3789/7467] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:06 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:07.373747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:07.375213 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:07.382595 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:07.383228 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:07.384115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:07.384675 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:07.597799 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:07.607890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44b6cce6-ad48-4aa3-ad99-96b2f4f97ffc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1371 microversion: 2.1 time: 0.238214 Aug 04 05:45:07.617007 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3679/7468] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:07 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:07.628632 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7bab967c-f681-4afd-b98c-5a7ae0c465f9 req-60d4419e-dee7-4ddd-8b79-ab3796db098f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:45:07.640932 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7bab967c-f681-4afd-b98c-5a7ae0c465f9 req-60d4419e-dee7-4ddd-8b79-ab3796db098f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:07.641595 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7bab967c-f681-4afd-b98c-5a7ae0c465f9 req-60d4419e-dee7-4ddd-8b79-ab3796db098f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:07.657409 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-7bab967c-f681-4afd-b98c-5a7ae0c465f9 req-60d4419e-dee7-4ddd-8b79-ab3796db098f service nova] Creating event network-changed:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h2-851337-5 Aug 04 05:45:07.664133 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7bab967c-f681-4afd-b98c-5a7ae0c465f9 req-60d4419e-dee7-4ddd-8b79-ab3796db098f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039524 Aug 04 05:45:07.665130 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3790/7469] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:45:08.629026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:08.629635 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:08.637282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:08.637736 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:08.638511 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:08.638978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:08.773058 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:08.780850 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1ced0418-cf6b-4c0c-a367-38be947a8fb7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1371 microversion: 2.1 time: 0.155726 Aug 04 05:45:08.781429 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3680/7470] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:08 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:09.802464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:09.803226 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:09.809645 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:09.810112 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:09.810894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:09.811378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:09.949850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:09.957522 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f196714a-0b27-4269-812a-ede336d9837f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1371 microversion: 2.1 time: 0.160331 Aug 04 05:45:09.958123 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3791/7471] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:09 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:10.980350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:10.981118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:10.988061 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:10.988500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:10.989280 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:10.989714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:11.132380 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:11.140109 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-08fd7c51-98a2-4323-92f0-fe11d95c2763 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1371 microversion: 2.1 time: 0.164380 Aug 04 05:45:11.142806 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3681/7472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:10 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:45:12.162332 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:12.163046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:12.170154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:12.170624 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:12.171536 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:12.171997 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:12.302420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:12.310612 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-edcb67d3-08c6-45b9-ba6c-5649bdfebc9d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1371 microversion: 2.1 time: 0.152238 Aug 04 05:45:12.311222 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3792/7473] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:12 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:13.124202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-a1622419-df55-42f2-87b9-d1d3ab6da2e6 req-c15bfcbc-1bab-4279-a019-854d9609ce58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "name": "network-vif-plugged", "status": "completed", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:45:13.137022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a1622419-df55-42f2-87b9-d1d3ab6da2e6 req-c15bfcbc-1bab-4279-a019-854d9609ce58 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:13.137991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-a1622419-df55-42f2-87b9-d1d3ab6da2e6 req-c15bfcbc-1bab-4279-a019-854d9609ce58 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:13.150724 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-a1622419-df55-42f2-87b9-d1d3ab6da2e6 req-c15bfcbc-1bab-4279-a019-854d9609ce58 service nova] Creating event network-vif-plugged:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h2-851337-5 Aug 04 05:45:13.156250 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-a1622419-df55-42f2-87b9-d1d3ab6da2e6 req-c15bfcbc-1bab-4279-a019-854d9609ce58 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035804 Aug 04 05:45:13.156812 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3682/7474] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:45:13.331384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:13.332019 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:13.339718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:13.340186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:13.340988 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:13.341447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:13.493491 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:13.500959 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ae5a9ef5-f6c3-46ab-b364-f30816dd7d72 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1371 microversion: 2.1 time: 0.173561 Aug 04 05:45:13.501534 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3793/7475] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:13 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:45:14.524182 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:14.524894 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:14.526892 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:45:14.527588 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:45:14.535384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:14.535844 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:14.536628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:14.537706 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:14.678424 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:14.686063 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-310b008c-7d3a-47e2-944d-3cb65109c6c6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1553 microversion: 2.1 time: 0.166931 Aug 04 05:45:14.686634 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3683/7476] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:14 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:14.706991 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:45:14.707570 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:45:14.709590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:45:14.716555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:14.717040 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:14.717820 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:14.718282 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:14.852944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:45:14.860728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-8c8ca897-9e72-4023-a598-972445b6b66e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1553 microversion: 2.1 time: 0.157851 Aug 04 05:45:14.861565 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3794/7477] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:45:14 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:45:16.552734 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-8f3d5010-24d0-4be4-9430-69ba72faf5e8 req-73382926-fabe-433f-aac4-c7d04646d6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:45:16.562926 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8f3d5010-24d0-4be4-9430-69ba72faf5e8 req-73382926-fabe-433f-aac4-c7d04646d6b7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:45:16.563406 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-8f3d5010-24d0-4be4-9430-69ba72faf5e8 req-73382926-fabe-433f-aac4-c7d04646d6b7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:45:16.574981 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-8f3d5010-24d0-4be4-9430-69ba72faf5e8 req-73382926-fabe-433f-aac4-c7d04646d6b7 service nova] Creating event network-changed:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h2-851337-5 Aug 04 05:45:16.580051 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-8f3d5010-24d0-4be4-9430-69ba72faf5e8 req-73382926-fabe-433f-aac4-c7d04646d6b7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030985 Aug 04 05:45:16.580636 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3684/7478] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:46:14.543918 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:46:14.544494 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:46:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:47:12.175705 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:47:12.176911 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:47:12.177483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:12.178357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=32 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:12.184700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:47:12.184700 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:12.192275 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:12.192746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:12.193571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:12.194032 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:12.217766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lazy-loading 'flavor' on Instance uuid cec1940a-57da-4d30-be2d-1acc25249a64 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:47:12.521891 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [83d359c8-beba-4931-85a9-291af3d8bb72] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:47:13.185226 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 34736. Aug 04 05:47:13.185963 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 34738. Aug 04 05:47:13.529419 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [83d359c8-beba-4931-85a9-291af3d8bb72] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 34740. Aug 04 05:47:13.533837 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-673a3306-d28a-43a8-a281-055fba637419 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64/action" status: 202 len: 0 microversion: 2.1 time: 1.360018 Aug 04 05:47:13.534486 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3795/7479] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:47:12 2022] POST /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64/action => generated 0 bytes in 1361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:47:13.541683 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9144a5b8-8932-4876-89b8-03b531401516] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:47:13.544096 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [-] [902f3a7e-5393-49bb-9b47-9ffa644922ab] AMQP server on 10.222.0.69:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 05:47:13.544748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:13.545508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=36 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:13.550139 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:13.550852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:13.558698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:13.559172 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:13.559946 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:13.560385 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:13.746286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:13.753876 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-59a57aaf-9dd6-4a94-84e5-4a23e0bd86ba tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.214056 Aug 04 05:47:13.754470 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3685/7480] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:13 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:14.778069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:14.778912 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:14.785964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:14.786423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:14.787232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:14.787679 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:14.924212 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:14.932009 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-465d0dc7-28ae-4a2a-b978-606bc6bfe163 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.159853 Aug 04 05:47:14.932586 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3796/7481] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:14 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:15.954374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:15.955097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:15.971787 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:15.972238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:15.973009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:15.973443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:15.974670 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] [902f3a7e-5393-49bb-9b47-9ffa644922ab] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 34754. Aug 04 05:47:15.977948 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] [9144a5b8-8932-4876-89b8-03b531401516] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 34752. Aug 04 05:47:16.111764 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:16.119719 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-1b9bb24a-8530-4cee-88f7-3db11adfbbf0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.169585 Aug 04 05:47:16.120293 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3686/7482] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:15 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:17.141072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:17.141623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:17.148878 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:17.149685 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:17.150170 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:17.150625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:17.285548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:17.293176 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-47d19f27-b1a4-4845-a8bd-da5b96d2818f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.156247 Aug 04 05:47:17.293755 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3797/7483] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:17 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:18.314929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:18.315571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:18.322445 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:18.322905 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:18.323709 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:18.324154 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:18.466718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:18.474780 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8a24d21c-c98d-4bd3-9eff-36f64c7159aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.164414 Aug 04 05:47:18.475426 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3687/7484] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:18 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:19.496385 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:19.497041 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:19.504132 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:19.504598 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:19.505387 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:19.505830 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:19.641718 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:19.649504 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-052b3dca-be49-49cd-a7be-a2f200d513da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.157045 Aug 04 05:47:19.650073 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3798/7485] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:19 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:47:20.672650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:20.673275 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:20.680208 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:20.680664 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:20.681441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:20.681906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:20.813363 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:20.820906 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-49133165-f3fe-4330-af5d-20b8bc1d3919 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.152796 Aug 04 05:47:20.821487 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3688/7486] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:20 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:21.841733 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:21.842352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:21.849370 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:21.849825 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:21.850596 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:21.851072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:21.987393 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:21.995189 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9e75a521-95d1-4e95-abe8-a34f62922582 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.157208 Aug 04 05:47:21.995767 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3799/7487] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:21 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:23.017682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:23.018292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:23.025185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:23.025633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:23.026392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:23.026826 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:23.158539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:23.166049 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b649c549-418b-437a-a165-f70573d17780 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.152959 Aug 04 05:47:23.166663 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3689/7488] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:23 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:24.188279 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:24.189050 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:24.196195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:24.196660 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:24.197445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:24.197895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:24.333956 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:24.341621 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2e59239c-46e7-4aa3-aa2c-9cd1e20d7804 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1698 microversion: 2.1 time: 0.157889 Aug 04 05:47:24.342206 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3800/7489] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:24 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:47:25.364292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:25.364919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:25.372253 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:25.372713 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:25.373492 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:25.373936 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:25.510417 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:25.518691 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0cbb9b06-e7ba-48a7-b2b9-ce12bf04b790 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1698 microversion: 2.1 time: 0.158322 Aug 04 05:47:25.519323 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3690/7490] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:25 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:26.541319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:26.542274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:26.550166 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:26.550728 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:26.551625 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:26.552661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:26.711333 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:26.719895 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4c78786f-2cb5-4809-94e6-bd017183ea4e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1693 microversion: 2.1 time: 0.182673 Aug 04 05:47:26.720784 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3801/7491] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:26 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:27.630727 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-5848a76b-32d6-4bb4-b665-c2893a632561 req-78153601-d111-4cf7-9bd8-a635e3f0558a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "name": "network-vif-plugged", "status": "completed", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:47:27.642001 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5848a76b-32d6-4bb4-b665-c2893a632561 req-78153601-d111-4cf7-9bd8-a635e3f0558a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:27.642449 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-5848a76b-32d6-4bb4-b665-c2893a632561 req-78153601-d111-4cf7-9bd8-a635e3f0558a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:27.666023 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-5848a76b-32d6-4bb4-b665-c2893a632561 req-78153601-d111-4cf7-9bd8-a635e3f0558a service nova] Creating event network-vif-plugged:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h2-851337-5 Aug 04 05:47:27.675225 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-5848a76b-32d6-4bb4-b665-c2893a632561 req-78153601-d111-4cf7-9bd8-a635e3f0558a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048116 Aug 04 05:47:27.676501 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3691/7492] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:47:27.742188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:27.744120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:27.753869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:27.754618 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:27.755623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:27.756417 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:27.918450 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:27.933095 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1b72a5d6-1483-46a6-9476-3432cc5e7808 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1693 microversion: 2.1 time: 0.194913 Aug 04 05:47:27.934049 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3802/7493] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:27 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:47:28.956768 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:28.958136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:28.965334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:28.965792 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:28.966579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:28.967052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:29.128259 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:29.136128 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ce3934e3-390a-4bf2-a8bd-77f840da5bd5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1693 microversion: 2.1 time: 0.184756 Aug 04 05:47:29.136735 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3692/7494] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:28 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:30.160555 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:30.161269 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:30.168518 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:30.168986 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:30.169773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:30.170221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:30.336467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:30.344794 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f34820f2-13d9-402a-936d-92173e28b911 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1693 microversion: 2.1 time: 0.190528 Aug 04 05:47:30.345410 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3803/7495] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:30 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1693 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:31.366381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:31.367032 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:31.377118 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:31.377578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:31.378508 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:31.378941 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:31.572124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:31.580714 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-552ff123-aa5f-4600-a129-09c1e53496d6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1693 microversion: 2.1 time: 0.218246 Aug 04 05:47:31.581306 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3693/7496] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:31 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1693 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:32.601770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:32.602413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:32.610243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:32.610706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:32.611569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:32.612014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:32.768126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:32.779663 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7bc272ee-22cf-499e-9770-a88996afabb9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1693 microversion: 2.1 time: 0.181707 Aug 04 05:47:32.795437 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3804/7497] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:32 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:33.806120 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:33.807344 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:33.823361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:33.824341 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:33.825700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:33.826611 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:33.979911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:33.992896 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c151e00f-76d4-4cb8-ac76-500a716c8d6d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1693 microversion: 2.1 time: 0.193649 Aug 04 05:47:33.993593 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3694/7498] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:33 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:47:35.018124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:35.018824 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:35.026189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:35.026661 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:35.027472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:35.027927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:35.238877 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:35.247596 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-43f6ce68-9529-48b2-a712-65c53eb51775 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1675 microversion: 2.1 time: 0.235021 Aug 04 05:47:35.248202 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3805/7499] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:35 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:36.269748 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:36.270292 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:36.277482 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:36.277932 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:36.278728 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:36.279201 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:36.416547 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:36.424138 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2abdd308-b81d-47df-987c-e058008f7536 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1675 microversion: 2.1 time: 0.158448 Aug 04 05:47:36.424721 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3695/7500] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:36 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:37.445803 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:37.446575 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:37.453808 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:37.454268 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:37.455092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:37.455547 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:37.597059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:37.604681 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-87f63c5f-a3dc-45dd-a567-9527512692da tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1618 microversion: 2.1 time: 0.162856 Aug 04 05:47:37.605264 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3806/7501] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:37 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1618 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:37.625911 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:47:37.626837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:37.633938 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:37.634384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:37.635180 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:37.635616 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:37.664862 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-7fe3f552-c703-474a-a9eb-580ef29c7ee7 req-eb8b9aff-a434-4cf0-8ea0-62af2994df9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "name": "network-vif-unplugged", "status": "completed", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:47:37.676389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7fe3f552-c703-474a-a9eb-580ef29c7ee7 req-eb8b9aff-a434-4cf0-8ea0-62af2994df9f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:37.676892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-7fe3f552-c703-474a-a9eb-580ef29c7ee7 req-eb8b9aff-a434-4cf0-8ea0-62af2994df9f service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:37.684238 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119342) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:47:37.690077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.compute.server_external_events [req-7fe3f552-c703-474a-a9eb-580ef29c7ee7 req-eb8b9aff-a434-4cf0-8ea0-62af2994df9f service nova] Unable to find a host for instance cec1940a-57da-4d30-be2d-1acc25249a64. Dropping event network-vif-unplugged {{(pid=119343) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 05:47:37.691019 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-7fe3f552-c703-474a-a9eb-580ef29c7ee7 req-eb8b9aff-a434-4cf0-8ea0-62af2994df9f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032065 Aug 04 05:47:37.691806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3807/7502] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 05:47:37.753025 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-66b52e96-9b53-4382-b818-b382871988b0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64/action" status: 202 len: 0 microversion: 2.1 time: 0.131793 Aug 04 05:47:37.753880 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3696/7503] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:47:37 2022] POST /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:47:37.762150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:37.762921 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:37.769663 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:37.770139 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:37.770934 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:37.771413 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:37.920195 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:37.930152 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-4982f664-2ff7-4dc4-b709-f519eea47425 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1626 microversion: 2.1 time: 0.171808 Aug 04 05:47:37.930970 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3808/7504] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:37 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1626 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:38.955325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:38.955976 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:38.962043 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:38.962494 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:38.963282 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:38.963719 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:39.108694 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:39.116682 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-c1f7943c-4a1f-44eb-83ae-2cd1bd145cf3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.166117 Aug 04 05:47:39.117279 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3697/7505] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:38 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:39.839564 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-ea6dd197-0456-4c0c-8499-62272fb61186 req-42093cd6-eb9c-4836-9919-2f4a82580059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:47:39.851060 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ea6dd197-0456-4c0c-8499-62272fb61186 req-42093cd6-eb9c-4836-9919-2f4a82580059 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:39.851533 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-ea6dd197-0456-4c0c-8499-62272fb61186 req-42093cd6-eb9c-4836-9919-2f4a82580059 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:39.863886 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-ea6dd197-0456-4c0c-8499-62272fb61186 req-42093cd6-eb9c-4836-9919-2f4a82580059 service nova] Creating event network-changed:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h1-851337-5 Aug 04 05:47:39.870183 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-ea6dd197-0456-4c0c-8499-62272fb61186 req-42093cd6-eb9c-4836-9919-2f4a82580059 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034462 Aug 04 05:47:39.870802 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3809/7506] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:47:40.138724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:40.139495 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:40.146661 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:40.147468 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:40.148327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:40.148771 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:40.302415 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:40.310242 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-63ac2282-b98d-4486-af3e-5f0fd05243a4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.175480 Aug 04 05:47:40.310926 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3698/7507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:40 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:41.333199 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:41.334070 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:41.340872 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:41.341426 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:41.342303 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:41.342836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:41.492894 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:41.496701 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:41.502447 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9479995-27c3-4703-a184-c770c4aa7533 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.174557 Aug 04 05:47:41.503051 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3810/7508] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:41 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:42.523327 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:42.524747 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:42.533224 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:42.534052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:42.535190 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:42.535906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:42.683754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:42.692798 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-84c83b5b-be96-4d85-b3a6-4e8a5f81bba4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.173781 Aug 04 05:47:42.693741 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3699/7509] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:42 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:43.716816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:43.717454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:43.720768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=33 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:43.727682 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:43.728352 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:43.729150 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:43.729600 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:43.880221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:43.889104 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7efd66cd-24b5-410b-bd66-162303444eb8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.178436 Aug 04 05:47:43.890639 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3811/7510] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:43 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:44.912981 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:44.913801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:44.918101 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:44.925604 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:44.926057 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:44.926837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:44.927296 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:44.930825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:47:45.079339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:45.088116 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-29acb398-c152-498a-9afb-ede1cf0a23f2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.179670 Aug 04 05:47:45.088928 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3700/7511] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:44 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:46.111274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:46.111812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:46.119304 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:46.119766 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:46.120561 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:46.121088 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:46.280823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:46.289571 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a7a1c4bd-4a0f-417a-a26d-2d9789cfd903 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.182864 Aug 04 05:47:46.290173 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3812/7512] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:46 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:47.313835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:47.314591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:47.322796 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:47.323717 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:47.324514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:47.324514 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:47.463766 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:47.471638 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2411ea27-0494-4d9c-bb67-0b0327a1438b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.162374 Aug 04 05:47:47.472231 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3701/7513] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:47 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:48.493750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:48.494421 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:48.501720 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:48.502197 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:48.503014 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:48.503475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:48.644001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:48.652450 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b9699568-50bb-4cf6-9610-1f5471ef7241 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.162524 Aug 04 05:47:48.653044 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3813/7514] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:48 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:49.673798 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:49.674443 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:49.681407 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:49.681853 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:49.682617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:49.683070 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:49.816838 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:49.824293 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8829ef0c-552e-4dc9-9ea7-63fb4d5b9ca5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.154525 Aug 04 05:47:49.824872 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3702/7515] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:49 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:50.846438 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:50.847296 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:50.854131 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:50.854593 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:50.855416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:50.855868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:50.992061 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:50.999905 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-42d24252-410d-498c-a3a8-cc45816bb09f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.157954 Aug 04 05:47:51.000489 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3814/7516] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:50 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:52.023441 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:52.024067 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:52.031637 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:52.032093 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:52.032876 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:52.033312 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:52.172471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:52.180012 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-01bd8921-3727-4624-a359-4fdbf4b8300b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.160547 Aug 04 05:47:52.180581 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3703/7517] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:52 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:53.201372 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:53.202534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:53.209585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:53.210046 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:53.210829 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:53.211346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:53.346015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:53.353616 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f2c75002-8707-4ba4-8782-68db336ffccb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.156198 Aug 04 05:47:53.354211 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3815/7518] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:53 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:53.925588 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:47:53.926147 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:47:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:47:54.376044 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:54.376571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:54.383633 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:54.384063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:54.384830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:54.385269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:54.525688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:54.533616 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0453ee81-e67b-451b-8ab1-c61139d652ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.162151 Aug 04 05:47:54.534191 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3704/7519] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:54 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:54.546390 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:47:54.546866 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:47:55.555534 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:55.556148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:55.563839 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:55.564307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:55.565092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:55.565552 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:55.700892 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:55.708545 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-692652a5-68ba-4e8c-aa58-26d5f57b9a35 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.157086 Aug 04 05:47:55.709129 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3816/7520] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:55 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:56.729693 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:56.730325 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:56.737909 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:56.738368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:56.739205 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:56.739647 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:56.781408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-610d7e99-6c82-4cf1-8d4e-09e4e31c80f5 req-37136c5a-8114-45ab-a69e-e79304febc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "name": "network-vif-plugged", "status": "completed", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:47:56.792734 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-610d7e99-6c82-4cf1-8d4e-09e4e31c80f5 req-37136c5a-8114-45ab-a69e-e79304febc70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:56.793435 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-610d7e99-6c82-4cf1-8d4e-09e4e31c80f5 req-37136c5a-8114-45ab-a69e-e79304febc70 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:56.806549 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-610d7e99-6c82-4cf1-8d4e-09e4e31c80f5 req-37136c5a-8114-45ab-a69e-e79304febc70 service nova] Creating event network-vif-plugged:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h1-851337-5 Aug 04 05:47:56.812730 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-610d7e99-6c82-4cf1-8d4e-09e4e31c80f5 req-37136c5a-8114-45ab-a69e-e79304febc70 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Aug 04 05:47:56.813380 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3817/7521] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:47:56.884350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:56.892826 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-deca5841-dd07-408a-843a-81e3176b686e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.167537 Aug 04 05:47:56.893414 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3705/7522] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:56 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:47:57.918881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:57.919637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:57.926927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:57.927425 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:57.929247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:57.929913 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:58.072696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:58.080944 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f7ad857c-8c51-44f5-b6f9-cb39b8da582b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1684 microversion: 2.1 time: 0.167940 Aug 04 05:47:58.081511 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3818/7523] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:57 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:47:59.103166 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:47:59.103740 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:47:59.111412 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:59.111860 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:59.112623 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:47:59.113052 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:47:59.244388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:47:59.252031 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-15ae3e05-8a1c-4295-b6b6-77a22fa3e083 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1671 microversion: 2.1 time: 0.152940 Aug 04 05:47:59.252606 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3706/7524] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:47:59 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:49:34.552987 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:49:34.553571 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:49:39.295237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=15 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:49:39.296569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=44 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:49:39.300657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:49:39.301173 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:49:39.302063 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=13 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:49:39.303576 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=41 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:49:39.308659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:39.309125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:39.309849 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:39.310712 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:39.339317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:49:39.371006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-683141ec-8415-40a4-af74-fe7965f65d0e req-e8d431fd-25df-4f91-bc56-0eccad750528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:49:39.381940 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-683141ec-8415-40a4-af74-fe7965f65d0e req-e8d431fd-25df-4f91-bc56-0eccad750528 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:39.382542 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-683141ec-8415-40a4-af74-fe7965f65d0e req-e8d431fd-25df-4f91-bc56-0eccad750528 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:39.394890 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-683141ec-8415-40a4-af74-fe7965f65d0e req-e8d431fd-25df-4f91-bc56-0eccad750528 service nova] Creating event network-changed:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h1-851337-5 Aug 04 05:49:39.405503 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-683141ec-8415-40a4-af74-fe7965f65d0e req-e8d431fd-25df-4f91-bc56-0eccad750528 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108008 Aug 04 05:49:39.406405 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3707/7525] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:49:39.424230 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bbc9359c-a83c-4cc6-b92f-937236687d1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 204 len: 0 microversion: 2.1 time: 0.131048 Aug 04 05:49:39.424837 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3819/7526] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:49:39 2022] DELETE /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:49:39.434836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:49:39.447276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:49:39.459649 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:39.460249 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:39.461148 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:39.461830 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:39.611979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:49:39.620393 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d79ec758-a28a-4336-84b7-b89655cbe476 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.190977 Aug 04 05:49:39.620971 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3708/7527] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:49:39 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:49:40.645607 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:49:40.647125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:49:40.654947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:40.655440 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:40.656228 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:40.656676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:40.794980 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:49:40.802746 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7191a857-49b7-411f-a1df-ca3d23466b8b tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1677 microversion: 2.1 time: 0.163484 Aug 04 05:49:40.803665 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3820/7528] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:49:40 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:49:41.738149 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-521c3229-dc0f-4874-ae18-65b61ccf07b1 req-22576143-c2f9-4a79-a52f-76ec708350f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec1940a-57da-4d30-be2d-1acc25249a64", "name": "network-vif-deleted", "tag": "58dc2986-33da-4f5a-90c3-d1f960bcaa2a"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:49:41.751395 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-521c3229-dc0f-4874-ae18-65b61ccf07b1 req-22576143-c2f9-4a79-a52f-76ec708350f1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:41.751910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-521c3229-dc0f-4874-ae18-65b61ccf07b1 req-22576143-c2f9-4a79-a52f-76ec708350f1 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:41.764325 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-521c3229-dc0f-4874-ae18-65b61ccf07b1 req-22576143-c2f9-4a79-a52f-76ec708350f1 service nova] Creating event network-vif-deleted:58dc2986-33da-4f5a-90c3-d1f960bcaa2a for instance cec1940a-57da-4d30-be2d-1acc25249a64 on n-h1-851337-5 Aug 04 05:49:41.770662 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-521c3229-dc0f-4874-ae18-65b61ccf07b1 req-22576143-c2f9-4a79-a52f-76ec708350f1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035681 Aug 04 05:49:41.771529 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3709/7529] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:49:41.823670 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:49:41.824317 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:49:41.832901 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:41.833369 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:41.834174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:41.834630 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:41.902341 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:49:41.910272 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b32bd2be-36be-47f6-9222-1f9f278b56aa tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 200 len: 1332 microversion: 2.1 time: 0.090562 Aug 04 05:49:41.911505 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3821/7530] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:49:41 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:49:42.933889 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:49:42.934585 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: cec1940a-57da-4d30-be2d-1acc25249a64] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:49:42.941757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:42.942229 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:42.943031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:49:42.943473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:49:42.957562 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] HTTP exception thrown: Instance cec1940a-57da-4d30-be2d-1acc25249a64 could not be found. Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Request method failure captured: Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 HTTP/1.1 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61zYqL_0SbIO7E5yGr9ip6ngDooRQBwDtfzynhLUGAcMv0lSN6XNSrZvdY5tz7M0BTJQ4ciFUmnYoWocQUYyNg9XTamIep6guB9If5xk-xGATlEXe7AbiMdvuOPsbiD2zwlwd23NIMg4JgLVPkWWbRWzHZ2a9hufr3wqtjTG6rPSb60 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 141aa2286a7f421199d9a9dd6e273d08 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestShelveInstance-995823045 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/141aa2286a7f421199d9a9dd6e273d08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/141aa2286a7f421199d9a9dd6e273d08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/141aa2286a7f421199d9a9dd6e273d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_141aa2286a7f421199d9a9dd6e273d08", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestShelveInstance-995823045 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 141aa2286a7f421199d9a9dd6e273d08 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestShelveInstance-995823045 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestShelveInstance-995823045-project Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 164db8279c4f49dea8a12242934c0921 Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestShelveInstance-995823045-project Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance cec1940a-57da-4d30-be2d-1acc25249a64 could not be found. Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'cec1940a-57da-4d30-be2d-1acc25249a64'} Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec1940a-57da-4d30-be2d-1acc25249a64 could not be found. Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec1940a-57da-4d30-be2d-1acc25249a64 could not be found. Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:49:42.958645 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec1940a-57da-4d30-be2d-1acc25249a64 could not be found. Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Returning 404 to user: Instance cec1940a-57da-4d30-be2d-1acc25249a64 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-dfa33e6c-910e-487e-ac66-1cd33337b485 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64" status: 404 len: 111 microversion: 2.1 time: 0.031348 Aug 04 05:49:42.963146 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3710/7531] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:49:42 2022] GET /compute/v2.1/servers/cec1940a-57da-4d30-be2d-1acc25249a64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:49:43.132223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-bbf955e1-4c36-4eea-bea9-3e0d0b16b2f1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '.version_select at 0x7f191a343e50>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:49:43.168796 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-bbf955e1-4c36-4eea-bea9-3e0d0b16b2f1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1310343466" status: 202 len: 0 microversion: 2.1 time: 0.041012 Aug 04 05:49:43.170793 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3822/7532] 10.222.0.69 () {58 vars in 1254 bytes} [Thu Aug 4 05:49:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1310343466 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:49:43.191465 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a011e8ac-9698-4476-82e7-e88d7277e532 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'create', calling method: .version_select at 0x7f1918c428b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-804245620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+JK3IUqZ2keF0j8pjGhM6F+Ms/QvVfeOZ0+cPgPL/NSTIvrksdSc+0R72bwviBIfiYE2z2zdfVhOu+hjv52DT8de5su/fJCVThns9goQ2SKPqVU+3IXfga5G9zS1sRLA=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:49:43.207108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a011e8ac-9698-4476-82e7-e88d7277e532 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:49:43.213083 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-a011e8ac-9698-4476-82e7-e88d7277e532 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for user 164db8279c4f49dea8a12242934c0921 and project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:49:43.242224 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a011e8ac-9698-4476-82e7-e88d7277e532 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054845 Aug 04 05:49:43.242840 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3711/7533] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:49:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:49:59.598711 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:49:59.599502 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:49:59.604189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1699895730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-804245620", "security_groups": [{"name": "tempest-secgroup-smoke-634285052"}], "networks": [{"uuid": "584adcb6-9b0e-4f5b-ba02-cb057f559ee3"}], "block_device_mapping_v2": [{"uuid": "7fa1317c-0cb9-4b3d-9926-1d2b7a7ab9b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:49:59.719987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] validate_networks() for [('584adcb6-9b0e-4f5b-ba02-cb057f559ee3', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:50:00.147681 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:50:00.148127 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:50:00.148628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:50:00.149087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:50:00.149520 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:50:00.158879 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:00.159358 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:00.160968 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:00.161423 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:00.179122 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:50:00.184445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Getting quotas for user 164db8279c4f49dea8a12242934c0921 and project 141aa2286a7f421199d9a9dd6e273d08. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:50:00.242895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:50:00.245015 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fa1317c-0cb9-4b3d-9926-1d2b7a7ab9b4',volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:50:00.374233 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0a42f5c4-4580-4bd5-ab3b-653dd10cdd84 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777771 Aug 04 05:50:00.374965 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3823/7534] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:49:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:50:00.386863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5e96c7be-72bf-4b5c-b2a1-c84bbc9a147f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:00.388297 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5e96c7be-72bf-4b5c-b2a1-c84bbc9a147f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:00.390581 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:50:00.391285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=4 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:50:00.391900 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:50:00.448006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5e96c7be-72bf-4b5c-b2a1-c84bbc9a147f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:00.455114 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5e96c7be-72bf-4b5c-b2a1-c84bbc9a147f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1088 microversion: 2.1 time: 0.072549 Aug 04 05:50:00.455697 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3712/7535] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:00 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:50:01.478232 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:01.479124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:01.490233 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:01.490850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:01.492038 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:01.492669 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:01.583274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:01.591050 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-933210b2-00ae-41d6-a926-ba336cb6c8de tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1204 microversion: 2.1 time: 0.118732 Aug 04 05:50:01.591657 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3824/7536] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:01 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1204 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:02.699580 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:02.701105 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:02.713153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:02.713852 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:02.714879 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:02.715499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:02.939464 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a491bb61-b2e4-49d8-bb9f-c5d8e6133d22 req-d2209618-0c74-450b-8166-e6a08c595030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:50:02.950382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a491bb61-b2e4-49d8-bb9f-c5d8e6133d22 req-d2209618-0c74-450b-8166-e6a08c595030 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:02.950847 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a491bb61-b2e4-49d8-bb9f-c5d8e6133d22 req-d2209618-0c74-450b-8166-e6a08c595030 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:02.963388 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a491bb61-b2e4-49d8-bb9f-c5d8e6133d22 req-d2209618-0c74-450b-8166-e6a08c595030 service nova] Creating event network-changed:2808cf8d-2a0d-4273-aecd-5718db0fb949 for instance a7099237-18be-430c-bf25-d0c0b4cb3e52 on n-h2-851337-5 Aug 04 05:50:02.968490 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a491bb61-b2e4-49d8-bb9f-c5d8e6133d22 req-d2209618-0c74-450b-8166-e6a08c595030 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110343 Aug 04 05:50:02.969099 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3825/7537] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:50:02.978081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:02.986763 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-815108a1-e97b-42cd-9f32-e976bf2c8bc7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1271 microversion: 2.1 time: 0.377357 Aug 04 05:50:02.987408 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3713/7538] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:02 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1271 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:04.009274 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:04.010262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:04.016789 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:04.017307 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:04.018181 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:04.018637 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:04.216357 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:04.224623 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-44e664ba-6ac2-4a92-a15c-340d4bfb6426 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1271 microversion: 2.1 time: 0.220520 Aug 04 05:50:04.225289 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3826/7539] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:04 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:05.245996 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:05.246617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:05.253697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:05.254152 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:05.255487 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:05.255931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:05.398817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:05.406817 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7afecb67-5486-47fb-b859-184c03ce766d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1271 microversion: 2.1 time: 0.164711 Aug 04 05:50:05.407927 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3714/7540] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:05 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:06.429133 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:06.429869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:06.437185 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:06.437729 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:06.438535 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:06.439036 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:06.581634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:06.593701 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f43445e-8978-4b16-b67d-9280662869d9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1271 microversion: 2.1 time: 0.169029 Aug 04 05:50:06.594488 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3827/7541] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:06 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:07.617281 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:07.617856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:07.624839 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:07.625337 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:07.626082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:07.626527 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:07.758776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:07.766624 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d42a9801-ac25-4ac7-9990-61a7e8cfc683 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.154828 Aug 04 05:50:07.767246 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3715/7542] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:07 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:08.788063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:08.788719 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:08.796221 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:08.796680 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:08.797459 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:08.797905 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:08.934201 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:08.941784 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-dd9bdd5f-5965-4895-910a-e6e95ea39195 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.157674 Aug 04 05:50:08.942368 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3828/7543] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:08 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:09.963590 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:09.964262 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:09.971124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:09.971571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:09.972334 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:09.972762 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:10.105176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:10.112743 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e399cbd-867a-495d-8115-b71a561b6e3d tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.153511 Aug 04 05:50:10.113322 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3716/7544] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:09 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:11.133774 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:11.134408 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:11.137270 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:50:11.137958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:50:11.144162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:11.144633 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:11.145916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:11.146382 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:11.280786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:11.289278 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7d691a05-0671-461c-a294-40b7470a5cce tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.159536 Aug 04 05:50:11.289861 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3829/7545] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:11 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:12.309049 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:12.309669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:12.311680 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:50:12.318109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:12.318566 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:12.319368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:12.319810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:12.450646 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:12.458766 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f139fa34-83f8-491a-948b-89b3e48f08cf tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.153083 Aug 04 05:50:12.459357 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3717/7546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:12 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:13.479688 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:13.480347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:13.486676 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:13.487183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:13.487969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:13.488420 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:13.623248 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:13.631487 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-671bee45-ee8d-498c-8fa9-b0d2bce36f3c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.155786 Aug 04 05:50:13.632057 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3830/7547] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:13 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:14.655038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:14.655038 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:14.663474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:14.664054 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:14.665600 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:14.665729 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:14.811089 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:14.819159 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-2cec9697-bcf1-4e09-afaa-76f8af795206 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.170267 Aug 04 05:50:14.824072 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3718/7548] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:14 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:15.841608 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:15.842287 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:15.850631 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:15.851129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:15.851917 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:15.852860 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:15.986741 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:15.994294 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91c1d6b6-03ad-482a-a7dd-472d3bcd41ed tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.156719 Aug 04 05:50:15.994864 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3831/7549] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:15 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:16.452484 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-c1b25bcb-7596-43c5-a1b5-cb34d6c7a684 req-c998866b-4b33-4113-bd31-a42a0f363480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "name": "network-vif-plugged", "status": "completed", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:50:16.462851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c1b25bcb-7596-43c5-a1b5-cb34d6c7a684 req-c998866b-4b33-4113-bd31-a42a0f363480 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:16.462851 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-c1b25bcb-7596-43c5-a1b5-cb34d6c7a684 req-c998866b-4b33-4113-bd31-a42a0f363480 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:16.476765 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-c1b25bcb-7596-43c5-a1b5-cb34d6c7a684 req-c998866b-4b33-4113-bd31-a42a0f363480 service nova] Creating event network-vif-plugged:2808cf8d-2a0d-4273-aecd-5718db0fb949 for instance a7099237-18be-430c-bf25-d0c0b4cb3e52 on n-h2-851337-5 Aug 04 05:50:16.481804 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-c1b25bcb-7596-43c5-a1b5-cb34d6c7a684 req-c998866b-4b33-4113-bd31-a42a0f363480 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088149 Aug 04 05:50:16.482331 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3719/7550] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:50:17.016424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:17.017196 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:17.025339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:17.025812 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:17.026615 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:17.027097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:17.160386 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:17.168754 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a1e734bf-07e7-40a3-b9c3-9c0523f8a9c8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1259 microversion: 2.1 time: 0.157004 Aug 04 05:50:17.169330 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3832/7551] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:17 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:18.191009 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:18.191714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:18.198109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:18.198562 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:18.199368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:18.199903 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:18.334207 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:18.341920 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-13724e78-7367-4b27-85a1-9b42774f7aac tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1440 microversion: 2.1 time: 0.156077 Aug 04 05:50:18.342482 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3720/7552] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:18 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1440 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:18.362324 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:50:18.362975 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:50:18.370588 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:18.371097 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:18.371891 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:18.372360 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:18.507496 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:50:18.515194 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d9a96bee-0316-4313-a438-ee5e674aeace tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1440 microversion: 2.1 time: 0.156756 Aug 04 05:50:18.515768 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3833/7553] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:50:18 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1440 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:50:20.147532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-6ec461af-94f0-458b-a908-45526b431df7 req-eb28420e-63d2-4013-8f3c-05c5a9f18cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:50:20.158757 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ec461af-94f0-458b-a908-45526b431df7 req-eb28420e-63d2-4013-8f3c-05c5a9f18cbb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:50:20.159405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-6ec461af-94f0-458b-a908-45526b431df7 req-eb28420e-63d2-4013-8f3c-05c5a9f18cbb service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:50:20.171255 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-6ec461af-94f0-458b-a908-45526b431df7 req-eb28420e-63d2-4013-8f3c-05c5a9f18cbb service nova] Creating event network-changed:2808cf8d-2a0d-4273-aecd-5718db0fb949 for instance a7099237-18be-430c-bf25-d0c0b4cb3e52 on n-h2-851337-5 Aug 04 05:50:20.177183 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-6ec461af-94f0-458b-a908-45526b431df7 req-eb28420e-63d2-4013-8f3c-05c5a9f18cbb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032732 Aug 04 05:50:20.177967 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3721/7554] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:52:15.250369 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:52:15.251764 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:52:15.252467 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:15.253365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=58 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:15.259806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:52:15.260475 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:15.269786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:15.270256 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:15.271081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:15.271542 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:15.295519 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lazy-loading 'flavor' on Instance uuid a7099237-18be-430c-bf25-d0c0b4cb3e52 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:52:15.369927 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [83d359c8-beba-4931-85a9-291af3d8bb72] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:52:16.261077 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35290. Aug 04 05:52:16.262006 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35288. Aug 04 05:52:16.377270 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [83d359c8-beba-4931-85a9-291af3d8bb72] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35292. Aug 04 05:52:16.380648 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d0d0e76f-67b2-48d6-a67d-40f9e758d98c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52/action" status: 202 len: 0 microversion: 2.1 time: 1.132697 Aug 04 05:52:16.381331 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3834/7555] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:52:15 2022] POST /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:52:16.388999 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9144a5b8-8932-4876-89b8-03b531401516] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:52:16.389917 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [-] [902f3a7e-5393-49bb-9b47-9ffa644922ab] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:52:16.390791 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=22 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:16.391579 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=46 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:16.398223 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:16.399183 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:16.408317 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:16.409211 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:16.409992 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:16.410427 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:16.624564 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:16.632102 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d6abd788-3255-4179-84c3-9a820d4438d3 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.245433 Aug 04 05:52:16.632668 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3722/7556] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:16 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:17.655396 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:17.656119 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:17.664200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:17.664673 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:17.665470 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:17.666086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:17.860104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:17.868481 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1f4efab3-c77d-4ba1-afbe-435cd158b355 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.218542 Aug 04 05:52:17.869060 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3835/7557] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:17 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:18.890536 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:18.891398 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:18.900597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:18.901053 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:18.901841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:18.902286 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:18.909284 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] [9144a5b8-8932-4876-89b8-03b531401516] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35306. Aug 04 05:52:18.919691 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] [902f3a7e-5393-49bb-9b47-9ffa644922ab] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35308. Aug 04 05:52:19.035700 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:19.043227 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6ef077df-6a18-4cf9-af18-d74f3e962fd6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.157454 Aug 04 05:52:19.043800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3723/7558] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:18 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:52:20.065162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:20.065799 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:20.073365 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:20.073836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:20.074628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:20.075113 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:20.216778 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:20.224468 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-1d6739ca-0c15-4d3b-9a08-307b6a46ada9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.163355 Aug 04 05:52:20.225044 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3836/7559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:20 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:21.245801 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:21.246422 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:21.253451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:21.253906 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:21.254673 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:21.255143 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:21.387621 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:21.395187 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-0bc66d49-7bc7-44dc-874c-d58d09285b05 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.153372 Aug 04 05:52:21.395766 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3724/7560] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:21 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:22.417077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:22.417742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:22.424735 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:22.425204 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:22.425998 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:22.426453 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:22.562291 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:22.569978 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2af00882-1bc7-40b2-93fc-ce679103a54c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.156828 Aug 04 05:52:22.570550 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3837/7561] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:22 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:23.591463 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:23.592082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:23.599202 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:23.599654 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:23.600436 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:23.600914 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:23.738290 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:23.746926 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6db14117-659d-4e0b-a3f0-0d4c2a8aadb5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.159416 Aug 04 05:52:23.747524 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3725/7562] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:23 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:24.770909 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:24.771571 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:24.779445 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:24.779910 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:24.780705 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:24.781159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:24.916219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:24.924211 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-64c77616-3f97-41fe-9e7c-16b88eeac451 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.157152 Aug 04 05:52:24.924807 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3838/7563] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:24 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:25.947386 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:25.948028 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:25.955018 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:25.955473 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:25.956233 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:25.956662 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:26.113628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:26.122483 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-71009670-d028-4edb-b3f4-90bfbfbf9362 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.181132 Aug 04 05:52:26.123130 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3726/7564] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:25 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:27.145784 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:27.146447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:27.153686 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:27.154154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:27.154938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:27.155416 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:27.288104 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:27.295936 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0b915ad0-c0da-4885-adf5-0e45296dac19 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.154136 Aug 04 05:52:27.296533 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3839/7565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:27 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:28.317818 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:28.318381 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:28.325872 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:28.326324 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:28.327111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:28.327551 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:28.464100 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:28.472335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-b1476186-8178-43a8-b045-8c020bb88372 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.158293 Aug 04 05:52:28.472749 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3727/7566] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:28 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:29.493710 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:29.494428 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:29.501628 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:29.502348 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:29.503001 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:29.503462 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:29.640756 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:29.648813 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c375482c-69b3-46d1-bde0-0be16fc65fc4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.159491 Aug 04 05:52:29.649400 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3840/7567] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:29 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:30.669737 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:30.670349 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:30.677278 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:30.677722 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:30.678483 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:30.678917 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:30.815345 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:30.823145 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-60c92fbc-7fa3-4c6d-9490-4b8732d353c5 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1506 microversion: 2.1 time: 0.157202 Aug 04 05:52:30.823725 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3728/7568] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:30 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:30.843987 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:52:30.844611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:30.852390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:30.852861 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:30.853652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:30.854105 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:30.895078 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119343) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:52:30.960890 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-2bd08c7e-d648-4e90-b0c5-a01e15b45c8a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "POST /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52/action" status: 202 len: 0 microversion: 2.1 time: 0.120093 Aug 04 05:52:30.961754 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3841/7569] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:52:30 2022] POST /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:52:30.970174 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:30.971252 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:30.977732 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:30.978269 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:30.979081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:30.979532 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:31.112697 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:31.121055 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-7e9f4508-a1f8-49b3-bccc-f1db31d72202 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1514 microversion: 2.1 time: 0.154780 Aug 04 05:52:31.121645 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3729/7570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:30 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:32.144548 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:32.145189 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:32.156371 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:32.156840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:32.157667 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:32.158203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:32.290258 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:32.298326 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7aadf1b4-d30f-4327-b0c5-cb1a5ba33739 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1514 microversion: 2.1 time: 0.157670 Aug 04 05:52:32.298910 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3842/7571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:32 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:33.285800 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9d8a2132-7fa3-4634-815e-9215b95e33c4 req-456ca003-35f3-46c3-8a7a-e82147126ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "name": "network-vif-unplugged", "status": "completed", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:52:33.296539 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9d8a2132-7fa3-4634-815e-9215b95e33c4 req-456ca003-35f3-46c3-8a7a-e82147126ac0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:33.296997 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9d8a2132-7fa3-4634-815e-9215b95e33c4 req-456ca003-35f3-46c3-8a7a-e82147126ac0 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:33.309808 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.compute.server_external_events [req-9d8a2132-7fa3-4634-815e-9215b95e33c4 req-456ca003-35f3-46c3-8a7a-e82147126ac0 service nova] Unable to find a host for instance a7099237-18be-430c-bf25-d0c0b4cb3e52. Dropping event network-vif-unplugged {{(pid=119342) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 05:52:33.311024 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9d8a2132-7fa3-4634-815e-9215b95e33c4 req-456ca003-35f3-46c3-8a7a-e82147126ac0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029790 Aug 04 05:52:33.311629 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3730/7572] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 05:52:33.320126 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:33.322010 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:33.329781 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:33.330558 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:33.331716 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:33.332178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:33.477053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:33.485237 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c775f73f-6d7b-4525-a893-635026d54df7 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1514 microversion: 2.1 time: 0.169637 Aug 04 05:52:33.485828 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3843/7573] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:33 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:34.508065 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:34.508687 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:34.516751 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:34.517255 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:34.518181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:34.518631 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:34.651543 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:34.659398 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e70453ca-be9d-44e7-afba-13a0e2b6857a tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1514 microversion: 2.1 time: 0.155591 Aug 04 05:52:34.659972 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3731/7574] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:34 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:35.681063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:35.681627 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:35.688793 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:35.689261 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:35.690057 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:35.690513 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:35.835838 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:35.843225 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-7bf463eb-40c9-4f26-89b5-6c7bd51e7d81 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1516 microversion: 2.1 time: 0.166728 Aug 04 05:52:35.843806 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3844/7575] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:35 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:36.865609 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:36.866718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:36.873943 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:36.874389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:36.875186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:36.875627 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:37.011593 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:37.019605 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e6ba31d0-f660-402a-89ac-20d2ca695ac9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1516 microversion: 2.1 time: 0.157926 Aug 04 05:52:37.020312 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3732/7576] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:36 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:52:38.041383 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:38.041966 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:38.049783 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:38.050374 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:38.051207 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:38.051659 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:38.187577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:38.195755 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-0e2ad310-de58-40e7-a777-6a19ed605473 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1516 microversion: 2.1 time: 0.158418 Aug 04 05:52:38.196542 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3845/7577] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:38 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:39.216421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:39.217126 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:39.224453 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:39.224910 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:39.225714 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:39.226153 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:39.370124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:39.378352 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-65951bd8-fe0c-4bf1-9c8f-6eb9f2eb986c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1516 microversion: 2.1 time: 0.165771 Aug 04 05:52:39.378978 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3733/7578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:39 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:40.401124 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:40.401770 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:40.408963 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:40.409684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:40.410465 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:40.411156 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:40.548746 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:40.557058 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c074fa5f-1a55-4f1c-b1f3-595dcfb8b9fc tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1516 microversion: 2.1 time: 0.160950 Aug 04 05:52:40.557639 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3846/7579] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:40 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:41.578474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:41.579157 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:41.587109 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:41.587569 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:41.588350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:41.588788 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:41.729128 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:41.737335 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-65a2a467-1e58-4f74-9162-e207a84b6c9c tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.162961 Aug 04 05:52:41.737980 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3734/7580] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:41 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:41.832826 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-5b61e46e-d38c-4b6d-8688-4696f190dbd8 req-02c7d27a-4fc7-49d2-aa82-c30fc67d126e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:52:41.847290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5b61e46e-d38c-4b6d-8688-4696f190dbd8 req-02c7d27a-4fc7-49d2-aa82-c30fc67d126e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:41.847750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-5b61e46e-d38c-4b6d-8688-4696f190dbd8 req-02c7d27a-4fc7-49d2-aa82-c30fc67d126e service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:41.859971 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-5b61e46e-d38c-4b6d-8688-4696f190dbd8 req-02c7d27a-4fc7-49d2-aa82-c30fc67d126e service nova] Creating event network-changed:2808cf8d-2a0d-4273-aecd-5718db0fb949 for instance a7099237-18be-430c-bf25-d0c0b4cb3e52 on n-h1-851337-5 Aug 04 05:52:41.865134 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-5b61e46e-d38c-4b6d-8688-4696f190dbd8 req-02c7d27a-4fc7-49d2-aa82-c30fc67d126e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037234 Aug 04 05:52:41.865742 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3847/7581] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:52:42.759306 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:42.759928 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:42.766805 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:42.767293 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:42.768062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:42.768504 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:42.904863 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:42.913625 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-fe7c966b-c4c9-408f-9c7e-b47c1c5f5fb1 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.157600 Aug 04 05:52:42.914351 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3735/7582] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:42 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:43.937476 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:43.938288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:43.945796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:43.946610 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:43.947614 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:43.948072 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:43.952900 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:44.090539 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:44.098173 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cd359dd6-827c-4a28-aa8a-1d113a22dac4 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.165996 Aug 04 05:52:44.098769 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3848/7583] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:43 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:45.120528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:45.121171 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:45.128177 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:45.128629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:45.129389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:45.129825 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:45.264682 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:45.273012 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-010e1a0e-a483-49db-8552-d59346ea09a9 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.155951 Aug 04 05:52:45.273592 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3736/7584] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:45 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:46.295472 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:46.296313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:46.298171 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:46.304343 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:46.304813 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:46.305668 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:46.306074 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:46.439864 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:46.447576 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d4b4afa9-a638-4c99-8876-610a347b3e86 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.156632 Aug 04 05:52:46.448160 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3849/7585] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:46 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:47.468754 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:47.469361 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:47.472081 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=31 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:47.477541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:47.477999 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:47.478779 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:47.479244 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:47.483373 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=87 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:52:47.614181 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:47.622366 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-338cca0e-ed41-4152-930d-af100938b34e tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.157580 Aug 04 05:52:47.622946 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3737/7586] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:47 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:48.643621 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:48.644262 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:48.652151 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:48.652623 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:48.653429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:48.653895 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:48.789225 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:48.796930 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a3d0e44a-9661-4111-ba62-d261f7aa96a2 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.157369 Aug 04 05:52:48.797508 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3850/7587] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:48 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:49.820131 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:49.820724 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:49.827206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:49.827669 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:49.828442 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:49.828886 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:49.970967 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:49.979268 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83052bf4-882d-4fef-923a-ecd9516fea07 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.163260 Aug 04 05:52:49.979874 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3738/7588] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:49 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:51.000804 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:51.001446 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:51.008549 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:51.009016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:51.009795 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:51.010247 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:51.142206 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:51.150541 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-91f3b872-6699-46c2-bd83-b959102ea8ea tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.153660 Aug 04 05:52:51.151140 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3851/7589] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:50 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:52.172469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:52.173082 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:52.180972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:52.181421 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:52.182197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:52.182630 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:52.241833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-708d58e8-ea8d-4edc-bb64-e82047eea69d req-7fe47f60-edf7-4443-8b96-8f5a949e2362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "name": "network-vif-plugged", "status": "completed", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:52:52.254313 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-708d58e8-ea8d-4edc-bb64-e82047eea69d req-7fe47f60-edf7-4443-8b96-8f5a949e2362 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:52.254786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-708d58e8-ea8d-4edc-bb64-e82047eea69d req-7fe47f60-edf7-4443-8b96-8f5a949e2362 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:52.267732 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-708d58e8-ea8d-4edc-bb64-e82047eea69d req-7fe47f60-edf7-4443-8b96-8f5a949e2362 service nova] Creating event network-vif-plugged:2808cf8d-2a0d-4273-aecd-5718db0fb949 for instance a7099237-18be-430c-bf25-d0c0b4cb3e52 on n-h1-851337-5 Aug 04 05:52:52.272385 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-708d58e8-ea8d-4edc-bb64-e82047eea69d req-7fe47f60-edf7-4443-8b96-8f5a949e2362 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035463 Aug 04 05:52:52.273257 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3852/7590] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:52:52.324606 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:52.333248 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6e6ed41a-d305-4278-ae80-25a8780664ff tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.164513 Aug 04 05:52:52.334392 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3739/7591] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:52 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:53.357013 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:53.357724 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:53.364081 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:53.364543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:53.365322 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:53.366260 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:53.507768 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:53.517375 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-a499913d-e15c-4f6a-9a70-38d04ed53a1f tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1572 microversion: 2.1 time: 0.165421 Aug 04 05:52:53.517969 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3853/7592] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:53 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:52:53.935788 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:52:53.936541 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:52:54.411168 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:52:54.411383 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:52:54.539513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:52:54.540134 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:52:54.547163 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:54.547614 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:54.548392 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:52:54.548831 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:52:54.557461 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:52:54.557962 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:52:54.694469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:52:54.702243 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3b3f541f-9d73-455d-bdc1-4bb23ffbdea6 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1559 microversion: 2.1 time: 0.167597 Aug 04 05:52:54.702800 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3740/7593] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:52:54 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:53:00.680356 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:53:00.680932 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:53:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:54:08.568958 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=9 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:08.570347 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=30 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:08.575274 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-38737a1f-fa7d-4ea5-8f81-cf208223c64f req-fdaa0899-1cd3-42d3-b1f7-61c550bf9b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:54:08.575767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:08.575952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:08.583326 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:08.583802 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:08.583916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=7 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:08.584736 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:08.584881 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=23 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:08.585806 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:08.588509 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-38737a1f-fa7d-4ea5-8f81-cf208223c64f req-fdaa0899-1cd3-42d3-b1f7-61c550bf9b0a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:08.588959 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-38737a1f-fa7d-4ea5-8f81-cf208223c64f req-fdaa0899-1cd3-42d3-b1f7-61c550bf9b0a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:08.601682 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-38737a1f-fa7d-4ea5-8f81-cf208223c64f req-fdaa0899-1cd3-42d3-b1f7-61c550bf9b0a service nova] Creating event network-changed:2808cf8d-2a0d-4273-aecd-5718db0fb949 for instance a7099237-18be-430c-bf25-d0c0b4cb3e52 on n-h1-851337-5 Aug 04 05:54:08.609328 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-38737a1f-fa7d-4ea5-8f81-cf208223c64f req-fdaa0899-1cd3-42d3-b1f7-61c550bf9b0a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039717 Aug 04 05:54:08.610142 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3741/7594] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:54:08.615641 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Going to try to terminate instance {{(pid=119343) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:54:08.716372 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b507f579-8014-4b77-b3e8-e3b40a428488 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 204 len: 0 microversion: 2.1 time: 0.149240 Aug 04 05:54:08.717128 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3854/7595] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:54:08 2022] DELETE /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:54:08.725902 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:08.726887 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:08.734469 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:08.735062 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:08.735919 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:08.737136 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:08.881634 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:08.891106 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4d2f9ae7-ccba-4e6a-8d92-290c07d837bb tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.169393 Aug 04 05:54:08.891694 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3742/7596] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:08 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:54:09.913626 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:09.914353 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:09.921944 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:09.922543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:09.923447 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:09.923908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:10.067392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:10.075785 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ec6c12ee-ca03-4342-a681-cc25da1ba7a0 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1565 microversion: 2.1 time: 0.166805 Aug 04 05:54:10.076370 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3855/7597] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:09 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:10.974026 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-30f7188a-f0ba-4dd7-8a1f-15ba3662d072 req-73603208-15fa-4dab-a554-a713999d9b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7099237-18be-430c-bf25-d0c0b4cb3e52", "name": "network-vif-deleted", "tag": "2808cf8d-2a0d-4273-aecd-5718db0fb949"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:54:10.987837 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-30f7188a-f0ba-4dd7-8a1f-15ba3662d072 req-73603208-15fa-4dab-a554-a713999d9b54 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:10.989098 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-30f7188a-f0ba-4dd7-8a1f-15ba3662d072 req-73603208-15fa-4dab-a554-a713999d9b54 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:11.004359 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-30f7188a-f0ba-4dd7-8a1f-15ba3662d072 req-73603208-15fa-4dab-a554-a713999d9b54 service nova] Creating event network-vif-deleted:2808cf8d-2a0d-4273-aecd-5718db0fb949 for instance a7099237-18be-430c-bf25-d0c0b4cb3e52 on n-h1-851337-5 Aug 04 05:54:11.010079 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-30f7188a-f0ba-4dd7-8a1f-15ba3662d072 req-73603208-15fa-4dab-a554-a713999d9b54 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039904 Aug 04 05:54:11.010680 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3743/7598] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:54:11.098086 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:11.098721 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:11.106750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:11.107590 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:11.108384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:11.108834 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:11.173278 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:11.182562 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-99c18391-f583-4e23-af9f-90697795d464 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1219 microversion: 2.1 time: 0.088600 Aug 04 05:54:11.183329 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3856/7599] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:11 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:12.204502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:12.205499 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:12.213625 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:12.214108 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:12.214931 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:12.215394 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:12.289340 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:12.297267 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-e5c8dc10-7900-4f8b-98c3-4d85c90555b8 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1219 microversion: 2.1 time: 0.097383 Aug 04 05:54:12.310913 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3744/7600] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:12 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:13.319327 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:13.319965 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:13.327957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:13.328424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:13.329231 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:13.329692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:13.396666 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:13.404574 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-9741f0b0-dc22-493c-ace9-7a22ffd5ab09 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1219 microversion: 2.1 time: 0.089240 Aug 04 05:54:13.405464 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3857/7601] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:13 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:14.425726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:14.426350 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:14.434094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:14.434571 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:14.435374 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:14.435820 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:14.509978 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:14.518604 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-d172d299-c1c0-499c-a67f-a54bbbfeb615 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1219 microversion: 2.1 time: 0.096395 Aug 04 05:54:14.519125 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3745/7602] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:14 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:15.553016 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:15.553947 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:15.569200 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:15.569652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:15.572543 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:15.574098 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:15.634816 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:15.635833 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:15.636612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.objects.instance [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lazy-loading 'fault' on Instance uuid a7099237-18be-430c-bf25-d0c0b4cb3e52 {{(pid=119343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:54:15.686216 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164db8279c4f49dea8a12242934c0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141aa2286a7f421199d9a9dd6e273d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:15.698031 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3d262026-4842-4885-b2d5-ed1959072733 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 200 len: 1224 microversion: 2.1 time: 0.153186 Aug 04 05:54:15.699099 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3858/7603] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:15 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:16.719185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:16.719810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] [instance: a7099237-18be-430c-bf25-d0c0b4cb3e52] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:16.727227 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:16.727688 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:16.728548 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:16.729069 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:16.743319 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] HTTP exception thrown: Instance a7099237-18be-430c-bf25-d0c0b4cb3e52 could not be found. Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Request method failure captured: Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 HTTP/1.1 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi61zYqL_0SbIO7E5yGr9ip6ngDooRQBwDtfzynhLUGAcMv0lSN6XNSrZvdY5tz7M0BTJQ4ciFUmnYoWocQUYyNg9XTamIep6guB9If5xk-xGATlEXe7AbiMdvuOPsbiD2zwlwd23NIMg4JgLVPkWWbRWzHZ2a9hufr3wqtjTG6rPSb60 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 141aa2286a7f421199d9a9dd6e273d08 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestShelveInstance-995823045 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/141aa2286a7f421199d9a9dd6e273d08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/141aa2286a7f421199d9a9dd6e273d08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/141aa2286a7f421199d9a9dd6e273d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_141aa2286a7f421199d9a9dd6e273d08", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestShelveInstance-995823045 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 141aa2286a7f421199d9a9dd6e273d08 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestShelveInstance-995823045 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestShelveInstance-995823045-project Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 164db8279c4f49dea8a12242934c0921 Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestShelveInstance-995823045-project Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance a7099237-18be-430c-bf25-d0c0b4cb3e52 could not be found. Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'a7099237-18be-430c-bf25-d0c0b4cb3e52'} Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7099237-18be-430c-bf25-d0c0b4cb3e52 could not be found. Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7099237-18be-430c-bf25-d0c0b4cb3e52 could not be found. Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:54:16.745046 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7099237-18be-430c-bf25-d0c0b4cb3e52 could not be found. Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Returning 404 to user: Instance a7099237-18be-430c-bf25-d0c0b4cb3e52 could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-9a7032b5-5715-482f-8f1a-38b6a7af8990 tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52" status: 404 len: 111 microversion: 2.1 time: 0.031292 Aug 04 05:54:16.749770 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3746/7604] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:16 2022] GET /compute/v2.1/servers/a7099237-18be-430c-bf25-d0c0b4cb3e52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:54:16.924844 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-ffe9e15b-ffd4-4a79-8f51-ca89675c53dd tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] Calling method '.version_select at 0x7f192399f700>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:16.958765 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-ffe9e15b-ffd4-4a79-8f51-ca89675c53dd tempest-TestShelveInstance-995823045 tempest-TestShelveInstance-995823045-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-804245620" status: 202 len: 0 microversion: 2.1 time: 0.038461 Aug 04 05:54:16.971047 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3859/7605] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Aug 4 05:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-804245620 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:54:34.564022 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:54:34.564831 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:54:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:54:34.649115 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=12 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:34.651006 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=24 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:34.919843 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-bc3dd69d-f174-4ba2-8275-cfeabd9511f6 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Action: 'create', calling method: .version_select at 0x7f1918aad820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-202721181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi36CvdbE32aAi7alClNZAF/rC6Op32ilLDA4MF2Xl36TpihXEJKQrXQt1pCN3C8X8hGTaAql4q8vfom1fNADvg9rXYfNPXZCQx+lFUG70k7mF7m6kZGmn7wnLHfPwboQ=="}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:54:34.935975 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bc3dd69d-f174-4ba2-8275-cfeabd9511f6 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Getting quotas for project 909c3aec07af480f963dd5c94c65ee28. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:54:34.945464 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.quota [None req-bc3dd69d-f174-4ba2-8275-cfeabd9511f6 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Getting quotas for user 54e20e5027d441c7b95e1af26d0c5e9b and project 909c3aec07af480f963dd5c94c65ee28. Resources: {'key_pairs'} {{(pid=119342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:54:34.976606 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-bc3dd69d-f174-4ba2-8275-cfeabd9511f6 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.333356 Aug 04 05:54:34.977217 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3747/7606] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Aug 4 05:54:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:54:36.014169 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:36.015384 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:36.021243 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1318672327", "imageRef": "9aa8a0ec-360d-40bf-b352-1066adb51df0", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-202721181", "security_groups": [{"name": "tempest-secgroup-smoke-1715497567"}], "networks": [{"uuid": "6d2dae87-75bc-4a4b-ad10-788ed86fbc91"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:54:36.138217 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] validate_networks() for [('6d2dae87-75bc-4a4b-ad10-788ed86fbc91', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:54:36.535969 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:54:36.536432 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:54:36.536922 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:54:36.537346 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:54:36.537773 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:54:36.546920 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:36.547437 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:36.548246 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:36.548694 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:36.566129 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Getting quotas for project 909c3aec07af480f963dd5c94c65ee28. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:54:36.572183 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Getting quotas for user 54e20e5027d441c7b95e1af26d0c5e9b and project 909c3aec07af480f963dd5c94c65ee28. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:54:36.585203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:54:36.587569 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa8a0ec-360d-40bf-b352-1066adb51df0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:54:36.636891 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f43357f6-0247-4e08-b45d-6b9ee290e57f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.624367 Aug 04 05:54:36.637571 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3860/7607] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:54:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:54:36.651528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a5e48190-0e2b-4c8a-a7f8-0a74847fa1b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:36.652318 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a5e48190-0e2b-4c8a-a7f8-0a74847fa1b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:36.717500 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a5e48190-0e2b-4c8a-a7f8-0a74847fa1b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:36.730526 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a5e48190-0e2b-4c8a-a7f8-0a74847fa1b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1248 microversion: 2.1 time: 0.083977 Aug 04 05:54:36.731161 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3748/7608] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:36 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:37.754744 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:37.756203 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:37.772430 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:37.772908 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:37.773726 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:37.774186 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:37.889738 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:37.903682 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-954222a4-0f9b-4991-87bc-eedef8b56aba tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1306 microversion: 2.1 time: 0.155241 Aug 04 05:54:37.904586 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3861/7609] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:37 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:38.925087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:38.925784 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:38.935912 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:38.936705 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:38.937502 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:38.938094 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:39.171918 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:39.181401 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ac606b9f-9db5-4f90-b95f-3260807c2cc2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1374 microversion: 2.1 time: 0.259994 Aug 04 05:54:39.195877 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3749/7610] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:38 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1374 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:39.259337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-96c31586-4fd0-44af-9046-fad1a97299a3 req-41856d24-ed12-48cd-a6fe-5a4273f1de76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9520b89-a137-4852-86a4-b402ef616fea", "tag": "5ae8e91f-7c3f-4bef-9b14-027547d371a4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:54:39.273146 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-96c31586-4fd0-44af-9046-fad1a97299a3 req-41856d24-ed12-48cd-a6fe-5a4273f1de76 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:39.273964 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-96c31586-4fd0-44af-9046-fad1a97299a3 req-41856d24-ed12-48cd-a6fe-5a4273f1de76 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:39.290774 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-96c31586-4fd0-44af-9046-fad1a97299a3 req-41856d24-ed12-48cd-a6fe-5a4273f1de76 service nova] Creating event network-changed:5ae8e91f-7c3f-4bef-9b14-027547d371a4 for instance c9520b89-a137-4852-86a4-b402ef616fea on n-h2-851337-5 Aug 04 05:54:39.295892 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-96c31586-4fd0-44af-9046-fad1a97299a3 req-41856d24-ed12-48cd-a6fe-5a4273f1de76 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041681 Aug 04 05:54:39.296665 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3862/7611] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:54:40.204225 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:40.204836 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:40.212378 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:40.213135 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:40.213597 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:40.214031 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:40.346301 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:40.354532 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8d14561d-be18-4a26-88f8-b28a7d86cc6f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1374 microversion: 2.1 time: 0.154257 Aug 04 05:54:40.355194 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3750/7612] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:40 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:41.376748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:41.377512 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:41.383871 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:41.384339 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:41.385128 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:41.385611 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:41.515702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:41.523248 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-084a61fc-57c0-445f-b019-430004bf7348 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1374 microversion: 2.1 time: 0.151555 Aug 04 05:54:41.523830 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3863/7613] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:41 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:42.544814 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:42.545351 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:42.553176 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:42.553638 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:42.554561 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:42.555072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:42.690756 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:42.698272 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-199aa751-eb2d-4e5d-85e6-1d8df2458218 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1374 microversion: 2.1 time: 0.157472 Aug 04 05:54:42.698846 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3751/7614] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:42 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:43.720045 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:43.720692 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:43.721578 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-d9a6569d-28f1-417f-a881-1e298ae6fe42 req-97eae93b-e855-4739-bad9-c1ec9629c127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9520b89-a137-4852-86a4-b402ef616fea", "name": "network-vif-plugged", "status": "completed", "tag": "5ae8e91f-7c3f-4bef-9b14-027547d371a4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:54:43.729263 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:43.729785 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:43.730754 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:43.731316 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:43.733460 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d9a6569d-28f1-417f-a881-1e298ae6fe42 req-97eae93b-e855-4739-bad9-c1ec9629c127 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:43.733983 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-d9a6569d-28f1-417f-a881-1e298ae6fe42 req-97eae93b-e855-4739-bad9-c1ec9629c127 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:43.751955 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-d9a6569d-28f1-417f-a881-1e298ae6fe42 req-97eae93b-e855-4739-bad9-c1ec9629c127 service nova] Creating event network-vif-plugged:5ae8e91f-7c3f-4bef-9b14-027547d371a4 for instance c9520b89-a137-4852-86a4-b402ef616fea on n-h2-851337-5 Aug 04 05:54:43.756916 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-d9a6569d-28f1-417f-a881-1e298ae6fe42 req-97eae93b-e855-4739-bad9-c1ec9629c127 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040359 Aug 04 05:54:43.757524 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3752/7615] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:54:43.934154 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:43.941828 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-f4fe4997-0dc3-4ac5-8013-a0911f1b96f3 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1374 microversion: 2.1 time: 0.226166 Aug 04 05:54:43.942421 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3864/7616] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:43 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1374 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:44.965916 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:44.967423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:44.973869 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:44.974328 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:44.975156 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:44.975685 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:45.118418 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:45.126434 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6a2cec8f-e84b-4458-8618-53273631edff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1558 microversion: 2.1 time: 0.166634 Aug 04 05:54:45.127044 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3753/7617] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:44 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:45.147302 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:54:45.147927 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:54:45.155671 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:45.156140 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:45.156929 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:45.157392 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:45.289035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:54:45.296857 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-d56b5148-409e-443f-9118-b3a8f9c1eaff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1558 microversion: 2.1 time: 0.153506 Aug 04 05:54:45.297423 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3865/7618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:54:45 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:54:47.323346 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-9751123e-7b01-4aaf-931b-fd5f991bdf03 req-a08bf686-2226-4bef-9d4b-53c2ae3dd68a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9520b89-a137-4852-86a4-b402ef616fea", "tag": "5ae8e91f-7c3f-4bef-9b14-027547d371a4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:54:47.329112 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=6 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:54:47.335408 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9751123e-7b01-4aaf-931b-fd5f991bdf03 req-a08bf686-2226-4bef-9d4b-53c2ae3dd68a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:54:47.335878 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-9751123e-7b01-4aaf-931b-fd5f991bdf03 req-a08bf686-2226-4bef-9d4b-53c2ae3dd68a service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:54:47.348085 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-9751123e-7b01-4aaf-931b-fd5f991bdf03 req-a08bf686-2226-4bef-9d4b-53c2ae3dd68a service nova] Creating event network-changed:5ae8e91f-7c3f-4bef-9b14-027547d371a4 for instance c9520b89-a137-4852-86a4-b402ef616fea on n-h2-851337-5 Aug 04 05:54:47.353344 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-9751123e-7b01-4aaf-931b-fd5f991bdf03 req-a08bf686-2226-4bef-9d4b-53c2ae3dd68a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034190 Aug 04 05:54:47.353980 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3754/7619] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:56:14.422018 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:56:14.422737 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:56:42.775794 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:56:42.776996 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 05:56:42.777407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:42.778172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:42.778888 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:42.779556 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=28 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:42.784087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-95f33363-f4f1-4b3e-8f89-5d6a7e20856f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1328239913"}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:56:42.786775 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-95f33363-f4f1-4b3e-8f89-5d6a7e20856f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:56:42.795159 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f33363-f4f1-4b3e-8f89-5d6a7e20856f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:42.795634 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f33363-f4f1-4b3e-8f89-5d6a7e20856f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:42.797087 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f33363-f4f1-4b3e-8f89-5d6a7e20856f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:42.797545 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-95f33363-f4f1-4b3e-8f89-5d6a7e20856f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:42.987004 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-95f33363-f4f1-4b3e-8f89-5d6a7e20856f tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "POST /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea/action" status: 202 len: 0 microversion: 2.1 time: 0.212928 Aug 04 05:56:42.987668 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3866/7620] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:56:42 2022] POST /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 05:56:48.355391 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9144a5b8-8932-4876-89b8-03b531401516] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:56:48.356246 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [-] [902f3a7e-5393-49bb-9b47-9ffa644922ab] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:56:48.356835 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:48.357645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=28 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:48.436979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-be956219-1001-4df0-a842-8317d7664799 req-0a8047bc-993e-43e1-a0de-479979c546d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9520b89-a137-4852-86a4-b402ef616fea", "name": "network-vif-plugged", "status": "completed", "tag": "5ae8e91f-7c3f-4bef-9b14-027547d371a4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:56:48.448565 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-be956219-1001-4df0-a842-8317d7664799 req-0a8047bc-993e-43e1-a0de-479979c546d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:48.449012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-be956219-1001-4df0-a842-8317d7664799 req-0a8047bc-993e-43e1-a0de-479979c546d9 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:48.461103 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-be956219-1001-4df0-a842-8317d7664799 req-0a8047bc-993e-43e1-a0de-479979c546d9 service nova] Creating event network-vif-plugged:5ae8e91f-7c3f-4bef-9b14-027547d371a4 for instance c9520b89-a137-4852-86a4-b402ef616fea on n-h2-851337-5 Aug 04 05:56:48.467530 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-be956219-1001-4df0-a842-8317d7664799 req-0a8047bc-993e-43e1-a0de-479979c546d9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113640 Aug 04 05:56:48.469025 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3755/7621] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:56:55.512522 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:55.513424 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:56:55.517562 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1878810285", "imageRef": "50344556-7cdd-47bb-8d35-71773265d675", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-202721181", "security_groups": [{"name": "tempest-secgroup-smoke-1715497567"}], "networks": [{"uuid": "6d2dae87-75bc-4a4b-ad10-788ed86fbc91"}]}} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:56:55.543637 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35812. Aug 04 05:56:55.544766 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35810. Aug 04 05:56:55.631136 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.network.neutron [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] validate_networks() for [('6d2dae87-75bc-4a4b-ad10-788ed86fbc91', None, None, None, None, None)] {{(pid=119343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:56:56.081237 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Flavor limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:56:56.081684 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Image limits 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:56:56.082178 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Flavor pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:56:56.082612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Image pref 0:0:0 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:56:56.083092 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.virt.hardware [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:56:56.092289 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:56.092763 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:56.093585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:56.094059 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:56.111355 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Getting quotas for project 909c3aec07af480f963dd5c94c65ee28. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:56:56.116957 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.quota [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Getting quotas for user 54e20e5027d441c7b95e1af26d0c5e9b and project 909c3aec07af480f963dd5c94c65ee28. Resources: {'ram', 'instances', 'cores'} {{(pid=119343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:56:56.130003 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Going to run 1 instances... {{(pid=119343) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:56:56.132488 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='50344556-7cdd-47bb-8d35-71773265d675',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:56:56.178190 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-cc87be92-f2f5-4267-95b5-923b75f00016 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.667823 Aug 04 05:56:56.178844 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3867/7622] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Aug 4 05:56:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:56:56.192533 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-83b56043-2357-4a98-96dd-57ac80a398ed tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:56:56.193276 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-83b56043-2357-4a98-96dd-57ac80a398ed tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:56:56.220250 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] [9144a5b8-8932-4876-89b8-03b531401516] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35826. Aug 04 05:56:56.221029 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] [902f3a7e-5393-49bb-9b47-9ffa644922ab] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35828. Aug 04 05:56:56.254873 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-83b56043-2357-4a98-96dd-57ac80a398ed tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:56:56.267403 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-83b56043-2357-4a98-96dd-57ac80a398ed tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1248 microversion: 2.1 time: 0.081068 Aug 04 05:56:56.268005 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3756/7623] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:56:56 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:56:57.290591 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:56:57.292172 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:56:57.308319 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:57.309168 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:57.310236 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:57.310791 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:57.386411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:56:57.395077 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-370aeaee-fb51-4149-847b-18e9d93e95ff tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1318 microversion: 2.1 time: 0.110683 Aug 04 05:56:57.395682 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3868/7624] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:56:57 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:56:58.418185 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:56:58.418816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:56:58.426541 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:58.427022 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:58.427813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:58.428257 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:58.573567 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:56:58.582753 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-ac13e811-dc10-478e-a438-ed802bbfdcca tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.168463 Aug 04 05:56:58.584126 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3757/7625] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:56:58 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:56:59.604828 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:56:59.605696 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:56:59.613111 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:59.613579 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:59.614429 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:56:59.615073 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:56:59.772863 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:56:59.781374 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e9c4e1e4-d822-4a37-9014-9a985c59a464 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.180808 Aug 04 05:56:59.782067 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3869/7626] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:56:59 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:00.327033 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [req-43f1662b-bfc3-4e8f-a383-ec783b8fd7ce req-d8c03ccc-9550-4937-b165-6af025af9168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9520b89-a137-4852-86a4-b402ef616fea", "name": "network-vif-unplugged", "status": "completed", "tag": "5ae8e91f-7c3f-4bef-9b14-027547d371a4"}]} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:57:00.341072 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-43f1662b-bfc3-4e8f-a383-ec783b8fd7ce req-d8c03ccc-9550-4937-b165-6af025af9168 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:00.341528 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [req-43f1662b-bfc3-4e8f-a383-ec783b8fd7ce req-d8c03ccc-9550-4937-b165-6af025af9168 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:00.354630 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.compute.server_external_events [req-43f1662b-bfc3-4e8f-a383-ec783b8fd7ce req-d8c03ccc-9550-4937-b165-6af025af9168 service nova] Creating event network-vif-unplugged:5ae8e91f-7c3f-4bef-9b14-027547d371a4 for instance c9520b89-a137-4852-86a4-b402ef616fea on n-h2-851337-5 Aug 04 05:57:00.360490 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [req-43f1662b-bfc3-4e8f-a383-ec783b8fd7ce req-d8c03ccc-9550-4937-b165-6af025af9168 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037513 Aug 04 05:57:00.361180 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3758/7627] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:57:00.802750 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:00.803466 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:00.811109 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:00.811577 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:00.812407 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:00.812865 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:00.964000 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:00.972495 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-c43733e8-a4f3-463c-864c-a47744908dc5 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.173503 Aug 04 05:57:00.973275 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3870/7628] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:00 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:01.995617 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:01.996423 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:02.003864 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:02.004650 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:02.005516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:02.006030 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:02.166589 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:02.174296 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-44c76504-e397-47a0-89af-a1fd09b9ca20 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.184059 Aug 04 05:57:02.174881 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3759/7629] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:01 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:03.196257 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:03.196993 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:03.210035 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:03.210525 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:03.211411 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:03.211859 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:03.360508 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:03.368360 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-12f3021f-0778-482b-9d0d-0d319ffa193b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.176398 Aug 04 05:57:03.368945 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3871/7630] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:03 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:04.392550 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:04.394012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:04.401389 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:04.401841 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:04.402626 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:04.403090 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:04.553723 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:04.562346 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-99dfbcc6-d1e4-4f73-8f42-4a0a3aeca75b tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.176567 Aug 04 05:57:04.563450 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3760/7631] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:04 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:57:05.583308 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:05.583952 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:05.590870 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:05.591359 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:05.592144 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:05.592589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:05.725977 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:05.734111 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-22007081-d164-4a05-82a3-8afaf3ecd0de tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.154789 Aug 04 05:57:05.734703 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3872/7632] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:05 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:06.755471 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:06.756097 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:06.758913 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell0:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:57:06.765186 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:06.765643 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:06.766419 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:06.766862 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:06.908954 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:06.916763 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-a9089952-ad46-4fcf-a05a-1840e203d240 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.165326 Aug 04 05:57:06.917344 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3761/7633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:06 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:07.932290 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:57:07.933461 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell0:SELECT=6 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:57:07.942111 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:07.945339 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:07.956901 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:07.957356 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:07.958377 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:07.959003 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:08.014638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-20155b5b-93f0-4cc3-857f-024779b47905 req-8b1ede43-aa5b-47fd-9341-14a8af00e00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a08e0d1-b6f1-46b1-828a-a15f613f8cba", "tag": "3971dc40-96d2-4448-9cf0-31d921829fc2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:57:08.034063 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-20155b5b-93f0-4cc3-857f-024779b47905 req-8b1ede43-aa5b-47fd-9341-14a8af00e00d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:08.034638 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-20155b5b-93f0-4cc3-857f-024779b47905 req-8b1ede43-aa5b-47fd-9341-14a8af00e00d service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:08.046940 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-20155b5b-93f0-4cc3-857f-024779b47905 req-8b1ede43-aa5b-47fd-9341-14a8af00e00d service nova] Creating event network-changed:3971dc40-96d2-4448-9cf0-31d921829fc2 for instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba on n-h1-851337-5 Aug 04 05:57:08.054261 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-20155b5b-93f0-4cc3-857f-024779b47905 req-8b1ede43-aa5b-47fd-9341-14a8af00e00d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125510 Aug 04 05:57:08.055256 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3873/7634] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:57:08.113197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:08.121434 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-04b98e55-6cfd-484d-aa8d-8210777e7870 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.186738 Aug 04 05:57:08.122020 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3762/7635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:07 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:09.145223 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:09.145938 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:09.152277 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:09.152739 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:09.153515 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:09.153960 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:09.293148 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:09.300928 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-38dd986f-49a4-471d-b662-3a32d6302fe2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.160650 Aug 04 05:57:09.301392 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3874/7636] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:09 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:10.320573 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:10.321197 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:10.328264 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:10.328718 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:10.329490 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:10.330027 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:10.472807 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:10.481223 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6d917c99-34a2-406c-9f82-5b90cce15085 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.164504 Aug 04 05:57:10.481835 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3763/7637] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:10 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:11.503242 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:11.503881 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:11.510981 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:11.511454 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:11.512250 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:11.512702 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:11.650448 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:11.658151 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b4b78efe-9b71-4b87-92cb-efb559a9c6c8 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.158834 Aug 04 05:57:11.658741 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3875/7638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:11 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:12.679891 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:12.680515 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:12.687982 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:12.688437 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:12.689203 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:12.689645 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:12.823434 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:12.831541 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-767e52e3-9ee1-4c83-b6f5-38c64ff9a7a7 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.155558 Aug 04 05:57:12.832111 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3764/7639] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:12 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:13.852723 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:13.853389 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:13.860585 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:13.861053 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:13.862069 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:13.862786 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:13.997378 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:14.005655 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-3e8a0302-7d90-450b-a8f7-2805b21b0178 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.157012 Aug 04 05:57:14.006243 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3876/7640] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:13 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:15.027283 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:15.027817 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:15.035357 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:15.035813 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:15.036582 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:15.037285 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:15.174785 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:15.182277 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5b08693f-1ecc-4a78-8e45-fad90ca2b966 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.159157 Aug 04 05:57:15.182847 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3765/7641] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:15 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:15.540796 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-026907ea-683a-40b5-92c9-ecf3d24887f9 req-0ae3cecc-ee52-440a-80e8-3d0e4de58d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a08e0d1-b6f1-46b1-828a-a15f613f8cba", "name": "network-vif-plugged", "status": "completed", "tag": "3971dc40-96d2-4448-9cf0-31d921829fc2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:57:15.552331 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-026907ea-683a-40b5-92c9-ecf3d24887f9 req-0ae3cecc-ee52-440a-80e8-3d0e4de58d53 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:15.553039 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-026907ea-683a-40b5-92c9-ecf3d24887f9 req-0ae3cecc-ee52-440a-80e8-3d0e4de58d53 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:15.565849 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-026907ea-683a-40b5-92c9-ecf3d24887f9 req-0ae3cecc-ee52-440a-80e8-3d0e4de58d53 service nova] Creating event network-vif-plugged:3971dc40-96d2-4448-9cf0-31d921829fc2 for instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba on n-h1-851337-5 Aug 04 05:57:15.571238 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-026907ea-683a-40b5-92c9-ecf3d24887f9 req-0ae3cecc-ee52-440a-80e8-3d0e4de58d53 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034404 Aug 04 05:57:15.571942 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3877/7642] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:57:16.203516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:16.204060 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:16.211998 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:16.212488 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:16.213231 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:16.213666 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:16.521810 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:16.530849 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-13dd19fd-be94-4a0d-a233-f2744d508e29 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1374 microversion: 2.1 time: 0.331381 Aug 04 05:57:16.531468 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3766/7643] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:16 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1374 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:17.556748 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:17.557460 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:17.564405 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:17.564869 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:17.565652 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:17.566106 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:17.699395 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:17.707107 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-78016a03-d062-4eaf-85db-4c9ce3ed420d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1559 microversion: 2.1 time: 0.156037 Aug 04 05:57:17.707692 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3878/7644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:17 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:17.728388 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:57:17.728991 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:57:17.736770 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:17.737217 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:17.738002 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:17.738438 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:17.880206 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:57:17.889027 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-8e99ca0f-bde2-47dc-98a3-ba90710a72fb tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1559 microversion: 2.1 time: 0.164723 Aug 04 05:57:17.889623 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3767/7645] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:57:17 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:57:19.484125 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-1e22059d-d773-4f41-858f-2d235d07523c req-193be477-4618-4e75-aa34-f6dca4fcfa5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a08e0d1-b6f1-46b1-828a-a15f613f8cba", "tag": "3971dc40-96d2-4448-9cf0-31d921829fc2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:57:19.494457 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1e22059d-d773-4f41-858f-2d235d07523c req-193be477-4618-4e75-aa34-f6dca4fcfa5c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:57:19.494916 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-1e22059d-d773-4f41-858f-2d235d07523c req-193be477-4618-4e75-aa34-f6dca4fcfa5c service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:57:19.506412 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-1e22059d-d773-4f41-858f-2d235d07523c req-193be477-4618-4e75-aa34-f6dca4fcfa5c service nova] Creating event network-changed:3971dc40-96d2-4448-9cf0-31d921829fc2 for instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba on n-h1-851337-5 Aug 04 05:57:19.511583 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-1e22059d-d773-4f41-858f-2d235d07523c req-193be477-4618-4e75-aa34-f6dca4fcfa5c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031678 Aug 04 05:57:19.512262 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3879/7646] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:57:53.947256 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:57:53.947825 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:59:32.741516 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=28 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:32.742271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=64 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:32.746300 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-675635896"}} {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:59:32.748702 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:32.755629 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:32.756086 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:32.756856 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:32.757294 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:32.950158 n-d-851337-5 devstack@n-api.service[119342]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [d85d0382-5bb5-4068-8094-24a85061a402] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:59:33.957170 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [d85d0382-5bb5-4068-8094-24a85061a402] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 35968. Aug 04 05:59:33.964167 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-aaa196fe-64bb-4197-aac0-65171f25df33 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "POST /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba/action" status: 202 len: 0 microversion: 2.1 time: 1.225070 Aug 04 05:59:33.964829 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3768/7647] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Aug 4 05:59:32 2022] POST /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba/action => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 05:59:34.431605 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:59:34.431836 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 05:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:59:34.570746 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:59:34.571333 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:59:34.575435 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:59:34.575849 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 05:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:59:42.143782 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] AMQP server on 10.222.0.69:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 05:59:42.147649 n-d-851337-5 devstack@n-api.service[119343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] AMQP server on 10.222.0.69:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 05:59:42.148589 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:42.149606 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=62 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:42.168239 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-0a9bfca2-652d-49c3-8d6d-12e73dca8689 req-c9a27f72-dd7f-4d76-940c-de2b4909a461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a08e0d1-b6f1-46b1-828a-a15f613f8cba", "name": "network-vif-plugged", "status": "completed", "tag": "3971dc40-96d2-4448-9cf0-31d921829fc2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:59:42.198612 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0a9bfca2-652d-49c3-8d6d-12e73dca8689 req-c9a27f72-dd7f-4d76-940c-de2b4909a461 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:42.199401 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-0a9bfca2-652d-49c3-8d6d-12e73dca8689 req-c9a27f72-dd7f-4d76-940c-de2b4909a461 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:42.214992 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-0a9bfca2-652d-49c3-8d6d-12e73dca8689 req-c9a27f72-dd7f-4d76-940c-de2b4909a461 service nova] Creating event network-vif-plugged:3971dc40-96d2-4448-9cf0-31d921829fc2 for instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba on n-h1-851337-5 Aug 04 05:59:42.222656 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-0a9bfca2-652d-49c3-8d6d-12e73dca8689 req-c9a27f72-dd7f-4d76-940c-de2b4909a461 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081954 Aug 04 05:59:42.224151 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3880/7648] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:59:52.865710 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_api:SELECT=2 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:52.866648 n-d-851337-5 devstack@n-api.service[119342]: DEBUG dbcounter [-] [119342] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:52.871087 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:52.872307 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:52.872463 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-bf40b42d-109a-4cc8-8d33-6ccae917fc96 req-507d97a9-ee9d-4ae2-b0e1-21fa2fd4c787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a08e0d1-b6f1-46b1-828a-a15f613f8cba", "tag": "3971dc40-96d2-4448-9cf0-31d921829fc2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:59:52.880330 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_cell1:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:52.881493 n-d-851337-5 devstack@n-api.service[119343]: DEBUG dbcounter [-] [119343] Writing DB stats nova_api:SELECT=2 {{(pid=119343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:59:52.882774 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:52.883271 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:52.884124 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:52.884663 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:52.889034 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-bf40b42d-109a-4cc8-8d33-6ccae917fc96 req-507d97a9-ee9d-4ae2-b0e1-21fa2fd4c787 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:52.889976 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-bf40b42d-109a-4cc8-8d33-6ccae917fc96 req-507d97a9-ee9d-4ae2-b0e1-21fa2fd4c787 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:52.904580 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf3e5cb9-923d-4584-9ebc-99db823de950] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 36172. Aug 04 05:59:52.907816 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-bf40b42d-109a-4cc8-8d33-6ccae917fc96 req-507d97a9-ee9d-4ae2-b0e1-21fa2fd4c787 service nova] Creating event network-changed:3971dc40-96d2-4448-9cf0-31d921829fc2 for instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba on n-h1-851337-5 Aug 04 05:59:52.913930 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-bf40b42d-109a-4cc8-8d33-6ccae917fc96 req-507d97a9-ee9d-4ae2-b0e1-21fa2fd4c787 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046691 Aug 04 05:59:52.914679 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3881/7649] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:59:52.924726 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:59:53.019872 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-03825019-c4ca-4b98-945e-7ba5c9806909 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 204 len: 0 microversion: 2.1 time: 0.147182 Aug 04 05:59:53.020863 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3769/7650] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:59:52 2022] DELETE /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:59:53.030077 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:53.031244 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:53.033502 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] [12864455-7e72-4b4e-835e-a45262ab2290] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 36174. Aug 04 05:59:53.040174 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:53.041120 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:53.042219 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:53.042868 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:53.238337 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:59:53.246728 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-07ebaef3-cb56-4b84-a92b-0b3ee8e016a4 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1684 microversion: 2.1 time: 0.220694 Aug 04 05:59:53.247350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3882/7651] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:59:53 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1684 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:59:54.268972 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:54.269692 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:54.276628 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:54.277085 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:54.278498 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:54.278942 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:54.418776 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:59:54.426748 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-f71ea7fe-0e74-494f-9093-1dbe4196e819 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1684 microversion: 2.1 time: 0.162058 Aug 04 05:59:54.427361 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3770/7652] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:59:54 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:59:55.313283 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-d53f6960-142f-40c6-b49e-27184aacc262 req-8d38a8f5-787f-4d11-9898-03ad9d5e57d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a08e0d1-b6f1-46b1-828a-a15f613f8cba", "name": "network-vif-deleted", "tag": "3971dc40-96d2-4448-9cf0-31d921829fc2"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:59:55.324162 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d53f6960-142f-40c6-b49e-27184aacc262 req-8d38a8f5-787f-4d11-9898-03ad9d5e57d7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:55.324657 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-d53f6960-142f-40c6-b49e-27184aacc262 req-8d38a8f5-787f-4d11-9898-03ad9d5e57d7 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:55.340732 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-d53f6960-142f-40c6-b49e-27184aacc262 req-8d38a8f5-787f-4d11-9898-03ad9d5e57d7 service nova] Creating event network-vif-deleted:3971dc40-96d2-4448-9cf0-31d921829fc2 for instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba on n-h1-851337-5 Aug 04 05:59:55.347567 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-d53f6960-142f-40c6-b49e-27184aacc262 req-8d38a8f5-787f-4d11-9898-03ad9d5e57d7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037899 Aug 04 05:59:55.348660 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3883/7653] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:59:55.448769 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:55.449570 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:55.456979 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:55.457456 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:55.458251 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:55.458698 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:55.491994 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:55.492368 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:55.492821 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lazy-loading 'fault' on Instance uuid 8a08e0d1-b6f1-46b1-828a-a15f613f8cba {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:59:55.534402 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:59:55.542246 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-6475688a-fa34-4166-8713-ebab36b3480d tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 200 len: 1338 microversion: 2.1 time: 0.097683 Aug 04 05:59:55.542822 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3771/7654] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:59:55 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:59:56.565483 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:56.566188 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: 8a08e0d1-b6f1-46b1-828a-a15f613f8cba] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:56.572582 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:56.573044 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:56.573823 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:56.574288 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:56.587429 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.wsgi [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] HTTP exception thrown: Instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba could not be found. Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Request method failure captured: Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: request: GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba HTTP/1.1 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: Accept: application/json Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: Accept-Encoding: identity Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: Connection: close Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: Content-Length: 0 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: Content-Type: application/json Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: Host: 10.222.0.69 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: Openstack-System-Scope: None Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: User-Agent: python-urllib3/1.26.11 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Auth-Token: gAAAAABi618Vhvn1N15ASUOs3XjrWEszG0wSy_9Y_SVwhU-gK0AdLfbCnMXKAZX0pYdQ5dNoKEkSoTL-5M5DJKQNtkJ7ocbRdF6wfS0X4ZEqxfh9IJLK902qma-exhASLeSrPKjY6gcncIrKRqRkOji4Qo7rqf9fSu1eiMaqGOkFiCK0bIg8Buc Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Id: None Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Domain-Name: None Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Identity-Status: Confirmed Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Is-Admin-Project: True Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Id: default Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Domain-Name: Default Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Id: 909c3aec07af480f963dd5c94c65ee28 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Project-Name: tempest-TestSnapshotPattern-76826013 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Role: member,reader Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Roles: member,reader Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/909c3aec07af480f963dd5c94c65ee28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/909c3aec07af480f963dd5c94c65ee28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/909c3aec07af480f963dd5c94c65ee28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_909c3aec07af480f963dd5c94c65ee28", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant: tempest-TestSnapshotPattern-76826013 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Id: 909c3aec07af480f963dd5c94c65ee28 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-Tenant-Name: tempest-TestSnapshotPattern-76826013 Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-User: tempest-TestSnapshotPattern-76826013-project Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Id: default Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-User-Domain-Name: Default Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-User-Id: 54e20e5027d441c7b95e1af26d0c5e9b Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: X-User-Name: tempest-TestSnapshotPattern-76826013-project Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: method: > Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: exception: Instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba could not be found. Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: action_args: {'id': '8a08e0d1-b6f1-46b1-828a-a15f613f8cba'} Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba could not be found. Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba could not be found. Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:59:56.589049 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba could not be found. Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: ERROR nova.api.openstack.wsgi Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Returning 404 to user: Instance 8a08e0d1-b6f1-46b1-828a-a15f613f8cba could not be found. {{(pid=119343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-e8720e62-a189-463f-89be-435abfc35b34 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba" status: 404 len: 111 microversion: 2.1 time: 0.030688 Aug 04 05:59:56.594281 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3884/7655] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:59:56 2022] GET /compute/v2.1/servers/8a08e0d1-b6f1-46b1-828a-a15f613f8cba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:59:57.963691 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:57.964391 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-a28765ff-8f62-4023-a03f-8ca2e5f55eeb req-1d4885c3-f318-4df0-966b-5646782ad2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9520b89-a137-4852-86a4-b402ef616fea", "tag": "5ae8e91f-7c3f-4bef-9b14-027547d371a4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:59:57.964929 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:57.972457 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:57.973194 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:57.974235 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:57.974690 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:57.975002 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a28765ff-8f62-4023-a03f-8ca2e5f55eeb req-1d4885c3-f318-4df0-966b-5646782ad2f6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:57.975477 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-a28765ff-8f62-4023-a03f-8ca2e5f55eeb req-1d4885c3-f318-4df0-966b-5646782ad2f6 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:57.988437 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-a28765ff-8f62-4023-a03f-8ca2e5f55eeb req-1d4885c3-f318-4df0-966b-5646782ad2f6 service nova] Creating event network-changed:5ae8e91f-7c3f-4bef-9b14-027547d371a4 for instance c9520b89-a137-4852-86a4-b402ef616fea on n-h2-851337-5 Aug 04 05:59:57.994169 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-a28765ff-8f62-4023-a03f-8ca2e5f55eeb req-1d4885c3-f318-4df0-966b-5646782ad2f6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033678 Aug 04 05:59:57.995013 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3885/7656] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 05:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:59:58.002332 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Going to try to terminate instance {{(pid=119342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:59:58.092713 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-5abe3ef8-aa1c-4261-9e0a-557fffc4b8b2 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 204 len: 0 microversion: 2.1 time: 0.132211 Aug 04 05:59:58.094279 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3772/7657] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Aug 4 05:59:57 2022] DELETE /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:59:58.104767 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:58.105840 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.compute.api [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119343) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:58.113836 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:58.114456 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:58.115314 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:58.116052 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:58.274030 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.policy [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:59:58.282076 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b56a12db-6dc4-464d-8d83-f3da02d44e43 tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1682 microversion: 2.1 time: 0.182810 Aug 04 05:59:58.282751 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3886/7658] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:59:58 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:59:59.304816 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:59:59.305474 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:59:59.312591 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:59.313042 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:59.313809 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:59.314254 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:59.346513 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:59:59.346973 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:59:59.347451 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.objects.instance [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lazy-loading 'fault' on Instance uuid c9520b89-a137-4852-86a4-b402ef616fea {{(pid=119342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:59:59.396534 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.policy [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e20e5027d441c7b95e1af26d0c5e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c3aec07af480f963dd5c94c65ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:59:59.404834 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-3f6522b1-6916-4ff7-90eb-e5727a59b68c tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 200 len: 1338 microversion: 2.1 time: 0.104309 Aug 04 05:59:59.405355 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3773/7659] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 05:59:59 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 06:00:00.008742 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [req-2eab5274-dd20-4f34-85db-a234bd1e424a req-1e97a9e4-6414-48bc-bbac-3eadb101ca47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9520b89-a137-4852-86a4-b402ef616fea", "name": "network-vif-deleted", "tag": "5ae8e91f-7c3f-4bef-9b14-027547d371a4"}]} {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 06:00:00.019390 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2eab5274-dd20-4f34-85db-a234bd1e424a req-1e97a9e4-6414-48bc-bbac-3eadb101ca47 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 06:00:00.019850 n-d-851337-5 devstack@n-api.service[119343]: DEBUG oslo_concurrency.lockutils [req-2eab5274-dd20-4f34-85db-a234bd1e424a req-1e97a9e4-6414-48bc-bbac-3eadb101ca47 service nova] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 06:00:00.031323 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.compute.server_external_events [req-2eab5274-dd20-4f34-85db-a234bd1e424a req-1e97a9e4-6414-48bc-bbac-3eadb101ca47 service nova] Creating event network-vif-deleted:5ae8e91f-7c3f-4bef-9b14-027547d371a4 for instance c9520b89-a137-4852-86a4-b402ef616fea on n-h2-851337-5 Aug 04 06:00:00.036622 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [req-2eab5274-dd20-4f34-85db-a234bd1e424a req-1e97a9e4-6414-48bc-bbac-3eadb101ca47 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031352 Aug 04 06:00:00.037350 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3887/7660] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Aug 4 06:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 06:00:00.426384 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '>' {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 06:00:00.427047 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.compute.api [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] [instance: c9520b89-a137-4852-86a4-b402ef616fea] Fetching instance by UUID {{(pid=119342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 06:00:00.434029 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 06:00:00.434489 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 06:00:00.435405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 06:00:00.435854 n-d-851337-5 devstack@n-api.service[119342]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Lock "252fd515-9666-4464-b81b-0a319b17989b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 06:00:00.452752 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.wsgi [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] HTTP exception thrown: Instance c9520b89-a137-4852-86a4-b402ef616fea could not be found. Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Request method failure captured: Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: request: GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea HTTP/1.1 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: Accept: application/json Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: Accept-Encoding: identity Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: Connection: close Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: Content-Length: 0 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: Content-Type: application/json Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: Host: 10.222.0.69 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: Openstack-System-Scope: None Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: User-Agent: python-urllib3/1.26.11 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Auth-Token: gAAAAABi618Vhvn1N15ASUOs3XjrWEszG0wSy_9Y_SVwhU-gK0AdLfbCnMXKAZX0pYdQ5dNoKEkSoTL-5M5DJKQNtkJ7ocbRdF6wfS0X4ZEqxfh9IJLK902qma-exhASLeSrPKjY6gcncIrKRqRkOji4Qo7rqf9fSu1eiMaqGOkFiCK0bIg8Buc Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Id: None Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Domain-Name: None Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Identity-Status: Confirmed Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Is-Admin-Project: True Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Id: default Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Domain-Name: Default Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Id: 909c3aec07af480f963dd5c94c65ee28 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Project-Name: tempest-TestSnapshotPattern-76826013 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Role: member,reader Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Roles: member,reader Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/909c3aec07af480f963dd5c94c65ee28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/909c3aec07af480f963dd5c94c65ee28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/909c3aec07af480f963dd5c94c65ee28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_909c3aec07af480f963dd5c94c65ee28", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}] Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant: tempest-TestSnapshotPattern-76826013 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Id: 909c3aec07af480f963dd5c94c65ee28 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-Tenant-Name: tempest-TestSnapshotPattern-76826013 Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-User: tempest-TestSnapshotPattern-76826013-project Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Id: default Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-User-Domain-Name: Default Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-User-Id: 54e20e5027d441c7b95e1af26d0c5e9b Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: X-User-Name: tempest-TestSnapshotPattern-76826013-project Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: method: > Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: exception: Instance c9520b89-a137-4852-86a4-b402ef616fea could not be found. Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: action_args: {'id': 'c9520b89-a137-4852-86a4-b402ef616fea'} Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: {{(pid=119342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9520b89-a137-4852-86a4-b402ef616fea could not be found. Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9520b89-a137-4852-86a4-b402ef616fea could not be found. Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 06:00:00.454405 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9520b89-a137-4852-86a4-b402ef616fea could not be found. Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: ERROR nova.api.openstack.wsgi Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: DEBUG nova.api.openstack.wsgi [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Returning 404 to user: Instance c9520b89-a137-4852-86a4-b402ef616fea could not be found. {{(pid=119342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: INFO nova.api.openstack.requestlog [None req-4d1d0a5e-5528-4704-aae4-67f274edd0dc tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea" status: 404 len: 111 microversion: 2.1 time: 0.033466 Aug 04 06:00:00.459012 n-d-851337-5 devstack@n-api.service[119342]: [pid: 119342|app: 0|req: 3774/7661] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Aug 4 06:00:00 2022] GET /compute/v2.1/servers/c9520b89-a137-4852-86a4-b402ef616fea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 06:00:00.618706 n-d-851337-5 devstack@n-api.service[119343]: DEBUG nova.api.openstack.wsgi [None req-b2ccbdf5-3ce1-4422-9dee-06d3570ccfdd tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] Calling method '.version_select at 0x7f191a33eca0>' {{(pid=119343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 06:00:00.645323 n-d-851337-5 devstack@n-api.service[119343]: INFO nova.api.openstack.requestlog [None req-b2ccbdf5-3ce1-4422-9dee-06d3570ccfdd tempest-TestSnapshotPattern-76826013 tempest-TestSnapshotPattern-76826013-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-202721181" status: 202 len: 0 microversion: 2.1 time: 0.030825 Aug 04 06:00:00.645920 n-d-851337-5 devstack@n-api.service[119343]: [pid: 119343|app: 0|req: 3888/7662] 10.222.0.69 () {58 vars in 1254 bytes} [Thu Aug 4 06:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-202721181 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 06:01:13.957586 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:01:13.958165 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 06:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:02:54.440230 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:02:54.441036 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 06:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:02:54.582550 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:02:54.583185 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 06:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:02:54.585482 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:02:54.585757 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 06:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:03:00.695481 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:03:00.696033 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 06:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:03:10.343892 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:03:10.344566 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 06:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:04:33.965996 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:04:33.966506 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 06:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:06:14.448350 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:06:14.449072 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 06:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:06:14.595864 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:06:14.596470 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 06:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:06:14.624602 n-d-851337-5 devstack@n-api.service[119343]: Traceback (most recent call last): Aug 04 06:06:14.624760 n-d-851337-5 devstack@n-api.service[119343]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 04 06:06:14.624760 n-d-851337-5 devstack@n-api.service[119343]: timer() Aug 04 06:06:14.624760 n-d-851337-5 devstack@n-api.service[119343]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 04 06:06:14.624760 n-d-851337-5 devstack@n-api.service[119343]: cb(*args, **kw) Aug 04 06:06:14.624760 n-d-851337-5 devstack@n-api.service[119343]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 04 06:06:14.624760 n-d-851337-5 devstack@n-api.service[119343]: waiter.switch() Aug 04 06:06:14.624760 n-d-851337-5 devstack@n-api.service[119343]: greenlet.error: cannot switch to a different thread Aug 04 06:06:20.704115 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:06:20.704593 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 06:06:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:06:30.352469 n-d-851337-5 devstack@n-api.service[119343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:06:30.353022 n-d-851337-5 devstack@n-api.service[119343]: Thu Aug 4 06:06:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 06:07:53.974249 n-d-851337-5 devstack@n-api.service[119342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 06:07:53.974834 n-d-851337-5 devstack@n-api.service[119342]: Thu Aug 4 06:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!